08.11.2014 Views

News Media Coverage of City Governments in 2009 - Quello Center ...

News Media Coverage of City Governments in 2009 - Quello Center ...

News Media Coverage of City Governments in 2009 - Quello Center ...

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

<strong>News</strong> <strong>Media</strong> <strong>Coverage</strong> <strong>of</strong> <strong>City</strong> <strong>Governments</strong> <strong>in</strong> <strong>2009</strong><br />

Thomas Baldw<strong>in</strong>, Daniel Bergan, Fred Fico,<br />

Stephen Lacy, and Steven S. Wildman<br />

<strong>Quello</strong> <strong>Center</strong> for Telecommunication Management and Law<br />

Michigan State University<br />

July 30, 2010<br />

This material is based upon work supported by the National Science Foundation<br />

under Grant No. SES - 0819519.<br />

Any op<strong>in</strong>ions, f<strong>in</strong>d<strong>in</strong>gs, and conclusions or recommendations expressed <strong>in</strong> this material<br />

are those <strong>of</strong> the authors and do not necessarily reflect the view <strong>of</strong> the National Science<br />

Foundation.<br />

The authors thank Paul Zube, Allison Eden, Miron Varouhakis and Tithi<br />

Chattopadhyay for their essential assistance <strong>in</strong> the project.


Executive Summary<br />

This study exam<strong>in</strong>ed news coverage and commentary about city government by<br />

daily newspapers, weekly newspapers, television, cable, radio and citizen journalism<br />

sites <strong>in</strong> 98 metropolitan central cities and 77 suburban cities. The results show that city<br />

government news cont<strong>in</strong>ues to be a ma<strong>in</strong>stay <strong>of</strong> local news coverage <strong>in</strong> most cities with<br />

news coverage, and that the bulk <strong>of</strong> that coverage cont<strong>in</strong>ues to come from daily and<br />

weekly newspapers.<br />

Generally, coverage <strong>of</strong> central cities differed from coverage <strong>of</strong> suburban cities.<br />

Few television stories addressed suburban city government, and suburban cities were<br />

far more reliant on weekly newspapers than dailies. Central city coverage was more<br />

likely to address crimes and courts, accidents and disasters, and bus<strong>in</strong>ess than was<br />

suburban city coverage. Overall, suburban coverage was more likely to address city<br />

government, human <strong>in</strong>terest and community news, and education than was central<br />

cities coverage.<br />

Topics <strong>in</strong> city government coverage varied <strong>in</strong> importance, but the most heavily<br />

covered topics were city budgets and taxes, government meet<strong>in</strong>gs, the relationship<br />

between city government and bus<strong>in</strong>ess, and safety issues. The most commonly used<br />

sources <strong>in</strong> the news stories were local government <strong>of</strong>ficials, followed by bus<strong>in</strong>ess<br />

people, and ord<strong>in</strong>ary citizens.<br />

i


<strong>News</strong> <strong>Media</strong> <strong>Coverage</strong> <strong>of</strong> <strong>City</strong> Government <strong>in</strong> <strong>2009</strong><br />

The majority <strong>of</strong> U.S. news outlets emphasize local news coverage, which reflects the<br />

decentralized system <strong>of</strong> government <strong>in</strong> the United States. This local coverage also<br />

results from the <strong>in</strong>herent connection between news coverage and politics, which is<br />

rooted <strong>in</strong> the foundation <strong>of</strong> American journalism. Research has established the strong<br />

relationship between political <strong>in</strong>terest and news <strong>in</strong>terest. This project was funded by<br />

the National Science Foundation to measure the nature and extent <strong>of</strong> local government<br />

coverage and to exam<strong>in</strong>e the factors that predict variation <strong>in</strong> coverage among cities.<br />

This report provides a description <strong>of</strong> a small portion <strong>of</strong> the larger content<br />

analysis that is central to the study and <strong>in</strong>cludes news and op<strong>in</strong>ion content about local<br />

government for the central cities and 77 suburban cities <strong>in</strong> 98 Metropolitan Statistical<br />

Areas (MSAs). The data start with general topics covered by daily newspapers, weekly<br />

newspapers, broadcast television, cable television, news/talk radio, non-news radio,<br />

citizen news sites and citizen blogs <strong>in</strong> central and suburban cities. <strong>City</strong> government<br />

news and op<strong>in</strong>ion coverage is then exam<strong>in</strong>ed <strong>in</strong> more detail for number and types <strong>of</strong><br />

sources and topics <strong>of</strong> city government coverage.<br />

The content analyzed here came from two days for each city between February<br />

1, <strong>2009</strong> and May 2, <strong>2009</strong>. The days were selected to be the day <strong>of</strong> and the day after a<br />

randomly selected regular city council meet<strong>in</strong>g. The dates for meet<strong>in</strong>gs were selected<br />

from listed dates on cities’ Web sites and from meet<strong>in</strong>g dates supplied by city <strong>of</strong>ficials<br />

when they were telephoned. However, the listed meet<strong>in</strong>gs did not always occur as<br />

scheduled (See Method section). In some cases, there were just no stories about city<br />

1


government on the selected days. Of the orig<strong>in</strong>al sample <strong>of</strong> 120 central MSA cities, 21<br />

did not have a city council meet<strong>in</strong>g on the selected date and one city had no content<br />

available for the date. Of the 119 suburban cities, seven did not have a city council<br />

meet<strong>in</strong>g that day, and 35 did not have any stories <strong>in</strong> any <strong>of</strong> the news outlets about the<br />

cities on the selected dates. As a result, the sample analyzed here <strong>in</strong>cluded news from<br />

98 MSA central cities and 77 suburban cities from the orig<strong>in</strong>al 120 MSAs.<br />

General Topics<br />

For the selected dates, 389 news outlets provided 6,042 local stories for the 98<br />

central cities (an average <strong>of</strong> 61.6 news and op<strong>in</strong>ion items per city) and 769 local stories<br />

for the 77 suburban cities (an average <strong>of</strong> about 10 items per suburban city).<br />

Table 1 provides a breakdown <strong>of</strong> stories by type <strong>of</strong> city and story topics. For<br />

central cities, city government was not as high a priority as crimes and courts, which<br />

received the highest proportion <strong>of</strong> stories at 25.1%. The second most covered topic was<br />

bus<strong>in</strong>ess (18.4%), followed by city government (18%) and human <strong>in</strong>terest and<br />

community news (17.8%). If city, county and regional government are summed, the<br />

local government coverage equals 21.9%, and if crimes and courts are summed with<br />

accidents and disasters, 33.5% <strong>of</strong> the items were about public safety types <strong>of</strong> events.<br />

Education received limited coverage with 5.8% <strong>of</strong> the items.<br />

Table 1<br />

Topic <strong>of</strong> Story by Type <strong>of</strong> <strong>City</strong><br />

Story Topic<br />

Type <strong>of</strong> <strong>City</strong><br />

Central <strong>City</strong> Suburban <strong>City</strong><br />

<strong>City</strong> Government 18.0% 24.1%<br />

County Government 3.4% 2.3%<br />

Regional Government 0.5% 0.5%<br />

2


Education 5.8% 10.0%<br />

Crimes & Courts 25.1% 21.7%<br />

Accidents & Disasters 8.4% 3.9%<br />

Human Interest & Community 17.8% 24.1%<br />

Bus<strong>in</strong>ess 18.4% 12.1%<br />

All Else 2.5% 1.3%<br />

N 6,042 769<br />

All Government 21.9% 26.9%<br />

All Crime, Courts,<br />

Accidents & Disasters<br />

33.5% 25.6%<br />

<strong>News</strong> and op<strong>in</strong>ion items about suburban cities differed from those about central<br />

cities <strong>in</strong> the order <strong>of</strong> topic emphasis. <strong>City</strong> government and human <strong>in</strong>terest/community<br />

news tied for most coverage with 24.1% each <strong>of</strong> the 769 items. If city, county and<br />

regional government items are summed, they accounted for 26.9% <strong>of</strong> the items, which<br />

was a higher proportion than found for central cities. The third highest covered topic<br />

was crimes and courts with 21.7%, and if this topic were summed with accidents and<br />

disasters, the total equals 25.6% <strong>of</strong> all items. Bus<strong>in</strong>ess had a smaller proportion <strong>of</strong><br />

coverage than found <strong>in</strong> central cities with 12.1%, and education had a higher<br />

proportion with 10%.<br />

If the allocation <strong>of</strong> news and op<strong>in</strong>ion space represents the priorities <strong>of</strong> news<br />

outlets, then news outlet mangers value government, human <strong>in</strong>terest/community and<br />

education coverage <strong>in</strong> suburbs, while they value crime, courts, accidents, disasters,<br />

government and bus<strong>in</strong>ess coverage <strong>in</strong> central city coverage. Crime and courts receive a<br />

great deal <strong>of</strong> attention <strong>in</strong> both types <strong>of</strong> cities, but the coverage was greater for central<br />

cities. Human <strong>in</strong>terest and community coverage were important <strong>in</strong> news coverage <strong>of</strong><br />

both types <strong>of</strong> cities, but the coverage was greater for suburban cities. These<br />

3


distributions may reflect differences <strong>in</strong> the relative frequencies <strong>of</strong> the different types <strong>of</strong><br />

events with<strong>in</strong> the two types <strong>of</strong> cities. Larger cities typically have more crimes and<br />

accidents and are the headquarters <strong>of</strong> more bus<strong>in</strong>esses. Further, media <strong>in</strong> these cities<br />

cover many political units and reach a broad audience. Crime, accident and bus<strong>in</strong>ess<br />

types <strong>of</strong> stories may be deemed <strong>of</strong> more universal <strong>in</strong>terest than stories focused on a<br />

specific government body <strong>in</strong> a particular geographic context.<br />

<strong>Media</strong> <strong>Coverage</strong> <strong>of</strong> General Topics<br />

Table 2 breaks down the item topics by medium. Because <strong>of</strong> the low numbers <strong>of</strong><br />

cable and citizen journalism (both news sites and blogs sites) items, the eight types <strong>of</strong><br />

media were reduced to four – newspapers, television (cable and broadcast), radio<br />

(news/talk and non-news formats) and citizen journalism (blogs and news sites). For<br />

the 6,810 news and op<strong>in</strong>ion items, 47% were published <strong>in</strong> daily and weekly<br />

newspapers, 42% ran on television, 8% were broadcast on radio, and 3% were posted<br />

on citizen journalism sites. Consistent with prior Project for Excellence <strong>in</strong> Journalism<br />

(http://www.journalism.org/) research, newspapers covered city government to a<br />

greater degree than other types <strong>of</strong> media. The five topics emphasized by newspapers <strong>in</strong><br />

order were city government (24.5%), human <strong>in</strong>terest/community news (24.1%),<br />

crimes and courts (17.8%), bus<strong>in</strong>ess (16.8%), and education (8.7%). The five topics<br />

emphasized by television <strong>in</strong> order were crimes and courts (32.4%), bus<strong>in</strong>ess (18.2%),<br />

human <strong>in</strong>terest/community news (13%), city government (12.9%), and accident and<br />

disasters (12.2%).<br />

Table 2<br />

Type <strong>of</strong> Story By Type <strong>of</strong> Medium<br />

4


Type <strong>of</strong> Medium<br />

Type <strong>of</strong> Story<br />

Citizen Total<br />

<strong>News</strong>paper Television Radio<br />

Journalism<br />

<strong>City</strong> Government 24.5% 12.9% 16.6% 16.5% 18.7%<br />

County Government 2.0% 4.0% 5.7% 6.1% 3.3%<br />

Regional Government 0.4% 0.6% 0.7% 0.5% 0.5%<br />

Education 8.7% 4.1% 5.3% 3.3% 6.3%<br />

Crimes/Courts 17.8% 32.4% 29.3% 14.6% 24.7%<br />

Accident/Disasters 4.1% 12.2% 9.9% 3.3% 7.9%<br />

Human/Community<br />

Interest<br />

24.1% 13.0% 12.2% 27.4% 18.5%<br />

Bus<strong>in</strong>ess 16.8% 18.2% 17.3% 23.6% 17.5%<br />

All Else 1.7% 2.8% 2.9% 4.7% 2.3%<br />

N 3,185 2,870 543 212 6,810<br />

Radio did not cover city government to the degree newspapers did, but they<br />

provided a higher proportion <strong>of</strong> coverage than television. The five topics emphasized<br />

by radio are similar to television’s rank<strong>in</strong>gs: crimes and courts (29.3%), bus<strong>in</strong>ess<br />

(17.3%), city government (16.6%), human <strong>in</strong>terest/community news (12.2%), and<br />

accident and disasters (9.9%). Citizen journalism sites fell between newspaper and<br />

broadcast outlets <strong>in</strong> their emphasis. The top five rank<strong>in</strong>gs were human<br />

<strong>in</strong>terest/community news (27.4%), bus<strong>in</strong>ess (23.6%), city government (16.5%), crimes<br />

and courts (16.5%), and county government (6.1%).<br />

The variation <strong>in</strong> topic emphasis among newspapers, television, radio, and citizen<br />

journalism <strong>in</strong>dicates that news outlets <strong>in</strong> these cities provided a diversity <strong>of</strong> coverage<br />

that created choice for consumers. The most frequently covered topic for newspapers<br />

was local city government; for television and radio, it was crimes and courts; for citizen<br />

journalism sites, it was human <strong>in</strong>terest. Other than the similarities between television<br />

and radio, the different types <strong>of</strong> media provide different news topic agendas.<br />

5


Orig<strong>in</strong>ators <strong>of</strong> General Topics Items<br />

Table 3 breaks down the content by medium and type <strong>of</strong> person who created the<br />

content, which <strong>in</strong>cluded staff (people who work at the outlet), news/op<strong>in</strong>ion service<br />

(e.g., Associated Press), creators for the onl<strong>in</strong>e site (s<strong>in</strong>gle-author blogs), local<br />

submission (local people contributed the material), and can’t tell (content without<br />

byl<strong>in</strong>es or any <strong>in</strong>dication <strong>of</strong> the source.) There was no significant difference between<br />

newspapers (81.1%) and television (80.8%) when it came to staff prepared content.<br />

About 74.8% <strong>of</strong> radio items and 78.8% <strong>of</strong> citizen news items came from staff. The<br />

differences between newspapers and radio and television and radio were statistically<br />

significant at a p < .05 level, but the differences between newspapers and citizen<br />

journalism and television and citizen journalism were not. This suggests a greater<br />

degree <strong>of</strong> formal organizational affiliation than might have been expected for citizen<br />

journalism sites. And across all media, only small proportions <strong>of</strong> content are<br />

attributable to local citizen submissions.<br />

Table 3<br />

Orig<strong>in</strong>ator by Type <strong>of</strong> Medium<br />

Type <strong>of</strong> Medium<br />

Orig<strong>in</strong>ator<br />

Citizen Total<br />

<strong>News</strong>paper Television Radio<br />

Journalism<br />

Staff 81.1% 80.8% 74.8% 78.8% 80.4%<br />

<strong>News</strong>/Op<strong>in</strong>ion Service 2.3% 12.6% 23.2% 6.1% 8.4%<br />

Creator Onl<strong>in</strong>e Site N/A N/A N/A 1.4% >0.1%<br />

Local submission* 5.9% 0.3% 0.0% 3.3% 3.0%<br />

Can’t Tell 10.7%** 6.3% 2.0% 10.4% 8.1%<br />

N 3,185 2,870 543 212 6,810<br />

* Local submission articles were those submitted by people who had no <strong>of</strong>ficial connection with<br />

the news organizations. These were typically readers or other members <strong>of</strong> the community.<br />

** The bulk <strong>of</strong> can’t tell stories were <strong>in</strong> weekly newspapers. The daily percentage was 3% <strong>of</strong> 2,179<br />

stories, and the weekly percentage was 27.4% <strong>of</strong> 1,006 stories.<br />

6


Perhaps the most <strong>in</strong>terest<strong>in</strong>g result from Table 3 is the high proportion <strong>of</strong> stories<br />

with no identifiable creator. Of the 1,006 weekly newspaper items, 27.4% provided no<br />

way <strong>of</strong> know<strong>in</strong>g who created the content. The figure was 10.4% for citizen journalism<br />

items, 6.3% for television items, 3% for daily newspapers, and 2% for radio items. One<br />

<strong>of</strong> the basic tenets <strong>of</strong> <strong>in</strong>dependent journalism is that readers should be able to evaluate<br />

the news and op<strong>in</strong>ion by know<strong>in</strong>g who created the content. This was not the case for<br />

8.1% <strong>of</strong> the 6,810 items analyzed. It’s not clear why weekly newspapers had such a<br />

high proportion <strong>of</strong> unidentified news and op<strong>in</strong>ion items, but historically, some weeklies<br />

have depended heavily on press releases for content.<br />

Data from Table 3 also show that radio (23.2%) and television (12.6%) were<br />

much more dependent on wire and news service for local coverage than citizen<br />

journalism sites (6.1%) and newspapers (2.3%). These differences were statistically<br />

significant at a p < .05 level. Given that most <strong>of</strong> these cities did not have wire service<br />

reporters stationed <strong>in</strong> them, these data suggest that the broadcast stations could be<br />

us<strong>in</strong>g stories first published by newspapers and picked up by Associated Press. This is<br />

consistent with previous research by the Project for Excellence <strong>in</strong> Journalism<br />

(http://www.journalism.org/node/18897). These data also show that the television<br />

and radio sites had few items contributed by local citizens and that pr<strong>in</strong>t copies <strong>of</strong><br />

newspapers had a higher proportion <strong>of</strong> items submitted by local people (5.9%) than did<br />

citizen journalism sites (3.3%).<br />

<strong>City</strong> Government Stories<br />

7


Of the 6,810 local items for the two selected dates, 1,206 were about city<br />

government. Table 4 shows the breakdown <strong>of</strong> these stories among eight types <strong>of</strong> city<br />

government items. Most stories had more than one topic, and all topics were coded as<br />

be<strong>in</strong>g present or not <strong>in</strong> the stories. However, as noted above, not all <strong>of</strong> these stories<br />

actually came from dates when a city council met. The first two columns <strong>in</strong> Table 4<br />

allows a comparison <strong>of</strong> stories that ran on the day <strong>of</strong> and day after a city’s city council<br />

meet<strong>in</strong>g with those that ran on days not related to city council meet<strong>in</strong>gs.<br />

Table 4<br />

Percentage <strong>of</strong> <strong>City</strong> Government Stories By Topics<br />

(Columns do not sum to zero because stories could have more than one topic.)<br />

Non-city<br />

Council Dates<br />

<strong>City</strong> Council<br />

Related Dates*<br />

Stories Uniquely<br />

about Topic<br />

(% <strong>of</strong> stories from<br />

<strong>City</strong> Council dates<br />

<strong>in</strong>clud<strong>in</strong>g topic)<br />

Government<br />

Meet<strong>in</strong>g**<br />

26.9%<br />

(77)<br />

43.4%<br />

(399)<br />

17.5%<br />

Budget and<br />

Taxes**<br />

39.5%<br />

(113)<br />

45.9%<br />

(421)<br />

15.7%<br />

Bus<strong>in</strong>ess**<br />

24.1%<br />

(69)<br />

32.1%<br />

(294)<br />

17.0%<br />

Safety<br />

21.9%<br />

(59)<br />

22.8%<br />

(210)<br />

28.1%<br />

General<br />

Government<br />

21%<br />

(60)<br />

15.3%<br />

(143)<br />

70.6%<br />

Elections<br />

15%<br />

(43)<br />

9.5%<br />

(87)<br />

44.8%<br />

Oversight<br />

4.2%<br />

(12)<br />

7.4%<br />

(67)<br />

47.8%<br />

Studies<br />

3.5%<br />

(10)<br />

2.9%<br />

(27)<br />

3.7%<br />

N 286 920<br />

* <strong>City</strong> council-related dates were the days <strong>of</strong> a city council meet<strong>in</strong>g and the days after a<br />

city council meet<strong>in</strong>g. Non-city council dates where days selected <strong>in</strong> error that were<br />

thought to have city council meet<strong>in</strong>gs but did not.<br />

** The difference between the city council-related dates figure and the non-city council<br />

dates figure is statistically significant at the p < .05 level.<br />

8


The dates when a city council actually met had a higher percentage <strong>of</strong> city<br />

government stories (43.3%) devoted to meet<strong>in</strong>gs than the dates when a council<br />

meet<strong>in</strong>g was not held (26.9%). These data suggest that news media cont<strong>in</strong>ue to publish<br />

news from many, but not all, government meet<strong>in</strong>gs. In this data set, there were 467<br />

government-meet<strong>in</strong>g stories for 389 news outlets.<br />

However, the most reported topic was budget and taxes, which occurred <strong>in</strong><br />

45.9% <strong>of</strong> the stories from the date the city council met and 39.5% from the dates when<br />

there was no meet<strong>in</strong>g. Bus<strong>in</strong>esses and safety were the next most frequently covered<br />

topics and the relative frequency with which safety was covered was statistically<br />

<strong>in</strong>dist<strong>in</strong>guishable for city council-related dates and non-city council dates.<br />

Most <strong>of</strong> the articles <strong>in</strong>cluded multiple topics. The last column <strong>in</strong> Table 4 has the<br />

percentage <strong>of</strong> articles by government topic for which this was the only topic covered.<br />

The three most common topics (government meet<strong>in</strong>gs, budget and taxes, and bus<strong>in</strong>ess)<br />

were among the least likely to appear as the only topic <strong>in</strong> a story. This reflected the<br />

likelihood that city council meet<strong>in</strong>gs <strong>of</strong>ten <strong>in</strong>volve budgets and taxes, as well as<br />

bus<strong>in</strong>ess issues. The most likely government topic to appear as a s<strong>in</strong>gle topic was<br />

general government, which were stories that did not fit <strong>in</strong>to the other categories. Of all<br />

stories with general government <strong>in</strong> the story (143), 76.4% were only about general<br />

government. Of all stories with election topics, 46.2% only dealt with elections, and <strong>of</strong><br />

all the stories about government oversight, 46.8% only dealt with oversight.<br />

<strong>Coverage</strong> <strong>of</strong> MSA Central and Suburban <strong>City</strong> Government<br />

The sample was developed to allow a comparison <strong>of</strong> coverage for central cities<br />

and suburban cities. Table 5 provides a breakdown <strong>of</strong> news stories about central cities<br />

9


and suburban cities by type <strong>of</strong> media along with the numbers <strong>of</strong> news outlets and the<br />

average number <strong>of</strong> stories per outlet. Comb<strong>in</strong>ed the 389 news outlets produced 929<br />

news stories on these two days about central city governments and 141 news articles<br />

about suburban governments.<br />

Table 5<br />

<strong>News</strong> Stories by Type <strong>of</strong> Outlet and Type <strong>of</strong> <strong>City</strong><br />

No. <strong>of</strong> Outlets Central <strong>City</strong> Suburban <strong>City</strong><br />

with Stories Number Mean Number Mean<br />

Television 152 337 2.21 26 0.17<br />

Radio 54 78 1.44 9 0.16<br />

Citizen Journalism 19 24 1.26 1 0.04<br />

Daily <strong>News</strong>papers 114 383 3.36 46 0.40<br />

Weekly <strong>News</strong>papers 50 107 2.14 59 1.18<br />

Total 389 929 2.39 141 0.36<br />

As one might expect, city government received far more coverage <strong>in</strong> central than<br />

<strong>in</strong> suburban cities. The news media generated an average <strong>of</strong> 2.39 stories per city about<br />

central city governments but only .36 stories per suburban city. Daily newspapers<br />

dom<strong>in</strong>ated city government coverage <strong>of</strong> central cities with an average <strong>of</strong> 3.36 articles<br />

per city for the two days, compared to an average <strong>of</strong> 2.21 stories for television stations<br />

and 2.14 for weekly newspapers. Television, radio and citizen journalism sites<br />

averaged more than one story for the two days<br />

<strong>Coverage</strong> <strong>of</strong> suburban city government was provided primarily by weekly<br />

newspapers, which published an average <strong>of</strong> 1.18 city government articles per city<br />

dur<strong>in</strong>g the two days. Dailies averaged .4 articles per suburban city for the two days. The<br />

152 television stations provided only 26 city government stories for the 77 suburbs and<br />

10


78 radio stations only provided 9 city government stories. The 19 citizen journalism<br />

sites had only one story for all 77 suburban cities for the two days.<br />

An <strong>in</strong>terest<strong>in</strong>g question is just which medium provided the most city<br />

government news articles for the two types <strong>of</strong> cities. Table 6 breaks down the articles<br />

by central cities and suburbs. The large central cities were more likely than suburbs to<br />

have city government coverage by each <strong>of</strong> the eight types <strong>of</strong> media. All eight media<br />

types provided at least some coverage <strong>of</strong> one or more central cities. However, no<br />

suburban city government coverage was provided by citizen blogs and cable news.<br />

Table 6<br />

Percentage <strong>of</strong> <strong>City</strong> Government <strong>News</strong> Stories by <strong>News</strong> <strong>Media</strong> and Type <strong>of</strong> <strong>City</strong><br />

(Numbers <strong>of</strong> stories <strong>in</strong> parenthesis.)<br />

Central <strong>City</strong> Suburban <strong>City</strong> Total<br />

41.5%<br />

33.6%<br />

40.4%<br />

Daily <strong>News</strong>papers<br />

(381)<br />

(48)<br />

(429)<br />

11.6%<br />

41.3%<br />

15.6%<br />

Weekly <strong>News</strong>papers<br />

(107)<br />

(59)<br />

(166)<br />

35.5%<br />

18.2%<br />

33.5%<br />

Broadcast TV<br />

(329)<br />

(26)<br />

(355)<br />

1.0%<br />

0.0%<br />

1.0%<br />

Cable TV<br />

(8)<br />

(0)<br />

(8)<br />

5.3%<br />

3.5%<br />

5.1%<br />

<strong>News</strong>/Talk Radio<br />

(49)<br />

(5)<br />

(54)<br />

3.1%<br />

2.8%<br />

3.1%<br />

Non-<strong>News</strong> Radio<br />

(29)<br />

(4)<br />

(33)<br />

1.6%<br />

0.7%<br />

1.5%<br />

Citizen <strong>News</strong> Sites<br />

(15)<br />

(1)<br />

(16)<br />

1.1%<br />

0.0%<br />

1.0%<br />

Citizen Blog Sites<br />

(10)<br />

(0)<br />

(10)<br />

Total number 928 143 1,061<br />

Daily newspapers generated the highest percentage <strong>of</strong> city government coverage<br />

<strong>in</strong> central cities with 41.5% <strong>of</strong> all items. For suburban cities, weekly newspaper had the<br />

highest percentage with 41.3%. The two types <strong>of</strong> cities also differed <strong>in</strong> the second most<br />

11


prolific medium. For central cities, broadcast television produced 35.5% <strong>of</strong> the items,<br />

and for suburbs, daily newspapers generated 33.6% <strong>of</strong> the items. Only 26 <strong>of</strong> the 143<br />

items about suburban city government (18.2%) were provided by broadcast television.<br />

Overall, the data <strong>in</strong> Table 6 <strong>in</strong>dicate that the for all cities, the dom<strong>in</strong>ant providers<br />

<strong>of</strong> news and op<strong>in</strong>ion about city government were daily newspapers, weekly newspapers<br />

and broadcast television. These three media generated 88.6% <strong>of</strong> all items about central<br />

city governments and 93% <strong>of</strong> all items about suburban city governments. Radio (<strong>of</strong><br />

both types) played a m<strong>in</strong>or role <strong>in</strong> both types <strong>of</strong> cities, provid<strong>in</strong>g 8.4% <strong>of</strong> items about<br />

central city government and 6.3% <strong>of</strong> items about suburban city government.<br />

F<strong>in</strong>ally, for all news media cover<strong>in</strong>g all city types, cable TV outlets provided the<br />

least coverage, followed by citizen blogs and citizen news sites. This f<strong>in</strong>d<strong>in</strong>g should give<br />

significant pause to those who believe that the ¡°new media¡± will fill any gaps left by<br />

the ¡°old media.¡±<br />

Sourc<strong>in</strong>g <strong>in</strong> <strong>City</strong> Government Stories<br />

Tables 7 and 8 concern the number and diversity <strong>of</strong> sources used <strong>in</strong> the city<br />

government stories. The mean number <strong>of</strong> sources per story was calculated by add<strong>in</strong>g<br />

the total number <strong>of</strong> unique sources, whatever their type, and div<strong>in</strong>g by the total number<br />

<strong>of</strong> stories. The diversity <strong>in</strong>dex was determ<strong>in</strong>ed by assess<strong>in</strong>g how many <strong>of</strong> the 15<br />

categories <strong>of</strong> sources were actually used <strong>in</strong> a story. Eight <strong>of</strong> these were types <strong>of</strong> human<br />

sources (e.g. local <strong>of</strong>ficials, bus<strong>in</strong>ess people, etc.) and seven were non-human sources<br />

(e.g., document, press releases, etc.). Each <strong>of</strong> these types <strong>of</strong> sources was coded as<br />

present (1) or absent (0) <strong>in</strong> the story. It did not matter how <strong>of</strong>ten the type <strong>of</strong> source<br />

appeared <strong>in</strong> a story. To calculate the diversity <strong>in</strong>dex, the types <strong>of</strong> sources were<br />

12


summed, which created an <strong>in</strong>dex that ran from zero (no sources) to 15 (all types <strong>of</strong><br />

sources present). The greater the number, the more diverse were the types <strong>of</strong> sources<br />

<strong>in</strong> the stories.<br />

Table 7 presents the average number <strong>of</strong> sources and the average diversity <strong>in</strong>dex<br />

for news and op<strong>in</strong>ion articles about city government. The average number <strong>of</strong> sources<br />

ranged from a high <strong>of</strong> 3.11 <strong>in</strong> the 19 citizen news site articles to a low <strong>of</strong> 0.86 <strong>in</strong> the 14<br />

citizen blog sites articles. In more traditional news media, items <strong>in</strong> daily newspapers<br />

(average = 2.66) and weekly newspapers (average = 2.01) carried more sources than<br />

electronic media. Broadcast television stories averaged 1.91 sources, and non-news and<br />

talk radio stations averaged 1.59 sources. Trail<strong>in</strong>g were the eight cable television<br />

stories that averaged 1.25 sources and news/talk radio that averaged 1.22 sources. In<br />

general, the more sources a story had, the more diverse it tended to be.<br />

Table 7<br />

Average Sources and Source Diversity Index Per <strong>City</strong> Government <strong>News</strong> or Op<strong>in</strong>ion<br />

Article by Medium<br />

(Number <strong>of</strong> stories <strong>in</strong> parentheses)<br />

Mean Story Sources<br />

Mean Diversity Index<br />

Daily <strong>News</strong>paper (529) 2.66 1.47<br />

Weekly <strong>News</strong>paper (206) 2.01 1.21<br />

Broadcast TV (356) 1.91 1.40<br />

Cable TV (8) 1.25 1.25<br />

<strong>News</strong>/Talk Radio (54) 1.22 1.09<br />

Non-<strong>News</strong>/Talk Radio (34) 1.59 1.21<br />

Citizen <strong>News</strong> Site (19) 3.11 1.79<br />

Citizen Blog Site (14) 0.86 0.86<br />

NOTE: The distributions for story sources and diversity <strong>in</strong>dex are both statistically<br />

significant.<br />

13


The number <strong>of</strong> sources <strong>in</strong> a story is related to its length <strong>in</strong> words and time.<br />

Measured <strong>in</strong> terms <strong>of</strong> content delivered, electronic media typically devote less time to a<br />

story than newspapers do space. But even the daily newspaper average <strong>of</strong> 2.66 means a<br />

limited number <strong>of</strong> sources for government stories.<br />

The average diversity <strong>in</strong>dex showed some variation, with daily newspapers<br />

aga<strong>in</strong> averag<strong>in</strong>g a slightly higher average <strong>in</strong>dex (1.47) than broadcast television (1.40).<br />

However, citizen news sites had the highest average among all types <strong>of</strong> outlets at 1.79.<br />

The lowest average was with citizen blogs (0.86), which makes sense because most<br />

blogs are op<strong>in</strong>ion pieces. Weekly newspapers, non-talk radio and cable television had<br />

roughly the same diversity <strong>in</strong>dex.<br />

Overall, the average diversity <strong>in</strong>dex suggests that the types <strong>of</strong> sources used are<br />

not very diverse. An <strong>in</strong>dex under 2 means the average news and op<strong>in</strong>ion article had<br />

fewer that two different types <strong>of</strong> sources.<br />

Table 8 shows the sources and diversity <strong>in</strong>dex just for news stories, and the<br />

average number and diversity <strong>of</strong> sources was higher for some media when the op<strong>in</strong>ion<br />

items were removed from the data. The average did not change for broadcast television,<br />

cable television and news/talk radio because these media did not run op<strong>in</strong>ion items on<br />

these days. The average number <strong>of</strong> sources and diversity <strong>in</strong>dex for daily newspapers<br />

<strong>in</strong>creased to 3.09 and 1.67 from 2.66 and 1.47, respectively, while average number <strong>of</strong><br />

sources and diversity <strong>in</strong>dex <strong>in</strong>creased to 2.19 and 1.32 from 2.01 and 1.21, respectively,<br />

for weekly newspapers. This result <strong>in</strong>dicates that op<strong>in</strong>ion items generally use fewer<br />

sources than do news items.<br />

14


Table 8<br />

Average Sources and Source Diversity Index Per <strong>City</strong> Government <strong>News</strong><br />

Article by Medium<br />

(Number <strong>of</strong> stories <strong>in</strong> parentheses)<br />

Mean Story Sources<br />

Mean Diversity Index<br />

Daily <strong>News</strong>paper (429) 3.09 1.67<br />

Weekly <strong>News</strong>paper (166) 2.19 1.32<br />

Broadcast TV (355) 1.91 1.40<br />

Cable TV (8) 1.25 1.25<br />

<strong>News</strong>/Talk Radio (54) 1.22 1.09<br />

Non-<strong>News</strong>/Talk Radio (33) 1.48 1.15<br />

Citizen <strong>News</strong> Site (15) 3.80 2.13<br />

Citizen Blog Site (10) 0.90 0.90<br />

Summary<br />

This study exam<strong>in</strong>ed news coverage and commentary about city government by<br />

daily newspapers, weekly newspapers, television, cable, radio and citizen journalism<br />

sites <strong>in</strong> 98 metropolitan central cities and 77 suburban cities. The results show that city<br />

government news cont<strong>in</strong>ues to be a ma<strong>in</strong>stay <strong>of</strong> local news coverage <strong>in</strong> most cities, and<br />

that the bulk <strong>of</strong> that coverage cont<strong>in</strong>ues to come from daily and weekly newspapers.<br />

However, this sample was selected to have a high probability <strong>of</strong> f<strong>in</strong>d<strong>in</strong>g city government<br />

news because the dates for each city were the day <strong>of</strong> and the day after a city council<br />

meet<strong>in</strong>g. Topics <strong>in</strong> city government coverage varied <strong>in</strong> importance but the most heavily<br />

covered topics were city budgets and taxes, government meet<strong>in</strong>gs, the relationship<br />

between city government and bus<strong>in</strong>ess, and safety issues. The most commonly used<br />

sources <strong>in</strong> the news stories were local government <strong>of</strong>ficials, followed by bus<strong>in</strong>ess<br />

15


people, and ord<strong>in</strong>ary citizens. <strong>Coverage</strong> <strong>of</strong> central cities differed from coverage <strong>of</strong><br />

suburban cities. Few television stories addressed suburban city government, and<br />

suburban cities were far more reliant on weekly newspapers than dailies. Overall,<br />

suburban coverage was more likely to address city government, human <strong>in</strong>terest and<br />

community news, and education than was central cities coverage. Central city coverage<br />

was more likely to address crimes and courts, accidents and disasters, and bus<strong>in</strong>ess<br />

than was suburban city coverage.<br />

Table 1<br />

Topic <strong>of</strong> Story by Type <strong>of</strong> <strong>City</strong><br />

Type <strong>of</strong> <strong>City</strong><br />

Central <strong>City</strong><br />

Suburban <strong>City</strong><br />

Story Topic<br />

<strong>City</strong> Government 18.0% 24.1%<br />

County Government 3.4% 2.3%<br />

Regional Government 0.5% 0.5%<br />

Education 5.8% 10.0%<br />

Crimes & Courts 25.1% 21.7%<br />

Accidents & Disasters 8.4% 3.9%<br />

16


Human Interest & 17.8% 24.1%<br />

Community<br />

Bus<strong>in</strong>ess 18.4% 12.1%<br />

All Else 2.5% 1.3%<br />

N 6,042 769<br />

All Government 21.9% 26.9%<br />

All Crime, Courts,<br />

Accidents & Disasters 33.5% 25.6%<br />

Table 2<br />

Type <strong>of</strong> Story By Type <strong>of</strong> Medium<br />

<strong>News</strong>paper Television Radio Citizen Total<br />

Journalism<br />

<strong>City</strong> Government 24.5% 12.9% 16.6% 16.5% 18.7%<br />

County Government 2.0% 4.0% 5.7% 6.1% 3.3%<br />

Regional Government .4% .6% .7% .5% .5%<br />

Education 8.7% 4.1% 5.3% 3.3% 6.3%<br />

Crimes/Courts 17.8% 32.4% 29.3% 14.6% 24.7%<br />

Accident/Disasters 4.1% 12.2% 9.9% 3.3% 7.9%<br />

17


Human/Community 24.1% 13.0% 12.2% 27.4% 18.5%<br />

Interest<br />

Bus<strong>in</strong>ess 16.8% 18.2% 17.3% 23.6% 17.5%<br />

All Else 1.7% 2.8% 2.9% 4.7% 2.3%<br />

N 3,185 2,870 543 212 6,810<br />

Orig<strong>in</strong>ator<br />

Table 3<br />

Orig<strong>in</strong>ator by Type <strong>of</strong> Medium<br />

Type <strong>of</strong> Medium<br />

<strong>News</strong>paper Television Radio Citizen Journalism Total<br />

Staff 81.1% 80.8% 74.8% 78.8% 80.4%<br />

<strong>News</strong>/Op<strong>in</strong>ion Service 2.3% 12.6% 23.2% 6.1% 8.4%<br />

Creator Onl<strong>in</strong>e Site N/A N/A N/A 1.4% >0.1%<br />

Local submission * 5.9% 0.3% 0.0% 3.3% 3.0%<br />

Can’t Tell 10.7% ** 6.3% 2.0% 10.4% 8.1%<br />

18


N 3,185 2,870 543 212 6,810<br />

* Local submission articles were those submitted by people who had no <strong>of</strong>ficial connection<br />

with the news organizations. These were typically readers or other members <strong>of</strong> the community.<br />

** The bulk <strong>of</strong> can’t tell stories were <strong>in</strong> weekly newspapers. The daily percentage was 3% <strong>of</strong><br />

2,179 stories, and the weekly percentage was 27.4% <strong>of</strong> 1,006 stories.<br />

Table 4<br />

Percentage <strong>of</strong> <strong>City</strong> Government Stories By Topics<br />

(Columns do not sum to zero because stories could have more than one topic.)<br />

Non-city <strong>City</strong> Council Stories Uniquely<br />

Council Related Dates * about Topic<br />

Dates<br />

(% <strong>of</strong> stories<br />

from <strong>City</strong><br />

Council dates<br />

<strong>in</strong>clud<strong>in</strong>g topic)<br />

Government ** 26.9% 43.4% 17.5%<br />

Meet<strong>in</strong>g (77) (399)<br />

Budget and 39.5% 45.9% 15.7%<br />

Taxes ** (113) (421)<br />

19


Bus<strong>in</strong>ess ** 24.1% 32.1% 17.0%<br />

(69) (294)<br />

Safety 21.9% 22.8% 28.1%<br />

(59) (210)<br />

General 21.0% 15.3% 70.6%<br />

Govt (60) (143)<br />

Elections 15.0% 9.5% 44.8%<br />

(43) (87)<br />

Oversight 4.2% 7.4% 47.8%<br />

(12) (67)<br />

Studies 3.5% 2.9% 3.7%<br />

(10) (27)<br />

N 286 920<br />

* <strong>City</strong> council-related dates were the days <strong>of</strong> a city council meet<strong>in</strong>g and the days<br />

after a city council meet<strong>in</strong>g. Non-city council dates where days selected <strong>in</strong> error that<br />

were thought to have city council meet<strong>in</strong>gs but did not.<br />

** The difference between the city council-related dates figure and the non-city council dates<br />

figure is statistically significant at the p < .05 level.<br />

Table 5<br />

<strong>News</strong> Stories by Type <strong>of</strong> Outlet and Type <strong>of</strong> <strong>City</strong><br />

No. <strong>of</strong> Outlets Central <strong>City</strong> Suburban <strong>City</strong><br />

with Stories Number Mean Number Mean<br />

Television 152 337 2.21 26 0.17<br />

Radio 54 78 1.44 9 0.16<br />

Citizen Journalism 19 24 1.26 1 0.04<br />

Daily <strong>News</strong>papers 114 383 3.36 46 0.40<br />

Weekly <strong>News</strong>papers 50 107 2.14 59 1.18<br />

Total 389 929 2.39 141 0.36<br />

20


Table 6<br />

Percentage <strong>of</strong> <strong>City</strong> Government <strong>News</strong> Stories by <strong>News</strong> <strong>Media</strong> and Type <strong>of</strong> <strong>City</strong><br />

(Numbers <strong>of</strong> stories <strong>in</strong> parenthesis.)<br />

Central <strong>City</strong> Suburban <strong>City</strong> Total<br />

Daily <strong>News</strong>papers 41.5% 33.6% 40.4%<br />

(381) (48) (429)<br />

Weekly <strong>News</strong>papers 11.6% 41.3% 15.6%<br />

(107) (59) (166)<br />

Broadcast TV 35.5% 18.2% 33.5%<br />

(329) (26) (355)<br />

Cable TV 1.0% 0.0% 1.0%<br />

( 8) (0) (8)<br />

<strong>News</strong>/Talk Radio 5.3% 3.5% 5.1%<br />

(49) (5) (54)<br />

Non-<strong>News</strong> Radio 3.1% 2.8% 3.1%<br />

(29) (4) (33)<br />

Citizen <strong>News</strong> Sites 1.6% 0.7% 1.5%<br />

(15) (1) (16)<br />

Citizen Blog Sites 1.1% 0.0% 1.0%<br />

(10) (0) (10)<br />

Total number 928 143 1,061<br />

22


Table 7<br />

Average Sources and Source Diversity Index Per <strong>City</strong> Government <strong>News</strong> or Op<strong>in</strong>ion<br />

Article by Medium<br />

(Number <strong>of</strong> stories <strong>in</strong> parentheses)<br />

Mean Story Sources<br />

Mean Diversity Index<br />

Daily <strong>News</strong>paper (529) 2.66 1.47<br />

Weekly <strong>News</strong>paper (206) 2.01 1.21<br />

Broadcast TV (356) 1.91 1.40<br />

Cable TV (8) 1.25 1.25<br />

<strong>News</strong>/Talk Radio (54) 1.22 1.09<br />

Non-<strong>News</strong>/Talk Radio (34) 1.59 1.21<br />

Citizen <strong>News</strong> Site (19) 3.11 1.79<br />

Citizen Blog Site (14) .86 .86<br />

NOTE: The distributions for story sources and diversity <strong>in</strong>dex are both statistically significant.<br />

23


Table 8<br />

Average Sources and Source Diversity Index Per <strong>City</strong> Government <strong>News</strong><br />

Article by Medium<br />

(Number <strong>of</strong> stories <strong>in</strong> parentheses)<br />

Mean Story Sources<br />

Mean Diversity Index<br />

Daily <strong>News</strong>paper (429) 3.09 1.67<br />

Weekly <strong>News</strong>paper (166) 2.19 1.32<br />

Broadcast TV (355) 1.91 1.40<br />

Cable TV (8) 1.25 1.25<br />

<strong>News</strong>/Talk Radio (54) 1.22 1.09<br />

Non-<strong>News</strong>/Talk Radio (33) 1.48 1.15<br />

Citizen <strong>News</strong> Site (15) 3.80 2.13<br />

Citizen Blog Site (10) .90 .90<br />

NOTE: The distributions for story sources and diversity <strong>in</strong>dex are both statistically significant.<br />

24


Method Section<br />

Sampl<strong>in</strong>g<br />

The goal <strong>of</strong> the project was to exam<strong>in</strong>e the nature <strong>of</strong> news media coverage <strong>of</strong> city<br />

government and to identify factors that could expla<strong>in</strong> variations <strong>in</strong> that coverage across<br />

cities. This required random sampl<strong>in</strong>g both cities and content.<br />

<strong>City</strong> Sampl<strong>in</strong>g<br />

Because the goal was to study coverage by a range <strong>of</strong> news media, the sample<br />

concentrated on Metropolitan Statistical Areas (MSAs). With<strong>in</strong> the areas, television,<br />

radio and citizen journalism sites are most likely to provide news coverage <strong>of</strong><br />

governments because larger markets attract more news outlets. MSAs are def<strong>in</strong>ed by<br />

the U.S. Census Bureau. The size <strong>of</strong> central cities (the large cities that serve as the hub<br />

for such areas) and the size and number <strong>of</strong> suburban cities with<strong>in</strong> MSAs varies. In order<br />

to capture this variance, the sample <strong>of</strong> cities consists <strong>of</strong> randomly selected central cities<br />

and suburbs <strong>of</strong> the central cities.<br />

The 363 MSAs were divided <strong>in</strong>to four groups on the basis <strong>of</strong> population rank<strong>in</strong>gs.<br />

Large central cities were those ranked between 1 and 50. Medium large central cities<br />

were those ranked between 51 and 100. Medium central cities were ranked between<br />

101 and 200, and small central cities were ranked between 201 and 363. With<strong>in</strong> each<br />

group, 30 cities were randomly selected for a total <strong>of</strong> 120 central cities.<br />

In order to exam<strong>in</strong>e the coverage <strong>of</strong> suburban cities, one <strong>in</strong>corporated suburb<br />

was selected for each <strong>of</strong> the 120 MSAs represent<strong>in</strong>g the central cities. To create<br />

variance <strong>in</strong> the population size <strong>of</strong> suburbs, two types <strong>of</strong> suburbs were selected. Large<br />

suburbs were the largest population suburbs <strong>in</strong> the MSA, and medium suburbs were<br />

25


those that were approximately half the size <strong>of</strong> the largest suburb. Whether the suburb<br />

for a given central city was large or small was determ<strong>in</strong>ed by selection <strong>of</strong> a random<br />

start<strong>in</strong>g po<strong>in</strong>t <strong>in</strong> the list <strong>of</strong> central cities and then alternat<strong>in</strong>g large and medium<br />

suburbs. The result was 119 suburbs. Midland, Texas, had no other <strong>in</strong>corporated city<br />

with<strong>in</strong> its MSA. Suburbs were identified us<strong>in</strong>g a variety <strong>of</strong> atlases and Web sites.<br />

Content sampl<strong>in</strong>g<br />

Sampl<strong>in</strong>g content typically <strong>in</strong>volves the selection <strong>of</strong> media outlets, a timeframe<br />

and the type <strong>of</strong> content to be sampled dur<strong>in</strong>g that period.<br />

Because this project is about city council coverage, we limited the <strong>in</strong>itial selected<br />

content to news coverage about events, issues and people with<strong>in</strong> the MSA. This was<br />

def<strong>in</strong>ed as news and op<strong>in</strong>ion that related to cities, counties and regional (<strong>in</strong>tercounty<br />

and <strong>in</strong>tercity) relationships with<strong>in</strong> the MSA. This excluded news and op<strong>in</strong>ion that dealt<br />

with rout<strong>in</strong>e sports material, rout<strong>in</strong>e weather material, enterta<strong>in</strong>ment (e.g., plays),<br />

celebrities (their lives), state government, national and <strong>in</strong>ternational news with no<br />

reference to local issues. When doubt existed <strong>in</strong> the <strong>in</strong>itial identification <strong>of</strong> items, the<br />

items were reta<strong>in</strong>ed until the cod<strong>in</strong>g procedure when the research team could make a<br />

decision about the appropriateness <strong>of</strong> <strong>in</strong>dividual items.<br />

In an effort to be complete, content was collected from all news outlets with<strong>in</strong><br />

the area that carried local news as def<strong>in</strong>ed above. The outlets were identified through<br />

the use <strong>of</strong> a variety <strong>of</strong> onl<strong>in</strong>e and pr<strong>in</strong>ted directories and lists <strong>of</strong> daily newspapers,<br />

weekly newspapers, television stations, cable news operations, radio stations (both<br />

news/talk and non-news/talk), citizen journalism news sites and citizen journalism<br />

blogs. A news outlet was only <strong>in</strong>cluded <strong>in</strong> the f<strong>in</strong>al data analysis if it carried local news.<br />

26


For example, some radio stations only carried news service material that did not deal<br />

with local news and op<strong>in</strong>ion. These outlets were not <strong>in</strong>cluded.<br />

With regard to timeframe, two types <strong>of</strong> samples were selected with<strong>in</strong> the<br />

thirteen-week period between Februay1 and May 2, <strong>2009</strong>. The first sample, which is the<br />

subject <strong>of</strong> this report, <strong>in</strong>volved the selection <strong>of</strong> a city council meet<strong>in</strong>g date for each city.<br />

The day <strong>of</strong> the meet<strong>in</strong>g and the day after the meet<strong>in</strong>g were exam<strong>in</strong>ed because it was<br />

assumed that a city council meet<strong>in</strong>g might generate city government news. The city<br />

council dates were determ<strong>in</strong>ed <strong>in</strong> December 2008 by exam<strong>in</strong><strong>in</strong>g city Web sites and by<br />

contact<strong>in</strong>g the cities that did not have Web sites. It turned out that dates planned for<br />

city council meet<strong>in</strong>gs do not necessarily have city council meet<strong>in</strong>g. This could be due to<br />

mistakes on Web sites or changes <strong>in</strong> plans. It appears that some city governments<br />

create lists <strong>of</strong> possible meet<strong>in</strong>gs dates and adjust as needed. This turned out to be<br />

fortuitous because the <strong>in</strong>clusion <strong>of</strong> cities <strong>in</strong> this sample that did not have city council<br />

meet<strong>in</strong>gs on the identified date allowed the test<strong>in</strong>g <strong>of</strong> the assumption that such dates<br />

would generate more city government stories.<br />

The second sample was a constructed week for each <strong>of</strong> the cities. This <strong>in</strong>volved<br />

randomly select<strong>in</strong>g a Monday, Tuesday, Wednesday, Thursday, Friday, Saturday and<br />

Sunday from the 13-week period for each city. No two cities had the same constructed<br />

week. This process provided a representative sample <strong>of</strong> days for each city and spread<br />

the content collection process across each day with<strong>in</strong> the time period.<br />

Content was collected by download<strong>in</strong>g television, radio and citizen journalism<br />

content from the Internet and by order<strong>in</strong>g hardcopies <strong>of</strong> daily and weekly newspapers.<br />

Captur<strong>in</strong>g radio and television content <strong>of</strong>f air for this many outlets was deemed to be<br />

27


cost prohibitive. It was assumed that television stations loaded all or most <strong>of</strong> their<br />

broadcast content onl<strong>in</strong>e. A survey <strong>of</strong> people at television and radio stations who were<br />

responsible for content was conducted to determ<strong>in</strong>e the likelihood that radio stations<br />

placed their content onl<strong>in</strong>e. Survey results <strong>in</strong>dicated that this was an accurate<br />

assumption for the television stations and a vast majority <strong>of</strong> radio stations. In some<br />

cases, when subscriptions to newspapers were unavailable, the content was<br />

downloaded from Web sites.<br />

From February 1 to May 2, approximately two-dozen undergraduate and<br />

graduate students download content from the Internet and collected and organized<br />

newspapers. As is always the case, problems sometimes occur with the collection <strong>of</strong><br />

content. For example, subscriptions were not received or errors were made <strong>in</strong> the<br />

execution <strong>of</strong> download<strong>in</strong>g <strong>in</strong>structions. For the 120 central cities, content was not<br />

downloaded for one city, and 21 cities did not have city council meet<strong>in</strong>gs on the<br />

selected dates, although content was downloaded for these 21 cities. This left 98 cities<br />

with content selected on the day <strong>of</strong> and the day after a city council meet<strong>in</strong>g. For the 119<br />

suburbs, seven cities did not have a city council meet<strong>in</strong>g on the selected date and 35<br />

cities had no stories for the two dates. Four <strong>of</strong> the 35 cities resulted from not hav<strong>in</strong>g<br />

content for those dates, and the rest resulted from not hav<strong>in</strong>g any coverage <strong>of</strong> the<br />

suburban city for that date. Fifty-three <strong>of</strong> the suburbs had no weekly or daily<br />

newspapers located <strong>in</strong> the town. Overall, 77 suburban cities had content from the day <strong>of</strong><br />

and the day after a city council meet<strong>in</strong>g dedicated to the city <strong>of</strong> <strong>in</strong>terest.<br />

Coder Tra<strong>in</strong><strong>in</strong>g and Reliability Assessment<br />

28


The extensiveness <strong>of</strong> the proposed content analysis required a two-stage process<br />

for cod<strong>in</strong>g. Coder tra<strong>in</strong><strong>in</strong>g for the project began <strong>in</strong> the summer <strong>of</strong> <strong>2009</strong> and project<br />

cod<strong>in</strong>g cont<strong>in</strong>ued <strong>in</strong>to the summer <strong>of</strong> 2010.<br />

Two protocols had to be developed and used <strong>in</strong> sequence as the project<br />

progressed. The first protocol, applied to 6,810 units <strong>of</strong> content for the city council<br />

dates, was used <strong>in</strong> the first stage <strong>of</strong> the project with a limited number <strong>of</strong> crucial<br />

variables. Specifically <strong>in</strong> that first stage, a number <strong>of</strong> coders were tra<strong>in</strong>ed and tested to<br />

recognize the k<strong>in</strong>d <strong>of</strong> outlet produc<strong>in</strong>g the content and the primary topic <strong>of</strong> the content.<br />

Special attention was paid to topic because the cod<strong>in</strong>g on that variable determ<strong>in</strong>ed<br />

whether more extensive cod<strong>in</strong>g would be done subsequently on that content unit. The<br />

second stage, <strong>in</strong>volv<strong>in</strong>g fewer than 1,206 units <strong>of</strong> content identified <strong>in</strong> the first stage as<br />

<strong>in</strong>volv<strong>in</strong>g city government, required tra<strong>in</strong><strong>in</strong>g coders to recognize more specific topics<br />

and a variety <strong>of</strong> sources used to cover them that were cited <strong>in</strong> the content.<br />

Tra<strong>in</strong><strong>in</strong>g for the first stage <strong>of</strong> the project lasted five weeks and <strong>in</strong>volved a dozen<br />

coders at undergraduate, master’s and doctoral levels recruited from the Michigan State<br />

University undergraduate honors and from master’s and doctoral programs <strong>in</strong> the<br />

College <strong>of</strong> Communication Arts and Sciences. The three-hours per day tra<strong>in</strong><strong>in</strong>g sessions<br />

followed an <strong>in</strong>variant pattern <strong>of</strong> practice, prelim<strong>in</strong>ary test<strong>in</strong>g and debrief<strong>in</strong>g. At the end<br />

<strong>of</strong> the five-week period, coders were tested on a subsample <strong>of</strong> 150 stories. Their<br />

reliability was assessed us<strong>in</strong>g percentage agreement and the Scott’s Pi statistic to<br />

correct for chance agreement. The m<strong>in</strong>imum Scott’s Pi score for reta<strong>in</strong><strong>in</strong>g coders (and<br />

variables) was set at .8, and all coders (and variables) achieved this level <strong>of</strong> reliability.<br />

29


However, cod<strong>in</strong>g for this stage <strong>of</strong> the project lasted months, and researchers<br />

required periodic ¡°check reliability¡± assessments to make sure that coder<br />

understand<strong>in</strong>g <strong>of</strong> the operational def<strong>in</strong>itions <strong>of</strong> the variables rema<strong>in</strong>ed consistent.<br />

Three such ¡°checks¡± were made, us<strong>in</strong>g subsamples <strong>of</strong> 50 stories when researchers<br />

estimated that about a quarter, half and three-quarters <strong>of</strong> the content was coded for the<br />

<strong>in</strong>itial stage <strong>of</strong> the project. All such tests were passed by all coders (and variables) as<br />

assessed by the standards described above.<br />

The second stage <strong>of</strong> the project proceeded similarly. A four-week tra<strong>in</strong><strong>in</strong>g<br />

period was run concurrently with cod<strong>in</strong>g also be<strong>in</strong>g done for the first stage. This<br />

tra<strong>in</strong><strong>in</strong>g used coders available from the first stage and augmented by additional<br />

undergraduate and master’s level students.<br />

The protocol used for this stage was more extensive and complex, and results<br />

from reliability test<strong>in</strong>g (us<strong>in</strong>g a subsample <strong>of</strong> 50 stories) required that some coders be<br />

dropped from the project and some variables dropped from the analysis. Of n<strong>in</strong>e coders<br />

who tra<strong>in</strong>ed, five were reta<strong>in</strong>ed. Some protocol variables were comb<strong>in</strong>ed <strong>in</strong>to larger,<br />

more easily coded categories and others were dropped entirely. Aga<strong>in</strong>, standards for<br />

assess<strong>in</strong>g coder reliability were percentage <strong>of</strong> agreement and the Scott’s Pi statistic to<br />

correct for chance agreement. And because this cod<strong>in</strong>g operation also lasted months, a<br />

subsequent retest <strong>of</strong> coders was conducted when researchers estimated that about 40<br />

percent <strong>of</strong> all content units were coded. In addition, some <strong>of</strong> the project’s orig<strong>in</strong>al<br />

coders could not cont<strong>in</strong>ue, requir<strong>in</strong>g additional recruitment at this po<strong>in</strong>t. So for this<br />

¡°check¡± test, coders work<strong>in</strong>g on the project were jo<strong>in</strong>ed by newly recruited ones. Of<br />

n<strong>in</strong>e current and newly recruited coders undergo<strong>in</strong>g tra<strong>in</strong><strong>in</strong>g, six were reta<strong>in</strong>ed for the<br />

30


project because their reliability on protocol variables met or exceeded the m<strong>in</strong>imum<br />

standards set.<br />

Overall, then, this project presented unusual problems because <strong>of</strong> the volume <strong>of</strong><br />

the material and the consequent need to conduct cod<strong>in</strong>g operations over a very long<br />

period. In particular, the length <strong>of</strong> the cod<strong>in</strong>g operation presented concerns about the<br />

ability <strong>of</strong> coders to reta<strong>in</strong> the reliability they had been tra<strong>in</strong>ed to achieve. The ¡°check<br />

tests,¡± however, largely allayed these concerns.<br />

31

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!