Download the eBook (8.25 MB) - ECREA Thematic Sections

More documents

Recommendations

Info

Diversity of Journalisms. Proceedings of ECREA/CICOM Conference, Pamplona, 4-5 July 2011 Method Size of the sample and online media to be analyzed When it comes to determining the size of the sample of our intercoder reliability test, we must bear in mind that “the appropriate size of the sample depends on many factors and should not be less than 50 units or 10% of the full sample.” (Lombard et al., 2002:601). Therefore, to situate ourselves within this margin, we must analyze three online media, which would involve analyzing 12.5% of the total units of analysis. For the test of intercoder agreement, we will analyze The Guardian (http://www.guardian.co.uk/), Clarín (http://www.clarin.com/) and Asahi Simbun. English Web Edition (http://www.asahi.com/english/). We have selected these online media as they employ the two most widely used languages in the total set of our study sample: English and Spanish. Number of coders The research work will be carried out by the two researchers responsible for this study: Guillermo López García and Javier Odriozola Chéné. Indexes to be used When it comes to measuring the reliability of our different categories, we should recall that there are liberal indexes and others that are conservative. The former do not take account of possible agreements or coincidences that the coders reach by chance. Such chance agreement becomes more possible the briefer the number of variables (for example, in our work “yes/no” answer variables are more liable to chance agreement). Therefore, we will use: A) A calculation of the index of general reliability using Holsti’s Method (liberal method). This index which serves for measuring the reliability between two coders does not take account of chance agreement. Nonetheless, we should recall that the large quantity of variables and, in their turn, the large quantity of categories that the majority of these have, make it possible to use this type of index. Subsequently, we will also realize a personalized calculation of each one of those variables that have more than two categories, that is, all of those that are not a “Yes/No” answer. Holst’s formula (1969) is: 264
Diversity of Journalisms. Proceedings of ECREA/CICOM Conference, Pamplona, 4-5 July 2011 (see figure 2). B) Following this, we will employ Cohen’s Kappa index, a more conservative method for two coders, in order to measure the reliability of all the Yes or No variables as a whole, and of each of the variables individually whose categories are Yes or No. This index “also accounts for chance agreement, using the same conceptual formula as Scott’s Pi” (Lombard et al., 2002: 591). Cohen’s Kappa formula (1960) is: (see figure 3). Determining an acceptable level of reliability. As well as the appropriate choice of a particular index, we must determine what constitutes an acceptable level of reliability, given that there are no established standard values. In spite of that, we will take into account the conclusions reached by Neuendorf (2002), after carrying out a study on the different indexes according to which coefficients of 0.90 or greater would be acceptable to all, 0.80 or greater would be acceptable in most situations, and below that, there exists great disagreement. Nonetheless, we must bear in mind that “the criterion of .70 is often used for exploratory research” (Lombard et al., 2002:593). Results We therefore establish the reliability levels for all the units of register, except for the number of comments, since this unit is provided by the comments gathered 24 hours after capture of the news stories. Thus, we can verify that the average reliability level of our content analysis is situated at 0.87 (see table 1). Nonetheless, we should be aware that agreement will vary depending on the unit of register studied. We can check whether the units whose reliability has been found through Holsti’s method show different values. Agreement is total in variables like position on the front page and section. Near total agreement is found in units of register like: author (0.90), localization (0.92), spatial distribution (0.94) and relevance on the front page (0.94). Reliability falls with respect to topics and sources: topics in the text (0.73), first topic (0.73), second topic (0.61), source of the headline (0.87), sources in the text (0.81), first source of the text (0.78), importance of the first source (0.78), second source of the text (0.79) and importance of the second source (0.79). Thus, the values referring to the topics dealt with are too low, even for a study with an exploratory character such as ours, and a restructuring of the variables becomes necessary. We will take the opportunity, at the same time, to restructure the units of register referring to the importance of the sources analyzed. On the other hand, units of register are found whose intercoder reliability has been measured through a conservative method (taking account of chance agreement), such 265
Page 1 and 2:
diversityof journalisms (cicom+ecre
Page 3 and 4:
Servicio de Publicaciones de la Uni
Page 5 and 6:
Getting Personal: Personification v
Page 7 and 8:
Tradition and Innovation in Online
Page 9 and 10:
Diversity of Journalisms. Proceedin
Page 11 and 12:
Page 13 and 14:
Page 15 and 16:
Page 17 and 18:
Page 19 and 20:
Page 21 and 22:
Page 23 and 24:
Page 25 and 26:
Page 27 and 28:
Page 29 and 30:
Page 31 and 32:
Page 33 and 34:
Page 35 and 36:
Page 37 and 38:
Page 39 and 40:
Page 41 and 42:
Page 43 and 44:
Page 45 and 46:
Page 47 and 48:
Page 49 and 50:
Page 51 and 52:
Page 53 and 54:
Page 55 and 56:
Page 57 and 58:
Page 59 and 60:
Page 61 and 62:
Page 63 and 64:
Page 65 and 66:
Page 67 and 68:
Page 69 and 70:
Page 71 and 72:
Page 73 and 74:
Page 75 and 76:
Page 77 and 78:
Page 79 and 80:
Page 81 and 82:
Page 83 and 84:
Page 85 and 86:
Page 87 and 88:
Page 89 and 90:
Page 91 and 92:
Page 93 and 94:
Page 95 and 96:
Page 97 and 98:
Page 99 and 100:
Page 101 and 102:
Page 103 and 104:
Page 105 and 106:
Page 107 and 108:
Page 109 and 110:
Page 111 and 112:
Page 113 and 114:
Page 115 and 116:
Page 117 and 118:
Page 119 and 120:
Page 121 and 122:
Page 123 and 124:
Page 125 and 126:
Page 127 and 128:
Page 129 and 130:
Page 131 and 132:
Page 133 and 134:
Page 135 and 136:
Page 137 and 138:
Page 139 and 140:
Page 141 and 142:
Page 143 and 144:
Page 145 and 146:
Page 147 and 148:
Page 149 and 150:
Page 151 and 152:
Page 153 and 154:
Page 155 and 156:
Page 157 and 158:
Page 159 and 160:
Page 161 and 162:
Page 163 and 164:
Page 165 and 166:
Page 167 and 168:
Page 169 and 170:
Page 171 and 172:
Page 173 and 174:
Page 175 and 176:
Page 177 and 178:
Page 179 and 180:
Page 181 and 182:
Page 183 and 184:
Page 185 and 186:
Page 187 and 188:
Page 189 and 190:
Page 191 and 192:
Page 193 and 194:
Page 195 and 196:
Page 197 and 198:
Page 199 and 200:
Page 201 and 202:
Page 203 and 204:
Page 205 and 206:
Page 207 and 208:
Page 209 and 210:
Page 211 and 212:
Page 213 and 214: Diversity of Journalisms. Proceedin
Page 263: Diversity of Journalisms. Proceedin
Page 315 and 316:
Page 317 and 318:
Page 319 and 320:
Page 321 and 322:
Page 323 and 324:
Page 325 and 326:
Page 327 and 328:
Page 329 and 330:
Page 331 and 332:
Page 333 and 334:
Page 335 and 336:
Page 337 and 338:
Page 339 and 340:
Page 341 and 342:
Page 343 and 344:
Page 345 and 346:
Page 347 and 348:
Page 349 and 350:
Page 351 and 352:
Page 353 and 354:
Page 355 and 356:
Page 357 and 358:
Page 359 and 360:
Page 361 and 362:
Page 363 and 364:
Page 365 and 366:
Page 367 and 368:
Page 369 and 370:
Page 371 and 372:
Page 373 and 374:
Page 375 and 376:
Page 377 and 378:
Page 379 and 380:
Page 381 and 382:
Page 383 and 384:
Page 385 and 386:
Page 387 and 388:
Page 389 and 390:
Page 391 and 392:
Page 393 and 394:
Page 395 and 396:
Page 397 and 398:
Page 399 and 400:
Page 401 and 402:
Page 403 and 404:
Page 405 and 406:
Page 407 and 408:
Page 409 and 410:
Page 411 and 412:
Page 413 and 414:
Page 415 and 416:
Page 417 and 418:
Page 419 and 420:
Page 421 and 422:
Page 423 and 424:
Page 425 and 426:
Page 427 and 428:
Page 429 and 430:
Page 431 and 432:
Page 433 and 434:
Page 435 and 436:
Page 437 and 438:
Page 439 and 440:
Page 441 and 442:
Page 443 and 444:
Page 445 and 446:
Page 447 and 448:
Page 449 and 450:
Page 451 and 452:
Page 453 and 454:
Page 455 and 456:
Page 457 and 458:
Page 459 and 460:
Page 461 and 462:
show all

Download the eBook (8.25 MB) - ECREA Thematic Sections

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?