12.07.2015 Views

file - ChaSen - 奈良先端科学技術大学院大学

file - ChaSen - 奈良先端科学技術大学院大学

file - ChaSen - 奈良先端科学技術大学院大学

SHOW MORE
SHOW LESS
  • No tags were found...

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

Figure 3.2. Combinations of Question Types in a Query.to the sentence that contains the passage. A sentence containing more than onequestion item was handled as having more than one question type. In this case,the agreement for question type annotation was assumed to agree when all thequestion types of the sentence matched. The F-measure 4 as used in the evaluationof MUC was used for the inter-annotator agreement for question type annotation.The F-measure can be defined by equation 3.1.P (t) and R(t) are calculated according to the equations 3.2 and 3.3 wherethe numbers of questions, which annotator A and annotator B classified intoquestion type t, are represented by C(A, t) and C(B, t), respectively, and thenumber of questions, which both rater A and rater B classified into question typet, is represented by C(A, B, t).4 http://www–nlpir.nist.gov/related projects/muc/proceedings/muc 7 proceedings/muc7 score intro.pdf25

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!