3.3.4 Combination of question types in a query.Table 3.3. Definition of Classes of Question Types.Yes-No Yes-NoFactoid Name, Location, TimeMixed Description, ConsultationNon-Factoid How-to, Evaluation, ReasonFigure 3.2 shows a ratio of frequencies in the combinations of question typeswithin a query. The labels in this bar chart, that are Yes-No, Factoid, non-factoidand Mixed, are defined in Table 3.3.4, which indicate classes of annotated questiontypes. Mixed types are defined for Description and Consultation questiontypes, because these two types can be classified to both factoid and non-factoidquestions depending on the contents of question. These classes of question typesare assigned to horizontal and vertical axes in the graph, each bar indicates aratio of co-occurrence frequency corresponding to question types in both axes tothe frequency of the question types in vertical axis.As shown in Figure 3.2, the cases that the same question types co-occur in aquery appear the most frequently in all classes of question types. The chart alsoindicates that Yes-No type frequently occurs compared with other classes, i.e.,Factoid, Non-factoid and Mixed. Especially, Yes-No type occurs more frequentlyin Mixed than in Factoid and Non-factoid. Contrarily, in the case of queries comprisingYes-No type questions, other three types occur in about similar frequenciesof co-occurrence. Besides Yes-No types, there is no salient difference of ratio ofco-occurrence between two different question types of Factoid, Non-factoid andMixed.3.3.5 Inter-annotator agreement for question type annotationThe agreement for question type annotation was calculated sentence-by-sentence.Question type was annotated for passages, consequently, the question type for asentence is not confirmed in this state. The question type of a passage is assigned24
Figure 3.2. Combinations of Question Types in a Query.to the sentence that contains the passage. A sentence containing more than onequestion item was handled as having more than one question type. In this case,the agreement for question type annotation was assumed to agree when all thequestion types of the sentence matched. The F-measure 4 as used in the evaluationof MUC was used for the inter-annotator agreement for question type annotation.The F-measure can be defined by equation 3.1.P (t) and R(t) are calculated according to the equations 3.2 and 3.3 wherethe numbers of questions, which annotator A and annotator B classified intoquestion type t, are represented by C(A, t) and C(B, t), respectively, and thenumber of questions, which both rater A and rater B classified into question typet, is represented by C(A, B, t).4 http://www–nlpir.nist.gov/related projects/muc/proceedings/muc 7 proceedings/muc7 score intro.pdf25
- Page 1: NAIST-IS-DD0061208Doctoral Disserta
- Page 4 and 5: This thesis studies two fundamental
- Page 6 and 7: F 0.8 F 0.7 , , , , , iv
- Page 8 and 9: 3.4.4 Experimental settings . . . .
- Page 10 and 11: List of Tables3.1 Definitions of Qu
- Page 12 and 13: List of Figures1.1 Division of Quer
- Page 15 and 16: Chapter 1Introduction1.1 Motivation
- Page 17 and 18: The Number of Question per QuerySin
- Page 19: answers. Although different distrib
- Page 22 and 23: ComputerHumanComputerHumanSpecializ
- Page 24 and 25: Blog PageMultipleSentenceQueryQ1Q2e
- Page 26 and 27: Data FlowQuestion TypeIdentificatio
- Page 28 and 29: I will introduce fundamental techno
- Page 31 and 32: Chapter 3Question Type Identificati
- Page 33 and 34: used for question sentence type ide
- Page 35 and 36: (1) We pay car commuter employees a
- Page 37: Table 3.2. Classified Given Questio
- Page 41 and 42: Plants can grow indoors. In additio
- Page 43 and 44: this thesis. This Chapter proposes
- Page 45 and 46: as Inside/Outside [113, 116] and St
- Page 47 and 48: Step 1 Segment a question article i
- Page 49 and 50: elements be Θ. Then the degree of
- Page 51 and 52: Table 3.5. Transition of Question T
- Page 53 and 54: Table 3.6. Summary of Experimental
- Page 55 and 56: Table 3.8. Results of Chunking Vary
- Page 57 and 58: However when using IOB2/IOE2/IOBES,
- Page 59 and 60: 3.6 Related workIdentification of t
- Page 61 and 62: Chapter 4Categorization of Descript
- Page 63 and 64: 30, 77, 154] and those asking reput
- Page 65 and 66: elements were usually eliminated. H
- Page 67 and 68: Table 4.1. The Definitions of Descr
- Page 69 and 70: 4.3.3 Overview of datasetsTable 4.2
- Page 71 and 72: Table 4.4. Categorization of n Obje
- Page 73 and 74: 4.3.6 DiscussionIn the field of nat
- Page 75 and 76: 4.4 Description type based answer c
- Page 77 and 78: R = |Rc||Ra|(4.10)Varying combinati
- Page 79 and 80: Chapter 5Extraction of ProceduralEx
- Page 81 and 82: Table 5.2. Domain and Type of List.
- Page 83 and 84: Figure 5.2. Collection of Lists fro
- Page 85 and 86: Table 5.3. Types of Tags.Tag types
- Page 87 and 88: domain with the document set in the
- Page 89 and 90:
Table 5.6. Result of Close-Domain.C
- Page 91 and 92:
Table 5.9. Comparison of SVM and De
- Page 93:
Sentence : “ [menyu] w o s ent a
- Page 96 and 97:
• It is applicable in case that m
- Page 98 and 99:
• For extraction of procedural ex
- Page 100 and 101:
[10] Regina Barzilay. Information F
- Page 102 and 103:
[29] Yoav Freund and Robert E. Scha
- Page 104 and 105:
[47] Chiori Hori, Takaaki Hori, Hid
- Page 106 and 107:
[63] Mingzhe Jin. Authorship attrib
- Page 108 and 109:
[84] Christopher D. Manning and Hin
- Page 110 and 111:
of International World Wide Web Con
- Page 112 and 113:
[122] Akihiro Shinmori, Manabu Okum
- Page 114 and 115:
[141] Akihiro Tamura, Hiroya Takamu
- Page 116 and 117:
[161] Yudong Yang and HongJiang Zha
- Page 118 and 119:
[187] . n-gram . , Vol. 23,No. 5,
- Page 120 and 121:
- (Evaluation) Yes-No Yes-No (Ho
- Page 122 and 123:
(Analysis) : (Fact) : (Instance)
- Page 125:
List of PublicationJournal Papers[1