Notes on computational linguistics.pdf - UCLA Department of ...

Stabler - Lx 185/209 2003
Contents
1 Setting the stage: logics, prolog, theories 4
1.1Summary............................................................................. 4
1.2Propositionalprolog...................................................................... 6
1.3Usingprolog .......................................................................... 10
1.4Somedistinctionsofhumanlanguages.......................................................... 11
1.5PredicateProlog ........................................................................ 13
1.6Thelogicofsequences .................................................................... 18
2 Recognition: first idea 26
2.1Aprovabilitypredicate.................................................................... 27
2.2Arecognitionpredicate.................................................................... 28
2.3Finitestaterecognizers.................................................................... 31
3 Extensions of the top-down recognizer 41
3.1Unificationgrammars..................................................................... 41
3.2Moreunificationgrammars:casefeatures ........................................................ 42
3.3Recognizers:timeandspace ................................................................ 44
3.4Trees,andparsing:firstidea ................................................................ 46
3.5Thetop-downparser ..................................................................... 47
3.6Somebasicrelationsontrees................................................................ 48
3.7Treegrammars......................................................................... 52
4 Brief digression: simple patterns of dependency 58
4.1Human-likelinguisticpatterns ............................................................... 58
4.2 Semilinearity and some inhuman linguistic patterns .................................................. 60
5 Trees, and tree manipulation: second idea 62
5.1Nodesandleavesintreestructures ............................................................ 62
5.2Categoriesandfeatures ................................................................... 64
5.3Movementrelations...................................................................... 66
6 Context free parsing: stack-based strategies 75
6.1LLparsing............................................................................ 75
6.2LRparsing............................................................................ 80
6.3LCparsing............................................................................ 82
6.4AlltheGLCparsingmethods(the“stackbased”methods).............................................. 86
6.5Oracles.............................................................................. 89
6.6AssessmentoftheGLC(“stackbased”)parsers..................................................... 96
7 Context free parsing: dynamic programming methods 103
7.1CKYrecognitionforCFGs .................................................................. 103
7.2Treecollection ......................................................................... 110
7.3EarleyrecognitionforCFGs ................................................................. 113
8 Stochastic influences on simple language models 116
8.1Motivationsandbackground ................................................................ 116
8.2Probabilisiticcontextfreegrammarsandparsing ................................................... 159
8.3Multipleknowledgesources................................................................. 163
8.4Nextsteps............................................................................ 166
9 Beyond context free: a first small step 167
9.1 “Minimalist”grammars.................................................................... 168
9.2CKYrecognitionforMGs................................................................... 183
10 Towards standard transformational grammar 198
10.1Review:phrasalmovement ................................................................. 198
10.2Headmovement ........................................................................ 201
10.3Verbclassesandotherbasics................................................................ 209
10.4Modifiersasadjuncts..................................................................... 220
10.5Summaryandimplementation ............................................................... 222
10.6Someremainingissues .................................................................... 227
11 Semantics, discourse, inference 231
12 Review: first semantic categories 234
12.1Things .............................................................................. 234
12.2Propertiesofthings...................................................................... 234
12.3Unaryquantifiers,propertiesofpropertiesofthings ................................................. 235
12.4Binaryrelationsamongthings ............................................................... 236
12.5Binaryrelationsamongpropertiesofthings....................................................... 237
13 Correction: quantifiers as functionals 237
14 A first inference relation 237
14.1Monotonicityinferencesforsubject-predicate...................................................... 238
14.2MoreBooleaninferences ................................................................... 239
15 Exercises 241
15.1Monotonicityinferencesfortransitivesentences.................................................... 242
15.2Monotonicityinference:Amoregeneralandconciseformulation ......................................... 243
16 Harder problems 246
16.1Semanticcategories...................................................................... 246
16.2Contextualinfluences..................................................................... 249
16.3Meaningpostulates ...................................................................... 250
16.4Scopeinversion......................................................................... 252
16.5Inference............................................................................. 254
17 Morphology, phonology, orthography 259
17.1Morphologysubsumed .................................................................... 259
17.2Asimplephonology,orthography ............................................................. 263
17.3Bettermodelsoftheinterface................................................................ 265
18 Some open (mainly) formal questions about language 267
1