15.04.2014 Views

Frame Semantics, Constructions, and the FrameNet Lexical Database

Frame Semantics, Constructions, and the FrameNet Lexical Database

Frame Semantics, Constructions, and the FrameNet Lexical Database

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

<strong>Frame</strong> <strong>Semantics</strong>,<br />

<strong>Constructions</strong>, <strong>and</strong> <strong>the</strong><br />

<strong>Frame</strong>Net <strong>Lexical</strong> <strong>Database</strong><br />

Collin F.Baker<br />

International Computer Science Institute<br />

Berkeley, California


Outline of Course<br />

• Background<br />

• What is a semantic frame?<br />

• Representing FS Concepts<br />

• The Lexicographic Process<br />

• Full text annotation<br />

• Automation<br />

• Related projects


Background


Fillmore on Case Grammar<br />

• 1968. The Case for Case<br />

• 1969. Towards a Modern Theory of<br />

Case<br />

• 1977. The Case for Case Reopened<br />

• S is underlyingly V + {N case1 , N case2 , …}<br />

• Saliency hierarchy ⇒ foregrounding<br />

• Case hierarchy ⇒ grammatical function


Fillmore on <strong>Frame</strong><br />

<strong>Semantics</strong><br />

• 1976 <strong>Frame</strong> semantics <strong>and</strong> <strong>the</strong> nature<br />

of language<br />

• 1977 Scenes-<strong>and</strong>-frames semantics<br />

• 1983 <strong>Frame</strong> semantics<br />

• 1985 <strong>Frame</strong>s <strong>and</strong> <strong>the</strong> <strong>Semantics</strong> of<br />

Underst<strong>and</strong>ing


Construction Grammar<br />

• Only 1 type of entity: constructions<br />

• Construction is pairing of form <strong>and</strong> meaning<br />

(Saussure’s sign)<br />

• Words, MWEs are lexical constructions<br />

• Non-lexical constructions: Subject-predicate,<br />

left isolation (“extraction”), modification<br />

• mono-stratal, no deep vs. surface<br />

• examples from What’s X doing Y? (Kay <strong>and</strong><br />

Fillmore 1999)


A Non-lexical Construction


A <strong>Lexical</strong> Construction


Embodied Conx Grammar<br />

• http://www.icsi.berkeley.edu/NTL<br />

• Outgrowth of Neural Theory of Language<br />

group (neé L-zero)<br />

• John Bryant, et al. (forthcoming) Cognitive<br />

Linguistics-- linguistic side<br />

• Jerome Feldman From Molecule to Metaphor<br />

-- CogSci side<br />

• How can a brain, made up of neurons <strong>and</strong><br />

connections between <strong>the</strong>m, give rise to<br />

thought <strong>and</strong> language?


The <strong>Frame</strong>Net Project<br />

• Creating a highly detailed lexicon of<br />

English predicators based on <strong>Frame</strong><br />

<strong>Semantics</strong><br />

• Documenting <strong>the</strong>ir valences by<br />

manually annotating corpus examples<br />

• Human- <strong>and</strong> machine-readable output<br />

• Full data at<br />

http://framenet.icsi.berkeley.edu


What is a semantic frame?<br />

What do you annotate?


Semantic <strong>Frame</strong>s<br />

• <strong>Frame</strong>: Semantic frames are schematic<br />

representations of situations involving various<br />

participants, props, <strong>and</strong> o<strong>the</strong>r conceptual<br />

roles, each of which is called a frame<br />

element (FE)<br />

• These include events, states, <strong>and</strong> relations<br />

• What were called in earlier work on <strong>Frame</strong><br />

<strong>Semantics</strong> “scenes” <strong>and</strong> “scenarios” are all<br />

represented in <strong>Frame</strong>Net by one data type,<br />

<strong>the</strong> frame.<br />

• <strong>Frame</strong>s are connected to each o<strong>the</strong>r via<br />

frame-to-frame relations


<strong>Frame</strong> Elements (FEs)<br />

• <strong>Frame</strong> Element (FE): The participants, props<br />

<strong>and</strong> roles of a frame. These can include<br />

agents, inanimate objects, <strong>and</strong> elements of<br />

<strong>the</strong> setting.<br />

• The syntactic dependents (broadly construed)<br />

of a predicating word correspond to <strong>the</strong> frame<br />

elements of <strong>the</strong> frame (or frames) associated<br />

with that word.<br />

• Each FE is defined relative to a single frame.<br />

Any connections between FEs have to be<br />

made explicitly.


<strong>Lexical</strong> Unit (LU)<br />

• The pairing of a lemma with a meaning; a<br />

word sense. The meaning is partially<br />

expressed by <strong>the</strong> relation between <strong>the</strong> lemma<br />

<strong>and</strong> a FN frame, i.e. between lexical form(s)<br />

<strong>and</strong> <strong>the</strong> semantic frame <strong>the</strong>y evoke.<br />

• Includes inflected forms see, saw seen<br />

• Includes multi-word expressions (MWEs):<br />

pick out, lose sleep, spitting image, family<br />

practitioner<br />

• May be any part of speech: verbs, nouns,<br />

adjectives, prepositions, etc.


LU Definitions<br />

• In addition to <strong>the</strong> connection to <strong>the</strong><br />

frame, <strong>the</strong> FN database also includes a<br />

definition of each LU.<br />

• The LU definition is human-readable<br />

(we hope), similar to a dictionary<br />

definition, <strong>and</strong> represents aspects of<br />

meaning finer than <strong>the</strong> frame<br />

distinctions.


Placing <strong>Frame</strong>: Definition<br />

• Generally without overall (translational)<br />

motion, an Agent places a Theme at a<br />

location, <strong>the</strong> Goal, which is profiled. In this<br />

frame, <strong>the</strong> Theme is under <strong>the</strong> control of <strong>the</strong><br />

Agent/Cause at <strong>the</strong> time of its arrival at <strong>the</strong><br />

Goal.<br />

• This frame differs from Filling in that it<br />

focuses on <strong>the</strong> Theme ra<strong>the</strong>r than <strong>the</strong> effect<br />

on <strong>the</strong> Goal entity. It differs from Removing in<br />

focusing on <strong>the</strong> Goal ra<strong>the</strong>r than <strong>the</strong> Source<br />

of motion for <strong>the</strong> Theme.


Placing <strong>Frame</strong>: FEs<br />

• Agent/Cause<br />

• Goal<br />

• Theme<br />

• Area<br />

• Co<strong>the</strong>me<br />

• Degree<br />

• Distance<br />

• Manner<br />

• Means<br />

• Place<br />

• Purpose<br />

• Time...


Placing <strong>Frame</strong>: LUs<br />

• archive.v, arrange.v, bag.v, bestow.v, billet.v,<br />

bin.v, bottle.v, box.v, brush.v, cage.v, cram.v,<br />

crate.v, dab.v, daub.v, deposit.v, drape.v,<br />

drizzle.v, dust.v, embed.v, file.v, garage.v,<br />

hang.v, heap.v, immerse.v, implant.v, inject.v,<br />

insert.v, ... put.v, rest.v, rub.v, set.v,<br />

shea<strong>the</strong>.v, shelve.v, shoulder.v, shower.v,<br />

sit.v, situate.v, smear.v, sow.v, stable.v,<br />

st<strong>and</strong>.v, stash.v, station.v, stick.v, stow.v,<br />

stuff.v, tuck.v, warehouse.v<br />

• Many of <strong>the</strong>se incorporate <strong>the</strong> Goal FE


Placing <strong>Frame</strong>: Annotation<br />

• [European heads of government ...<br />

AGENT ] showered [telegrams of<br />

congratulation THEME ] [on Clinton GOAL ],<br />

saying...<br />

• [I AGENT ] plunged [my h<strong>and</strong>s THEME ]<br />

[wrist deep DISTANCE ] [in <strong>the</strong> fragrant<br />

herbs GOAL ]...


The Revenge <strong>Frame</strong>


Revenge <strong>Frame</strong>: Definition<br />

• This frame concerns <strong>the</strong> infliction of punishment in<br />

return for a wrong suffered. An Avenger performs a<br />

Punishment on a Offender as a consequence of an<br />

earlier action by <strong>the</strong> Offender, <strong>the</strong> Injury.<br />

• The Avenger inflicting <strong>the</strong> Punishment need not be<br />

<strong>the</strong> same as <strong>the</strong> Injured_Party who suffered <strong>the</strong><br />

Injury, but <strong>the</strong> Avenger does have to share <strong>the</strong><br />

judgment that <strong>the</strong> Offender's action was wrong.<br />

• The judgment that <strong>the</strong> Offender had inflicted an Injury<br />

is made without regard to <strong>the</strong> law.


Revenge <strong>Frame</strong>: FEs<br />

• Core:<br />

– Avenger<br />

– Injured_party<br />

– Injury<br />

– Offender<br />

– Punishment<br />

• Non-Core:<br />

– Place<br />

– Time<br />

– Degree<br />

– Manner<br />

– Purpose, ...


Core FEs<br />

• Inherent in <strong>the</strong> concept of <strong>the</strong> frame<br />

itself<br />

• The most frame-specific FEs; core FEs<br />

differences serve to differentiate frames<br />

• Must be annotated for every instance of<br />

<strong>the</strong> frame


Peripheral FEs<br />

• Ontologically necessary, but not really<br />

frame-specific<br />

• Often presupposed, deprofiled<br />

• Bindings to high-level frames<br />

– Event ->Place, Time<br />

– Intentionally_act -> Reason


Extra-<strong>the</strong>matic FEs<br />

• Not actually part of <strong>the</strong> frame in<br />

question; <br />

• Beneficiary, description, etc.<br />

• Really amount to evocation of a<br />

separate frame<br />

• But appear frequently in sentences,<br />

should be annotated at <strong>the</strong> same time


Revenge <strong>Frame</strong>: LUs<br />

• avenge.v, get_back.v, get_even.v,<br />

payback.n, retaliate.v, retaliation.n,<br />

retribution.n, retributive.a, retributory.a,<br />

revenge.n, revenge.v, revengeful.a,<br />

sanction.n, vengeance.n, vengeful.a,<br />

vindictive.a<br />

• AND avenger.n, revenger.n


Revenge <strong>Frame</strong>: Annotation<br />

• 1. [They AVENGER ] took revenge [for <strong>the</strong><br />

deaths of two loyalist prisoners INJURY ]<br />

• 2. The next day, [<strong>the</strong> Roman forces AVENGER ]<br />

took revenge [on <strong>the</strong>ir enemies OFFENDER ]...]<br />

• 3. [The ban PUNISHMENT ] [is Cop ] [Prince<br />

Charles's AVENGER ] revenge [for her refusal to<br />

spend Christmas with <strong>the</strong> rest of <strong>the</strong> royals...<br />

INJURY ]


Text <strong>Frame</strong>: Definition<br />

• A Text is an entity that contains<br />

linguistic, symbolic information on a<br />

Topic, created by an Author at <strong>the</strong><br />

Time_of_creation. It may be a physical<br />

entity that is made of a certain Material<br />

etc. It may be constructed for an<br />

Honoree.


Text frame: FEs<br />

• Core<br />

– Text<br />

• Non-core<br />

– Author<br />

– Components<br />

– Containing_text<br />

– Genre<br />

– Honoree<br />

– Material<br />

– Medium<br />

– Time_of_creation<br />

– Topic<br />

– Use


Text <strong>Frame</strong>: LUs<br />

• account.n, article.n, autobiography.n, ballad.n,<br />

benediction.n, biography.n, book.n, booklet.n,<br />

bulletin.n, chronicle.n, comedy.n, diary.n,<br />

drama.n, edition.n, editorial.n, elegy.n, epic.n,<br />

epigram.n, epilogue.n, epistle.n, essay.n,<br />

eulogy.n, exemplum.n, fable.n, fanzine.n,<br />

festschrift.n, fiction.n, ... sermon.n, song.n,<br />

sonnet.n, speech.n, spellbook.n, tetralogy.n,<br />

thriller.n, tome.n, tract.n, tractate.n, tragedy.n,<br />

treatise.n, trilogy.n, volume.n, whodunit.n,<br />

writings.n


Text <strong>Frame</strong>: Annotation<br />

• [Shusaku Endo's AUTHOR ] novel [of ideas TOPIC ]<br />

can be read as symbolism or old-fashioned<br />

realism...<br />

• [Frodo's AUTHOR ] elegy [for G<strong>and</strong>alf HONOREE ]<br />

ends on <strong>the</strong> word “died”...<br />

• Has he seen <strong>the</strong> excellent [Glasgow Evening<br />

Times CONTAINING TEXT ] article [of 20 November<br />

TIME OF CREATION ] which...<br />

• [Its AUTHOR ] bulletin, [Christian Meditation<br />

Newsletter TITLE ], containing ...


Apply heat <strong>Frame</strong>: Definition<br />

• A Cook applies heat to Food, where <strong>the</strong><br />

Temperature_setting of <strong>the</strong> heat <strong>and</strong><br />

Duration of application may be specified. A<br />

Heating_instrument, generally indicated by<br />

a locative phrase, may also be expressed.<br />

Some cooking methods involve <strong>the</strong> use of a<br />

Medium (e.g. milk or water) by which heat is<br />

transferred to <strong>the</strong> Food. A less semantically<br />

prominent Food or Cook is marked<br />

Co_participant.


Apply heat frame: FEs<br />

• Core<br />

– Container<br />

– Cook<br />

– Food<br />

– Heating instrument<br />

– Temperature setting<br />

• Non-core<br />

– Co-participant<br />

– Degree<br />

– Duration<br />

– Manner<br />

– Means<br />

– Medium<br />

– Place<br />

– Purpose<br />

– Time


Apply heat frame: LUs<br />

• bake.v, barbecue.v, blanch.v, boil.v,<br />

braise.v, broil.v, brown.v, char.v,<br />

coddle.v, cook.v, deep fry.v, fry.v, grill.v,<br />

microwave.v, parboil.v, poach.v, roast.v,<br />

saute.v, scald.v, sear.v, simmer.v,<br />

singe.v, steam.v, steep.v, stew.v,<br />

toast.v


Apply heat frame: Annotation<br />

• 1. Bake [<strong>the</strong> souffles FOOD ] [for 12<br />

minutes DURATION ]. [CNI COOK ] [INI HEATING<br />

INSTRUMENT ]<br />

• [They COOK ] boil [<strong>the</strong>m FOOD ] [in an iron<br />

saucepan CONTAINER ].


Null Instantiation<br />

• CNI (“constructional null instantiation”)<br />

grammatically licensed<br />

– e.g.,missing subject of imperative<br />

Please leave <strong>the</strong> room.<br />

• INI (“indefinite null instantiation”)<br />

existential; lexically licensed<br />

– e.g., missing objects of some activity verbs<br />

I’ve been baking all afternoon.<br />

• DNI (“definite null instantiation”)<br />

anaphoric; lexically licensed<br />

– e.g., omitted complements of some cognitive<br />

verbs She already knows.


The art of frame definition<br />

• Not a science, but not haphazard, ei<strong>the</strong>r<br />

• Try to make useful generalizations<br />

across reasonable-sized groups<br />

• FN proceeds frame by frame ra<strong>the</strong>r than<br />

lemma by lemma<br />

• All LUs in a frame have <strong>the</strong> same FEs,<br />

with <strong>the</strong> same profiling / coreness<br />

• Respect stative / inchoative / causative<br />

distinction


The Lexicographic Process<br />

• Vanguarding<br />

• Subcorporation<br />

• Annotation<br />

• Reports <strong>and</strong> data distribution


“Vanguarding”<br />

• <strong>Frame</strong>s, FEs, <strong>and</strong> LUs defined–corpus, o<strong>the</strong>r<br />

resources<br />

• Rules written to extract examples of all<br />

syntactic patterns, some collocations<br />

• Rules can include comm<strong>and</strong>s to pre-mark<br />

FEs on chunks<br />

• “O<strong>the</strong>r” subcorpus for unforeseen patterns


Subcorporation<br />

• Non-interactive, comm<strong>and</strong>-line process<br />

• Down-sample when necessary for very<br />

common lemmas<br />

• Subcorpora produced by matching<br />

chunked sentences against rules<br />

– Slow<br />

– Parse-specific<br />

– Complex, cascaded filter


Annotation<br />

• Annotator chooses “good_ examples of<br />

each lexicographically relevant<br />

syntactic pattern (“alternations”)<br />

• All core FEs found are annotated for<br />

each sentence<br />

• If <strong>the</strong> predicator is a verb, core FEs not<br />

expressed in <strong>the</strong> sentence are<br />

annotated as “null instantiated_


Annotation<br />

• Each annotation set contains labels on<br />

multiple layers: FE, GF, PT, etc.<br />

• GF <strong>and</strong> PT added semi-automatically<br />

• Process allows multiple targets<br />

(annotation sets) per sentence (not<br />

needed for lexicographic work)<br />

• Goal is ~15-20 clear examples / LU


Retaliate: Annotation report


Retaliate: <strong>Lexical</strong> entry report


Representing <strong>Frame</strong><br />

Semantic Concepts


<strong>Frame</strong>-to-frame relations<br />

1. Inheritance<br />

2. Perspective on<br />

3. Using<br />

4. Subframe<br />

5. Precedes<br />

6. Causative of<br />

7. Inchoative of<br />

8. See also


FE-to-FE relations across<br />

frames<br />

• Every frame relation (except See also)<br />

is accompanied by one or more FE-to-<br />

FE relations.<br />

• At <strong>the</strong> moment, <strong>the</strong>re is only one type of<br />

FE-FE relation, which is “subtype of”<br />

(possibly improper).<br />

• This may change.


<strong>Frame</strong>Grapher


Inheritance<br />

• All FEs of parent are bound to FEs of<br />

child<br />

• Child FEs need not have same name<br />

• Child can have more FEs<br />

• Child semantics is a subtype of parent<br />

semantics<br />

• Any within-frame FE-FE relations of<br />

parent are duplicated in child


Perspective on<br />

• Some parent FEs missing or deprofiled<br />

in child<br />

• Commercial Transaction -- Buy, Sell<br />

• Employment -- Hiring, Getting a job


Using


Subframe <strong>and</strong> Precedes


Causative of <strong>and</strong> Inchoative of<br />

Causative of<br />

Inchoative of<br />

1. …o<strong>the</strong>rs BOUND <strong>the</strong><br />

forelegs, <strong>and</strong> <strong>the</strong> hind legs,<br />

toge<strong>the</strong>r with rope.<br />

2. Recombinant Oct-11 protein<br />

BINDS specifically to an<br />

octamer sequence…<br />

3. …<strong>the</strong> BOUND protein can<br />

detach from <strong>the</strong> protected<br />

DNA fragment <strong>and</strong><br />

reassociate to o<strong>the</strong>r DNA<br />

fragments…


See also<br />

• This is not a profoundly ontological<br />

relationship, it’s more like “see also” in<br />

a print dictionary, alerting <strong>the</strong> reader to<br />

ano<strong>the</strong>r frame that seems similar<br />

• Such links allow us to describe<br />

differences between a set of similar<br />

frames in just one place.


What happened to <strong>the</strong>matic<br />

roles?<br />

• They correspond fairly well to <strong>the</strong> FEs of<br />

top-level frames:<br />

– Event:<br />

– Act<br />

– Intentionally act:<br />

• Some also correspond fairly well to<br />

semantic types on FEs


Traditional <strong>the</strong>matic roles<br />

don't fit some frames<br />

• Similarity-- NB two ways of expressing<br />

this:<br />

– reciprocally (The children are very similar<br />

(to each o<strong>the</strong>r)) or<br />

– unequally (John resembles his fa<strong>the</strong>r.<br />

– NB: ??His fa<strong>the</strong>r resembles john.<br />

• Not an event but a state; event-type<br />

roles don’t apply


Traditional roles don’t fit (2)<br />

• Causative replacing<br />

– The coach replaced [Smith OLD] with<br />

[Jones NEW]<br />

• Inchoative replacing<br />

– [France NEW] replaced [Brazil OLD] as<br />

world champions.


FE-to-FE relations within<br />

frames<br />

• Excludes: 1 FE excludes ano<strong>the</strong>r<br />

• Requires: 1 FE requires <strong>the</strong> presence of<br />

ano<strong>the</strong>r.<br />

• [The children PARTICIPANTS] are very<br />

similar.<br />

• [John FIGURE] is similar to [his fa<strong>the</strong>r<br />

GROUND].


FE-to-FE relations within<br />

frames (2): Coresets<br />

• Any one of a set of FEs is sufficient for<br />

a pragmatically "complete” sentence<br />

• She ran [here GOAL] [from <strong>the</strong> bus-stop<br />

SOURCE]<br />

• She ran [for one kilometer DISTANCE]<br />

• She ran [along <strong>the</strong> canal PATH]<br />

• ?She ran. (OK in answer to <strong>the</strong> question<br />

How did she get here?...)


*LU-to-LU relations<br />

• Implied relation of inter-substitutability<br />

for all LUs within a frame<br />

• But more true of some frames than<br />

o<strong>the</strong>rs<br />

• Positive <strong>and</strong> negative words in same<br />

frame, marked with semantic types<br />

• Use WordNet for most such relations


FN Semantic Types<br />

• Ontological types--<br />

– relate to ontologies, WN hierarchy but<br />

data-driven<br />

– mostly on FEs<br />

• <strong>Lexical</strong> types -- on LUs (pos/ neg)<br />

• Framal types-- <strong>the</strong>ory-internal e.g.<br />

“non-lexical frame”


Framal Semantic Types


Full text annotation


Deeper text underst<strong>and</strong>ing<br />

• Although <strong>the</strong> main work of FN has been<br />

lexicographic, <strong>the</strong> ultimate goal has<br />

always been deep underst<strong>and</strong>ing of full<br />

texts (Fillmore <strong>and</strong> Baker 2001)<br />

• One annotation set for each frameevoking<br />

expression


In October 2002,<br />

<strong>the</strong> U.S. State Department<br />

informed<br />

North Korea<br />

that<br />

<strong>the</strong> U.S.<br />

was aware<br />

of this program,<br />

<strong>and</strong><br />

regards<br />

it<br />

as a violation<br />

of Pyongyang's<br />

nonproliferation<br />

commitments.<br />

Telling.inform


Telling.inform<br />

Time<br />

Speaker<br />

Target<br />

Addressee<br />

Message<br />

In 2002,<br />

<strong>the</strong> U.S. State Department<br />

INFORMED<br />

North Korea<br />

that <strong>the</strong> U.S. was aware of this program ,<br />

<strong>and</strong> regards it as a violation of Pyongyang's<br />

nonproliferation commitments


Inform<br />

• The meaning of inform that we wish to describe<br />

belongs to a Telling frame; here <strong>the</strong> emphasis is on<br />

getting information to an addressee, <strong>and</strong> is thus<br />

distinct from Saying.<br />

– The Telling frame is shared by inform, tell, notify, etc.,<br />

Saying is shared by say, announce, state, whisper, etc.<br />

• The meaning of inform in <strong>the</strong> Telling frame is distinct<br />

from <strong>the</strong> sense it has as a member of <strong>the</strong> Reporting<br />

frame, where it occurs as part of a phrasal verb,<br />

inform on. O<strong>the</strong>r members of this frame are report<br />

(<strong>the</strong>y reported me to <strong>the</strong> authorities), tell on, rat on,<br />

fink on.


Annotations with<br />

Telling.inform


O<strong>the</strong>r patterns with<br />

Telling.inform?<br />

• Those examples showed just one of <strong>the</strong> syntactic<br />

patterns available to inform in <strong>the</strong> Telling frame:<br />

simple active sentences with a that-clause<br />

expressing <strong>the</strong> Message. If <strong>the</strong> Message is<br />

expressed with a NP, <strong>the</strong> preposition of can be<br />

selected.<br />

– Passive with that: Were [you] informed [that<br />

Shelly has left home]?<br />

– Active with of: [I] already informed [you] [of my<br />

decision].<br />

– Passive with of: Had [you] been informed [of <strong>the</strong><br />

details]?<br />

• O<strong>the</strong>r possibilities include on, about, <strong>and</strong> as to.


In October 2002,<br />

<strong>the</strong> U.S. State Department<br />

informed<br />

North Korea<br />

that<br />

<strong>the</strong> U.S.<br />

was aware<br />

of this program,<br />

<strong>and</strong><br />

regards<br />

it<br />

as a violation<br />

of Pyongyang's<br />

nonproliferation<br />

commitments.<br />

Awareness.aware


Awareness.aware<br />

Cognizer<br />

TARGET<br />

Content<br />

<strong>the</strong> U.S.<br />

was AWARE<br />

of this program


Aware<br />

• The adjective aware is assigned to <strong>the</strong> Awareness<br />

frame, which it shares with cognizant, conscious <strong>and</strong><br />

a number of verbs (know, realize, ...) <strong>and</strong> nouns<br />

(awareness) that signal a relation between a<br />

Cognizer <strong>and</strong> a Content. As with Telling.inform, <strong>the</strong><br />

Content (corresponding to Message) can be<br />

expressed as a clause or as a NP:<br />

– Are [you] aware [of our crisis]?<br />

– Are [you] aware [that we are having a crisis]?


In October 2002,<br />

<strong>the</strong> U.S. State Department<br />

informed<br />

North Korea<br />

that<br />

<strong>the</strong> U.S.<br />

was aware<br />

of this program,<br />

<strong>and</strong><br />

regards<br />

it<br />

as a violation<br />

of Pyongyang's<br />

nonproliferation<br />

commitments.<br />

Categorization.regard


Categorization.regard<br />

Cognizer<br />

TARGET<br />

Item<br />

Category<br />

<strong>the</strong> U.S.<br />

REGARDS<br />

it<br />

as a violation of Pyongyang's<br />

nonproliferation commitments


Regard<br />

• Regard, in <strong>the</strong> Categorization frame, is<br />

used to express <strong>the</strong> idea of assigning<br />

some Item to a Category. Its frame<br />

partners include consider, classify,<br />

categorize <strong>and</strong> a few o<strong>the</strong>rs.


In October 2002,<br />

<strong>the</strong> U.S. State Department<br />

informed<br />

North Korea<br />

that<br />

<strong>the</strong> U.S.<br />

was aware<br />

of this program,<br />

<strong>and</strong><br />

regards<br />

it<br />

as a violation<br />

of Pyongyang's<br />

nonproliferation<br />

commitments.<br />

Compliance.violation


Compliance.violation<br />

Act<br />

Target<br />

Norm<br />

it<br />

a VIOLATION<br />

of Pyongyang's nonproliferation<br />

commitments


Violation<br />

• Violation, in <strong>the</strong> sense we have in mind, belongs to<br />

<strong>the</strong> negative-response set of lexical units in <strong>the</strong><br />

Compliance frame.<br />

• Alongside of X violated <strong>the</strong> rule we have X is a<br />

violation of <strong>the</strong> rule <strong>and</strong> X is in violation of <strong>the</strong> rule.<br />

• The X in <strong>the</strong>se formulas can st<strong>and</strong> for<br />

– <strong>the</strong> Protagonist (we),<br />

– <strong>the</strong> Act (what we did), or<br />

– <strong>the</strong> State_of_affairs (our situation).


In October 2002,<br />

<strong>the</strong> U.S. State Department<br />

informed<br />

North Korea<br />

that<br />

<strong>the</strong> U.S.<br />

was aware<br />

of this program,<br />

<strong>and</strong><br />

regards<br />

it<br />

as a violation<br />

of Pyongyang's<br />

nonproliferation<br />

commitments.<br />

Commitment.commitment


Commitment.commitment<br />

Speaker<br />

Message<br />

Target<br />

Pyongyang's<br />

nonproliferation<br />

COMMITMENTS.


Commitment<br />

• The noun commitment in <strong>the</strong> intended sense belongs<br />

to <strong>the</strong> Commitment frame.<br />

• O<strong>the</strong>r words sharing this frame include commit, vow,<br />

oath, swear, promise, covenant (some are verbs,<br />

some are nouns, some are both).<br />

• All of <strong>the</strong>m have to do with illocutionary acts that bind<br />

<strong>the</strong>ir speakers to a course of action.<br />

• This sense of commitment takes <strong>the</strong> support verb<br />

make.<br />

– Are you afraid to make a commitment?<br />

– You’ve made a commitment now, so you’d better honor it.


Support Verbs <strong>and</strong> Polysemy<br />

Commitment also occurs in <strong>the</strong><br />

Institutionalization frame: committing a person to a<br />

mental hospital. That meaning does not welcome<br />

<strong>the</strong> support verb make.<br />

The verb commit itself is a support verb for<br />

crimes <strong>and</strong> sins: to commit murder is <strong>the</strong> same as<br />

to murder. But this use of commit has commission,<br />

not commitment, as its nominalization!


Full Text Annotation<br />

• Text annotation is relatively recent task<br />

for FN<br />

– 5 texts from PropBank, for comparison with<br />

PB annotation (NSF subcontract)<br />

– 15 texts from NTI website-- CNS country<br />

profiles, etc. (AQUINAS)<br />

• Must deal with syntactic complexity, etc.


Lexicography vs. Full Text<br />

• Lexicography: Need to fill out frames, fully<br />

exemplify LUs, create training data for<br />

machine learning<br />

• Text annotation: Need to create new frames,<br />

LUs quickly, maximally reuse, fewer<br />

examples of rare LUs, more of common ones<br />

• Created new text-annotation form to speed<br />

up finding same LU across text(s)


PropBank<br />

• Closest annotation project to <strong>Frame</strong>Net in<br />

many ways<br />

• Starts from Penn TreeBank, mainly WSJ<br />

• Annotates arguments <strong>and</strong> adjuncts of verbs,<br />

with labels like Arg0, Arg1, ArgM<br />

• These general labels are given definitions<br />

specific to each word sense<br />

• Some generalization across LUs, but no true<br />

semantic frames<br />

• Now supplemented with NomBank for nouns


PropBank - WordNet -<br />

<strong>Frame</strong>Net Comparison<br />

• Felipe Gonzalez election victory<br />

– (live)<br />

– Capture 1


NIs <strong>and</strong> anaphora resolution<br />

• The United Nations said Somali<br />

gunmen who had hijacked a U.N.-<br />

chartered vessel carrying food aid<br />

to tsunami victims released <strong>the</strong> ship<br />

after holding it for more than two<br />

months.<br />

• Words in orange are in FN


FN is not <strong>the</strong> only resource<br />

you need for NLP…<br />

• Need treatment of negation or quantification<br />

• Need mechanism for syntactic/ semantic<br />

composition<br />

• Need discourse connectives<br />

• Need specialist terms, noun taxonomies<br />

(NER)<br />

• Need recognizers for time expressions,<br />

numbers, etc.


Automation<br />

or<br />

Can’t this be done by a machine?


Some parts just can’t be…<br />

• We are not basing our work on existing<br />

sense inventories; we want to be really<br />

accurate about <strong>the</strong> number <strong>and</strong> nature<br />

of <strong>the</strong> participants in each frame.<br />

• Unsupervised learning can only take<br />

you so far; we believe human judgment<br />

has to be part of <strong>the</strong> mix.


<strong>Frame</strong> assignment as WSD<br />

• Title of paper by K. Erk (2005)<br />

• Same basic problems as for machinelearning<br />

WSD-- insufficient data, interannotator<br />

agreement<br />

• Same methods, variety of classification<br />

algorithms, well-researched


Automatic semantic role<br />

labeling (ASRL)<br />

• Gildea & Jurafsky (2002)<br />

• Thompson, Levy <strong>and</strong> Manning (2003) --<br />

generative HMM model<br />

• Fleishman <strong>and</strong> Hovy (2003) “Maximum<br />

Entropy Approach to <strong>Frame</strong>Net Tagging<br />

• Senseval 3 ASRL task (Litkowsky 2004)


Shalmaneser<br />

• Erk & Padó 2006 LREC (“Shallow<br />

Semantic Parsing⇠”)<br />

• FRED-frame assignment = supervised<br />

WSD, Naïve Bayes classifier, MLE<br />

• ROSY-role labeling, 1 or 2-step<br />

• Trained on English, German<br />

• Out of <strong>the</strong> box or experimental use,<br />

substituting components


<strong>Frame</strong> Induction<br />

• Rebecca Green’s Ph.D. <strong>the</strong>sis, U<br />

Maryl<strong>and</strong>, Green & Dorr 2004, 2005<br />

• Used WordNet, LDOCE to find clusters<br />

of Vs, <strong>the</strong>n clusters of associated Ns<br />

• Induced prospective frames <strong>and</strong> names<br />

for frames <strong>and</strong> FEs in <strong>the</strong>m<br />

• Roughly 1500 frames, extensive lists of<br />

words in frames, but need more work<br />

• Tested on text tiling task--small but<br />

significant improvement


"Rapid Vanguarding"<br />

• Using principles of Kilgarriff's Word<br />

Sketch Engine/ WASPbench<br />

• WSE provides filtered summary of<br />

corpus data www.sketchengine.co.uk<br />

• WASPbench allows grouping into<br />

word senses (running at ITRI,<br />

Brighton)


Sample Word Sketch


Bootstrapping annotation<br />

• We are close to situation in which<br />

output of Shalmaneser can be input to<br />

FN annotation, output of annotation can<br />

be training data for Shalmaneser<br />

• Need to do error analysis, selective<br />

sampling to create best training data<br />

• Plan to create large corpus with FN<br />

annotation of differing quality-- platinum,<br />

gold, silver, …


Applications


Information Extraction<br />

• Mohit <strong>and</strong> Narayanan 2003 HLT-<br />

NAACL “Semantic Extraction with Wide-<br />

Coverage <strong>Lexical</strong> Resources”<br />

• IE using GATE on 100 crime stories<br />

• Used FN frames as “seeds” for IE<br />

patterns<br />

• Walked WN hierarchy to increase<br />

coverage


Question Answering<br />

• Narayanan <strong>and</strong> Harabagiu 2004 Coling<br />

• Analyse predicate argument structs <strong>and</strong><br />

semantic frames in qns <strong>and</strong> answers<br />

• Coordinated Probablistic Relational<br />

Model of events<br />

• Probabalistic inference from extracted<br />

events


Textual Entailment<br />

• Aljoscha Burchardt <strong>and</strong> Anette<br />

Frank 2006 (conference?)<br />

“Approximating Textual Entailment with<br />

LFG <strong>and</strong> <strong>Frame</strong>Net <strong>Frame</strong>s”<br />

• LFG f-struct -> FN roles<br />

• PASCAL RTE challenge<br />

• Computing match graphs for text <strong>and</strong><br />

hypo<strong>the</strong>sis


Modeling Sentence<br />

Processing<br />

• Ulrike Padó 2006 (conference?)<br />

• Semantic/syntactic “garden path”<br />

– The hunter shot by <strong>the</strong> teenager was quite<br />

young.<br />

– The deer shot by <strong>the</strong> hunter was truly<br />

impressive.<br />

• FN/PB comparison<br />

– PB better coverage<br />

– FN better modeling


Related projects


The SALSA Project<br />

• Manfred Pinkal, Universität des<br />

Saarl<strong>and</strong>es<br />

• Starts from TIGER German treebank<br />

• Adds <strong>Frame</strong>Net labels to constituents<br />

• Own annotation tool, TIGER XML<br />

• Where FN frames do not yet exist,<br />

creates “unknowns”, annotates<br />

somewhat like PropBank


<strong>Frame</strong>Nets in o<strong>the</strong>r<br />

Languages<br />

• Spanish <strong>Frame</strong>Net: Carlos Subirats, U<br />

Autónoma, Barcelona<br />

http://gemini.uab.es/SFN<br />

• Japanese <strong>Frame</strong>Net: Kyoko Ohara,<br />

Keio U (<strong>and</strong> o<strong>the</strong>rs from Tokyo Univ)<br />

http://jfn.st.hc.keio.ac.jp<br />

• German <strong>Frame</strong>Net: Hans C. Boas, U<br />

Texas, Austin<br />

http://gframenet.gmc.utexas.edu/


Spanish <strong>Frame</strong>Net<br />

• Universidad Autónoma de Barcelona<br />

• Built corpus of 350 million words of Old <strong>and</strong><br />

New World Spanish<br />

• Own system for extracting sentences,<br />

“subcorporation”<br />

• Using a copy of <strong>the</strong> FN software for<br />

annotation<br />

• Using FN frames, with some modifications for<br />

Spanish


Japanese <strong>Frame</strong>Net<br />

• Own Corpus (20 million words), Search<br />

Tool<br />

• JFN Desktop<br />

• JFN Report System (Dynamic)<br />

• HTML Report Creator (Static)<br />

• Currently annotating LUs in frames<br />

related to Motion, Risk, Commerce,<br />

Theft, etc.


German <strong>Frame</strong>Net<br />

• German corpora for GFN:<br />

– LDC German newspaper corpus<br />

– Institut für Deutsche Sprache: Datenbank<br />

gesprochenes Deutsch<br />

– Tagging with STTS<br />

• Working on lexicon, pipeline for texts


<strong>Frame</strong>Nets by Projection<br />

• English ⇒ French: Guillaume Pitel,<br />

CNRS (Nancy)<br />

• English ⇒ Chinese: Bi<strong>Frame</strong>Net:<br />

Pascale Fung (HKUST)<br />

• Related work: Padó <strong>and</strong> Lapata (2005)<br />

English ⇒ German, French


<strong>Frame</strong>SQL<br />

• Prof. Hiroaki Sato, Senshu University,<br />

Kawasaki, Japan http://sato.fm.senshuu.ac.jp/fn23/notes/<br />

• FEs extracted from FN data, loaded in<br />

to SQL database, form-based searching<br />

over <strong>the</strong> web<br />

• In areas where SFN has <strong>the</strong> same<br />

frames as English, can do parallel<br />

searches


Soccer <strong>Frame</strong>Net<br />

• Thomas Schmidt, Ph.D. U Hamburg--<br />

ICSI post-Doc<br />

• http://www.kicktionary.de


FN in OWL DL<br />

• Jan Scheffczyk (Bundeswehr U, ICSI<br />

Post-doc) <strong>and</strong> Srini Narayanan (ICSI)<br />

(OntoLex 2006)<br />

• <strong>Frame</strong> db in OWL DL, reasoning with<br />

st<strong>and</strong>ard tools<br />

• <strong>Frame</strong>s, FEs = classes; annotations =<br />

instances<br />

• Program for converting Annotation db<br />

into OWL DL, too big to distribute all


Linking FN to SUMO<br />

• Jan Scheffczyk <strong>and</strong> Michael Ellsworth<br />

(ICSI) (OntoLex 2006)<br />

• Links expressed in SUMO KIF<br />

• Manually specified links from FN<br />

semantic types to SUMO nodes<br />

• Semi-automatically link roughly 1/2 of<br />

FEs to SUMO nodes<br />

• SUMO already linked to WN


From FN STs to SUMO nodes


Data releases<br />

• Fifth data release “soon”-- R 1.3<br />

• HTML for browsing <strong>and</strong> XML for<br />

machines<br />

• OWL DL <strong>and</strong> program for generating<br />

• Java API?<br />

• The Book<br />

• Hundreds of users around <strong>the</strong> world


Thanks!<br />

• Talk to us<br />

• http://framenet.icsi.berkeley.edu

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!