NooJ, 1/4 Max Silberztein, Université de Franche-Comté, France ...

NooJ, 1/4NooJMax Silberztein, Université de Franche-Comté, Francewww.nooj4nlp.netNooJ is a linguistic software that processes texts andcorpora in real time.NooJ understands over 100+ file formats, includingall variants of ASCII, ISO, Unicode and HTML. NooJreads XML documents, and can import XML tags inits Text Annotation System.(will + shall) * + * (about + going) to to retrieve any sentence in the future (e.g. John willcome) or in the near future (e.g. John is going tocome). The symbol matches any conjugatedform of “to be” (e.g. “was”), matches anyadverb (e.g. “never”, “often”), including compoundadverbs such as “as far as possible”, e.g. in:Where relevant the two administrations will as far aspossible abide by the Concordats ... matches all verbs in the infinitive, etc.Here is another typical query:NooJ processes corpora in 100+ file formatsNooJ is mainly used as a corpus processor (to buildconcordances) and as an information extractor forsearch engines, text mining and competitiveintelligence applications.Each NooJ language module contains large-coveragedictionaries and grammars. Dictionaries andgrammars are applied to corpora in order to locatemorphological, lexical and syntactic patterns, as wellas to build complex concordances. Thanks to its largecoveragelinguistic resources, NooJ’s query systemcan retrieve complex patterns, such as:This pattern matches all nouns in the singular(including compound nouns such as customer service)followed by a verb conjugated in the preterit,

followed by an expression of date, followed by “in”,followed by a word form in uppercase.NooJ, 2/4French, Hebrew Hungarian, Italian and Spanish, withmore to come soon.NooJ’s linguistic engine manages annotations. Anannotation is any piece of information (lexical,morphological, syntactic or semantic) that isassociated with a sequence of text. All annotations arestored in the Text’s Annotation Structure (TAS),which is kept synchronized with the text.GrammarsNooJ grammars are organized sets of graphs, used torecognize syntactic constructs (e.g. noun phrases, verbgroups, etc.), entities (names of persons, companies,products, expressions of locations, addresses, dates,durations, etc.), as well as complex technicalexpressions (e.g. Protein X inhibits Gene Y), etc.Grammars can be applied to corpora, just like otherqueries, and the result is usually displayed in aconcordance:The Text Annotation SystemNooJ’s dictionaries and grammars are applied tocorpora in order to add annotations to (or filter outannotations from) texts’ annotation system. NooJ canalso import information from (or export to) XMLdocuments.NooJ includes tools to create, edit, test, debug andmanage dictionaries and grammars.DictionariesNooJ dictionaries contain indistinctly simple words(e.g. “a meeting”) or compounds (e.g. “a roundtable”). NooJ’s inflectional (e.g. verb conjugations)and derivational (e.g; nominalization) engineautomatically links all word forms to their lemmas.NooJ can process languages with heavy morphology,such as Hungarian, as well as Semitic languages (withan automatic vowellization) and Asian languages(with an automatic tokenization).Large NooJ dictionaries are already available forArabic, Armenian, Bulgarian, Chinese, English,Look for Date in a textSimple extractors, such as one to recognize allreferences to Canada (Canada, Canadians, Ontario,Montréal, etc.) are typically built in a few minutes.Hundreds of graphs have already been developed byNooJ users.Our project is to develop thousands of such reusablegraphs for each language:-- morphological grammars to recognize derivationsand synonymous expressions;-- syntactic grammars to recognize noun phrases andverb groups;-- semantic grammars to recognize entities, such asnames of persons, of companies or products,locations, addresses, technical expressions, etc.

NooJ, 3/4Concordance for the pattern: * The DATE grammar (structure, a graph, contract)

NooJ, 4/4Concordance for the graph “Canada” in the ProMED medical databaseCanada in ProMED2015Frequency, Standard Deviation10501 8 15 22 29 36 43 50 57 64 71 78 85 92 99 106 113 120 127 134 141 148 155 162 169 176Série1-5-10News Bytes