Northern Haida Disambiguation

• vislcg3 installed A text corpus. The one we have, test/data/haida_grammar.utf8corpus.txt, is fetched from Jordan's brochure. Only full sentences are included, they are marked with a sentence initial "# " symbol. They all have a translation in English, marked with an initial "&".

cat test/data/haida_grammar.utf8corpus.txt |grep "#"|cut -c3-|\
tr ' ' '\n' | tr '=' ' '|uhdn|grep '?' |cut -f1 | sort |\ 
uniq -c | sort -nr > doc/data/missing.haidagrammarcorpus

Haida differs from the other languuages in not having an adjusted version of the preprocessor yet. While waiting , we do some ad hoc solutions. Here is a pipeline that gives an analysis.

Note the = symbol, it is used to mark MWEs in the text.

cat test/data/haida_grammar.utf8corpus.txt |grep "#"|cut -c3-|tr ' ' '\n' | tr '=' ' '|uhdn|lookup2cg | vislcg3 -g src/syntax/disambiguation.cg3

Look at common ambiguity patterns

• Grammar ambiguity
• Word ambiguity

To create similar statics, use the sum-cg.pl script (write sum-cg.pl --help in order to get just that.

• Words missing from the analyser
• Grammatical homonymy

• Grammar ambiguity
• The list of missing words
• Word sense disambiguation