Meeting_2007-12-17

• Date: 17.12.2007
• Time: 09.30 Norw. time
• Place: Internet
• Tools: SubEthaEdit, iChat/Skype

1. Opening, agenda review
2. Reviewing the task list from last week
3. Documentation - divvun.no
4. Corpus gathering
5. Corpus infrastructure
6. Infrastructure
7. Linguistics
8. name lexicon infrastructure
9. Spellers
10. Other issues
11. Summary, task lists
12. Closing

Opened at 12: 34.

Present: Børre, Ilona, Sjur, Thomas

Absent: Risten, Per-Eric, Trond, Tomi

Agenda accepted as is.

Børre

• finalise InDesign hyphenator
  • not done
• new/updated front page (old front page to history page)
  • done
• fix bugs!

Ilona

• lexicalise smj missing words.
  • Not this week anymore, but this is never done.
• Help Trond with the smj dictionary.
  • Done?
• Translation, language checking.
  • Done
• Typo 494, sme
  • fixed the typos list in false negatives.

Maaren

• lexicalise actio compounds

Per-Eric

• check some unusual and missing words from the last Olavi missing list 071123.txt which still are not lexicalised
  • started with it
• fix bugs!
  • worked with it

Risten

• Print 50 CDs, take them to Oslo as backup
  • done

Saara

• add new XSL/XML headers for proofing test docs
• Set up ways of adding meta-information for proofing correct corpus docs (source info, used in testing or not, added to lexicon or not)
• add nested error markup to xml conversion
• discuss more parallel texts

Sjur

• document Windows CD installation work-around
  • done
• finalise InDesign hyphenator
  • not done
• update usage and installation documentation
  • done
• new/updated front page (old front page to history page)
  • done
• press release
  • done
• fix bugs!
  • done

Thomas

• sme->smj lexicon conversion to build bilingual lexicon resources
  • not any this week
• test hyphenation
  • not any this week
• analyse hyphenation test results
  • not any this week
• look at test cases still not behaving properly
  • worked some
• fix bugs!
  • worked some

Tomi

• Hunspell lexicon conversion
  • not done
• fix bugs!

Trond

• sme->smj lexicon conversion to build bilingual lexicon resources
  • Worked on this issues, better conversion now, errors corrected.
• analyse hyphenation test results
  • Not done
• fix bugs!.
  • Not done

InDesign documentation is needed.

TODO:

• update InDesign documentation (Børre, Sjur)
• translate InDesign documentation (Thomas, Sjur, Ilona)
• proofread the translated/written documentation (Børre, Per-Eric, Tomi)

Nothing.

TODO:

• add Jabber account in iChat (all)

North Sámi

Hyphenation bugs found in Polderland code, update expected this week, should fix everything.

Ilona fixed the sme false negatives in bug 494.

Lule Sámi

Hyphenation: same as for sme.

TODO:

• sme->smj lexicon conversion to build bilingual lexicon resources, and increase smj coverage (Trond, Thomas, Svenne). Add the words.

Delayed till Divvun2 (or after release of Divvun1).

Decisions made in Tromsø can be found in this meeting memo.

TODO:

1. fix bugs in lexc2xml; add comments to the log element (Saara)
2. finish first version of the editing (Sjur)
3. test editing of the xml files. If ok, then: ( Sjur, Thomas, Trond)
4. make terms-smX.xml <=== automatically from propernoun-sme-lex.xml (add nob as well) (the morphological section should be kept intact, in e.g. propernoun-sme-morph.txt) (Sjur, Saara)
5. convert propernoun-($lang)-lex.txt to a derived file from common xml files ( Sjur, Tomi, Saara)
6. implement data synchronisation between risten.no and the cvs repo, and possibly other servers (ie the G5 as an alternative server to the public risten.no - it might be faster and better suited than the official one; also local installations could be treated the same way)
7. start to use the xml file as source file
8. clean terms-sme.xml such that all names have the correct tag for their use (e.g. @type=secondary) (Thomas, Maaren, linguists)
9. merge placenames which are errouneously in different entries: e.g. Helsinki, Helsingfors, Helsset (linguists)
10. publish the name lexicon on risten.no (Sjur)
11. add missing parallel names for placenames (linguists)
12. add informative links between first names like Niillas and Nils ( linguists)

Hunspell

Proper nouns not yet working, and they do not contain anything to clearly identify the end of the stem. This makes it harder to generate proper HUNSPELL entries.

TODO:

• Hunspell lexicon conversion (Tomi, Børre)

Testing

Spelling Error Markup

This will wait till after the release.

TODO:

• Set up ways of adding meta-information (source info, used in testing or not, added to lexicon or not) (Saara)
• move Steinar's error markup in the xml files to (a copy of) the original ( Børre, Kimme)
• add nested error markup to xml conversion (Saara)
• test new and nested error markup (Sjur)

Automated testing

Paradigm testing not yet working as expected.

TODO:

• improve hyphenation testing (Sjur)
• fix paradigm testing (Sjur)

MS Office

Proofing tools do not work in Office 2003 when language is set to North Sámi (Finland/Sweden), and hyphenation doesn't work in Office 2007 under the same circumstances. This is reported to Polderland, and a fix is expected soon.

Lexicon conversion to the PLX format

Open issues based on test results:

sámi-dáru - not accepted => Gen+hyph compound, is not allowed with hyphen. We can allow such compounds without too much overgeneration by adding the hyphen to the last part, ie -dáru in the PLX entry. => Bugzilla as feature request.

smj

• 419 - fixed
• 518 - regression - Fuoskok = pl+clitic as well as derivation = won't fix
• 575 - fixed - no double hyphens
• 584 - fixed
• 589 - fixed
• 596 - C-giella

sme

• 425 - roman number - will not be fixed in 1.0 release
• 518 - regression - plural same as derivation, won't fix
• 588 - regression - r. accepted as final part
  • Tomi knows where is the problem, but because verb compilation takes much time, haven't tackled it yet
• 592 - fixed
• 593 - missing words in beta2, still a few
• 595 - prefix+name wihtout hyphen (ovdaLot instead of ovda-Lot)

TODO:

• look at test cases still not behaving properly (Thomas, Tomi)

InDesign tools

Almost finished, found a bug (reported to Polderland).

TODO:

• improve hyphenation testing (Sjur)
• upload (Sjur)
• documentation (Børre, Sjur)

Hyphenators

Waiting for the last bug fixes from Polderland.

Final release

Released!

Update

• update the list of changes/fixes (Børre)
• update the front page (Sjur, all)
• include latest fixes, update from Polderland (Sjur, Tomi)
• update list of installed files (Sjur, Børre)

Christmas vacation

Corpus contracts

Delayed till after final release.

TODO:

• publish corpus contracts and project infra as open-source on NoDaLi-sta ( Sjur)

Bug fixing

When fixing bugs, record the version number containing the fix in the Bugzilla bug report, such that for each bug, we know exactly when it should have been fixed, in what file(s) and what version.

83 open Divvun/Disamb bugs (45 of these 83 are speller-related bugs, 38 are other bugs), and 23 risten.no bugs

The next meeting is 7.1.2008, 09: 30 Norwegian time.

The meeting was closed at 13: 41.

Boerre

• finalise InDesign hyphenator
• new/updated front page (old front page to history page)
• fix bugs!

Ilona

• Continue the bug 494
• Still something to translate/proofread in Finnish?

Maaren

• lexicalise actio compounds

Per-Eric

• check some unusual and missing words from the last Olavi missing list 071123.txt which still are not lexicalised
• proofread the translated/written documentation
• fix bugs!

Risten

• Print 50 CDs, take them to Oslo as backup

Saara

• add new XSL/XML headers for proofing test docs
• Set up ways of adding meta-information for proofing correct corpus docs (source info, used in testing or not, added to lexicon or not)
• add nested error markup to xml conversion
• discuss more parallel texts

Sjur

• document Windows CD installation work-around
• finalise InDesign hyphenator
• update usage and installation documentation
• new/updated front page (old front page to history page)
• press release
• fix bugs!

Thomas

• translate InDesign documentation
• sme->smj lexicon conversion to build bilingual lexicon resources
• test hyphenation
• analyse hyphenation test results
• look at test cases still not behaving properly
• fix bugs!

Tomi

• Hunspell lexicon conversion
• fix bugs!

Trond

• sme->smj lexicon conversion to build bilingual lexicon resources
• analyse hyphenation test results
• fix bugs!.