Meeting_2007-10-29

Meeting setup

  • Date: 29.10.2007
  • Time: 09.30 Norw. time
  • Place: Internet
  • Tools: SubEthaEdit, iChat/Skype

Agenda

  1. Opening, agenda review
  2. Reviewing the task list from last week
  3. Documentation - divvun.no
  4. Corpus gathering
  5. Corpus infrastructure
  6. Infrastructure
  7. Linguistics
  8. name lexicon infrastructure
  9. Spellers
  10. Other issues
  11. Summary, task lists
  12. Closing

1. Opening, agenda review, participants

Opened at 10: 15.

Present: Børre, Per-Eric, Risten, Sjur, Thomas, Tomi, Trond

Absent: Ilona

Agenda accepted as is.

2. Updated task status since last meeting

Børre

  • move Steinar's error markup in the xml files to (a copy of) the original
  • begin adding support for the sami languages in OpenOffice.org
    • Began making locales, Sjur added a request for spelling
  • fix Unicode bug in Hunspell conversion java code
    • not done
  • test closed POSes in Hunspell speller
    • did some testing
  • buy InDesign CS3: one Mac upgrade, one Mac full, one Windows
    • done
  • fix bug 550
    • not done
  • fix bugs!

Ilona

  • lexicalise smj missing words
  • add smj proper nouns
  • other smj tasks

Maaren

  • lexicalise actio compounds

Per-Eric

  • lexicalise words from the Olavi missing list
    • Worked and still working
  • fix bugs!
    • fixed some

Risten

  • finish the design/text for the CD and the cover
  • set up CD-printing printer

Saara

  • add new XSL/XML headers for proofing test docs
  • Set up ways of adding meta-information for proofing correct corpus docs (source info, used in testing or not, added to lexicon or not)
  • add nested error markup to xml conversion

Sjur

  • document the AppleScript speller test output
    • done
  • work on the XML name editor/risten.no integration
    • nothing
  • set up risten.no on the G5 again
    • nope
  • test new and nested error markup
    • waiting for Saara
  • get command line hyphenator for automated testing of the hyph-lexicons
    • still not received
  • add hyphenation testing
    • waiting for command line hyphenator
  • add hunspell testing
    • looked at it, installed the first alpha in OpenOffice.org
  • fix bug 550
    • I have some ideas, but nothing done yet
  • fix bugs!
    • reported new ones
  • other:
    • requested support for Sámi languages in speller language list in OOo
    • tested installation from CD, on both Windows and Mac

Thomas

  • sme->smj lexicon conversion to build bilingual lexicon resources
    • not anything this week
  • add smj proper nouns
    • some added
  • check for bad hyphenation
    • worked
  • look at test cases still not behaving properly
    • worked
  • fix bugs!
    • worked

Tomi

  • Hunspell lexicon conversion
    • did some
  • sme->smj lexicon conversion to build bilingual lexicon resources
    • not done
  • fix Unicode bug in Hunspell conversion java code
    • not done
  • test closed POSes in Hunspell speller
    • tested
  • fix bugs!
    • fixed

Trond

  • sme->smj lexicon conversion to build bilingual lexicon resources
    • Worked hard on this issue. Continued the work based on joint work with Thomas. We will

3. Documentation

Bug 550

TODO:

  • fix bug 550 (Børre, Sjur)

4. Corpus infrastructure

Nothing.

5. Infrastructure

Nothing except bug 550 (see above).

6. Linguistics

North Sámi

No real issues at the moment.

Lule Sámi

Thomas has looked at the missing baseforms.

Trond: we are generating smj words from sme as part of the Univ. project for MT dictionary creation.

TODO:

  • lexicalise words from the Olavi missing list, but check against the pdf original where in doubt (Per-Eric)
  • sme->smj lexicon conversion to build bilingual lexicon resources, and increase smj coverage (Trond, Thomas, Svenne)
  • add proper nouns (Thomas, Ilona)
  • look at missing baseforms (Thomas)

7. Name lexicon infrastructure

This sub-project needs to get up and running soon. Mainly Sjur's task.

Decisions made in Tromsø can be found in this meeting memo.

TODO:

  1. set up Tomcat and risten.no on the G5 again (Sjur, Børre)
    1. install risten.no
  2. fix bugs in lexc2xml; add comments to the log element (Saara)
  3. finish first version of the editing (Sjur)
  4. test editing of the xml files. If ok, then: ( Sjur, Thomas, Trond)
  5. make terms-smX.xml <=== automatically from propernoun-sme-lex.xml (add nob as well) (the morphological section should be kept intact, in e.g. propernoun-sme-morph.txt) (Sjur, Saara)
  6. convert propernoun-($lang)-lex.txt to a derived file from common xml files ( Sjur, Tomi, Saara)
  7. implement data synchronisation between risten.no and the cvs repo, and possibly other servers (ie the G5 as an alternative server to the public risten.no - it might be faster and better suited than the official one; also local installations could be treated the same way)
  8. start to use the xml file as source file
  9. clean terms-sme.xml such that all names have the correct tag for their use (e.g. @type=secondary) (Thomas, Maaren, linguists)
  10. merge placenames which are errouneously in different entries: e.g. Helsinki, Helsingfors, Helsset (linguists)
  11. publish the name lexicon on risten.no (Sjur)
  12. add missing parallel names for placenames (linguists)
  13. add informative links between first names like Niillas and Nils ( linguists)

8. Proofing tools

Hunspell

The initial alpha is working, and looks promising.

TODO:

  1. Begin adding support for the sami languages in OpenOffice.org (Børre)
    1. Sjur started the process
  2. Hunspell lexicon conversion (Tomi, Børre)
    1. fix Unicode bug in Hunspell conversion java code (Tomi, Børre)
      1. it seems to work now on the G5
    2. test closed POSes (Tomi, Børre)
      1. done some
    3. add hunspell testing to the make file (Sjur)
      1. not yet done
    4. debug and fix remaining conversion issues (Børre, Tomi)
      1. a lot work to do here: )

Testing

Spelling Error Markup

TODO:

  • Set up ways of adding meta-information (source info, used in testing or not, added to lexicon or not) (Saara)
  • move Steinar's error markup in the xml files to (a copy of) the original ( Børre, Kimme)
  • add nested error markup to xml conversion (Saara)
  • test new and nested error markup (Sjur)

Automated testing

TODO:

  • document the AppleScript speller test output (Sjur)
    • done
  • add hyphenation testing
    • waiting for testing tool

Lexicon conversion to the PLX format

Open issues based on test results:

smj

482 - still problematic, 506 - fixed, 518 - fixed again, 552 - still open, Svierigadárogielan - still rejected

sme

408 - not really a prefix, but PLX-encoded as such, 419, 423, 425 - roman number, 426 - fixed, 431, 449 - fixed (almost), 452 - miel is a prefix, 461 - almost 50 % (17) gets correct suggestion, 489, 508 - regression, 518 - fixed again, 522, 524.

TODO:

  • look at test cases still not behaving properly (Thomas, Tomi)

InDesign tools

TODO:

  • add hyphenation testing (Sjur)
  • buy InDesign CS3: one Mac upgrade, one Mac full, one Windows (Børre)
    • ordered

Hyphenators

We should look into the possibility of generating pattern-based hyphenation for OOo. It shouldn't be too hard, or require too much work, but needs investigation.

TODO:

  • get command line hyphenator (Sjur)

Release version

The CD cover etc. will be worked on by John-Marcus Kuhmunen, and will follow the SD design rules. He is now waiting for the text to be put on the CD cover and other places.

Network printer for CD printing is ok.

TODO:

  • write text to go on the CD cover (Risten)
  • set up CD-printing printer (Risten)

Actual release

December 11-13, one of these days.

9. Other

Corpus contracts

Delayed till after final release.

TODO:

  • publish corpus contracts and project infra as open-source on NoDaLi-sta ( Sjur)

Faroese

Speller for fao using our infrastructure and the knowledge we have.

Bug fixing

When fixing bugs, record the version number containing the fix in the Bugzilla bug report, such that for each bug, we know exactly when it should have been fixed, in what file(s) and what version.

69 open Divvun/Disamb bugs (35 of these 56 are speller-related bugs, 34 are other bugs), and 23 risten.no bugs

SD yearly personell seminar

6.-7. December. Sjur will discuss it with Julia, but our view is that we don't have time to go this year. The release are just a few days later.

Software updates

  • SubEthaEdit
  • Leopard, 10.5
  • Skype 2.6.x

10. Next meeting, closing

The next meeting is 5.11.2007, 09: 30 Norwegian time.

The meeting was closed at 10: 49.

Appendix - task lists for the next week

Boerre

  • move Steinar's error markup in the xml files to (a copy of) the original
  • adding support for the sami languages in OpenOffice.org
  • fix Unicode bug in Hunspell conversion java code
  • fix bug 550
  • fix bugs!

Ilona

  • lexicalise smj missing words
  • add smj proper nouns
  • other smj tasks

Maaren

  • lexicalise actio compounds

Per-Eric

  • lexicalise words from the Olavi missing list
  • fix bugs!

Risten

  • finish the design/text for the CD and the cover
  • set up CD-printing printer

Saara

  • add new XSL/XML headers for proofing test docs
  • Set up ways of adding meta-information for proofing correct corpus docs (source info, used in testing or not, added to lexicon or not)
  • add nested error markup to xml conversion

Sjur

  • work on the XML name editor/risten.no integration
  • set up risten.no on the G5 again
  • test new and nested error markup
  • get command line hyphenator for automated testing of the hyph-lexicons
  • add hyphenation testing
  • add hunspell testing
  • fix bug 550
  • fix bugs!

Thomas

  • sme->smj lexicon conversion to build bilingual lexicon resources
  • add smj proper nouns
  • check for bad hyphenation
  • look at test cases still not behaving properly
  • fix bugs!

Tomi

  • Hunspell lexicon conversion
  • sme->smj lexicon conversion to build bilingual lexicon resources
  • fix Unicode bug in Hunspell conversion java code
  • fix bugs!

Trond

  • sme->smj lexicon conversion to build bilingual lexicon resources
  • fix bugs!.