Meeting_2008-10-13

Meeting setup

  • Date: 13.10.2008
  • Time: 09.30 Norw. time
  • Place: Internet
  • Tools: SubEthaEdit, iChat

Agenda

Cf. one of the following, depending on context:

  • the upper bar of the SEE window (provided you use the JSPWiki syntax mode)
  • the TOC in Forrest-rendered output, like HTML and PDF

Opening, agenda review, participants

Opened at 10: 36.

Present: Børre, Ciprian, David, Jovsset, Sjur, Thomas, Tomi, Trond

Absent: none

Agenda accepted as is.

Updated task status since last meeting

Børre

  • fix the Upload more link on the corpus upload page
    • not done
  • Make a divvun-tools download log
    • not done
  • Finish the OOo extension package of the hunspell dictionaries
    • made an extension package with the huge Northern Sami files, haven't published a link because machines with little ram will have problems using these files.
  • check the hunspell test bench and tokenization errors
    • not done
  • test installation of dictionaries
    • Done. OpenOffice.org version 2.4.x uses the one outlined in our documentation. Version 3.0.x uses the extension mechanism. In NeoOffice 2.2.5 I wasn't able to choose language for spell checking, so it seems to behave differently than OpenOffice.org in that regard.
  • setup iCal server on the XServe
    • Not done
  • make a 1-page, light version of the corpus contract, also in Swedish
    • Not done
  • fix bugs!
  • other
    • OpenOffice.org crashes in Windows and Mac when using the Northern Sami speller lexicons compiled with the makealias script. Searched and found the reason for it. Working on a fix for it.

Ciprian

  • close the open SVN repository at requested paths
    • done: closed for anonymous user (until we find the other solution)
  • make a test-all target that runs all tests we have (with Sjur and Trond)
    • todo
  • define and document testing routines (with Sjur and Trond)
    • todo
  • continue the dictionary infrastructure discussion (with Sjur, Trond)
    • todo (I need more preparation for this task)
  • add three more texts to the corpus
    • done (there were actually four)
    • I had a look at: error logging during xml conversion process, uploading texts via web interface
  • make the pipeline of StarDict dictionary generation running on the Mac
    • todo
  • have a closer look at the formatting for StarDict
    • todo
  • update the Makefile for generating dictionaries (related to the dictionary infrastructure task)
    • todo

David

  • continue gathering sma corpus texts
    • todo
  • contact Samefolket or Sáminuorat about writing about the project and advertising.
    • done
  • gather orthographic decisions (with Maaren)
    • Jovsset will help instead of Maaren.
  • translate corpus contract to swedish (with Jovsset)
    • started, rough translation done.
  • make a 1-page, light version of the corpus contract, also in Swedish
    • todo

Jovsset

  • get the Verbh manuscript in electronic form
    • We do not need the manuscript. We have decided to add the verbs manually since the publisher is reluctant to let us use the manuscript.
  • Write and translate leaflet text, add pictures.
    • In progress, David will help with the leaflet design.
  • Find a suitable infrastructure for the distribution of the CD version. Possible through the library bus, the language centres and common sami centres in all of Sápmi.
    • Not done.
  • Talk to person who can talk to translator of Gåessie dah jeatjebh åerieminie
    • Done. The translator is reluctant to let us use her translation.

Lene

  • Work on test routine with Trond and Sjur

Per-Eric

  • transfer the smj texts by Kurt Tore to our corpus repository
  • follow-up contracts from Nord-Salten avis and Lena Davidsson
  • Work with missing list same_dutkama_pgr.txt
  • Plan a smj pr tour for our tools
  • contact Ulf Stefan Winka for smj texts
  • fix bugs!

Saara

  • add new XSL/XML headers for proofing test docs
  • Set up ways of adding meta-information for proofing correct corpus docs (source info, used in testing or not, added to lexicon or not)
  • implement the ped UI and functionality

Sjur

  • name db/risten.no
    • nothing last week
  • update the Changes document
    • nothing last week
  • follow-up on some Polderland-related bugs: 621, 630, 652
    • nothing last week
  • InDesign documentation
    • nothing last week
  • make a test-all target that runs all tests we have (with Trond, Ciprian)
    • nothing last week
  • define and document testing routines (with Trond, Ciprian)
    • nothing last week
  • write leaflet text
    • nothing last week
  • continue the dictionary infrastructure discussion (with Ciprian, Trond)
    • nothing last week
  • finish make target for MS Office 2008 spellers
    • nothing last week
  • reformulate the sma noun grammar like the verbs (with Trond)
    • nothing
  • Contact Davvi Girji about cooperation on electronic dictionaries
    • nothing done last week
  • subcontractor work for sma proofing tools, MS and Adobe versions
    • not much here last week
  • support and maintenance contract for sme and smj, MS+Adobe tools
    • letter sent from SD (hopefully)
  • write paper about our test bench to be presented at the NLP for reading and writing workshop at SLTC2008 in Stockholm, Nov. 20-21
    • first version almost ready, deadline today
  • Sámi languages as part of Norsk språkbank
    • discussed with Julie Eira. I will have one more look at the letter, and then this will have to be cleared with the political level of SD
  • make a 1-page, light version of the corpus contract, also in Swedish
  • contact MS Nordic, and ask them to include the Divvun tools in the next Office releases (both Windows and Mac). The integration can/should be done by Polderland, which is an official MS subcontractor/integrator. It could be used by MS as part of their advertising for the next releases, and it will make it much easier for people to get access to the tools.
    • discussed this with A Lona, he is going to discuss this with some MS contacts, but he was pesimistic
  • integrate sma adjectives into the analyser (without morphology)
  • create a new test routine using the new speller test data
    • done, and used it once - the test results are very useful
  • fix bugs!

Thomas

  • type the verbs in manually (missing: the odd-syllabic only, now at dïjmedidh on p. 113). The verbs to be added are the ones with p. 76 s. 146-160
    • done with the 76, not done yet with the others
  • fine tune suggestions for Hunspell
    • not yet
  • look at test cases still not behaving properly
    • nothing this week
  • translate leaflet text
    • not yet
  • test leaflet installation instructions on Mac, Windows XP, Windows Vista
    • not yet
  • work with presentation at Guovdageaidnu-symposia
    • not yet
  • sme->smj lexicon conversion to build bilingual lexicon resources, and increase smj coverage
    • not yet
  • contact Astrid Helander at Ávvir for a project interview aimed at getting more knowledge about the tools out to the users = more users
    • written her a mail, she has not answered
  • fix bugs!
    • nothing this week

Tomi

  • document how compounding is controlled in the PLX conversion
    • not done
  • fix double hyphen bugs
    • working
  • fix PL hyphenator errors
    • not done
  • fix PL and Hunspell conversion bugs
    • working
  • work with presentation at Guovdageaidnu-symposia
    • not done
  • test hyphenator with new speller lexicons
    • problems with this, fixing
  • fix bugs!

Trond

  • Hunspell QA README and installation docs
    • Still not.
  • Look at dictionaries pipeline
    • Worked on dicts, but the pipeline itself -- no.
  • Plan recording for text-to-speech
    • Planned, recorded, hoping for a voice at the end of this week
  • South Sámi verbs
    • Much work done, soon is the time for sort-and-check
  • South Sámi adjectives
    • Awaiting meeting with Sjur and David
  • reformulate the noun grammar like the verbs (with Sjur)
    • After adjs.
  • make a 1-page, light version of the corpus contract, also in Swedish
    • Not done, must look into
  • integrate sma adjectives into the analyser (without morphology)
    • Meeting outcome to come
  • fix bugs!.

Pedagogical software online

Working on CG implementation for the ped software.

Meeting memos can be found at http://giellatekno.uit.no/ped/index.html#Meeting+memos

Corpus gathering

Børre and Ciprian suggests that we also store the corpus repository in svn, with access to it only for the corpus administrators. Ciprian suggests a slighly different model, where only the meta-information is stored in svn.

Trond suggests adding the original corpus files to rcs (as the metadata are today) (for log reasons), and then investigate whether we could set up some notification system (rlog the whole corp/$lang/orig/ catalogue, diff against previous, and mail the diff to whoever interested).

Sjur suggested using svn with filtering, such that the corpus files (bothorig and converted) are not available outside victorio, only the metadata. That is, to use access control to make sure the corpus files will stay on victorio (and secondarily on the G5/XServe).

Børre suggests a database system instead of rcs.

The problem with the present setup is that the corpus administrators are not informed about changes in the corpus repository, as well as a lack of a proper change history - we don't know who did what when. This has lead to a number of unidentifiable files, or files without known history or origin.

TODO:

  • continue gathering sma corpus texts (David, Jovsset)
    • Jovsset is working on the Gun Utsi book, as well as the problematic book
    • David has spoken to a lot of sma students at UmeåU last week, and urged them to send us their texts; also spoke to the teachers; spoke to Maidi Steinfjell, wanted to write about our need for texts
  • gather the smj texts from Kurt Tore ( Per-Eric)
  • other contacts: Nord-Salten avis ( Børge Strandskog), Lena Davidsson daughter to Lars-Matto Tuolja
  • Ulf Stefan Winka has a lot of smj texts (Per-Eric)
  • plan a smj pr tour for our tools (Per-Eric, Thomas)
  • meet with the Sámi publishers (meeting delayed) (Jovsset)
  • add incoming sma texts to the corpus rep (Børre, Ciprian)
    • Ciprian would like to add some more automatisation to the corpus processing
  • make a 1-page, light version of the contract, also in Swedish ( Børre, David, Sjur, Trond)
  • fix the Upload more link (Børre)
  • incorporate SK place name data when we have the proper name infrastructure
  • store SK data in svn:
    • make proper folder (Sjur)
    • add data files (Thomas)

Promoting Divvun

TODO:

  • Make a download log (Børre)
  • use a newspaper or something to write about the tools from an end-user point of view (a review in Š, Ávvir, Nordsalten avis?)
    • contact Astrid Helander at Ávvir for a project interview (Thomas)
      • written her a mail, she has not answered
    • contact Nordsalten avis ( Thomas)
    • contact Š ( Børre?)
  • consider the best way to inform potential users in Sweden about the Divvun tools (David)
    • David has suggested to announce in Sáminuorat and Samefolket
    • preferably get an article in the papers at the same time, about the project and the tools
    • make an add for our tools to go into newspapers (David, Jovsset)
  • Prepare for a coordinated info campaign when Ped is ready (inform teachers about Divvun as well as Ped when we inform about Ped) - next year
  • Tour de Divvun (smj info tour) (Thomas, Per-Eric)
    • fix the date
    • make sure the leaflet is ready (see below)
    • bring some CD's
  • make leaflet to inform about the project (Jovsset, David)
  • distribute CD version through the library bus, the language centres and common sami centres in all of Sápmi. Gaaltije in Östersund for example. ( Leif Åge, Jovsset)
  • contact MS Nordic, and ask them to include the Divvun tools in the next Office releases (both Windows and Mac). The integration can/should be done by Polderland, which is an official MS subcontractor/integrator. It could be used by MS as part of their advertising for the next releases, and it will make it much easier for people to get access to the tools. (Sjur)
    • discussed with A. Lona. He said it would be difficult, even if we use Polderland. Another solution could be to enforce it through a political decision.

Future plans, directions and ideas

See a separate document in plan/strat/5year.jspwiki.

Infrastructure

To accomodate future enhancements in different directions (in rough order of importance):

  1. test bench for all parts of our language technology efforts
    1. test bench enhanced, but not yet complet
  2. set up the Leopard Server features for collaborative support:
    1. permanent chat rooms
    2. stored (and indexed) chat transcripts of the chat rooms
    3. iCal server / group calendars
    4. wiki
  3. wiki? on G5 (is part of Leopard Server) or other web-based documentation
  4. improve Forrest stability and i18n support ( the divvun crashes)
    1. Sjur has been working on better i18n and pdf rendering
    2. Børre has some ideas for getting back to serving static html files
  5. reorganise the documentation:
    1. differ between target groups
    2. get better grouping
    3. decide what to write in forrest and what in wiki (cf. Apertium and http://xixona.dlsi.ua.es/apertium/) for a similar split)
    4. update/add missing parts
  6. migrate lexc lexicons to XML, splitting the task
    1. Name lexica (the Name project)
    2. Dictionaries (already in XML, task is to integrate them)
    3. At least migrate the lexc open POSes (Komi as a pilot case)
  7. change the look of the documentation web
  8. sfst?
    1. replacement for xfst -> see omorf , omorf wiki and omorfi
    2. replacement for hunspell/open-source proofing tools
  9. investigate the NSIS installer, potentially replacing the InstallShield package from Polderland
  10. corpus content moved to Max Planck repositories? Norsk språkbank?
  11. update infrastructure to allow content-restricted spellers for special target groups

SVN issues:

  • http access not yet available (https only at the moment, but it works as anonymous checkout if the user is not specified)
  • read access to the whole repo is working, BUT:
    • gt/*/polderland should be protected
    • plan should be protected
  • everything will be google-able by default if the repo URL is posted
  • certain users need to be on the UiT VPN to be able to commit (bug #705)
  • UTF-8 problem in svn commit mails: the commit log text is garbled

TODO:

  • infrastructure remake: ( Børre, Ciprian, Saara, Sjur, Tomi, Trond)
    • more modularised make / build infra (prepare for smn, sms, sjd, others)
    • merge gt, kt and st into one
    • modularised preprocess and spellrelax
  • make a test-all target that runs all tests we have (Ciprian, Sjur, Trond)
  • define and document testing routines (Ciprian, Sjur, Trond)
  • follow-up migration to svn:
    • close the open SVN repository at requested paths (Ciprian)
      • completely closed at the moment, until we have solved the path-based control
    • prepare and discuss with external users: Jack Ruether (Trond)
  • setup iCal Server (on XServe) (Børre)
  • repair the G5 (Børre)
    • e-mail and remind

Linguistics

North Sámi

(nothing new, see proofing bugs below)

http: //giellatekno.uit.no/bugzilla/show_bug.cgi?id=711

Lule Sámi

(nothing new, see proofing bugs below)

TODO:

  • sme->smj lexicon conversion to build bilingual lexicon resources, and increase smj coverage (Trond).
  • Add the words when all words are ready.

South Sámi

TODO:

  • ask for the list of sma verbs in baseform from the Verbh authors; NOTE: this is not the same as the manuscript, only the list of baseforms. It should be unproblematic to get this without asking the publisher, since this is not the book. (Jovsset)
  • type odd-syllable verbs in manually. The verbs to be added are the ones with reference to pages 78-84
    • 146-190 (Thomas)
  • add remaining verbs of type VI (Linda)
  • get an overview over all problematic areas of the orthography (David)
    • done as far as has been possible - a call to Lajla Mattsson-Magga confirmed the findings so far (ie mostly word lists have been handled, the only orthographic decision has been a partial decision on how to spell foreign words)
  • integrate adjectives into the analyser, without morphology as a starting point ( Trond, Sjur)
  • reformulate the noun grammar like the verbs (Sjur, Trond)
  • prepare a workshop on South Sámi orthography and grammar (David)
    • suggest dates
      • try to coordinate with the SGL so we meet together
    • we'll cover travel and hotel expenses
    • we'll invite both SGL and as many of the other key persons in the sma writing/normativity community as possible
    • set up a preliminary agenda (David, Sjur)
    • prepare data for each topic (David, Sjur, Trond)

Name lexicon/risten.no infrastructure

TODO:

  1. fix i18n bug in risten.no/G5 (so they will work without the proper locale request) (Sjur)
  2. fix bugs in lexc2xml; add comments to the log element (Saara)
  3. finish first version of the editing (Sjur)
  4. test editing of the xml files. If ok, then: ( Sjur, Thomas, Trond)
  5. make terms-smX.xml <=== automatically from propernoun-sme-lex.xml (add nob as well) (the morphological section should be kept intact, in e.g. propernoun-sme-morph.txt) (Sjur, Saara)
  6. convert propernoun-($lang)-lex.txt to a derived file from common xml files ( Sjur, Tomi, Saara)
  7. implement data synchronisation between risten.no and the cvs repo, and possibly other servers (ie the G5 as an alternative server to the public risten.no - it might be faster and better suited than the official one; also local installations could be treated the same way)
  8. start to use the xml file as source file
  9. clean terms-sme.xml such that all names have the correct tag for their use (e.g. @type=secondary) (Thomas, linguists)
  10. merge placenames which are errouneously in different entries: e.g. Helsinki, Helsingfors, Helsset (linguists)
  11. publish the name lexicon on risten.no (Sjur)
  12. add missing parallel names for placenames (linguists)
  13. add informative links between first names like Niillas and Nils ( linguists)

Dictionaries

TODO:

  • Continue the dictionary infrastructure discussion (Ciprian, Sjur, Trond)
  • clean up and generalise the make infrastructure
  • improve Linux and Windows local/integrated versions
  • make simple installer applications
  • make a public release
    • Make a homepage with instructions for dictionary use: xtdoc/gtuit/src/documentation/content/xdocs/dict.eng.xml
    • Clarify the difference between local and online dictionaries:
      • Plugin for Firefox and Internet Explorer (online dictionaries)
  • Contact Davvi Girji about cooperation on electronic dictionaries (Sjur)
  • short meeting to go through missing points before a release ( Ciprian, Sjur, Trond)

Proofing tools

Hunspell

The crashing bug has been identified, as being a problem with too many continuation lexicon, or more precisely, the aff table built by makealias creates cells with too many entries. Hunspell do not crash on Linux, which is using the latest version of Hunspell in the system. This might point to a version conflict, and that it is solved in the latest Hunspell code.

TODO:

  • QA README and installation docs - report (Trond)
  • test the latest hunspell speller files (Sjur)
    • done
  • check the hunspell test bench and tokenization errors (Børre, Sjur)
  • make extension packages of the spellers (Børre)
    • done (with big lex files), no link published
  • test installations on all platforms (Børre)
    • done, identified crashing bug on Win + Mac
  • implement an easter egg (almost) identical to the Polderland one (Børre)
  • fine tune suggestions (Børre, Thomas)

OpenXSpell

Working everywhere (almost) in MacOS X applications, provides Sámi spell checking system-wide through a hunspell back-end. OpenXSPell

Update: The UTF-8 problem seems to have been a false alarm, but need to check it again for the letter ŋ. In other cases it seems to work ok as far as the characters are concerned. But the speller does crash after a while, for unknown reasons. It can be related to the Hunspell problem reported above by Børre, and it can be a problem in OpenXSpell. We don't know yet.

TODO:

  • track down the crashing bug

Testing

Spelling Error Markup

TODO:

  • Set up ways of adding meta-information (source info, used in testing or not, added to lexicon or not) (Saara)
  • test new and nested error markup (Sjur)

Speller testing

The new test now working, altough not yet checked in to svn.

TODO:

  • create a new test case using the new data (Sjur)

Speller updates

TODO:

  • test the spellers (Divvun team)
  • new make target for Office 2008 (Sjur)
  • waiting for hyphenation updates for 2008 (Polderland)

Speller bugs

List of bugs returned from Polderland: 621, 630, 652, 656, 676.

Open issues based on test results:

sme

Version: Davvisámi, version 1.0.1, 2008-09-25

  • 380 - REGRESSION - citation compounds
  • 397 - REGRESSION - name compounds, their derivations, other compounds
  • 426 - comp words from Divvun.no - guoktedássásaš accepted, some compounds not accepted - still OPEN
  • 431 - REGRESSION - name compounds / lowering in front of hyphen
  • 435 - roman numbers - inflection of single letter numbers rejected, as well as some complex numbers (but is ok in smj) - still OPEN
    • we should pregenerate all numbers once and for all, and store them in a separate lexicon file
  • 449 - REGRESSION - suopmasápmelaš comps wrongly accepted
  • 489 - REGRESSION - stem vowel shortening / compound tags
  • 581 - REGRESSION - consonant doubling
  • 525 - REGRESSION - citation compounds not accepted (the bug relates to suggs)
  • 536 - REGRESSION - speller accepts "impossible" compound forms
  • 539 - REGRESSION - speller does not follow compound tagging
  • 542 - REGRESSION - speller does not pronouns + clitic
  • 575 - REGRESSION - name+name suggestions with double hyphens (legal compounds not accepted)
  • 582 - REGRESSION - noun+Prop without hyphen
  • 593 - REGRESSION - Missing words in beta 2
  • 595 - prefix+name wihtout hyphen (ovdaLot instead of ovda-Lot) - still OPEN
  • 597 - REGRESSION - does not recognize nubbelohki
  • 599 - REGRESSION - numeral attr: s on lot
  • 600 - gen+hyph compound sámi-dáru - still OPEN
  • 603 - suomabealdi accepted - still OPEN
  • 606 - speller accepts VUOHTA compound - FIXED
  • 609 - REGRESSION - Anár-julggaštusa not recognized
  • 610 - REGRESSION - duhát words missing
  • 611 - double hyphen sugg still accepted - still OPEN
  • 612 - REGRESSION - case-forms of makkár
  • 613 - short gen. as second compound part - still FIXED
  • 619 - numerals and pronouns to NAMÁK and SASJ fails - still OPEN
  • 627 - prefix + hyhpen does not get accepted - FIXED
  • 629 - a taking part in compounding without hyphen - still OPEN
  • 631 - REGRESSION: number compound, numbers starting with 0
  • 633 - double hyphens accepted
  • 634 - PropGen+hyph+PropGen - still OPEN
  • 641 - numeral+noun compounds - FIXED
  • 642 - noun/adj/proper + hyphen + ain - FIXED
  • 644 - cased numeral+numeral compund - still OPEN
  • 646 - adverb + hyphen + noun - still OPEN
  • 647 - numerals+NOUN - still OPEN
  • 648 - unmotivated suggestions with numeral+noun - FIXED
  • 649 - name + adj compound without hyphen - still OPEN
  • 654 - speller does not recognize ordinals on -nuppelogát - FIXED
  • 655 - pron + nai - still OPEN
  • 658 - Suggestion saame - FIXED
  • 666 - REGRESSION: guovtte- and njealje-
  • 676 - triple-hyphen - now completely FIXED
  • 696 - numerals + NAMAT-adjs + vuohta
  • 697 - +N+Der1+Der/laš+A+Der3+Der/vuohta
  • 709 - sámedikkeválga accepted, or with bad suggestion
  • 717 - noun-acro compounds (juovla-CD)
  • 728 - vowel shortening GenCmp+Left-tagged
  • other regressions:
    • eaktudáhtolaččat now accepted
    • skuvlajagin now accepted - FIXED
    • skierranis now accepted - FIXED

smj

Version: Julevsáme, version 1.0.1, 2008-09-15

  • 435 - roman number - single letter numbers now recognised
    • we should pregenerate all numbers once and for all, and store them in a separate lexicon file
    • please note that inflection of single letter numerals is fine in smj, as opposed to sme
  • 482 - REGRESSION: double hyphen, polar>-dutkamin suggested
  • 496 - REGRESSION: unrecognised clitics
  • 595 - prefix+name wihtout hyphen (tsåhkeLot instead of tsåhke-Lot) - FIXED
  • 599 - numeral attr: s on lot - still OPEN
  • 600 - gen+hyph compound sáme-dáro - still OPEN
  • 616 - Bispadime-me-ráden - still OPEN, try to find an acro or abbr me
  • 619 - numerals and pronouns to NAMÁK and SASJ fails - still OPEN
  • 627 - REGRESSION: prefix + hyhpen does not get accepted
  • 629 - a taking part in compound - still OPEN
  • 631 - REGRESSION: number compound, numbers starting with 0
  • 634 - rop gen + hyphen + Prop gen - still OPEN
  • 641 - numeral+noun compounds - still OPEN
  • 644 - cased numeral+numeral compund - still OPEN
  • 647 - numerals+NOUN - still OPEN
  • 648 - unmotivated suggestions with numeral+noun - still OPEN
  • 649 - name + adj compound without hyphen - still OPEN
  • 650 - noun prefix+name compound without hyphen - still OPEN
  • 652 - REGRESSION: UPPERCASE-typos only get acronym-suggestions
  • 658 - Suggestion saame - FIXED
  • 692 - numeral-variants
  • 717 - NEW: - noun-acro compounds
  • 721 - NEW: - Nom- and gen-numerals make compounds with nouns
  • other regressions:
    • gus NOT accepted anymore
    • Svierigadárogielan NOT accepted anymore

TODO:

  • document how compounding is controlled in the PLX conversion (Tomi)

Hyphenator bugs

Open issues based on test results :

sme

Lexicon version: Davvisámi, version 1.0.1, 2008-04-01

  • 468 - REGRESSION: Márkomeanu
  • 547 - REGRESSION: hyphen in front of vowel: Lotnolasealáhusas
  • 548 - REGRESSION: mid syllable hyphenation: Háliidivččen
  • 549 - REGRESSION: division without hyph: Váccedettiin
  • 673 - adj-derivations: guovttenuppelotčoarvvagiin (the word is not rec.)
  • 677 - NEW: Wrongly hyphenated ending -danidja - invalid

smj

Lexicon version: Julevsáme, version 1.0.1, 2008-04-01

  • 545 - REGRESSION: bad hyphenation in compounds: åhpadusorganisásjåvnån (not recognised)
  • 546 - REGRESSION: obligatory hyph rules seem to work in facultative manner: organisásjåvnån (not recognised)
  • 547 - REGRESSION: hyphen in front of vowel: Jienastimnjuolgadusá and Orgánajs

TODO:

  • fix PL hyphenator errors (Tomi)
  • test hyphenator with new speller lexicons (Tomi)

InDesign tools

Nothing new.

Releases

TODO:

  • update the Changes document (Sjur)
  • InDesign documentation (Sjur)
    • Norwegian translation received from Davvi Girji
  • prepare 1.1 release soon

Other

Forthcoming Sámi allaskuvla conference

Info on the conference site.

Title submitted is: Goallosteapmi ja suorggideapmi Divvun-reaidduin

Registration: http://www.viaregi.no/registration/deltagerweb.aspx?kid=3440&aid=8700

Registration deadline is September 10.

TODO:

  • write presentation (Thomas, Tomi)

Text to speech

Update: there can be something to listen to at the end of this week.

We are planning a North Sámi text to speech. Work on the text-to-transcription (ttt) component has begun, and for the transcription-to-sound we cooperate with U Hki. For a forthcoming october demo we have two alternative tracks:

  1. Do the ttt with quasi-Finnish orthography as output, and plug it onto the Finnish ttt (the Sámi-as-a-Finnish-priest solution) (pro: the web demo is there, so the demo is within reach; con: several phonemes are missing)
  2. Do the ttt with SAMPA as output, and read in 200 sentences, and have Hki generate a voice based upon that (pro: probably better result, head start on the project; con: we risk that is not be done by
  3. Do both in parallel. (pro: safety first, not much double work; con: well, the double work in the phon-sme.xfst file)

The best thing would probably be to do both tracks, to be on the safe side. 

echo "23847 ja de mun ipmirdán ja 12° ja §12 ja 23,2 ja 23,- ja 23-23" | jietna.sh
kuokː.hte.lo.gi kolə.bmɑ tuː.hɑːh kɑːvht.tsiː tʃuo.ðiː ɲeæl.lje lo.giː tʃie.dʃɑ 
jɑ te mun ip.mir.dɑːn jɑ kuokː.hte nup.pe.lohː.kɑːj grɑː.dɑ jɑ pɑ.rɑː.grɑː.fɑ...

TODO:

  • Technical issues on the ttt automata (Trond, ...)
  • Moving input to required xml format (Helsinki)
  • Read in the 200 sentences (Biret Ánne)
  • Make sounds out of them (Helsinki)

Corpus contracts + open source

Postponed until the svn repository is fully functional (it is too open now).

Next meeting, closing

The next meeting is 20.10.2008, 9.30 Norwegian time.

Thomas and Sjur will be off towards the end of the week due to autumn leaves in the schools. David will be away this Friday, and the coming Monday.

The meeting was closed at 12: 30.

Appendix - task lists for the next five days

Boerre

  • fix the Upload more link on the corpus upload page
  • Make a divvun-tools download log
  • Finish the OOo extension package of the hunspell dictionaries
  • check the hunspell test bench and tokenization errors
  • further investigate installation of dictionaries in NeoOffice
  • setup iCal server on the XServe
  • make a 1-page, light version of the corpus contract, also in Swedish
  • work around crashing Hunspell bug in OOo 2.x/3.0 on Win/Mac
  • e-mail about G5 repair status
  • infrastructure remake - news discussion
  • implement an easter egg (almost) identical to the Polderland one
  • fix bugs!

Ciprian

  • close the open SVN repository at requested paths
  • make a test-all target that runs all tests we have (with Sjur and Trond)
  • define and document testing routines (with Sjur and Trond)
  • continue the dictionary infrastructure discussion (with Sjur, Trond)
  • improve processing of new corpus documents
  • make the pipeline of StarDict dictionary generation running on the Mac
  • have a closer look at the formatting for StarDict
  • update the Makefile for generating dictionaries (related to the dictionary infrastructure task)
  • look at the xml conversion script
  • take care of the error logging during conversion process
  • look at the xml conversion quality
  • check the bug with the text uploading via web interface (with Børre)
  • make a list of (general and special) problems related with converting docs into xml-forat and adding them to the corpora
  • continue the search and testing of an appropriate tool for lexicon working (no xml-file editing via text editors!)
  • generate new sme: nob/nob: sme dictionaries in all formats, marking them as "Beta"-versions (Sjur's proposal to use an image background for that purpose)
  • infrastructure remake - news discussion
  • short meeting to go through missing points before a dictionary release (with Sjur, Trond)

David

  • continue gathering sma corpus texts
  • stay in contact with Sáminuorat about writing about the project and advertising.
  • gather orthographic decisions (with Jovsset)
  • translate corpus contract to swedish (with Jovsset)
  • make a 1-page, light version of the corpus contract, also in Swedish
  • prepare a workshop on South Sámi orthography and grammar (David)
    • suggest dates
      • try to coordinate with the SGL so we meet together
    • set up a preliminary agenda (with Sjur)
    • prepare data for each topic (with Sjur and Trond)
  • Assist Jovsset in the work with the leaflet.
  • make an add for our tools to go into Sámi newspapers (with Jovsset)

Jovsset

  • get the list of verbs from the auhtors of Verbh.
  • Write and translate leaflet text, add pictures.
  • Find a suitable infrastructure for the distribution of the CD version. Possible through the library bus, the language centres and common sami centres in all of Sápmi.
  • Talk to person who can talk to translator of Gåessie dah jeatjebh åerieminie
  • make an add for our tools to go into Sámi newspapers (with David)

Lene

  • Work on test routine with Trond and Sjur

Linda

  • add remaining verbs of type VI

Per-Eric

  • transfer the smj texts by Kurt Tore to our corpus repository
  • follow-up contracts from Nord-Salten avis and Lena Davidsson
  • Work with missing list same_dutkama_pgr.txt
  • Plan a smj pr tour for our tools
  • contact Ulf Stefan Winka for smj texts
  • fix bugs!

Saara

  • add new XSL/XML headers for proofing test docs
  • Set up ways of adding meta-information for proofing correct corpus docs (source info, used in testing or not, added to lexicon or not)
  • implement the ped UI and functionality
  • infrastructure remake - news discussion

Sjur

  • name db/risten.no
  • update the Changes document
  • follow-up on some Polderland-related bugs: 621, 630, 652
  • InDesign documentation
  • make a test-all target that runs all tests we have (with Trond, Ciprian)
  • define and document testing routines (with Trond, Ciprian)
  • write leaflet text
  • continue the dictionary infrastructure discussion (with Ciprian, Trond)
  • make make target for MS Office 2008 spellers
  • reformulate the noun grammar like the verbs (with Trond)
  • Contact Davvi Girji about cooperation on electronic dictionaries
  • subcontractor work for sma proofing tools, MS and Adobe versions
  • support and maintenance contract for sme and smj, MS+Adobe tools
  • finish paper about our test bench to be presented at the NLP for reading and writing workshop at SLTC2008 in Stockholm, Nov. 20-21
  • Sámi languages as part of Norsk språkbank
  • make a 1-page, light version of the corpus contract, also in Swedish
  • contact MS Nordic, and ask them to include the Divvun tools in the next Office releases (both Windows and Mac). The integration can/should be done by Polderland, which is an official MS subcontractor/integrator. It could be used by MS as part of their advertising for the next releases, and it will make it much easier for people to get access to the tools.
  • integrate sma adjectives into the analyser (without morphology)
  • create a new test case using the new speller test data
  • make proper folder for the SK parallell names
  • infrastructure remake - news discussion
  • set up a preliminary agenda for sma workshop (with David)
  • prepare data for each topic at for sma workshop (with David and Trond)
  • short meeting to go through missing points before a dictionary release (with Ciprian, Trond)
  • fix bugs!

Thomas

  • add SK parallel place name data files to proper folder
  • contact Nordsalten avis for a project interview aimed at getting more knowledge about the tools out to the users = more users
  • type the verbs in manually (missing: the odd-syllabic only, now at dïjmedidh on p. 113). The verbs to be added are the ones with p. 78-84 s. 146-160
  • fine tune suggestions for Hunspell
  • look at test cases still not behaving properly
  • translate leaflet text
  • test leaflet installation instructions on Mac, Windows XP, Windows Vista
  • work with presentation at Guovdageaidnu-symposia
  • sme->smj lexicon conversion to build bilingual lexicon resources, and increase smj coverage
  • fix bugs!

Tomi

  • document how compounding is controlled in the PLX conversion
  • fix double hyphen bugs
  • fix PL hyphenator errors
  • fix PL and Hunspell conversion bugs
  • work with presentation at Guovdageaidnu-symposia
  • test hyphenator with new speller lexicons
  • infrastructure remake - news discussion
  • fix bugs!

Trond

  • Hunspell QA README and installation docs
  • Look at dictionaries pipeline
  • Plan recording for text-to-speech
  • South Sámi verbs
  • South Sámi adjectives
  • reformulate the noun grammar like the verbs (with Sjur)
  • make a 1-page, light version of the corpus contract, also in Swedish
  • integrate sma adjectives into the analyser (without morphology)
  • infrastructure remake - news discussion
  • prepare data for each topic at for sma workshop (with David and Sjur)
  • short meeting to go through missing points before a dictionary release (with Ciprian, Sjur)
  • fix bugs!.