Meeting_2008-12-01
Contents:
- Meeting setup
- Agenda
- Opening, agenda review, participants
- Updated task status since last meeting
- Pedagogical software online
- Corpus gathering
- Promoting Divvun
- Future plans, directions and ideas
- Infrastructure
- Linguistics
- Name lexicon/risten.no infrastructure
- Proofing tools
- Other
- Next meeting, closing
- Appendix - task lists for the next five days
Meeting setup
- Date: 1.12.2008
- Time: 09.30 Norw. time
- Place: Internet
- Tools: SubEthaEdit, iChat
Agenda
Cf. one of the following, depending on context:
- the upper bar of the SEE window (provided you use the JSPWiki syntax mode)
- the TOC in Forrest-rendered output, like HTML and PDF
Opening, agenda review, participants
Opened at 10: 11.
Present: Børre, David, Jovsset, Sjur, Tomi
Absent: Ciprian, Thomas, Trond
Agenda accepted.
Updated task status since last meeting
Børre
- leaflet: add Linux info
- not done
- not done
- Make a divvun-tools download log
- not done
- not done
- check the hunspell test bench and tokenization errors
- not done
- not done
- setup iCal server on the XServe
- set it up on the G5
- set it up on the G5
-
gt/Makefile remake
- Nothing new this week
- Nothing new this week
- fine tune suggestions
- Added BREAK, WORDCHARS and TRY stanzas to the hunspell build process,
- Added BREAK, WORDCHARS and TRY stanzas to the hunspell build process,
- improve OOo instructions
- not done
- not done
- leaflet screenshots for MS Office 2003
- not done
- not done
- fix bugs!
Ciprian
- close the open SVN repository at requested paths
- make a test-all target that runs all tests we have (with Sjur and Trond)
- define and document testing routines (with Sjur and Trond)
- continue the dictionary infrastructure discussion (with Sjur, Trond)
- improve processing of new corpus documents
- make the pipeline of StarDict dictionary generation running on the Mac
- update the Makefile for generating dictionaries (related to the dictionary
- take care of the error logging during conversion process
- look at the xml conversion quality
- make a list of (general and special) problems related with
- continue the search and testing of an appropriate tool for
- generate new sme: nob/nob: sme dictionaries in all formats, marking them as
- infrastructure remake - news discussion
- short meeting to go through missing points before a dictionary release
- dictionary discussion on estethics, layout (with Trond)
- build the first version of smanob-dictionary (both MacDict and StarDict) by
- fix bugs!
David
- continue gathering sma corpus texts
- stay in contact with Sáminuorat about writing about the project and
- contacted Anneli
- contacted Anneli
- prepare a workshop on South Sámi orthography and grammar (David)
- ogoing
- set up a preliminary agenda (with Sjur)
- not done
- prepare data for each topic (with Sjur and Trond)
- ongoing
- ongoing
- ogoing
- call Ristin Persson for permission to use Sámi Radio texts
- contacted her but she hadn't read the info yet. Contacting again.
- contacted her but she hadn't read the info yet. Contacting again.
- integrate adjectives into the analyser, without morphology as a starting point
- nothing done last week
- nothing done last week
- work with missing lists
- nothing done last week
Jovsset
- get the list of verbs from the auhtors of Verbh.
- Not done
- Not done
- Write and translate leaflet text, add pictures. Talk to
- Talked to John Marcus
- Talked to John Marcus
- Find a suitable infrastructure for the distribution of the CD version.
- Not done
- Not done
- write formal letter to translator of Gåessie dah jeatjebh åerieminie
- Not done
- Not done
- leaflet: review the Windows pictures, and usage instructions for MS Office XP.
- In progress
- In progress
- Write installation instructions for word 2003
- Not done
- Not done
- better Windows usage descriptions, with emphasis on the pitfalls
- Š-bláđi. Take contact with them about article.
- Done.
- Done.
- work with missing lists
- Not done.
Per-Eric
- transfer the smj texts by Kurt Tore and Ulf Stefan Winka to our
- follow-up contract from Lena Davidsson
- fix bugs!
Saara
- add new XSL/XML headers for proofing test docs
- Set up ways of adding meta-information for proofing correct corpus docs
- implement the ped UI and functionality
Sjur
- name db/risten.no
- nothing
- nothing
- update the Changes document
- nothing
- nothing
- follow-up on some Polderland-related bugs: 621, 630, 652
- nothing
- nothing
- InDesign documentation
- nothing
- nothing
- continue the dictionary infrastructure discussion (with Ciprian, Trond)
- nothing
- nothing
- Contact Davvi Girji about cooperation on electronic dictionaries
- nothing
- nothing
- subcontractor work for sma proofing tools, MS and Adobe versions
- letter sent, waiting for offers
- letter sent, waiting for offers
- support and maintenance contract for sme and smj, MS+Adobe tools
- response from Polderland received, needs consideration
- response from Polderland received, needs consideration
- Sámi languages as part of Norsk språkbank
- nothing
- nothing
- contact MS Nordic, and ask them to include the Divvun tools in the next Office
- nothing
- nothing
- set up a preliminary agenda for sma workshop (with David)
- nothing
- nothing
- prepare data for each topic at sma workshop (with David and Trond)
- nothing
- nothing
- short meeting to go through missing points before a dictionary release
- nothing
- nothing
- leaflet: add link to OOo installation and usage instructions
- leaflet: add InDesign text
- nothing
- nothing
- meeting next week to discuss labour and cost estimates of TTS project
- nothing
- nothing
-
fix bugs!
- nothing
- nothing
- other issue:
- worked on speech synthesis cost request and technical requirements
Thomas
- gather the smj texts from Nord-Salten avis (online archive)
- fine tune suggestions for Hunspell
- look at test cases still not behaving properly
-
sme->smj lexicon conversion to build bilingual lexicon resources, and
- fix bugs!
Tomi
- document how compounding is controlled in the PLX conversion
- not done
- not done
- fix double hyphen bugs
- not sure if there are any such bugs
- not sure if there are any such bugs
- fix PL hyphenator bugs
- not done
- not done
- fix PL and Hunspell conversion bugs
- worked with
- worked with
- infrastructure remake
- not done
- not done
- check ccat, whether it allows specification of error type to be extracted or
- checked, seems to be working
- checked, seems to be working
- fix bugs!
Trond
- integrate sma adjectives into the analyser (without morphology)
- finish reformulating the proper noun grammar (with Sjur)
- infrastructure remake
- prepare data for each topic at sma workshop (with David and Sjur)
- dictionary discussion on estethics, layout (with Ciprian)
- meeting to go through missing points before a dictionary release
- clean the smanob data
- meeting next week to discuss labour and cost estimates of TTS project
- fix bugs!.
Pedagogical software online
Meeting memos can be found at
Corpus gathering
Jovsset got one more license signature for the book Bovtsen guelmieh by
TODO:
- continue gathering sma corpus texts (David, Jovsset)
- transfer the smj texts by Kurt Tore and Ulf Stefan Winka to our
- other contacts: Lena Davidsson, daughter to Lars-Matto Tuolja
- make a 1-page, light version of the contract, also in Swedish
- delayed till we have some more time
- delayed till we have some more time
- discuss infra improvements for corpus rep administration (Børre, Ciprian)
- delayed till we are done with the gt/Makefile improvements
- delayed till we are done with the gt/Makefile improvements
- gather the smj texts from Nord-Salten avis (online archive)
Promoting Divvun
TODO:
- Make a download log (Børre)
- use a newspaper or something to write about the tools from an end-user point
- follow-up Š ( Jovsset)
- talked to the main editor, she already wrote about us one year ago, not
- talked to the main editor, she already wrote about us one year ago, not
-
http://infonuorra.no interviewed David last week. Article in sma
- follow-up Š ( Jovsset)
- consider the best way to inform potential users in Sweden about the Divvun
-
David has suggested to announce in Sáminuorat
- stressed, will get back later
- stressed, will get back later
- preferably get an article in the paper at the same time, about the project
-
David has suggested to announce in Sáminuorat
- make leaflet to inform about the project (Jovsset, David)
- talk to John Markus Kuhmunen for tips, (Jovsset)
- done, more discussion needed
- done, more discussion needed
- better Windows usage descriptions, with emphasis on the pitfalls
- add link to OOo installation and usage instructions (Sjur)
- improve OOo instructions (Børre)
- add Linux info (Børre)
- add InDesign text (Sjur) - requires installer
- review the Windows pictures, and usage instructions for MS Office 2003
- screenshots (Børre)
- text (Jovsset)
- screenshots (Børre)
- talk to John Markus Kuhmunen for tips, (Jovsset)
- distribute CD version through the library bus, the language centres and common
- contact MS Nordic, and ask them to include the Divvun tools in the next Office
Future plans, directions and ideas
See a separate document in plan/strat/5year.jspwiki.
Infrastructure
To accomodate future enhancements in different directions (in rough order of
- test bench for all parts of our language technology efforts
- test bench enhanced, but not yet complet
- test bench enhanced, but not yet complet
- set up the Leopard Server features for collaborative support:
- permanent chat rooms
- stored (and indexed) chat transcripts of the chat rooms
- iCal server / group calendars
- wiki
- permanent chat rooms
- wiki? on G5 (is part of Leopard Server) or other web-based documentation
- improve Forrest stability and i18n support ( the divvun crashes)
-
Sjur has been working on better i18n and pdf rendering
-
Børre has some ideas for getting back to serving static html files
-
Sjur has been working on better i18n and pdf rendering
- reorganise the documentation:
- differ between target groups
- get better grouping
- decide what to write in forrest and what in wiki
- update/add missing parts
- differ between target groups
- migrate lexc lexicons to XML, splitting the task
- Name lexica (the Name project)
- Dictionaries (already in XML, task is to integrate them)
- At least migrate the lexc open POSes (Komi as a pilot case)
- Name lexica (the Name project)
- change the look of the documentation web
- sfst?
- replacement for xfst -> see omorf
,
- replacement for hunspell/open-source proofing tools
- replacement for xfst -> see omorf
,
- investigate the NSIS installer,
- corpus content moved to Max Planck repositories? Norsk språkbank?
- update infrastructure to allow content-restricted spellers for special target
SVN issues:
- http access not yet available (https only at the moment, but it works as
- read access to the whole repo is working, BUT:
-
gt/*/polderland should be protected
-
plan should be protected
-
gt/*/polderland should be protected
- certain users need to be on the UiT VPN to be able to commit (bug #705)
- UTF-8 problem in svn commit mails: the commit log text is garbled
TODO:
- infrastructure remake: ( Børre, Ciprian, Saara, Sjur, Tomi, Trond)
- more modularised make / build infra (prepare for smn, sms, sjd, others)
- merge gt, kt and st into one
- modularised preprocess and spellrelax
- more modularised make / build infra (prepare for smn, sms, sjd, others)
- make a test-all target that runs all tests we have (Ciprian, Sjur, Trond)
- delayed until we have restructured the make/build process
- delayed until we have restructured the make/build process
- define and document testing routines (Ciprian, Sjur, Trond)
- delayed until we have restructured the make/build process
- delayed until we have restructured the make/build process
- follow-up migration to svn:
- close the open SVN repository at requested paths (Ciprian)
- completely closed at the moment, until we have solved the path-based control
- completely closed at the moment, until we have solved the path-based control
- prepare and discuss with external users: Jack Ruether (Trond)
- close the open SVN repository at requested paths (Ciprian)
- setup iCal Server (on XServe) (Børre)
- should be running now, but not tested
- should be running now, but not tested
- remove TOC from the giellatekno home page by using dispatcher (Trond)
- nothing done
Linguistics
North Sámi
(nothing new, see proofing bugs below)
http: //giellatekno.uit.no/bugzilla/show_bug.cgi?id=711
Lule Sámi
(nothing new, see proofing bugs below)
TODO:
-
sme->smj lexicon conversion to build bilingual lexicon resources, and
- Add the words when all words are ready.
South Sámi
TODO:
- step two for adjectives (David, Trond, Sjur)
- finish reformulating the proper noun grammar like the verbs (Sjur, Trond)
- Missing list (focus on closed class words and addition on missing nouns,
- finish translation of sma version of http://divvun.no front page (David)
- prepare a workshop on South Sámi orthography and grammar (David)
- date: last week of February (23.-27.) seems to work fine with SGL/South Sámi
- Place: tentatively Trondheim, nothing decided, no meeting rooms ordered
- we'll cover travel and hotel expenses
- we'll invite both SGL and as many of the other key persons in the sma
- set up a preliminary agenda (David, Sjur)
- prepare data for each topic (David, Sjur, Trond)
- date: last week of February (23.-27.) seems to work fine with SGL/South Sámi
- clean the smanob data (Trond with some help)
Name lexicon/risten.no infrastructure
From the meeting with the terminology and IT teams last week:
- no major rework on the present search interface now
- no work on the editing section; instead:
- add existing lists of sanctioned terminology as separate term entities
- add a dictionary if we can make one with sufficient quality
This means the following tasks:
- find already approved lists, in paper or electronic form (term team)
- convert paper lists to electronic lists (term team)
- convert lists to standard XML (Sjur, Tomi)
- add prepared lists to risten.no (Sjur, Tomi)
TODO:
- fix i18n bug in risten.no/G5 (so they will work without the proper locale
- fix bugs in lexc2xml; add comments to the log element (Saara)
- finish first version of the editing (Sjur)
- test editing of the xml files. If ok, then: ( Sjur, Thomas, Trond)
- make terms-smX.xml <=== automatically from propernoun-sme-lex.xml (add nob
- convert propernoun-($lang)-lex.txt to a derived file from common xml files
- implement data synchronisation between risten.no and
- start to use the xml file as source file
- clean terms-sme.xml such that all names have the correct tag for their use
- merge placenames which are errouneously in different entries: e.g. Helsinki,
- publish the name lexicon on risten.no (Sjur)
- add missing parallel names for placenames (linguists)
- add informative links between first names like Niillas and Nils
Dictionaries
Ciprian is working hard on it.
TODO:
- Continue the dictionary infrastructure discussion (Ciprian, Sjur, Trond)
- make simple installer applications
- make a public release
- Make a homepage with instructions for dictionary use:
- Clarify the difference between local and online dictionaries:
- Plugin for Firefox and Internet Explorer (online dictionaries)
- Plugin for Firefox and Internet Explorer (online dictionaries)
- Make a homepage with instructions for dictionary use:
- Contact Davvi Girji about cooperation on electronic dictionaries (Sjur)
- short meeting to go through missing points before a release
Proofing tools
Hunspell
TODO:
- check the hunspell test bench and tokenization errors (Børre, Sjur)
- tried to improve tokenization by adding a WORDCHAR entry in the aff file
- tried to improve tokenization by adding a WORDCHAR entry in the aff file
- fine tune suggestions (Børre, Thomas)
- improving, but still not good enough
OpenXSpell
Working everywhere (almost) in MacOS X applications, provides Sámi spell
There are two issues:
- strings with non-ASCII chars are always flagged
- asking for suggestions on words witn non-ASCII chars crashes OpenXSpell
Testing
Spelling Error Markup
TODO:
- Set up ways of adding meta-information (source info, used in testing or not,
- test new and nested error markup (Sjur)
- nesting still needs to be tested, depends on new ccat feature
Speller testing
TODO:
- test the error type selection feature in ccat (Sjur)
- document the feature (Tomi)
Speller updates
TODO:
- compile new spellers (Tomi)
Speller bugs
List of bugs returned from Polderland: 621, 630, 652, 656, 676.
Open issues based on test results:
sme
- 397 - see 449
- 435 - roman numbers - inflection of single letter numbers
- we should pregenerate all numbers once and for all, and store them in a
- we should pregenerate all numbers once and for all, and store them in a
- 449 - REGRESSION: suopmasápmelaš comps wrongly accepted
- 581 - consonant doubling - still OPEN
- 593 - Missing words in beta 2 - one word left (Nuppelohkái), still
- 595 - prefix+name without hyphen (ovdaLot instead of ovda-Lot) - still
- 597 - does not recognize nubbelohki - still OPEN
- 599 - numeral attr: s on lot - oktalot not recognized - still OPEN
- 'oktalot' - 10? or 11?
- 'oktalot' - 10? or 11?
- 603 - suomabealdi accepted - still OPEN
- 611 - double hyphen sugg still accepted - still OPEN, but no double
- only open case is adjective derivation related bug
- only open case is adjective derivation related bug
- 613 - short gen. as second compound part - still OPEN
- 619 - numerals and pronouns to NAMÁK and SASJ fails - vihttasoarttat
- 629 - a taking part in compounding without hyphen - still OPEN
- 633 - double hyphens accepted - no double hyphens, but OPEN case, check
- 642 - noun/adj/proper + hyphen + ain - still OPEN
- 647 - numerals+NOUN - still OPEN
- 648 - REGRESSION: unmotivated suggestions with numeral+noun
- 655 - pron + nai - still OPEN, 'makkár+nai' missing
- sme.fst does not recognise it either
- sme.fst does not recognise it either
- 696 - numerals + NAMAT-adjs + vuohta - still OPEN
- 717 - noun-acro compounds (juovla-CD) - still OPEN, but fixed in smj
- 728 - vowel shortening GenCmp+Left-tagged - still OPEN
smj
- 435 - roman number - single letter numbers now recognised
- we should pregenerate all numbers once and for all, and store them in a
- please note that inflection of single letter numerals is fine in
- we should pregenerate all numbers once and for all, and store them in a
- 589 - suggestions involving vowel-replacement - OPEN
- 594 - lågenanguoktáj not recognized - OPEN
- 595 - prefix+name as split comp without hyphen - still OPEN
- 599 - numeral attr: s on lot - still OPEN
- 616 - Bispadime-me-ráden - still OPEN, try to find an acro or abbr me
- 629 - a taking part in compound - still OPEN
- 647 - numerals+NOUN - still OPEN
- 648 - unmotivated suggestions with numeral+noun - still OPEN
- 650 - noun prefix+name compound without hyphen - still OPEN
- 652 - UPPERCASE-typos only get acronym-suggestions - still OPEN
- 692 - numeral-variants - some fixed, but still OPEN
- one regression in 407, because input word has been SUBed.
TODO:
- document how compounding is controlled in the PLX conversion (Tomi)
Hyphenator bugs
Open issues based on test results :
sme
- 468 - REGRESSION: Márkomeanu - OPEN
- 547 - REGRESSION: hyphen in front of vowel: Lotnolasealáhusas -
- 548 - REGRESSION: mid syllable hyphenation: Háliidivččen - OPEN
- 549 - REGRESSION: division without hyph: Váccedettiin
- 673 - adj-derivations: guovttenuppelotčoarvvagiin (the word is not rec.)
smj
- 547 - REGRESSION: hyphen in front of vowel: Jienastimnjuolgadusá and
- 670 - REGRESSION: Hard hyphen replaced with soft hyphen
TODO:
- fix PL hyphenator errors (Tomi)
InDesign tools
They need a real installer.
TODO:
- make an installer for the InDesign Divvun tools (Sjur)
Releases
TODO:
- update the Changes document (Sjur)
- InDesign documentation (Sjur)
- Norwegian translation received from Davvi Girji
- Norwegian translation received from Davvi Girji
- prepare 1.1 release soon
- target date: December 12 - one year after the 1.0 release.
Other
Personell seminar in SD
Task for those going there: sit down with Leif Åge, and have a look at the
Who | going? |
---|---|
Børre | yes |
David | no |
Joseph | yes |
Sjur | no |
Thomas | no |
Tomi | yes |
TODO:
- talk to Leif Åge and install Divvun tools with him (Børre, Tomi)
- talk to John Marcus about leaflet (Jovsset)
Sámi week in Tromsø
Sigbjørn Skåden has asked the UiT gang to demonstrate etc at the Tromsø city
- ped tools
- Sámi dictionaries
- Sámi proofing tools
- other things?
Text to speech
Recording is done (Biret Ánne the local hero), the first alpha, or rather the
Antti has hinted at the possibility of doing beta versions of other
TODO:
- Make a second round of improvements.
- Consider more languages (pro-et-con for all-in-one-step vs.
- meeting to discuss labour and cost estimates next week - participants:
Corpus contracts + open source
Postponed until the svn repository is fully functional (it is too open now).
Next meeting, closing
The next meeting is 8.12.2008, 9.30 Norwegian time.
David in Tromsø, potentially away from the meeting.
The meeting was closed at 11: 16.
Appendix - task lists for the next five days
Boerre
- talk to Leif Åge and install Divvun tools with him
- leaflet: add Linux info
- Make a divvun-tools download log
- check the hunspell test bench and tokenization errors
-
gt/Makefile remake
- fine tune suggestions
- improve OOo instructions
- leaflet screenshots for MS Office 2003
- talk to Leif Åge in GG and install Divvun tools with him
- fix bugs!
Ciprian
- close the open SVN repository at requested paths
- continue the dictionary infrastructure discussion (with Sjur, Trond)
- improve processing of new corpus documents
- make the pipeline of StarDict dictionary generation running on the Mac
- update the Makefile for generating dictionaries (related to the dictionary
- take care of the error logging during conversion process
- look at the xml conversion quality
- make a list of (general and special) problems related with
- continue the search and testing of an appropriate tool for
- generate new sme: nob/nob: sme dictionaries in all formats, marking them as
- infrastructure remake - news discussion
- short meeting to go through missing points before a dictionary release
- dictionary discussion on estethics, layout (with Trond)
- build the first version of smanob-dictionary (both MacDict and StarDict) by
- fix bugs!
David
- continue gathering sma corpus texts
- prepare a workshop on South Sámi orthography and grammar (David)
- set up a preliminary agenda (with Sjur)
- prepare data for each topic (with Sjur and Trond)
- set up a preliminary agenda (with Sjur)
- call Ristin Persson for permission to use Sámi Radio texts
- integrate adjectives into the analyser
- work with missing lists
- translate the frontpage into sma
- send reminder and list of topics to the South sami SGM members
Jovsset
- get the list of verbs from the auhtors of Verbh.
- talk to John Marcus about leaflet
- Find a suitable infrastructure for the distribution of the CD version.
- write formal letter to translator of Gåessie dah jeatjebh åerieminie
- leaflet: review the Windows pictures, and usage instructions for MS Office.
- Write installation instructions for word 2003
- better Windows usage descriptions, with emphasis on the pitfalls
- work with missing lists
Per-Eric
- transfer the smj texts by Kurt Tore and Ulf Stefan Winka to our
- follow-up contract from Lena Davidsson
- fix bugs!
Saara
- add new XSL/XML headers for proofing test docs
- Set up ways of adding meta-information for proofing correct corpus docs
- implement the ped UI and functionality
Sjur
- name db/risten.no
- update the Changes document
- follow-up on some Polderland-related bugs: 621, 630, 652
- InDesign documentation
- continue the dictionary infrastructure discussion (with Ciprian, Trond)
- Contact Davvi Girji about cooperation on electronic dictionaries
- subcontractor work for sma proofing tools, MS and Adobe versions
- support and maintenance contract for sme and smj, MS+Adobe tools
- Sámi languages as part of Norsk språkbank
- contact MS Nordic, and ask them to include the Divvun tools in the next Office
- set up a preliminary agenda for sma workshop (with David)
- prepare data for each topic at sma workshop (with David and Trond)
- short meeting to go through missing points before a dictionary release
- leaflet: add link to OOo installation and usage instructions
- leaflet: add InDesign text
- meeting next week to discuss labour and cost estimates of TTS project
- make an installer for the InDesign Divvun tools
- check the hunspell test bench and tokenization errors
- fix bugs!
Thomas
- gather the smj texts from Nord-Salten avis (online archive)
- fine tune suggestions for Hunspell
- look at test cases still not behaving properly
-
sme->smj lexicon conversion to build bilingual lexicon resources, and
- fix bugs!
Tomi
- document how compounding is controlled in the PLX conversion
- fix double hyphen bugs
- fix PL hyphenator bugs
- fix PL and Hunspell conversion bugs
- infrastructure remake
- document the error type selection feature in ccat
- talk to Leif Åge in GG and install Divvun tools with him
- fix bugs!
Trond
- integrate sma adjectives into the analyser (without morphology)
- finish reformulating the proper noun grammar (with Sjur)
- infrastructure remake
- prepare data for each topic at sma workshop (with David and Sjur)
- dictionary discussion on estethics, layout (with Ciprian)
- meeting to go through missing points before a dictionary release
- clean the smanob data
- meeting next week to discuss labour and cost estimates of TTS project
- fix bugs!.