taskSwathanthra Malayalam Computing - Tasks: task #9305, Convert English-Malayalam...

 
 

You are not allowed to post comments on this tracker with your current authentification level.

task #9305: Convert English-Malayalam dictionary to TEI XML format

Submitted by:  Rajeesh K Nambiar <rajeeshknambiar>
Submitted on:  Mon 06 Apr 2009 05:40:39 PM UTC  
 
Category: dictionariesShould Start On: Tue 07 Apr 2009 12:00:00 AM UTC
Should be Finished on: Sun 27 Feb 2011 06:30:00 PM UTCPriority: 5 - Normal
Status: In ProgressPrivacy: Public
Percent Complete: 50%Assigned to: Sunil K <iamsunilk>
Open/Closed: OpenEffort: 0.00

Mon 21 Feb 2011 03:05:39 PM UTC, comment #4:

Dear Santhosh,

Only the teiheader part requires some modification such as proper copyright notice and maintainer etc.
I put some info there. But I dont know whether I missed anything

Other wise data part I thing it is complete. Tei to dict conversion is also working fine. But the following test I not able to do "xmllint --noout --valid eng-mal.tei"

I am not sure any other files are required.
Regards
Sunil

Sunil K <iamsunilk>
Project MemberIn charge of this item.
Mon 21 Feb 2011 11:31:40 AM UTC, comment #3:

Sunil,
Did we submit this to upstream? What is pending ?

Santhosh Thottingal <santhosh>
Project Administrator
Tue 25 Jan 2011 10:14:37 PM UTC, comment #2:

Dear Santhosh,

Thanks for the feedback. Thanks to that I have a better version of tei file (Header info need lot of modification )

1. I am not able to validate using http://sourceforge.net/apps/mediawiki/freedict/index.php?title=FreeDict_HOWTO_-_12
I am using debian (TEI DTD are not available from rep)

But I validated using http://wiki.tei-c.org/index.php/TEI-to-DICT_howto

xmllint --noout your-dictionary.tei

Other test I am not able do due to some errors
xmllint --noout --valid eng-mal.tei
eng-mal.tei:2: validity error : Validation failed: no
DTD found !
<TEI xmlns="http://www.tei-c.org/ns/1.0">

also the conversion given in the link is also working fine

"
Transform the TEI file into something appropriate to be fed into dictfmt by entering

xsltproc -o dictionary.c5 -novalid --stringparam current-date
$(date) ../CVS/tools/xsl/tei2c5.xsl dictionary.tei

Transform the intermediate file into the database and index files by entering one (or a combination) of the following:

dictfmt -t --utf8 my_dictionary < dictionary.c5

dictfmt -t --headword-separator %%% --utf8 my_dictionary <
dictionary.c5

dictfmt -t -s <short_descriptive_name> --utf8 my_dictionary <
dictionary.c5

"

And the resulting dictionary file is working fine in goldendict

2. Header file is not modified ---now it just a copy from eng-fra will do modify soon but I dont know the contents to be put.

3. whitespaces removed

one method described in http://wiki.tei-c.org/index.php/TEI-to-DICT_howto is working (given above) for converting from tei to dict
Note: there are few split lines in the dict, I removed quite a few of them but this may sometimes lead to missing part of the info(malayalam meaning). I will look into it once again

I didn;t use dict2tei.py because initially it didn;t worked for me. even now it is not giving output that can be validated

output of dict2tei.py is

<form><orth>abbey</orth></form>
<def> 1. കന്യകാമഠം</def>
<def> 2. മഠത്തോട് ബന്ധപ്പെട്ട ദേവാലയം</def>
<def> 3. സന്യാസിമഠം</def>
<form><orth>abbot</orth></form>
<def> 1. മഠാധിപതി</def>

but the output in the format given in eng-fra and eng-hin dicts is of form
<entry>
<form>
<orth>ABC</orth>
<pron>eibiːsiː</pron>
</form>
<sense n="1">
<cit type="trans">
<quote>abc</quote>
</cit>
<cit type="trans">
<quote>alphabet</quote>
</cit>
</sense>
<sense n="2">
<cit type="trans">
<quote>abc</quote>
</cit>
</sense>
</entry>
<entry>

So the script because of that (I know little bit perl but no python even to debug)

to run the script
perl tei2dict file.dict file.tei (file should not have comments)

git I have to learn. I will do it tomorrow

Thanks & Best regards

Sunil

Sunil K <iamsunilk>
Project MemberIn charge of this item.
Tue 25 Jan 2011 04:30:20 PM UTC, comment #1:

Thanks Sunil, good work!
Some points:
1. Did you validate the TEI xml file as documented here http://sourceforge.net/apps/mediawiki/freedict/index.php?title=FreeDict_HOWTO_-_12
2. In the XML file, I see wrong information in publicationStmt node. Similarly sourceDesc node. You may refer http://wiki.smc.org.in/Dictionary and dont forget to add your name in credits :)
3. In orth and quote node content, the white spaces before and after the word is intentional or by mistake?

Is there any too to convert the xml to dict format again?
Did you wrote the perl script yourself for this purpose? I see http://sourceforge.net/apps/mediawiki/freedict/index.php?title=FreeDict_HOWTO_-_7 talking about dict2tei.py - a python script.

And please add the xml and perl script to our git.

Santhosh Thottingal <santhosh>
Project Administrator
Mon 06 Apr 2009 05:40:39 PM UTC, original submission:

The existing data used to create English-Malayalam dictionary is to be formatted to Text Encoding Initiative(TEI)'s XML format before submitting to freedict.org for accepting.

See http://apps.sourceforge.net/mediawiki/freedict/index.php?title=FreeDict_HOWTO_-_TOC for further details.

Rajeesh K Nambiar <rajeeshknambiar>
Project Administrator

 

Attached Files
file #22514:  eng-mal1.tei.tar.gz added by iamsunilk (445kB - application/x-gzip)
file #22515:  dict2tei.pl added by iamsunilk (654B - application/octet-stream)
file #22499:  eng-mal.tei.tar.gz added by iamsunilk (445kB - application/x-gzip - Uploading eng-mal.tei based on eng-hin and eng-fra )
file #22500:  dict2tei.pl added by iamsunilk (639B - application/octet-stream - Uploading eng-mal.tei based on eng-hin and eng-fra )

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by santhosh (Posted a comment)
  • -unavailable- added by iamsunilk (Updated the item)
  • -unavailable- added by rajeeshknambiar (Submitted the item)
  •  

    Do you think this task is very important?
    If so, you can click here to add your encouragement to it.
    This task has 0 encouragements so far.

    Only logged-in users can vote.

     

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 8 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Tue 25 Jan 2011 10:13:03 PM UTCiamsunilkAttached File-=>Added eng-mal1.tei.tar.gz, #22514
      Attached File-=>Added dict2tei.pl, #22515
    Tue 25 Jan 2011 04:30:20 PM UTCsanthoshShould be Finished onSat 06 Jun 2009 12:00:00 AM UTC=>Sun 27 Feb 2011 06:30:00 PM UTC
      StatusNone=>In Progress
      Percent Complete0%=>50%
    Sun 23 Jan 2011 11:26:38 AM UTCiamsunilkAssigned toNone=>iamsunilk
    Sun 23 Jan 2011 11:26:06 AM UTCiamsunilkAttached File-=>Added eng-mal.tei.tar.gz, #22499
      Attached File-=>Added dict2tei.pl, #22500

    Back to the top


    Powered by Savane 3.1-cleanup