taskSwathanthra Malayalam Computing - Tasks: task #9305, Convert English-Malayalam...


You are not allowed to post comments on this tracker with your current authentification level.

task #9305: Convert English-Malayalam dictionary to TEI XML format

Submitted by:  Rajeesh K Nambiar <rajeeshknambiar>
Submitted on:  Mon Apr 6 17:40:39 2009  
Category: dictionariesShould Start On: Tue Apr 7 00:00:00 2009
Should be Finished on: Sun Feb 27 18:30:00 2011Priority: 5 - Normal
Status: In ProgressPrivacy: Public
Percent Complete: 50%Assigned to: Sunil K <iamsunilk>
Open/Closed: OpenEffort: 0.00

Mon Feb 21 15:05:39 2011, comment #4:

Dear Santhosh,

Only the teiheader part requires some modification such as proper copyright notice and maintainer etc.
I put some info there. But I dont know whether I missed anything

Other wise data part I thing it is complete. Tei to dict conversion is also working fine. But the following test I not able to do "xmllint --noout --valid eng-mal.tei"

I am not sure any other files are required.

Sunil K <iamsunilk>
Project MemberIn charge of this item.
Mon Feb 21 11:31:40 2011, comment #3:

Did we submit this to upstream? What is pending ?

Santhosh Thottingal <santhosh>
Project Administrator
Tue Jan 25 22:14:37 2011, comment #2:

Dear Santhosh,

Thanks for the feedback. Thanks to that I have a better version of tei file (Header info need lot of modification )

1. I am not able to validate using http://sourceforge.net/apps/mediawiki/freedict/index.php?title=FreeDict_HOWTO_-_12
I am using debian (TEI DTD are not available from rep)

But I validated using http://wiki.tei-c.org/index.php/TEI-to-DICT_howto

xmllint --noout your-dictionary.tei

Other test I am not able do due to some errors
xmllint --noout --valid eng-mal.tei
eng-mal.tei:2: validity error : Validation failed: no
DTD found !
<TEI xmlns="http://www.tei-c.org/ns/1.0">

also the conversion given in the link is also working fine

Transform the TEI file into something appropriate to be fed into dictfmt by entering

xsltproc -o dictionary.c5 -novalid --stringparam current-date
$(date) ../CVS/tools/xsl/tei2c5.xsl dictionary.tei

Transform the intermediate file into the database and index files by entering one (or a combination) of the following:

dictfmt -t --utf8 my_dictionary < dictionary.c5

dictfmt -t --headword-separator %%% --utf8 my_dictionary <

dictfmt -t -s <short_descriptive_name> --utf8 my_dictionary <


And the resulting dictionary file is working fine in goldendict

2. Header file is not modified ---now it just a copy from eng-fra will do modify soon but I dont know the contents to be put.

3. whitespaces removed

one method described in http://wiki.tei-c.org/index.php/TEI-to-DICT_howto is working (given above) for converting from tei to dict
Note: there are few split lines in the dict, I removed quite a few of them but this may sometimes lead to missing part of the info(malayalam meaning). I will look into it once again

I didn;t use dict2tei.py because initially it didn;t worked for me. even now it is not giving output that can be validated

output of dict2tei.py is

<def> 1. കന്യകാമഠം</def>
<def> 2. മഠത്തോട് ബന്ധപ്പെട്ട ദേവാലയം</def>
<def> 3. സന്യാസിമഠം</def>
<def> 1. മഠാധിപതി</def>

but the output in the format given in eng-fra and eng-hin dicts is of form
<sense n="1">
<cit type="trans">
<cit type="trans">
<sense n="2">
<cit type="trans">

So the script because of that (I know little bit perl but no python even to debug)

to run the script
perl tei2dict file.dict file.tei (file should not have comments)

git I have to learn. I will do it tomorrow

Thanks & Best regards


Sunil K <iamsunilk>
Project MemberIn charge of this item.
Tue Jan 25 16:30:20 2011, comment #1:

Thanks Sunil, good work!
Some points:
1. Did you validate the TEI xml file as documented here http://sourceforge.net/apps/mediawiki/freedict/index.php?title=FreeDict_HOWTO_-_12
2. In the XML file, I see wrong information in publicationStmt node. Similarly sourceDesc node. You may refer http://wiki.smc.org.in/Dictionary and dont forget to add your name in credits :)
3. In orth and quote node content, the white spaces before and after the word is intentional or by mistake?

Is there any too to convert the xml to dict format again?
Did you wrote the perl script yourself for this purpose? I see http://sourceforge.net/apps/mediawiki/freedict/index.php?title=FreeDict_HOWTO_-_7 talking about dict2tei.py - a python script.

And please add the xml and perl script to our git.

Santhosh Thottingal <santhosh>
Project Administrator
Mon Apr 6 17:40:39 2009, original submission:

The existing data used to create English-Malayalam dictionary is to be formatted to Text Encoding Initiative(TEI)'s XML format before submitting to freedict.org for accepting.

See http://apps.sourceforge.net/mediawiki/freedict/index.php?title=FreeDict_HOWTO_-_TOC for further details.

Rajeesh K Nambiar <rajeeshknambiar>
Project Administrator


Attached Files
file #22514:  eng-mal1.tei.tar.gz added by iamsunilk (445kB - application/x-gzip)
file #22515:  dict2tei.pl added by iamsunilk (654B - application/octet-stream)
file #22499:  eng-mal.tei.tar.gz added by iamsunilk (445kB - application/x-gzip - Uploading eng-mal.tei based on eng-hin and eng-fra )
file #22500:  dict2tei.pl added by iamsunilk (639B - application/octet-stream - Uploading eng-mal.tei based on eng-hin and eng-fra )


Depends on the following items: None found

Items that depend on this one: None found


Carbon-Copy List
  • -unavailable- added by santhosh (Posted a comment)
  • -unavailable- added by iamsunilk (Updated the item)
  • -unavailable- added by rajeeshknambiar (Submitted the item)

    Do you think this task is very important?
    If so, you can click here to add your encouragement to it.
    This task has 0 encouragements so far.

    Only logged-in users can vote.


    Please enter the title of George Orwell's famous dystopian book (it's a date):



    Follow 8 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Tue Jan 25 22:13:03 2011iamsunilkAttached File-=>Added eng-mal1.tei.tar.gz, #22514
      Attached File-=>Added dict2tei.pl, #22515
    Tue Jan 25 16:30:20 2011santhoshShould be Finished onSat Jun 6 00:00:00 2009=>Sun Feb 27 18:30:00 2011
      StatusNone=>In Progress
      Percent Complete0%=>50%
    Sun Jan 23 11:26:38 2011iamsunilkAssigned toNone=>iamsunilk
    Sun Jan 23 11:26:06 2011iamsunilkAttached File-=>Added eng-mal.tei.tar.gz, #22499
      Attached File-=>Added dict2tei.pl, #22500

    Back to the top

    Powered by Savane 3.1-cleanup