bugVarnamproject - Bugs: bug #41902, [libvarnam] Normalization of words...


bug #41902: [libvarnam] Normalization of words while learning

Submitter:  Navaneeth <navaneethkn>
Submitted:  Wed 19 Mar 2014 04:50:08 AM UTC
Category:  libvarnam Severity:  3 - Normal
Item Group:  * Bug Status:  None
Privacy:  Public Assigned to:  None
Open/Closed:  Open
* Mandatory Fields

Add a New Comment (Rich Markup)

Fri 28 Mar 2014 01:57:13 PM UTC, comment #2: 


Thanks for looking into this. But the patch you have submitted is not what it needs. This is much larger and needs to be configured at the scheme file level. Basically the scheme file will have a rule which specify how normalization should happen for the particular language and libvarnam applies it during learning.

Navaneeth <navaneethkn>
Group administrator
Thu 27 Mar 2014 10:47:38 AM UTC, comment #1: 
kiran <pskirann>
Wed 19 Mar 2014 04:50:08 AM UTC, original submission:  

In Unicode, there are characters which look same but have different code points. The atomic chills is Malayalam is an example. Also Unicode text can contain metadata characters like "SOFT HYPHEN (xad)". This has to be removed and normalized to a standard form while learning a word.

Scheme file will define the word normalization rules and varnam will apply them while learning.

Navaneeth <navaneethkn>
Group administrator


(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:

No files currently attached


Depends on the following items: None found

Items that depend on this one: None found


Carbon-Copy List
  • -email is unavailable- added by pskirann (Posted a comment)
  • -email is unavailable- added by navaneethkn (Submitted the item)

    There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.

    Only logged-in users can vote.





    No changes have been made to this item

    Back to the top

    Powered by Savane 3.12