bugGrammatica - Bugs: bug #17189, Grammatica does not accept Unicode...


You are not allowed to post comments on this tracker with your current authentication level.

bug #17189: Grammatica does not accept Unicode regular expression categories

Submitter:  Invalid User ID <#51073>
Submitted:  Sun 23 Jul 2006 06:16:13 PM UTC
Severity:  2 - Normal Item Group:  Software
Status:  Fixed Assigned to:  cederberg
Open/Closed:  Closed

Discussion locked!

Sat 14 Mar 2009 09:33:19 AM UTC, comment #3: 

Version 1.5 was released on 2009-03-07. Closing this issue.

Per Cederberg <cederberg>
Group administrator
Tue 24 Feb 2009 10:18:04 PM UTC, comment #2: 

Fixed in trunk, r146. Will be available in the 1.5.beta1 release.


Grammatica now uses the Java regexp engine for all cases it cannot handle properly.

Per Cederberg <cederberg>
Group administrator
Sat 27 Jan 2007 06:58:02 PM UTC, comment #1: 

Yes, this is known issue in the regular expression compiler used. See bug #3597 for a summary bug of all the missing features.

Severity lowered to normal, as this issue refers to a missing feature and not a regression error or a defect in existing functionality.

Per Cederberg <cederberg>
Group administrator
Sun 23 Jul 2006 06:16:13 PM UTC, original submission:  

In order to correctly parse Wikipedia's XML export, it is necessary to deal with Unicode strings in many places. Ideally we would have full and flexible access to this feature set, but even simply accepting the Unicode definitions of e.g. \w and \d would suffice.

The reference grammar is described here: http://www.unicode.org/unicode/reports/tr18/

These token definitions:
LETTER              = <<[\p{Alphabetic}]>>
DIGIT               = <<[\p{Number}]>>

Fail with this error message:
Error: in wiki.grammar: line 74:
    token 'LETTER' is invalid, as regular expression contains
    error(s): unsupported escape character: '\p{Alphabetic}]' at
    position 1

Invalid User ID <#51073>


(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

No files currently attached


Depends on the following items: None found

Items that depend on this one: None found


Carbon-Copy List
  • -email is unavailable- added by cederberg (Posted a comment)

    There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.


    Follow 5 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2009-03-14 cederberg Open/ClosedOpen Closed
        Discussion LockNone Locked
    2009-02-24 cederberg StatusNone Fixed
    2007-01-27 cederberg Severity5 - Major 2 - Normal
        Assigned toNone cederberg

    Back to the top

    Powered by Savane 3.13-6ae7.
    Corresponding source code