bugGrammatica - Bugs: bug #13009, Tokenizer: String tokens are...


You are not allowed to post comments on this tracker with your current authentication level.

bug #13009: Tokenizer: String tokens are always considered first

Submitted by:  Per Cederberg <cederberg>
Submitted on:  Sat 07 May 2005 09:49:48 AM UTC  
Severity:  1 - Minor Item Group:  Software
Status:  Fixed Assigned to:  Per Cederberg <cederberg>
Open/Closed:  Closed

Sat 14 Mar 2009 09:33:50 AM UTC, comment #2: 

Version 1.5 was released on 2009-03-07. Closing this issue.

Per Cederberg <cederberg>
Project AdministratorIn charge of this item.
Sat 14 Feb 2009 12:38:59 PM UTC, comment #1: 

Fixed in r130.

Per Cederberg <cederberg>
Project AdministratorIn charge of this item.
Sat 07 May 2005 09:49:48 AM UTC, original submission:  

When tokenizing an input string, the string token patterns are always checked and considered first. This means that if a regular expression and a string token pattern matches the same input sequence, the string token will always be returned. This is wrong, as the token pattern order should determine which token is returned in cases where multiple patterns match.

Per Cederberg <cederberg>
Project AdministratorIn charge of this item.


No files currently attached


Depends on the following items: None found

Items that depend on this one: None found


Carbon-Copy List
  • -email is unavailable- added by cederberg (Posted a comment)

    Do you think this task is very important?
    If so, you can add your encouragement to it.
    This task has 0 encouragements so far.

    Only logged-in users can vote.




    Follow 4 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2009-03-14 cederberg Open/ClosedOpen => Closed
        Discussion LockUnlocked => Locked
    2009-02-14 cederberg StatusNone => Fixed
        Assigned toNone => cederberg

    Back to the top

    Powered by Savane 3.6