Grammatica - Bugs: bug #13009, Tokenizer: String tokens are...
You are not allowed to post comments on this tracker with your current authentication level.
bug #13009: Tokenizer: String tokens are always considered first
Submitter: | Per Cederberg <cederberg> | ||
Submitted: | Sat 07 May 2005 09:49:48 AM UTC | ||
Severity: | 1 - Minor | Item Group: | Software |
Status: | Fixed | Assigned to: | cederberg |
Open/Closed: | Closed |
Discussion locked!
Sat 14 Mar 2009 09:33:50 AM UTC, comment #2: |
Per Cederberg <cederberg>![]() ![]() |
Sat 14 Feb 2009 12:38:59 PM UTC, comment #1: Fixed in r130. |
Per Cederberg <cederberg>![]() ![]() |
Sat 07 May 2005 09:49:48 AM UTC, original submission:
When tokenizing an input string, the string token patterns are always checked and considered first. This means that if a regular expression and a string token pattern matches the same input sequence, the string token will always be returned. This is wrong, as the token pattern order should determine which token is returned in cases where multiple patterns match. |
Per Cederberg <cederberg>![]() ![]() |
No files currently attached
Depends on the following items: None found
Items that depend on this one: None found
There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.
Version 1.5 was released on 2009-03-07. Closing this issue.