bugGrammatica - Bugs: bug #3604, Tokenizer: Add support for modes


You are not allowed to post comments on this tracker with your current authentication level.

bug #3604: Tokenizer: Add support for modes

Submitter:  Per Cederberg <cederberg>
Submitted:  Wed 14 May 2003 03:57:20 PM UTC
Severity:  5 - Major Item Group:  Future Improvement
Status:  Postponed Assigned to:  cederberg
Open/Closed:  Closed

Discussion locked!

Sun 05 Apr 2009 03:10:46 PM UTC, comment #1: 

Tokenizer modes is a subset of modular grammars. Now on the Wiki:


Closing this issue.

Per Cederberg <cederberg>
Group administrator
Wed 14 May 2003 03:57:20 PM UTC, original submission:  

When reading certain tokens the tokenizer should be able to enter some kind of "mode", limiting the set of tokens that are considered for a match. This is highly useful in some grammars, where the token syntax isn't easily represented with regular expressions.

Per Cederberg <cederberg>
Group administrator


(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

No files currently attached


Depends on the following items: None found

Items that depend on this one: None found


Carbon-Copy List
  • -email is unavailable- added by cederberg (Posted a comment)

    There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.


    Follow 4 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2009-04-05 cederberg StatusNone Postponed
        Assigned toNone cederberg
        Open/ClosedOpen Closed
        Discussion LockNone Locked

    Back to the top

    Powered by Savane 3.13-4b48.
    Corresponding source code