MHonArc - Bugs: bug #12314, linebreak not utf-8 aware
You are not allowed to post comments on this tracker with your current authentication level.
bug #12314: linebreak not utf-8 aware
Submitter: | Jeff Breidenbach <jab> | ||
Submitted: | Mon 14 Mar 2005 07:49:37 AM UTC | ||
Category: | Character Sets | Severity: | 3 - Normal |
Priority: | 5 - Normal | Item Group: | Undesired Behavior |
Status: | Fixed | Privacy: | Public |
Assigned to: | None | Open/Closed: | Closed |
Operating System: | Linux | Perl Version: | 5.8.4 |
Component Version: | 2.6.10 | Fixed Release: | 2.6.13 |
Mon 20 Jun 2005 04:30:24 AM UTC, comment #2: |
Earl Hood <ehood> |
Mon 14 Mar 2005 07:52:35 AM UTC, comment #1:
octet equivalents.
avoid using octets between 0 and 127 within multi-byte sequences to
|
Jeff Breidenbach <jab> |
Mon 14 Mar 2005 07:49:37 AM UTC, original submission:
maxwidth=80 does poorly on mixed English/Japanese UTF-8 |
Jeff Breidenbach <jab> |
No files currently attached
Depends on the following items: None found
Items that depend on this one: None found
There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.
Follow 5 latest changes.
Date | Changed by | Updated Field | Previous Value | => | Replaced by |
---|---|---|---|---|---|
2005-07-06 | ehood | Status | Ready For Test | Fixed | |
Open/Closed | Open | Closed | |||
Fixed Release | CVS | 2.6.13 | |||
2005-06-20 | ehood | Status | None | Ready For Test | |
Fixed Release | CVS |
Powered by Savane 3.13-02a9.
Corresponding source code
Applied a fix that will work with versions of Perl with
the Encode module installed (i.e Perl >=5.8). The fix converts
the input to perl's internal utf-8 so line breaking is done on characters
vs bytes. The data is translated back after operation.
To avoid unnecessary translations, translation is not done on
us-ascii or iso-8859 sets, common 7/8-bit charsets. Of course,
conversion could be avoided for other 8-bit sets, but charset check
may cause more overhead then translation, so only common ones are
checked for.
Anyone who can, please test changes to make sure nothing got
broke. Note, translation only done when maxwidth is set.
Changes will be available in next snapshot build.
Side Comment: For the future, it is worth considering that
all textual content get normalized to Perl's internal utf-8
format. Of course, such a change would cause mhonarc to
not be compatible with versions of Perl < 5.8.