mainSavannah Administration - Support: sr #109423, Non-BMP characters truncate...

 
 

sr #109423: Non-BMP characters truncate comments

Submitter:  David Corbett <dscorbett>
Submitted:  Mon 27 Nov 2017 09:09:10 PM UTC
   
 
Category:  Savannah trackers - bugs, tasks, etc. Priority:  5 - Normal
Severity:  3 - Normal Status:  Done
Privacy:  Public Assigned to:  ineiev
Operating System:  None Open/Closed:  Closed
* Mandatory Fields

Add a New Comment Rich Markup
   

Jump to the original submission

Sat 28 Jul 2018 12:29:18 PM UTC, comment #7: 

It turns out, my terminal wasn't capable to display it; mutt with gnome-terminal shows that character in notifications correctly.

Closing the request.

Ineiev <ineiev>
Site Administrator
Sat 03 Mar 2018 04:59:37 PM UTC, comment #6: 

The notifications still come broken

Ineiev <ineiev>
Site Administrator
Sat 03 Mar 2018 04:55:05 PM UTC, comment #5: 

I've just pushed and installed a workaround: whenever a new comment is written, it reads back what it actually inserted in the database, and if it differs from the original text, it base64encodes it and inserts with a magic prefix.

When extracting comments from the database, it checks for that prefix and base64decodes when needed:

test: 😀

Ineiev <ineiev>
Site Administrator
Fri 08 Dec 2017 10:15:33 AM UTC, comment #4: 

This looks like a MySQL bug: the string breaks when inserted.  FYI: Savannah runs on top of 'mysql Ver 14.14 Distrib 5.5.58, for debian-linux-gnu (x86_64) using readline 6.3'.

Ineiev <ineiev>
Site Administrator
Tue 28 Nov 2017 05:52:43 PM UTC, comment #3: 

Thanks for the sample; curiously, preview seems to be unaffected.

Ineiev <ineiev>
Site Administrator
Tue 28 Nov 2017 05:45:56 PM UTC, comment #2: 

Does it reproduce?

begin

Ineiev <ineiev>
Site Administrator
Tue 28 Nov 2017 01:02:39 PM UTC, comment #1: 

Could you attach a sample text in a file?

Ineiev <ineiev>
Site Administrator
Mon 27 Nov 2017 09:09:10 PM UTC, original submission:  

When a comment containing a non-BMP Unicode character is submitted, it will be truncated before that character. See, for example, the original submissions of bug #51672 and bug #52538.

David Corbett <dscorbett>

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

Attached Files
file #42509:  1f600.txt added by dscorbett (4B - text/plain)

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by ineiev (Posted a comment)
  • -email is unavailable- added by dscorbett (Submitted the item)
  •  

    There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.

    Only logged-in users can vote.

     

    Follow 6 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2018-07-28 ineiev StatusIn Progress Done
        Open/ClosedOpen Closed
    2018-03-03 ineiev StatusWorks For Me In Progress
    2018-03-03 ineiev StatusNone Works For Me
    2017-11-28 dscorbett Attached File- Added 1f600.txt, #42509
    2017-11-28 ineiev Assigned toNone ineiev

    Back to the top

    Powered by Savane 3.13-3230.
    Corresponding source code