bugrdiff-backup - Bugs: bug #23080, rdiff-backup fails on file with...

 
 

bug #23080: rdiff-backup fails on file with unknown unicode character

Submitter:  None
Submitted:  Sun 27 Apr 2008 09:11:42 PM UTC
   
 
Category:  None Severity:  3 - Normal
Item Group:  None Status:  Fixed
Privacy:  Public Assigned to:  None
Open/Closed:  Closed
* Mandatory Fields

Add a New Comment Rich Markup
   

Sun 01 Mar 2009 04:30:15 AM UTC, comment #5: 

I just ran into this problem with rdiff-backup 1.2.5. Backing up a Windows NTFS volume to an Ubuntu ntfs3g volume:

Exception '[Errno 84] Invalid or incomplete multibyte or wide character: '/media/netdrive/backups/bartt/My Music/iTunes/iTunes Music/Ali Farka Tour\xe9'' raised of class '<type 'exceptions.OSError'>':
  File "rdiff_backup\Main.pyc", line 304, in error_check_Main
  File "rdiff_backup\Main.pyc", line 324, in Main
  File "rdiff_backup\Main.pyc", line 280, in take_action
  File "rdiff_backup\Main.pyc", line 346, in Backup
  File "rdiff_backup\backup.pyc", line 38, in Mirror
  File "rdiff_backup\connection.pyc", line 450, in _call_
  File "rdiff_backup\connection.pyc", line 370, in reval

Traceback (most recent call last):
  File "rdiff-backup", line 30, in <module>
  File "rdiff_backup\Main.pyc", line 304, in error_check_Main
  File "rdiff_backup\Main.pyc", line 324, in Main
  File "rdiff_backup\Main.pyc", line 280, in take_action
  File "rdiff_backup\Main.pyc", line 346, in Backup
  File "rdiff_backup\backup.pyc", line 38, in Mirror
  File "rdiff_backup\connection.pyc", line 450, in _call_
  File "rdiff_backup\connection.pyc", line 370, in reval
OSError: [Errno 84] Invalid or incomplete multibyte or wide character: '/media/netdrive/backups/bartt/My Music/iTun
es/iTunes Music/Ali Farka Tour\xe9'
Fatal Error: Lost connection to the remote system

Bart Teeuwisse <bartt>
Tue 22 Jul 2008 05:59:36 PM UTC, comment #4: 

Hi,

I have good news: rdiff-backup now does an even better job with Unicode filenames. The error first reported below is now properly fixed, and does not require Python 3.

The fix will be present in the next release of rdiff-backup (probably 1.2.0).

Andrew

Andrew Ferguson <owsla>
Group administrator
Fri 04 Jul 2008 02:16:19 AM UTC, comment #3: 

Hi,

Thank you for reporting this error.

I have corrected the problem in CVS -- rdiff-backup will no longer have a fatal error if it cannot handle an unknown Unicode character. The fix will be present in rdiff-backup versions 1.1.17 and above.

Python 3 / 2.6 will introduce much better support for Unicode in Python. The plan is for the next edition of rdiff-backup development (1.3.x and beyond) to include complete support for Unicode (and never encounter an 'unknown' character).


thanks,
Andrew

Andrew Ferguson <owsla>
Group administrator
Sat 03 May 2008 03:25:01 PM UTC, comment #2: 
Anonymous
Sun 27 Apr 2008 09:15:54 PM UTC, comment #1: 

The problem occured while backing up from an ext3 volume to a NTFS (ntfs3g) volume with rdiff-backup 1.1.15.

Operating System: Ubuntu 7.10.

Hanno Stock <hefe_bia>
Sun 27 Apr 2008 09:11:42 PM UTC, original submission:  

Trace:

Processing changed file hanno/.caff/keys/2008-03-30/XXXXXXXXXXXXX.key.1.XXXXXXXei�_x9f <xxxxxxxxxxxxxxxxxxxxxx>.asc
Exception '[Errno 84] Invalid or incomplete multibyte or wide character: '/media/BIG_BACKUP/home_backup/hanno/.caff/keys/2008-03-30/XXXXXXXXXXXXX.key.1.XXXXXXXei\xc3_x9f <xxxxxxxxxxxxxxxxxxxxxx>.asc'' raised of class '<type 'exceptions.OSError'>':
  File "/var/lib/python-support/python2.5/rdiff_backup/Main.py", line 302, in error_check_Main
    try: Main(arglist)
  File "/var/lib/python-support/python2.5/rdiff_backup/Main.py", line 322, in Main
    take_action(rps)
  File "/var/lib/python-support/python2.5/rdiff_backup/Main.py", line 278, in take_action
    elif action == "backup": Backup(rps[0], rps[1])
  File "/var/lib/python-support/python2.5/rdiff_backup/Main.py", line 344, in Backup
    backup.Mirror(rpin, rpout)
  File "/var/lib/python-support/python2.5/rdiff_backup/backup.py", line 38, in Mirror
    DestS.patch(dest_rpath, source_diffiter)
  File "/var/lib/python-support/python2.5/rdiff_backup/backup.py", line 225, in patch
    ITR(diff.index, diff)
  File "/var/lib/python-support/python2.5/rdiff_backup/rorpiter.py", line 281, in _call_
    last_branch.fast_process(*args)
  File "/var/lib/python-support/python2.5/rdiff_backup/backup.py", line 519, in fast_process
    self.CCPP.get_rorps(index), self.basis_root_rp)
  File "/var/lib/python-support/python2.5/rdiff_backup/longname.py", line 200, in get_mirror_inc_rps
    mirror_rp, alt_mirror, alt_inc = mir_triple_new(new_rorp)
  File "/var/lib/python-support/python2.5/rdiff_backup/longname.py", line 171, in mir_triple_new
    mirror_rp = check_new_index(mirror_root, new_rorp.index)
  File "/var/lib/python-support/python2.5/rdiff_backup/longname.py", line 125, in check_new_index
    rp = wrap_call(base.new_index, index)
  File "/var/lib/python-support/python2.5/rdiff_backup/longname.py", line 111, in wrap_call
    try: result = func(*args)
  File "/var/lib/python-support/python2.5/rdiff_backup/rpath.py", line 1040, in new_index
    return self.__class__(self.conn, self.base, index)
  File "/var/lib/python-support/python2.5/rdiff_backup/rpath.py", line 757, in _init_
    else: self.setdata()
  File "/var/lib/python-support/python2.5/rdiff_backup/rpath.py", line 781, in setdata
    self.data = self.conn.C.make_file_dict(self.path)

Traceback (most recent call last):
  File "/usr/bin/rdiff-backup", line 23, in <module>
    rdiff_backup.Main.error_check_Main(sys.argv[1:])
  File "/var/lib/python-support/python2.5/rdiff_backup/Main.py", line 302, in error_check_Main
    try: Main(arglist)
  File "/var/lib/python-support/python2.5/rdiff_backup/Main.py", line 322, in Main
    take_action(rps)
  File "/var/lib/python-support/python2.5/rdiff_backup/Main.py", line 278, in take_action
    elif action == "backup": Backup(rps[0], rps[1])
  File "/var/lib/python-support/python2.5/rdiff_backup/Main.py", line 344, in Backup
    backup.Mirror(rpin, rpout)
  File "/var/lib/python-support/python2.5/rdiff_backup/backup.py", line 38, in Mirror
    DestS.patch(dest_rpath, source_diffiter)
  File "/var/lib/python-support/python2.5/rdiff_backup/backup.py", line 225, in patch
    ITR(diff.index, diff)
  File "/var/lib/python-support/python2.5/rdiff_backup/rorpiter.py", line 281, in _call_
    last_branch.fast_process(*args)
  File "/var/lib/python-support/python2.5/rdiff_backup/backup.py", line 519, in fast_process
    self.CCPP.get_rorps(index), self.basis_root_rp)
  File "/var/lib/python-support/python2.5/rdiff_backup/longname.py", line 200, in get_mirror_inc_rps
    mirror_rp, alt_mirror, alt_inc = mir_triple_new(new_rorp)
  File "/var/lib/python-support/python2.5/rdiff_backup/longname.py", line 171, in mir_triple_new
    mirror_rp = check_new_index(mirror_root, new_rorp.index)
  File "/var/lib/python-support/python2.5/rdiff_backup/longname.py", line 125, in check_new_index
    rp = wrap_call(base.new_index, index)
  File "/var/lib/python-support/python2.5/rdiff_backup/longname.py", line 111, in wrap_call
    try: result = func(*args)
  File "/var/lib/python-support/python2.5/rdiff_backup/rpath.py", line 1040, in new_index
    return self.__class__(self.conn, self.base, index)
  File "/var/lib/python-support/python2.5/rdiff_backup/rpath.py", line 757, in _init_
    else: self.setdata()
  File "/var/lib/python-support/python2.5/rdiff_backup/rpath.py", line 781, in setdata
    self.data = self.conn.C.make_file_dict(self.path)
OSError: [Errno 84] Invalid or incomplete multibyte or wide character: '/media/BIG_BACKUP/home_backup/hanno/.caff/keys/2008-03-30/XXXXXXXXXXXXX.key.1.XXXXXXXei\xc3_x9f <xxxxxxxxxxxxxxxxxxxxxx>.asc'

Anonymous

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by bartt (Posted a comment)
  • -email is unavailable- added by owsla (Posted a comment)
  • -email is unavailable- added by hefe_bia (Posted a comment)
  •  

    There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.

    Only logged-in users can vote.

     

    Follow 2 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2008-07-04 owsla StatusNone Fixed
        Open/ClosedOpen Closed

    Back to the top

    Powered by Savane 3.13-02a9.
    Corresponding source code