bugrdiff-backup - Bugs: bug #23080, rdiff-backup fails on file with...

 
 

bug #23080: rdiff-backup fails on file with unknown unicode character

Submitted by:  None
Submitted on:  Sun 27 Apr 2008 09:11:42 PM UTC  
 
Category: NoneSeverity: 3 - Normal
Item Group: NoneStatus: Fixed
Privacy: PublicAssigned to: None
Open/Closed: Closed

Add a New Comment(Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Sun 01 Mar 2009 04:30:15 AM UTC, comment #5:

I just ran into this problem with rdiff-backup 1.2.5. Backing up a Windows NTFS volume to an Ubuntu ntfs3g volume:

Exception '[Errno 84] Invalid or incomplete multibyte or wide character: '/media/netdrive/backups/bartt/My Music/iTunes/iTunes Music/Ali Farka Tour\xe9'' raised of class '<type 'exceptions.OSError'>':
File "rdiff_backup\Main.pyc", line 304, in error_check_Main
File "rdiff_backup\Main.pyc", line 324, in Main
File "rdiff_backup\Main.pyc", line 280, in take_action
File "rdiff_backup\Main.pyc", line 346, in Backup
File "rdiff_backup\backup.pyc", line 38, in Mirror
File "rdiff_backup\connection.pyc", line 450, in _call_
File "rdiff_backup\connection.pyc", line 370, in reval

Traceback (most recent call last):
File "rdiff-backup", line 30, in <module>
File "rdiff_backup\Main.pyc", line 304, in error_check_Main
File "rdiff_backup\Main.pyc", line 324, in Main
File "rdiff_backup\Main.pyc", line 280, in take_action
File "rdiff_backup\Main.pyc", line 346, in Backup
File "rdiff_backup\backup.pyc", line 38, in Mirror
File "rdiff_backup\connection.pyc", line 450, in _call_
File "rdiff_backup\connection.pyc", line 370, in reval
OSError: [Errno 84] Invalid or incomplete multibyte or wide character: '/media/netdrive/backups/bartt/My Music/iTun
es/iTunes Music/Ali Farka Tour\xe9'
Fatal Error: Lost connection to the remote system

Bart Teeuwisse <bartt>
Tue 22 Jul 2008 05:59:36 PM UTC, comment #4:

Hi,

I have good news: rdiff-backup now does an even better job with Unicode filenames. The error first reported below is now properly fixed, and does not require Python 3.

The fix will be present in the next release of rdiff-backup (probably 1.2.0).

Andrew

Andrew Ferguson <owsla>
Project Administrator
Fri 04 Jul 2008 02:16:19 AM UTC, comment #3:

Hi,

Thank you for reporting this error.

I have corrected the problem in CVS -- rdiff-backup will no longer have a fatal error if it cannot handle an unknown Unicode character. The fix will be present in rdiff-backup versions 1.1.17 and above.

Python 3 / 2.6 will introduce much better support for Unicode in Python. The plan is for the next edition of rdiff-backup development (1.3.x and beyond) to include complete support for Unicode (and never encounter an 'unknown' character).

thanks,
Andrew

Andrew Ferguson <owsla>
Project Administrator
Sat 03 May 2008 03:25:01 PM UTC, comment #2:

See also https://bugs.edge.launchpad.net/ubuntu/+source/rdiff-backup/+bug/223280

Anonymous
Sun 27 Apr 2008 09:15:54 PM UTC, comment #1:

The problem occured while backing up from an ext3 volume to a NTFS (ntfs3g) volume with rdiff-backup 1.1.15.

Operating System: Ubuntu 7.10.

Hanno Stock <hefe_bia>
Sun 27 Apr 2008 09:11:42 PM UTC, original submission:

Trace:

Processing changed file hanno/.caff/keys/2008-03-30/XXXXXXXXXXXXX.key.1.XXXXXXXei�_x9f <xxxxxxxxxxxxxxxxxxxxxx>.asc
Exception '[Errno 84] Invalid or incomplete multibyte or wide character: '/media/BIG_BACKUP/home_backup/hanno/.caff/keys/2008-03-30/XXXXXXXXXXXXX.key.1.XXXXXXXei\xc3_x9f <xxxxxxxxxxxxxxxxxxxxxx>.asc'' raised of class '<type 'exceptions.OSError'>':
File "/var/lib/python-support/python2.5/rdiff_backup/Main.py", line 302, in error_check_Main
try: Main(arglist)
File "/var/lib/python-support/python2.5/rdiff_backup/Main.py", line 322, in Main
take_action(rps)
File "/var/lib/python-support/python2.5/rdiff_backup/Main.py", line 278, in take_action
elif action == "backup": Backup(rps[0], rps[1])
File "/var/lib/python-support/python2.5/rdiff_backup/Main.py", line 344, in Backup
backup.Mirror(rpin, rpout)
File "/var/lib/python-support/python2.5/rdiff_backup/backup.py", line 38, in Mirror
DestS.patch(dest_rpath, source_diffiter)
File "/var/lib/python-support/python2.5/rdiff_backup/backup.py", line 225, in patch
ITR(diff.index, diff)
File "/var/lib/python-support/python2.5/rdiff_backup/rorpiter.py", line 281, in _call_
last_branch.fast_process(*args)
File "/var/lib/python-support/python2.5/rdiff_backup/backup.py", line 519, in fast_process
self.CCPP.get_rorps(index), self.basis_root_rp)
File "/var/lib/python-support/python2.5/rdiff_backup/longname.py", line 200, in get_mirror_inc_rps
mirror_rp, alt_mirror, alt_inc = mir_triple_new(new_rorp)
File "/var/lib/python-support/python2.5/rdiff_backup/longname.py", line 171, in mir_triple_new
mirror_rp = check_new_index(mirror_root, new_rorp.index)
File "/var/lib/python-support/python2.5/rdiff_backup/longname.py", line 125, in check_new_index
rp = wrap_call(base.new_index, index)
File "/var/lib/python-support/python2.5/rdiff_backup/longname.py", line 111, in wrap_call
try: result = func(*args)
File "/var/lib/python-support/python2.5/rdiff_backup/rpath.py", line 1040, in new_index
return self.__class__(self.conn, self.base, index)
File "/var/lib/python-support/python2.5/rdiff_backup/rpath.py", line 757, in _init_
else: self.setdata()
File "/var/lib/python-support/python2.5/rdiff_backup/rpath.py", line 781, in setdata
self.data = self.conn.C.make_file_dict(self.path)

Traceback (most recent call last):
File "/usr/bin/rdiff-backup", line 23, in <module>
rdiff_backup.Main.error_check_Main(sys.argv[1:])
File "/var/lib/python-support/python2.5/rdiff_backup/Main.py", line 302, in error_check_Main
try: Main(arglist)
File "/var/lib/python-support/python2.5/rdiff_backup/Main.py", line 322, in Main
take_action(rps)
File "/var/lib/python-support/python2.5/rdiff_backup/Main.py", line 278, in take_action
elif action == "backup": Backup(rps[0], rps[1])
File "/var/lib/python-support/python2.5/rdiff_backup/Main.py", line 344, in Backup
backup.Mirror(rpin, rpout)
File "/var/lib/python-support/python2.5/rdiff_backup/backup.py", line 38, in Mirror
DestS.patch(dest_rpath, source_diffiter)
File "/var/lib/python-support/python2.5/rdiff_backup/backup.py", line 225, in patch
ITR(diff.index, diff)
File "/var/lib/python-support/python2.5/rdiff_backup/rorpiter.py", line 281, in _call_
last_branch.fast_process(*args)
File "/var/lib/python-support/python2.5/rdiff_backup/backup.py", line 519, in fast_process
self.CCPP.get_rorps(index), self.basis_root_rp)
File "/var/lib/python-support/python2.5/rdiff_backup/longname.py", line 200, in get_mirror_inc_rps
mirror_rp, alt_mirror, alt_inc = mir_triple_new(new_rorp)
File "/var/lib/python-support/python2.5/rdiff_backup/longname.py", line 171, in mir_triple_new
mirror_rp = check_new_index(mirror_root, new_rorp.index)
File "/var/lib/python-support/python2.5/rdiff_backup/longname.py", line 125, in check_new_index
rp = wrap_call(base.new_index, index)
File "/var/lib/python-support/python2.5/rdiff_backup/longname.py", line 111, in wrap_call
try: result = func(*args)
File "/var/lib/python-support/python2.5/rdiff_backup/rpath.py", line 1040, in new_index
return self.__class__(self.conn, self.base, index)
File "/var/lib/python-support/python2.5/rdiff_backup/rpath.py", line 757, in _init_
else: self.setdata()
File "/var/lib/python-support/python2.5/rdiff_backup/rpath.py", line 781, in setdata
self.data = self.conn.C.make_file_dict(self.path)
OSError: [Errno 84] Invalid or incomplete multibyte or wide character: '/media/BIG_BACKUP/home_backup/hanno/.caff/keys/2008-03-30/XXXXXXXXXXXXX.key.1.XXXXXXXei\xc3_x9f <xxxxxxxxxxxxxxxxxxxxxx>.asc'

Anonymous

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by bartt (Posted a comment)
  • -unavailable- added by owsla (Posted a comment)
  • -unavailable- added by hefe_bia (Posted a comment)
  •  

    Do you think this task is very important?
    If so, you can click here to add your encouragement to it.
    This task has 0 encouragements so far.

    Only logged-in users can vote.

     

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 2 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Fri 04 Jul 2008 02:16:19 AM UTCowslaStatusNone=>Fixed
      Open/ClosedOpen=>Closed

    Back to the top


    Powered by Savane 3.1-cleanup1