mainstoreBackup - Support: sr #107126, Are lateLinks and block files not...

 
 

sr #107126: Are lateLinks and block files not compatible?

Submitter:  None
Submitted:  Mon 16 Nov 2009 08:02:59 PM UTC
   
 
Category:  None Priority:  5 - Normal
Severity:  3 - Normal Status:  Done
Privacy:  Public Assigned to:  None
Originator Email:  -email is unavailable- Open/Closed:  Open
Operating System:  None
* Mandatory Fields

Add a New Comment Rich Markup
   

Fri 20 Nov 2009 09:19:32 AM UTC, comment #4: 

You can use openvpn with nfs until I changed the useless handling of that file. (like always, next release ;-) ).

Heinz-Josef Claes <hjclaes>
Group administrator
Thu 19 Nov 2009 07:10:24 PM UTC, comment #3: 

Thanks for the response.  My hope was to use storeBackup --lateLinks over sshfs, and then run storeBackupUpdateBackup to create hard links where appropriate.  That works, except for block files.  Everything works great over NFS, but I'm looking for something that will work remotely---when an NFS mount isn't possible.  I had been using rsync for this, but as I'm sure you're aware, storeBackup has many advantages over a simple rsync backup.

Anonymous
Wed 18 Nov 2009 12:17:40 PM UTC, comment #2: 

First of all, sorry for the late response :-(

storeBackup is based on hard links. Files or block of files which are identified via md5sums as beeing equal (in a former or the same backup) are hard linked to save disk space.

So sorry, it's not possible up to now to use storebackup in that way.

I need to make some additional test - perhaps I can make some changes so (only the) combination of --lateLinks and sshfs will be possible (you have to run storeBackupUpdateBackup on the remote site later).

btw.,
--checkBlocksSuffix \*
must be
--checkBlocksSuffix '.*'

Heinz-Josef Claes <hjclaes>
Group administrator
Mon 16 Nov 2009 09:53:37 PM UTC, comment #1: 

Hmm, for some reason marked up lines in the original submission aren't showing up correctly.  Without any markup, this is what I meant to say:

I am trying to run storeBackup with --lateLinks --checkBlocksSuffix \*
--checkBlocksMinSize 200M

The first time through everything works fine.  The next time I try to update
the backup, it dies with

ERROR     2009.11.16 12:21:20 22435 cannot link
</Net/backup/root/2009.11.15_00.40.58/home/user/.googleearth/Cache/dbCache.dat/.md5BlockCheckSums.bz2>
</Net/backup/root/2009.11.16_12.15.25/home/user/.googleearth/Cache/dbCache.dat/.md5BlockCheckSums.bz2>

where /Net/backup is an sshfs mount of a remote filesystem (so hard links are
not possible).

This seems to follow from the code where starting on line 5761 it says

                    if ($lateLinks)
                    {
                        my $from = "$backupDir/$file";
                        my $to = "$targetDir/$file";
                        $prLog->print('-kind' => 'E',
                                      '-str' =>
                                      ["cannot link
<$from/$blockCheckSumFile.bz2>".
                                      " <$to/$blockCheckSumFile.bz2>"],
                                      '-exit' => 1)
                            unless (link "$from/$blockCheckSumFile.bz2",
                                    "$to/$blockCheckSumFile.bz2");


Am I not getting the configuration options correct, or is what I want to do
not possible?

Anonymous
Mon 16 Nov 2009 08:02:59 PM UTC, original submission:  

I am trying to run storeBackup with --lateLinks --checkBlocksSuffix \* --checkBlocksMinSize 200M

The first time through everything works fine.  The next time I try to update the backup, it dies with

ERROR     2009.11.16 12:21:20 22435 cannot link </Net/backup/root/2009.11.15_00.40.58/home/user/.googleearth/Cache/dbCache.dat/.md5BlockCheckSums.bz2> </Net/backup/root/2009.11.16_12.15.25/home/user/.googleearth/Cache/dbCache.dat/.md5BlockCheckSums.bz2>
+verbatim+
where /Net/backup is an sshfs mount of a remote filesystem (so hard links are not possible).

This seems to follow from the code where starting on line 5761 it says
+verbatim+
                    if ($lateLinks)
                    {
                        my $from = "$backupDir/$file";
                        my $to = "$targetDir/$file";
                        $prLog->print('-kind' => 'E',
                                      '-str' =>
                                      ["cannot link <$from/$blockCheckSumFile.bz2>".
                                      " <$to/$blockCheckSumFile.bz2>"],
                                      '-exit' => 1)
                            unless (link "$from/$blockCheckSumFile.bz2",
                                    "$to/$blockCheckSumFile.bz2");
+verbatim+

Am I not getting the configuration options correct, or is what I want to do not possible?

Anonymous

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by hjclaes (Posted a comment)
  • -email is unavailable- added by None (Submitted the item)
  •  

    There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.

    Only logged-in users can vote.

     

    Follows 1 latest change.

    Date Changed by Updated Field Previous Value => Replaced by
    2012-05-31 hjclaes StatusNone Done

    Back to the top

    Powered by Savane 3.13-f8d8.
    Corresponding source code