mainstoreBackup - Support: sr #107375, storeBackup stalling

 
 

sr #107375: storeBackup stalling

Submitter:  None
Submitted:  Thu 13 May 2010 11:23:06 AM UTC
   
 
Category:  None Priority:  5 - Normal
Severity:  3 - Normal Status:  Done
Privacy:  Public Assigned to:  None
Originator Email:  -email is unavailable- Open/Closed:  Open
Operating System:  GNU/Linux
* Mandatory Fields

Add a New Comment Rich Markup
   

Sat 15 May 2010 05:45:30 PM UTC, comment #3: 

The only reason I can imagine why storebackup may stall (and stalled in the past) is because of network problems (esp. via NFS).

Storebackups starts several programs (fork/exec) in parallel and waits for them to finish (at some point). This could be a "typical" situation where it may "stall" if these processes are stalling.

Can you run your backup (additionally) to a local (usb) drive to check if the problem is originated in the network?

btw, there should be no need to use the saveRam option if 1.5 GB are available - or do you save several millions of files?


Heinz-Josef Claes <hjclaes>
Group administrator
Sat 15 May 2010 12:24:01 PM UTC, comment #2: 

Normal servers via SSHFS

Both OS's are CentOS 5.

About 1.5G of memory free when storeBackup is running (using the saveRam option).

Load is below 0.75 on both servers at peak. Dual quad cores on both.

Anonymous
Sat 15 May 2010 07:44:41 AM UTC, comment #1: 

On what kind of machine do you make the backup (NAS, normal server, OS, memory, ...)?
Do you make your backup over a network? NFS?


Heinz-Josef Claes <hjclaes>
Group administrator
Thu 13 May 2010 11:23:06 AM UTC, original submission:  

StoreBackup appears to constantly stall every few days.

The last line output was:

PROGRESS  2010.05.13 18:12:01 14197 67024 files processed (1.8G, 756M) (1972497738, 792820661)

It's now well after 21:00:00.

Configuration options are below. I've tried both with and without latency option. Love the solution, just wish it'd work!



/usr/local/bin/storeBackup.pl --saveRAM .....

# .configs/global.conf
writeExcludeLog = no
verbose = no
progressReport = 2
printDepth = yes
keepRelative = 1d 3d 7d 31d 100d
exceptRule = '$size > &::SIZE("50M")' or '$file =~ m#error_log$#'  or '$file =~ m#virtfs$#'  or '$file =~ m#tmp$#'  or '$file =~ m#trash$#'  or '$file =~ m#.ssh$#' or '$file =~ m#\.bash.*$#'
ignorePerms = yes
lateLinks = yes
lateCompress = yes
doNotDelete = yes
cpIsGnu = yes
linkSymlinks = yes
highLatency = yes

Anonymous

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by hjclaes (Posted a comment)
  • -email is unavailable- added by None (Submitted the item)
  •  

    There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.

    Only logged-in users can vote.

     

    Follows 1 latest change.

    Date Changed by Updated Field Previous Value => Replaced by
    2012-05-31 hjclaes StatusNone Done

    Back to the top

    Powered by Savane 3.13-f8d8.
    Corresponding source code