maindavfs2 - Support: sr #107864, davfs2 does not clear the cache

 
 

sr #107864: davfs2 does not clear the cache

Submitter:  Hans Schulz <hschulz>
Submitted:  Sat 05 Nov 2011 08:14:31 AM UTC
   
 
Category:  None Priority:  5 - Normal
Severity:  5 - Blocker Status:  Need Info
Privacy:  Public Assigned to:  _71007
Open/Closed:  Closed Operating System:  GNU/Linux
* Mandatory Fields

Add a New Comment Rich Markup
   

Sat 12 Nov 2011 12:03:39 PM UTC, comment #2: 

Thanks for your reply, very useful since I was able to look in the right direction now!
I had already checked that a single file was correctly being uploaded to the server although I noticed that it took very long and it used a lot of network resources, which puzzled me a bit.

I started to turn on only debug cache and the syslog reported that the cache size was exceeded. I increased the cache from 5 MiB to 50000 MiB. So now I have to wait and see whether this solved the issue.

BTW: I make backups using duplicity, which creates its own manifests etc. in a local cache. Based on the local manifests duplicity produces encrypted .gz archives that are then transferred to the remote server. So there is no timestamp checking directly with files on the remote server.

Thanks again and I'll keep you posted
cheers
hans

Hans Schulz <hschulz>
Sun 06 Nov 2011 07:10:33 PM UTC, comment #1: 

No davfs2 does not clear the cache at umount. The files stay in cache to avoid downloading of unchanged files when it is mounted again.
davfs2 will delete files in the cache when the cache size exceeds the configured maximum size. But it will never delete files that are open or that have been changed localy and not yet been uploaded to the server.
When files are generated or changed locally, davfs2 will upload them to the server some seconds after they are closed. If the upload is successful it will not try to upload it again as long as the file is unchanged.

When the cache is ever growing this usually means, that uploading to the server does not work. Please check wether the files you created or changed locally are really uploaded to the server.

You mentioned backup scripts. If these scripts rely on time stamps there may be a problem. Because uploads to the server are done asynchronously the time stamps on the server side may be different form the time stamps davfs2 stores locally. This is not aproblem as long as the file system is mounted and for files that are kept it is not even a problem after umount and mout. But for files that are not kept in the cacche davfs2 will take the time stamps from the server when the file system is mounted. This time stamp will in many cases be newer than what you sow when it was mounted the last time.

You can savely remove the the cache when the file system is not mounted. The cache directory contains subdirectories for each davrfs2 file system. You can easily recognize it by the name. Just remove the complete subdirectory with all its files. When the file system is mounted the next time davfs2 will build a new cache directory.

If none of the above helps to solve the issue, please do this:
- remove the cache subdirectory
- add option 'debug most'
- mount the file system
- create just one small file
- unmount the file system
- create a copy of the file 'index' in the cache subdirectory
- mount again
- wait about 20 seconds
- unmount
- search for the debug logs in your log file
- send the debug log and the index file
- report any error messages you may get in full length

Cheers
Werner


- <_71007>
Sat 05 Nov 2011 08:14:31 AM UTC, original submission:  

When I installed my new linux box, using the AMD64 version of Ubuntu 11.04, I copied my davfs.conf (attached) and backup scripts from the old box, with no changes. On the new box I noticed that files are incrementally written to /var/cache/davfs/<my webdav mount> but not deleted after a succesful umount. Result is that the next time I mount and then umount the remote webdav server, the entire - ever growing - contents of the cache are again written to the webdav server, taking tens of hours now for a umount to complete.

What could cause this?

Hans Schulz <hschulz>

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

Attached Files
file #24304:  davfs2.conf added by hschulz (2KiB - application/octet-stream)

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by _71007 (Posted a comment)
  • -email is unavailable- added by hschulz (Submitted the item)
  •  

    There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.

    Only logged-in users can vote.

     

    Follow 4 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2014-04-20 _71007 Open/ClosedOpen Closed
    2011-11-06 _71007 StatusNone Need Info
        Assigned toNone _71007
    2011-11-05 hschulz Attached File- Added davfs2.conf, #24304

    Back to the top

    Powered by Savane 3.13-cf05.
    Corresponding source code