Wed 14 Nov 2007 07:34:11 PM UTC, original submission:
I have a small glusterfs setup with 6 machines (the configuration for the server and client are attached).
A summary of the setup is this:
- I have 3 mirrored volumes composed to 2 machines each using AFR
- The AFR volumes are unified, and the namespace is also AFRed.
- I have tried the ALU scheduler in the attached configuration, but the error occurs regardless.
- The computers are connected via a 1000Mbit switch.
The error occurs when I try to rsync a lot of files onto the glusterfs, using rsync as follows:
rsync -av /etc /usr /bin /sbin /dbs /home-local /lib /opt /root /share /src /srv /sys /var /mnt/gluster-unify/backup/
/mnt/gluster-unify/ is empty at the start of the test.
Many files are synced properly, but many also come up with an error similar to this:
rsync: mkstemp "/mnt/gluster-unify/backup/etc/gconf/gconf.xml.schemas/schemas/apps/stickynotes_applet/settings/.%gconf.xml.b7bb0P" failed: Function not implemented (38)
The same rsync command works fine on local storage.
Now, a perhaps related error occurs when I try to delete all of the files in the glusterfs using the following command:
rm -rf /mnt/gluster-unify/*
The error returned is:
rm: FATAL: cannot ensure `/mnt/gluster-unify/backup/etc/gconf/gconf.xml.schemas/schemas/apps/gnumeric/core/sort' (returned to via ..) is safe: Input/output error
In both cases, the log files on the machines remain silent.
Last night glusterfs continually crashed with the same setup using rsync but I can't seem to reproduce it this morning.
If there is any additional information that you need, please let me know.
|