TurboGit/hubicfuse

rsync error: error in file IO (code 11)

Closed this issue · 4 comments

Hi,

I'm trying to sync backups (BackupPC) on a backup server in my LAN with Hubic, using rsync. rsync copies a bunch of files, runs about 1.5 hour, then exits with code 11.

I checked SSL thread support as suggested in issue #98 : enabled.

/etc/fstab line (I tried with and without no_splice_write,no_splice_move with the same result) :

hubicfuse /mnt/hubic fuse noauto_cache,sync_read,allow_other,no_splice_write,no_splice_move      0       0

rsync command :

rsync -az --delete --exclude-from=$EXCLUDE_FILE --log-file=$LOG_FILE /var/lib/backuppc /mnt/hubic/default/backup

Platform : Debian server Jessie 8.2
Kernel : 3.16.0-4-686-pae #1 SMP Debian 3.16.7-ckt20-1+deb8u1 (2015-12-14) i686 GNU/Linux

Log file sample : filter "failed" string (BackupPC.sock is a special socket file ; no big deal)

root@radada:~# grep "failed" /var/log/rsync.log
2016/01/07 12:02:07 [22931] rsync: mknod "/mnt/hubic/default/backup/backuppc/log/BackupPC.sock" failed: Function not implemented (38)
2016/01/07 13:05:28 [22931] rsync: write failed on "/mnt/hubic/default/backup/backuppc/cpool/f/b/c/fbc68e86ab0fdfe11ccfe25ff077b94e": Operation not permitted (1)

Log file sample : end of file

root@radada:~# tail /var/log/rsync.log
2016/01/07 13:05:28 [22931] .d..tpog... backuppc/pc/vostro-w7/5/fysy/fLettres types/
2016/01/07 13:05:28 [22931] .d..tpog... backuppc/pc/vostro-w7/5/fysy/fimages/
2016/01/07 13:05:28 [22931] >f..tpog... backuppc/pc/vostro-w7/5/fysy/fimages/attrib
2016/01/07 13:05:28 [22931] .d..tpog... backuppc/pc/vostro-w7/5/fysy/fimages/fresultat/
2016/01/07 13:05:28 [22931] .d..tpog... backuppc/pc/vostro-w7/5/fysy/fsons/
2016/01/07 13:05:28 [22931] .d..tpog... backuppc/pool/
2016/01/07 13:05:28 [22931] .d..tpog... backuppc/trash/
2016/01/07 13:05:28 [22931] rsync: write failed on "/mnt/hubic/default/backup/backuppc/cpool/f/b/c/fbc68e86ab0fdfe11ccfe25ff077b94e": Operation not permitted (1)
2016/01/07 13:05:28 [22931] rsync error: error in file IO (code 11) at receiver.c(393) [receiver=3.1.1]
2016/01/07 13:05:28 [22931] rsync error: error in file IO (code 11) at io.c(1633) [sender=3.1.1]

When I ran configure for the 1st time, it requested various libraries. When I installed them, I noticed that I could choose between multiple implementations, and just picked one randomly until it would compile... So, I ran ldd, hoping someone can possibly point out a wrong choice :

root@radada:~# ldd /usr/local/bin/hubicfuse
        linux-gate.so.1 (0xb77a6000)
        libxml2.so.2 => /usr/lib/i386-linux-gnu/libxml2.so.2 (0xb761b000)
        libcurl-gnutls.so.4 => /usr/lib/i386-linux-gnu/libcurl-gnutls.so.4 (0xb759f000)
        libfuse.so.2 => /lib/i386-linux-gnu/libfuse.so.2 (0xb7564000)
        libssl.so.1.0.0 => /usr/lib/i386-linux-gnu/i686/cmov/libssl.so.1.0.0 (0xb7506000)
        libcrypto.so.1.0.0 => /usr/lib/i386-linux-gnu/i686/cmov/libcrypto.so.1.0.0 (0xb733a000)
        libjson-c.so.2 => /lib/i386-linux-gnu/libjson-c.so.2 (0xb732e000)
        libmagic.so.1 => /usr/lib/i386-linux-gnu/libmagic.so.1 (0xb730a000)
        libpthread.so.0 => /lib/i386-linux-gnu/i686/cmov/libpthread.so.0 (0xb72ed000)
        libc.so.6 => /lib/i386-linux-gnu/i686/cmov/libc.so.6 (0xb7143000)
        libdl.so.2 => /lib/i386-linux-gnu/i686/cmov/libdl.so.2 (0xb713e000)
        libz.so.1 => /lib/i386-linux-gnu/libz.so.1 (0xb7121000)
        liblzma.so.5 => /lib/i386-linux-gnu/liblzma.so.5 (0xb70f8000)
        libm.so.6 => /lib/i386-linux-gnu/i686/cmov/libm.so.6 (0xb70b1000)
        libidn.so.11 => /usr/lib/i386-linux-gnu/libidn.so.11 (0xb707c000)
        librtmp.so.1 => /usr/lib/i386-linux-gnu/librtmp.so.1 (0xb705c000)
        libssh2.so.1 => /usr/lib/i386-linux-gnu/libssh2.so.1 (0xb702e000)
        libnettle.so.4 => /usr/lib/i386-linux-gnu/libnettle.so.4 (0xb6ff9000)
        libgnutls-deb0.so.28 => /usr/lib/i386-linux-gnu/libgnutls-deb0.so.28 (0xb6eb6000)
        libgssapi_krb5.so.2 => /usr/lib/i386-linux-gnu/libgssapi_krb5.so.2 (0xb6e65000)
        libkrb5.so.3 => /usr/lib/i386-linux-gnu/libkrb5.so.3 (0xb6d8f000)
        libk5crypto.so.3 => /usr/lib/i386-linux-gnu/libk5crypto.so.3 (0xb6d5b000)
        libcom_err.so.2 => /lib/i386-linux-gnu/libcom_err.so.2 (0xb6d56000)
        liblber-2.4.so.2 => /usr/lib/i386-linux-gnu/liblber-2.4.so.2 (0xb6d45000)
        libldap_r-2.4.so.2 => /usr/lib/i386-linux-gnu/libldap_r-2.4.so.2 (0xb6ceb000)
        /lib/ld-linux.so.2 (0xb77a9000)
        libhogweed.so.2 => /usr/lib/i386-linux-gnu/libhogweed.so.2 (0xb6cba000)
        libgmp.so.10 => /usr/lib/i386-linux-gnu/libgmp.so.10 (0xb6c2b000)
        libgcrypt.so.20 => /lib/i386-linux-gnu/libgcrypt.so.20 (0xb6b79000)
        libp11-kit.so.0 => /usr/lib/i386-linux-gnu/libp11-kit.so.0 (0xb6b36000)
        libtasn1.so.6 => /usr/lib/i386-linux-gnu/libtasn1.so.6 (0xb6b22000)
        libkrb5support.so.0 => /usr/lib/i386-linux-gnu/libkrb5support.so.0 (0xb6b15000)
        libkeyutils.so.1 => /lib/i386-linux-gnu/libkeyutils.so.1 (0xb6b10000)
        libresolv.so.2 => /lib/i386-linux-gnu/i686/cmov/libresolv.so.2 (0xb6af8000)
        libsasl2.so.2 => /usr/lib/i386-linux-gnu/libsasl2.so.2 (0xb6ada000)
        libgpg-error.so.0 => /lib/i386-linux-gnu/libgpg-error.so.0 (0xb6ac6000)
        libffi.so.6 => /usr/lib/i386-linux-gnu/libffi.so.6 (0xb6abe000)

Regards.

I have the same issue. Any workaround found?

As said in another ticket, rsync is not something we can make to run reliably on hubic.

Or Hubic cannot run reliably with rsync ?
Could you then recommend another method to sync backups on a linux box with Hubic ?

Yes, rsync is not supported by hubic.

On my side I'm using a script that:

  1. look for files in the directory to copy
  2. record files copied by cp in another file
  3. copy only files that are not present on this file

I'm running this script during the night (from midnight to 7am) to avoid using all my bandwidth that I need during the day. My connection is not that fast, I do copy around 2.5Gb per night, but that's just ok for my use.

As you see I'm not using a backup software for this.