icewind1991/files_external_dropbox

Some subfolders will never sync

Opened this issue · 15 comments

GAS85 commented

Hi, I noticed that after latest master upgrade, root sync issue was solved, but I've noticed that API2 Dropbox folder is smaller than it should be...
image

The thing is - I still have APIv1 enabled and use both of them, but it is time limited:
image

If I discover subfolders, some of them has different size. I could not really find what exactly is wrong with not synced folders, like path is too long or files fas some strange symbols in names, nothing.
image

php occ files:scan --all was executed many times, does not solve the issue.

edited:
Just checked statistic and new App with APIv2 creates around 5k API calls per day, and App with APIv1 around 300 API calls per day.
image
image

Can you provide the names of some of the incorrect folders?

GAS85 commented

I found some interesting thing, all corrupted folder are listed on APIv2 with creation date 01.01.1970:
This I can see only if connect via webdav

... webdav/Dropbox-gas_A2/Other/OLD$ ls -la
итого 1080
drwx------ 1 user user      0 Dez 29 11:38 .
drwx------ 1 user user      0 Dez 29 11:38 ..
...
drwx------ 1 user user      0 Jan  1  1970 Hurgada
...
drwx------ 1 user user      0 Jan  1  1970 Nsk 22122013

So path will be like
.../Dropbox-gas_A2/Other/OLD/Hurgada

Or this is other examples:

webdav/Dropbox-gas_A2/Other/OLD$ ls -la ../../Share/ | grep 1970
drwx------ 1 user user        0 Jan  1  1970 Knaus

path is /Dropbox-gas_A2/Share/Knaus
and
/Dropbox-gas_A2/Share/Master
Nothing special - 0 Files.

I will try to recreate APIv2 Dropbox. Could it be that issue comes because of update of this app?

I seem to be seeing this as well. In my case it's files in my YNAB folder.

Dropbox:\Apps\... (these are ok)
Dropbox:\Camera Uploads\... (these are ok)
Dropbox:\YNAB\Exports\... (files missing, directory empty)
Dropbox:\YNAB\Lisa's Budget 2018~5F8411EF.ynab4\... (files and direcotries missing, directory empty)
Dropbox:\YNAB\My Budget 2018~9D9A9073.ynab4\... (files and direcotries missing, directory empty)
Dropbox:\YNAB\My Budget~C022A36D.ynab4\... (files and direcotries missing, directory empty)
GAS85 commented

Just checked with other user that we have Dropbox shares... The same folder is corrupted "/Share/Master". But for me it is empty, and for user 2 it contains subfolders, but 0 files at all.
Originally it has subfolders and files everywhere.

It looks like all directories whose names begin with uppercase letters are not synced. Can anyone confirm that?

GAS85 commented

Not really, I have more folders with uppercase letters at the begging, but not all of them have trouble.

Can you try re-scanning the storage.

occ files:scan --path /$user/files/Path/To/Dropbox
GAS85 commented

I did it before and I have a cron job twice a day to run this rescan scrip: https://github.com/GAS85/nextcloud_scripts/blob/master/nextcloud-file-sync.sh there was no positive effect at all. I will try to run command manually this evening to do the test.

hpfmn commented

For me is also one folder not synced and this is a folder that is also synced with another app. It is all small letters - so it has nothing to do with capital letters.

hpfmn commented

If it is of any interest I used the owncloud version of this plugin and didn't have the issue for me.

GAS85 commented

Size is still 0 for same folders.

zpv commented

@GAS85
I took the latest plugin from ownCloud and made it compatible with Nextcloud using icewind1991's original patch.

https://github.com/zpv/files_external_dropbox

It has been working fine for me so far and fixes the missing files/subdirectories the current version of this experiences.

hpfmn commented

@zpv it is not possible to activate your plugin... but if just updating the base helps maybe @icewind1991 should consider this?

zpv commented

@hpfmn Latest commit should be working now. Forgot to remove a line in the metadata regarding ownCloud dependency.

hpfmn commented

I think the problem is commit 03ba610 - for some reason it helps to put everything to lower case.