mcrapet/plowshare

Some links unprocessed by plowdown

Closed this issue · 5 comments

plowdown works perfectly but some links stay unprocessed. Assume that i have 10 links to download sometimes there are on or two links unprocessed after the end of the task (also uncommented in the listfile). If i restart the command it processes correctly the missing ones. This is an example of command:

plowdown -m myLinkList.txt

Thank you

and the links are ?

how can i reproduce it ?

In my opinnion its very random. Assuming the list-file contains these links :

http://uptobox.com/hvvuk8ek9smk
http://uptobox.com/h1libqcn0qmf
http://uptobox.com/64xnsjatlp3x
http://uptobox.com/l7fj0r6r3zi2
http://uptobox.com/3v4ywc76ahjg
http://uptobox.com/85sfiyki7i4i
http://uptobox.com/3kqn3nqlplbk
http://uptobox.com/rywywka06uul

below i put the console output, as you can see something failed at the line 49-50 so part 5 never downloaded:
line 87 i restarted the script and part 5 download is successful (start-HD-download.sh is just the command i mentionned before) Dont pay attention to the chmod fails. Please copy to nodepad++ or other to see the line numbers

pi@rpi-main /media/Storage/Media/Films/HD $ ~/start-HD-download.sh
Output directory: /media/Storage/Media/Films/HD
Starting download (uptobox): http://uptobox.com/hvvuk8ek9smk
File URL: http://www85.uptobox.com/d/6yysugfufcr76xkq7eyzugbbmne6hkcktqj6fkmqps5ttk32kgtk7zp6/unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part01.rar
Filename: unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part01.rar
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1024M  100 1024M    0     0   297k      0  0:58:40  0:58:40 --:--:--  285k
chmod failed: /media/Storage/Media/Films/HD/unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part01.rar.part
sed: preserving permissions for `/media/Storage/Media/Films/HD/sedFrBasS': Opération non permise
link marked in file `/media/Storage/Media/Films/HD/l-hd-down.txt' (#OK)
/media/Storage/Media/Films/HD/unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part01.rar
Starting download (uptobox): http://uptobox.com/h1libqcn0qmf
Waiting 77 seconds... done           
Waiting 3522 seconds... done            
File URL: http://www85.uptobox.com/d/6yy4qhnufcr76xkq7eyzuxz3p6ayppimjcrewpkoinkq2mi6vge6v43u/unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part02.rar
Filename: unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part02.rar
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1024M  100 1024M    0     0  51200      0  5:49:31  5:49:31 --:--:-- 58868
chmod failed: /media/Storage/Media/Films/HD/unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part02.rar.part
sed: preserving permissions for `/media/Storage/Media/Films/HD/sedEvbPV5': Opération non permise
link marked in file `/media/Storage/Media/Films/HD/l-hd-down.txt' (#OK)
/media/Storage/Media/Films/HD/unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part02.rar
Starting download (uptobox): http://uptobox.com/64xnsjatlp3x
Waiting 2698 seconds... done            
File URL: http://www85.uptobox.com/d/6yy6mevufcr76xkq7ey4iwrppbddpyutmtjsjri7segormlgwdv63mym/unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part03.rar
Filename: unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part03.rar
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1024M  100 1024M    0     0  1378k      0  0:12:40  0:12:40 --:--:-- 1396k
chmod failed: /media/Storage/Media/Films/HD/unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part03.rar.part
sed: preserving permissions for `/media/Storage/Media/Films/HD/sedUGxpsE': Opération non permise
link marked in file `/media/Storage/Media/Films/HD/l-hd-down.txt' (#OK)
/media/Storage/Media/Films/HD/unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part03.rar
Starting download (uptobox): http://uptobox.com/l7fj0r6r3zi2
Waiting 1936 seconds... done            
Waiting 721 seconds... done            
File URL: http://www85.uptobox.com/d/6yyz6hvufcr76xkq7eyz4wjrptaedxyngzroyughv52evisu77myzokw/unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part04.rar
Filename: unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part04.rar
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1024M  100 1024M    0     0  1387k      0  0:12:35  0:12:35 --:--:-- 1396k
chmod failed: /media/Storage/Media/Films/HD/unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part04.rar.part
sed: preserving permissions for `/media/Storage/Media/Films/HD/sed53fPdm': Opération non permise
link marked in file `/media/Storage/Media/Films/HD/l-hd-down.txt' (#OK)
/media/Storage/Media/Films/HD/unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part04.rar
Starting download (uptobox): http://uptobox.com/3v4ywc76ahjg
parse failed (sed): "/start your download/ s/^.*href="\([^"]\+\)".*$/\1/p" (skip -2)
Failed inside uptobox_download(), line 245, uptobox.sh
Failed inside uptobox_download() [1]
Starting download (uptobox): http://uptobox.com/85sfiyki7i4i
Waiting 2696 seconds... done            
File URL: http://www85.uptobox.com/d/6yy7yhvufcr76xkq7ey4uwzeobs5if5ddvkhagkob64vq6nbj4ijvibq/unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part06.rar
Filename: unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part06.rar
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1024M  100 1024M    0     0  1368k      0  0:12:46  0:12:46 --:--:-- 1396k
chmod failed: /media/Storage/Media/Films/HD/unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part06.rar.part
sed: preserving permissions for `/media/Storage/Media/Films/HD/sedkrFTih': Opération non permise
link marked in file `/media/Storage/Media/Films/HD/l-hd-down.txt' (#OK)
/media/Storage/Media/Films/HD/unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part06.rar
Starting download (uptobox): http://uptobox.com/3kqn3nqlplbk
Waiting 1932 seconds... done            
Waiting 721 seconds... done            
File URL: http://www85.uptobox.com/d/6yy3gh5ufcr76xkq7ey4cbjgpa2igjaqeu36rpqz34nwychxfucgzote/unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part07.rar
Filename: unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part07.rar
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1024M  100 1024M    0     0  1393k      0  0:12:32  0:12:32 --:--:-- 1395k
chmod failed: /media/Storage/Media/Films/HD/unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part07.rar.part
sed: preserving permissions for `/media/Storage/Media/Films/HD/sed38NiBI': Opération non permise
link marked in file `/media/Storage/Media/Films/HD/l-hd-down.txt' (#OK)
/media/Storage/Media/Films/HD/unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part07.rar
Starting download (uptobox): http://uptobox.com/rywywka06uul
Waiting 1945 seconds... done            
Waiting 712 seconds... done            
File URL: http://www68.uptobox.com/d/4uy7whfufcr76xkq7eyyafzan7hniprvk7zd646h6ui2viwkwmjhlk25/unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part08.rar
Filename: unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part08.rar
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  972M  100  972M    0     0  1394k      0  0:11:54  0:11:54 --:--:-- 1397k
chmod failed: /media/Storage/Media/Films/HD/unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part08.rar.part
sed: preserving permissions for `/media/Storage/Media/Films/HD/sed2ufcD8': Opération non permise
link marked in file `/media/Storage/Media/Films/HD/l-hd-down.txt' (#OK)
/media/Storage/Media/Films/HD/unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part08.rar
pi@rpi-main /media/Storage/Media/Films/HD $ ~/start-HD-download.sh
Output directory: /media/Storage/Media/Films/HD
Starting download (uptobox): http://uptobox.com/3v4ywc76ahjg
File URL: http://www85.uptobox.com/d/6yy5shvufcr76xkq7ey4cgddn4cuwftwjnjwevy3l4pyp636lnfwhpjn/unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part05.rar
Filename: unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part05.rar
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1024M  100 1024M    0     0  1391k      0  0:12:33  0:12:33 --:--:-- 1395k
chmod failed: /media/Storage/Media/Films/HD/unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part05.rar.part
sed: preserving permissions for `/media/Storage/Media/Films/HD/sedagqbUg': Opération non permise
link marked in file `/media/Storage/Media/Films/HD/l-hd-down.txt' (#OK)
/media/Storage/Media/Films/HD/unthinkable.extended.multi.1080p.bluray.x264.www.zone-telechargement.com.part05.rar
pi@rpi-main /media/Storage/Media/Films/HD $
plowdown  -m list.txt 
Starting download (uptobox): http://uptobox.com/hvvuk8ek9smk
Link is not alive: file not found
link marked in file `list.txt' (#NOTFOUND)
Starting download (uptobox): http://uptobox.com/h1libqcn0qmf
Link is not alive: file not found
link marked in file `list.txt' (#NOTFOUND)
Starting download (uptobox): http://uptobox.com/64xnsjatlp3x
Link is not alive: file not found
link marked in file `list.txt' (#NOTFOUND)
Starting download (uptobox): http://uptobox.com/l7fj0r6r3zi2
Link is not alive: file not found
link marked in file `list.txt' (#NOTFOUND)
Starting download (uptobox): http://uptobox.com/3v4ywc76ahjg
curl: failed with exit code 56
Starting download (uptobox): retry 1/2
curl: failed with exit code 56
Starting download (uptobox): retry 2/2
Link is not alive: file not found
link marked in file `list.txt' (#NOTFOUND)
Starting download (uptobox): http://uptobox.com/85sfiyki7i4i
Link is not alive: file not found
link marked in file `list.txt' (#NOTFOUND)
Starting download (uptobox): http://uptobox.com/3kqn3nqlplbk
Link is not alive: file not found
link marked in file `list.txt' (#NOTFOUND)
Starting download (uptobox): http://uptobox.com/rywywka06uul
Link is not alive: file not found
link marked in file `list.txt' (#NOTFOUND)

I cant reproduce.

Yes sure links are dead.