[prev in list] [next in list] [prev in thread] [next in thread] 

List:       wget
Subject:    Re: wget bug in finding files after disconnect
From:       Georg Schulte Althoff <georg.news () webzuhause ! de>
Date:       2006-11-18 20:04:08
Message-ID: Xns987FD66BB8AD1georgnewswebzuhaused () 80 ! 91 ! 229 ! 5
[Download RAW message or body]

Paul Bickerstaff <paul.bickerstaff@infoics.co.nz> wrote in 
news:1163646510.7815.69.camel@soho.infoics.co.nz:

> I'm using wget version "GNU Wget 1.10.2 (Red Hat modified)" on a fedora
> core5 x86_64 system (standard wget rpm). I'm also using version 1.10.2b
> on a WinXP laptop. Both display the same faulty behaviour which I don't
> believe was present in earlier versions of wget that I've used.
> 
> When the internet connection disconnects wget automatically tries to
> redownload the file (starting from where it was disconnected).
> 
> The problem is that it is consistently failing to find the file. The
> following output shows what is happening.
> 
> wget -c ftp://bio-mirror.jp.apan.net/pub/biomirror/blast/nr.*.tar.gz
[...]
> Retrying.
> 
> --14:13:54--
> ftp://bio-mirror.jp.apan.net/pub/biomirror/blast/nr.00.tar.gz
>   (try: 2) => `nr.00.tar.gz'
> Connecting to bio-mirror.jp.apan.net|150.26.2.58|:21... connected.
> Logging in as anonymous ... Logged in!
> ==> SYST ... done.    ==> PWD ... done.
> ==> TYPE I ... done.  ==> CWD not required.
> ==> PASV ... done.    ==> REST 315859600 ... done.
> ==> RETR nr.00.tar.gz ...
> No such file `nr.00.tar.gz'.
> 
[...]
> 
> I have checked and the files are there and have not moved or altered in
> any way.
> 
> I believe that the problem is almost certainly associated with the
> logged item "CWD not required" after a reconnect.
> 
> Cheers

I encountered the same situation and solved it this way:
Call wget with -B (--base) option to set base directory
and with -i (--input-file) to point to a file containing
the relative URLs you want to download.

Not tested, but it should look like this
  wget 
    -c 
    --base=ftp://bio-mirror.jp.apan.net/pub/biomirror/blast/
    --input-file=urls.txt
with urls.txt containing
  nr.*.tar.gz

Hope it helps you.

Georg

[prev in list] [next in list] [prev in thread] [next in thread]