[prev in list] [next in list] [prev in thread] [next in thread] 

List:       wget
Subject:    Re: weird behavior while mirroring an https url
From:       Konstantin Vayner <konstantin () appcell ! com>
Date:       2004-11-15 3:57:09
Message-ID: 41982915.9020701 () appcell ! com
[Download RAW message or body]

Me again :)

Disregard my previous emails (sorry for bothering:))
Found the source of the problem: keepalive

--no-http-keep-alive works just fine

P.S. hopefully, this will save a little time to someone else , too :)

Regards,
    Konstantin

Konstantin Vayner wrote:

> Moreinfo:
>
> strace output:
>
> write(3, 
> "\25\3\1\0\22\256#\31S\233\225f?I\245R\250\2021\33\331\267"..., 23) = 23
> read(3, 0x8092458, 5)                   = -1 ECONNRESET (Connection 
> reset by peer)
>
> here (on read() call it waits those 2 and a half minutes)
>
> Regards,
>    Konstantin
>
> Konstantin Vayner wrote:
>
>> Hi List,
>>
>> i am trying to mirror a file from https url, wget hangs when the file 
>> is already on local...
>> here's the example that fails for me (just picked some image from 
>> godaddy site):
>>
>> *wget -m https://images.godaddy.com/assets/home/gd_logo_make.jpg*
>>
>> ---
>> on first run everything is fine, the file is retrieved, directories 
>> created, perfect!
>> ---
>>
>> /$ wget -m https://images.godaddy.com/assets/home/gd_logo_make.jpg
>> --05:22:35--  https://images.godaddy.com/assets/home/gd_logo_make.jpg
>>           => `images.godaddy.com/assets/home/gd_logo_make.jpg'
>> Resolving images.godaddy.com... 64.202.167.78
>> Connecting to images.godaddy.com[64.202.167.78]:443... connected.
>> HTTP request sent, awaiting response... 200 OK
>> Length: 4,298 [image/jpeg]
>>
>> 100%[=================================================================================>] 
>> 4,298         --.--K/s           05:22:36 (42.70 MB/s) - 
>> `images.godaddy.com/assets/home/gd_logo_make.jpg' saved [4298/4298]
>>
>>
>> FINISHED --05:22:36--
>> Downloaded: 4,298 bytes in 1 files
>> /
>> ---
>> then i rerun the same command again (which should actually say that 
>> the file is already there and is not changed...) but:
>> ---
>>
>> /$ wget -m https://images.godaddy.com/assets/home/gd_logo_make.jpg
>> --05:25:02--  https://images.godaddy.com/assets/home/gd_logo_make.jpg
>>           => `images.godaddy.com/assets/home/gd_logo_make.jpg'
>> Resolving images.godaddy.com... 64.202.167.78
>> Connecting to images.godaddy.com[64.202.167.78]:443... connected.
>> HTTP request sent, awaiting response... 200 OK
>> Length: 4,298 [image/jpeg]
>> /
>> ---
>> at this point wget hangs for a VERY long time (after more than 2 
>> minutes(!) it does produce the message about the fact file is 
>> unchanged... but i'd say it's kinda very long delay...
>> ---
>>
>> /Server file no newer than local file 
>> `images.godaddy.com/assets/home/gd_logo_make.jpg' -- not retrieving.
>>
>>
>> FINISHED --05:27:24--
>> Downloaded: 0 bytes in 0 files
>>
>> / ---
>> This has been tested on debian sarge, debian sid and fedora core 2, 
>> all with same result.
>> Is there something i am missing here or is that realy wget misbehavior?
>> What do you suggest (in either case)?
>>
>> P.S. also tried lftp to mirror the file, but it (lftp) seems to 
>> require directory listings enabled on a target server which, in most 
>> cases, may not be done... (and why the hell requesting directory 
>> listings when i specifically target a file anyway? :))
>>
>> Kind Regards,
>>    Konstantin
>>
>
>

[prev in list] [next in list] [prev in thread] [next in thread]