[prev in list] [next in list] [prev in thread] [next in thread] 

List:       hadoop-user
Subject:    Re: Mismatch in length of source:
From:       Ulul <hadoop () ulul ! org>
Date:       2017-01-02 15:05:26
Message-ID: 314911d7-18aa-e9c0-0cce-0b1abbf355da () ulul ! org
[Download RAW message or body]

Hi

I can't remember the exact error message but distcp consistently fails 
when trying to copy open files. Is it your case ?

Workaround it to snapshot prior to copying

Ulul


On 31/12/2016 19:25, Aditya exalter wrote:
> Hi All,
>       A very happy new year to ALL.
>
>   I am facing issue while executing distcp between two different clusters,
>
> Caused by: java.io.IOException: Mismatch in length of 
> source:hdfs://ip1/xxxxxxxxxx/xxxxx and 
> target:hdfs://nameservice1/xxxxxx/.distcp.tmp.attempt_1483200922993_0056_m_000011_2
>
> I tried using -pb and -skipcrccheck
>
>  hadoop distcp -pb -skipcrccheck -update hdfs://ip1/xxxxxxxxxx/xxxxx 
> hdfs:///xxxxxxxxxxxx/
>
> hadoop distcp -pb  hdfs://ip1/xxxxxxxxxx/xxxxx hdfs:///xxxxxxxxxxxx/
>
> hadoop distcp -skipcrccheck -update 
> hdfs://ip1/xxxxxxxxxx/xxxxx hdfs:///xxxxxxxxxxxx/
>
>
> but nothing seems to be working .Any solutions please.
>
>
> Regards,
> Aditya.


---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org

[prev in list] [next in list] [prev in thread] [next in thread]