[prev in list] [next in list] [prev in thread] [next in thread] 

List:       hadoop-user
Subject:    WebHDFS checksumming on write/read
From:       Anthony Hsu <ahsu () linkedin ! com ! INVALID>
Date:       2017-01-31 19:26:47
Message-ID: CANtSFbfNO4qJOtHxmN-2nJXgc-NM=w4HOoPHUbN1-UO8XT2sww () mail ! gmail ! com
[Download RAW message or body]

Hi,

When writing files to HDFS using the WebHdfsFileSystem, does WebHDFS
transparently do checksumming to ensure the bytes were transferred
correctly?

On the flip side, when reading files from HDFS using WebHDFS, does WebHDFS
transparently checksum the bytes transferred to the client?

I did some searching online and looked briefly through the code, but I
couldn't get a definitive answer.

Best,
Anthony

[Attachment #3 (text/html)]

<div dir="ltr">Hi,<div><br></div><div>When writing files to HDFS using the \
WebHdfsFileSystem, does WebHDFS transparently do checksumming to ensure the bytes \
were transferred correctly?</div><div><br></div><div>On the flip side, when reading \
files from HDFS using WebHDFS, does WebHDFS transparently checksum the bytes \
transferred to the client?</div><div><br></div><div>I did some searching online and \
looked briefly through the code, but I couldn&#39;t get a definitive \
answer.</div><div><br></div><div>Best,</div><div>Anthony</div></div>



[prev in list] [next in list] [prev in thread] [next in thread]