[prev in list] [next in list] [prev in thread] [next in thread] 

List:       hadoop-user
Subject:    Re: Who splits the file into blocks
From:       Harsh J <harsh () cloudera ! com>
Date:       2013-03-31 17:32:54
Message-ID: CAOcnVr0fa+tN+TQ5Q6cZSQ3imMcsfYjRqO-qkJF3Yss_+HAxKQ () mail ! gmail ! com
[Download RAW message or body]

The client splits the file. The block size attribute is a per-file
one, sent along with the file creation request. Blocks are requested
as-it-goes, not pre-allocated.

On Sun, Mar 31, 2013 at 2:15 PM, Sai Sai <saigraph@yahoo.in> wrote:
> Here is my understanding about putting a file into hdfs:
> A client contacts name node and gets the location of blocks where it needs
> to put the blocks in data nodes.
> But before this how does the name node know how many blocks it needs to
> split a file into.
> Who splits the file is it the client itself or is it the name node.
> Since the file is never written to the name node so there is no chance it is
> the name node.
> Please clarify.
> Thanks
> Sai
>



-- 
Harsh J
[prev in list] [next in list] [prev in thread] [next in thread]