[prev in list] [next in list] [prev in thread] [next in thread] 

List:       hadoop-dev
Subject:    [jira] [Created] (HADOOP-14255) S3A to delete unnecessary fake directory objects in mkdirs()
From:       "Mingliang Liu (JIRA)" <jira () apache ! org>
Date:       2017-03-29 21:57:41
Message-ID: JIRA.13060181.1490824655000.159115.1490824661698 () Atlassian ! JIRA
[Download RAW message or body]

Mingliang Liu created HADOOP-14255:
--------------------------------------

             Summary: S3A to delete unnecessary fake directory objects in mkdirs()
                 Key: HADOOP-14255
                 URL: https://issues.apache.org/jira/browse/HADOOP-14255
             Project: Hadoop Common
          Issue Type: Sub-task
          Components: fs/s3
            Reporter: Mingliang Liu
            Assignee: Mingliang Liu


In S3AFileSystem, as an optimization, we delete unnecessary fake directory objects if \
that directory contains at least one (nested) file. That is done in closing stream of \
newly created file. However, if the directory becomes non-empty after we just create \
an empty subdirectory, we do not delete its fake directory object though that fake \
directory object becomes "unnecessary".

So in {{S3AFileSystem::mkdirs()}}, we have a pending TODO:
{quote}
  // TODO: If we have created an empty file at /foo/bar and we then call
  // mkdirs for /foo/bar/baz/roo what happens to the empty file /foo/bar/?
  private boolean innerMkdirs(Path p, FsPermission permission)
{quote}

This JIRA is to fix the TODO: provide consistent behavior for a fake directory object \
between its nested subdirectory and nested file by deleting it.

See related discussion in [HADOOP-14236].



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org


[prev in list] [next in list] [prev in thread] [next in thread]