[prev in list] [next in list] [prev in thread] [next in thread] 

List:       hadoop-user
Subject:    Re: accessing HDFS Snapshot using HDFS NFS Gateway
From:       Mukul Kumar Singh <mksingh.apache () gmail ! com>
Date:       2019-05-15 8:12:07
Message-ID: 697e953c-97fa-f254-2bfe-2f0e585a4dc8 () gmail ! com
[Download RAW message or body]

Hi Markus,

HDFS NFS gateway currently does not support snapshots. Following issues 
are tracking this in HDFS.

https://issues.apache.org/jira/browse/HDFS-5084

https://issues.apache.org/jira/browse/HDFS-11315

However we do not have a fix for these jira.

Thanks,

Mukul

On 5/9/19 1:16 AM, Markus.Gierich@fiduciagad.de wrote:
>
> Hi!
>
> I have mounted the HDFS root path over the HDFS NFS Gateway and I'm 
> able to do all kind of file operations. Now I want to read a from a 
> HDFS snapshot using the NFS mount,
>
>
> snapshot in hdfs works and I can see it using hdfs dfs -ls
>
>     hdfs dfs -ls /data/standard/.snapshot/s20190507-063223.621
>
>     Found 2 items
>
>     So when I try a ls command on the nfs mount I get an error.
>
>     ll /mnt/hdfs/data/standard/.snapshot/s20190507-063223.621
>
>     ls: cannot access
>     /mnt/hdfs/data/standard/.snapshot/s20190507-063223.621:
>     Input/output error​
>
>     I'm using HDP 3.1.0
>
>     Any ideas ?
>
>     Best Regards
>
>     MARKUS
>
>
> Fiducia & GAD IT AG | www.fiduciagad.de
> AG Frankfurt a. M. HRB 102381 | Sitz der Gesellschaft: Frankfurt a. M. 
> | USt-IdNr. DE 143582320
> Vorstand: Klaus-Peter Bruns (Vorsitzender), Jens-Olaf Bartels,
> Martin Beyer, Birgit Frohnhoff, Carsten Pfläging, Jörg Staff
> Vorsitzender des Aufsichtsrats: Jürgen Brinkmann 

[Attachment #3 (text/html)]

<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
  </head>
  <body text="#000000" bgcolor="#FFFFFF">
    <p>Hi Markus,</p>
    <p>HDFS NFS gateway currently does not support snapshots. Following
      issues are tracking this in HDFS.</p>
    <p><a class="moz-txt-link-freetext" \
href="https://issues.apache.org/jira/browse/HDFS-5084">https://issues.apache.org/jira/browse/HDFS-5084</a></p>
  <p><a class="moz-txt-link-freetext" \
href="https://issues.apache.org/jira/browse/HDFS-11315">https://issues.apache.org/jira/browse/HDFS-11315</a></p>
  <p>However we do not have a fix for these jira.    </p>
    <p>Thanks,</p>
    <p>Mukul<br>
    </p>
    <div class="moz-cite-prefix">On 5/9/19 1:16 AM,
      <a class="moz-txt-link-abbreviated" \
href="mailto:Markus.Gierich@fiduciagad.de">Markus.Gierich@fiduciagad.de</a> \
wrote:<br>  </div>
    <blockquote type="cite"
      cite="mid:201905081946.x48JkmfH004761@mail-srz-p-02.noc.fiducia.de">
      <meta http-equiv="content-type" content="text/html; charset=UTF-8">
      <p><font size="2" face="sans-serif">Hi!</font><br>
        <br>
        <font size="2" face="sans-serif">I have mounted the HDFS root
          path over the HDFS NFS Gateway and I'm able to do all kind of
          file operations. Now I want to read a from a HDFS snapshot
          using the NFS mount, </font><br>
        <br>
        <br>
        <font size="2" face="sans-serif">snapshot in hdfs works and I
          can see it using hdfs dfs -ls</font><br>
        <br>
      </p>
      <ul style="padding-left: 12pt">
        <font size="3" face="serif" color="#272727">hdfs dfs -ls
          /data/standard/.snapshot/s20190507-063223.621</font>
        <p><font size="3" face="serif" color="#272727">Found 2 items</font>
        </p>
        <p>
        </p>
        <p><font size="3" face="serif" color="#272727">So when I try a
            ls command on the nfs mount I get an error.</font>
        </p>
      </ul>
      <ul style="padding-left: 12pt">
        <font size="3" face="serif" color="#272727">ll
          /mnt/hdfs/data/standard/.snapshot/s20190507-063223.621</font>
        <p><font size="3" face="serif" color="#272727">ls: cannot access
            /mnt/hdfs/data/standard/.snapshot/s20190507-063223.621:
            Input/output error​</font>
        </p>
        <p>
        </p>
        <p><font size="3" face="serif" color="#272727">I'm using HDP
            3.1.0</font>
        </p>
        <p>
        </p>
        <p><font size="3" face="serif" color="#272727">Any ideas ?</font>
        </p>
        <p>
        </p>
        <p><font size="3" face="serif" color="#272727">Best Regards</font>
        </p>
        <p>
        </p>
        <p><font size="3" face="serif" color="#272727">MARKUS</font></p>
      </ul>
      <br>
      <font size="2" face="sans-serif">Fiducia &amp; GAD IT AG | </font><font
        size="2" face="sans-serif"><a class="moz-txt-link-abbreviated" \
href="http://www.fiduciagad.de">www.fiduciagad.de</a></font><br>  <font size="2" \
                face="sans-serif">AG Frankfurt a. M. HRB 102381 |
        Sitz der Gesellschaft: Frankfurt a. M. | USt-IdNr. DE 143582320</font><br>
      <font size="2" face="sans-serif">Vorstand: Klaus-Peter Bruns
        (Vorsitzender), Jens-Olaf Bartels, </font><br>
      <font size="2" face="sans-serif">Martin Beyer, Birgit Frohnhoff,
        Carsten Pfläging, Jörg Staff</font><br>
      <font size="2" face="sans-serif">Vorsitzender des Aufsichtsrats:
        Jürgen Brinkmann</font>
    </blockquote>
  </body>
</html>



[prev in list] [next in list] [prev in thread] [next in thread]

Configure | About | News | Add a list | Sponsored by KoreLogic