[prev in list] [next in list] [prev in thread] [next in thread] 

List:       mogilefs
Subject:    Re: Tracker cannot find a file even if it is present on the devices
From:       "Dinesh Gadge" <dinesh.gadge () gmail ! com>
Date:       2008-03-06 5:12:03
Message-ID: 74e7557c0803052100p49cdc67bo16541e401102e089 () mail ! gmail ! com
[Download RAW message or body]

Just to update the list ..
The problem was a programming goof-up on my part .. The files were indeed
there .. but somehow ended up in the wrong domain ...
A few corrections .. and everything worked like magic !

Thanks for the initiative to help though !

Dinesh.

On Thu, Feb 28, 2008 at 2:02 AM, dormando <dormando@rydia.net> wrote:

> First I've heard of this.
>
> Any chance you could send the list (or me privately) the some of the
> rows from your database?
>
> SELECT * FROM file WHERE fid = brokenfid;
> SELECT * FROM file_on WHERE fid = brokenfid;
>
> maybe what's in domain, devices tables. devices would be more important.
>
> I suspect there might be no file_on rows associated with it, or it's
> failing the paths test somehow.
>
> You can try fetching the key with the 'noverify=1' option set and see if
> it returns paths (that may not work). By default mogilefs will try a
> HEAD request against the storage node for each path, and filter by what
> paths actually work. This is even probably a better suggestion to test
> than sending me parts of your database.
>
> -Dormando
>
> Dinesh Gadge wrote:
> > Hello everybody,
> > I am using the ruby mogilefs-client library to interact with my mogilefs
> > installation.
> >
> > It has happened on a few occasions that after storing a file with a
> > particular key, tracker does not recognize the key, and returns nil on
> > using
> >
> > get_file_data(key)
> >
> > where key is the key of that file.
> >
> > This is an irreproducible [and hence an annoying :( ] problem [at least
> > for me].
> > When I checked up, the file had a correct entry in the db, with the
> > correct key and devids.
> > On checking up the /var/mogdata directory for the corresponding devices,
> > the file was present.
> >
> > Still, it seems, the tracker is unable to find the file using that key.
> > I have tried it with the perl client too, even it gives an 'undef' on
> > asking for the file using get_file_data with the corresponding key.
> >
> > I have tried 'list_keys' on both ruby and perl client .. and the result
> > does not have any entry for the given key.
> >
> > My question is .. is this a known issue ?
> > or is it something I experienced randomly ? (on more-than-one occasions
> > though)
> >
> > --
> > Regards,
> > Dinesh
>
>

[Attachment #3 (text/html)]

Just to update the list .. <br>The problem was a programming goof-up on my part .. \
The files were indeed there .. but somehow ended up in the wrong domain ...<br>A few \
corrections .. and everything worked like magic !<br><br> Thanks for the initiative \
to help though !<br><br>Dinesh.<br><br><div class="gmail_quote">On Thu, Feb 28, 2008 \
at 2:02 AM, dormando &lt;<a \
href="mailto:dormando@rydia.net">dormando@rydia.net</a>&gt; wrote:<br><blockquote \
class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt \
0pt 0.8ex; padding-left: 1ex;"> First I&#39;ve heard of this.<br>
<br>
Any chance you could send the list (or me privately) the some of the<br>
rows from your database?<br>
<br>
SELECT * FROM file WHERE fid = brokenfid;<br>
SELECT * FROM file_on WHERE fid = brokenfid;<br>
<br>
maybe what&#39;s in domain, devices tables. devices would be more important.<br>
<br>
I suspect there might be no file_on rows associated with it, or it&#39;s<br>
failing the paths test somehow.<br>
<br>
You can try fetching the key with the &#39;noverify=1&#39; option set and see if<br>
it returns paths (that may not work). By default mogilefs will try a<br>
HEAD request against the storage node for each path, and filter by what<br>
paths actually work. This is even probably a better suggestion to test<br>
than sending me parts of your database.<br>
<font color="#888888"><br>
-Dormando<br>
</font><div><div></div><div class="Wj3C7c"><br>
Dinesh Gadge wrote:<br>
&gt; Hello everybody,<br>
&gt; I am using the ruby mogilefs-client library to interact with my mogilefs<br>
&gt; installation.<br>
&gt;<br>
&gt; It has happened on a few occasions that after storing a file with a<br>
&gt; particular key, tracker does not recognize the key, and returns nil on<br>
&gt; using<br>
&gt;<br>
&gt; get_file_data(key)<br>
&gt;<br>
&gt; where key is the key of that file.<br>
&gt;<br>
&gt; This is an irreproducible [and hence an annoying :( ] problem [at least<br>
&gt; for me].<br>
&gt; When I checked up, the file had a correct entry in the db, with the<br>
&gt; correct key and devids.<br>
&gt; On checking up the /var/mogdata directory for the corresponding devices,<br>
&gt; the file was present.<br>
&gt;<br>
&gt; Still, it seems, the tracker is unable to find the file using that key.<br>
&gt; I have tried it with the perl client too, even it gives an &#39;undef&#39; \
on<br> &gt; asking for the file using get_file_data with the corresponding key.<br>
&gt;<br>
&gt; I have tried &#39;list_keys&#39; on both ruby and perl client .. and the \
result<br> &gt; does not have any entry for the given key.<br>
&gt;<br>
&gt; My question is .. is this a known issue ?<br>
&gt; or is it something I experienced randomly ? (on more-than-one occasions<br>
&gt; though)<br>
&gt;<br>
&gt; --<br>
&gt; Regards,<br>
&gt; Dinesh<br>
<br>
</div></div></blockquote></div>



[prev in list] [next in list] [prev in thread] [next in thread] 

Configure | About | News | Add a list | Sponsored by KoreLogic