[prev in list] [next in list] [prev in thread] [next in thread] 

List:       ceph-users
Subject:    [ceph-users] Re: Why did ceph turn /etc/ceph/ceph.client.admin.keyring into a directory?
From:       Marc <Marc () f1-outsourcing ! eu>
Date:       2022-10-26 8:19:49
Message-ID: 6bcbcb70bedd4eb6a7aa8d51e52fa69f () f1-outsourcing ! eu
[Download RAW message or body]


I can't remember that much of it, afaicr this is more a kubernetes plugin, and what \
functionality was lacking in kubernetes they tried to bypass with the plugin. So I \
have problems creating preprovisioned volumes. Afaicr you need the driver to create a \
volume, so when you use the driver from the commandline, you are confronted with all \
these weird things.

This an issue where I point out that they are not even validating passed arguments, \
if an argument is lacking for some reason. Your hosts root fs is getting mounted in \
the launched task.  https://github.com/ceph/ceph-csi/issues/1798#issuecomment-748916298


This is were I report files being deleted
https://github.com/ceph/ceph-csi/issues/1799

They just don't get the concept of csi. I have even seen old issues where they were \
storing volume id's locally, so your task could never migrate to a different host. \
Who is designing that like this .....




> 
> Could you explain? I have just deployed Ceph CSI just like the docs
> specified. What mode is it running in if not container mode?
> 
> 
> On Tue, Oct 25, 2022 at 10:56 AM Marc <Marc@f1-outsourcing.eu
> <mailto:Marc@f1-outsourcing.eu> > wrote:
> 
> 
> 	Wtf, unbelievable that it is still like this. You can't fix it, I
> had to fork and patch it because these @#$@#$@ ignored it. I don't know
> much about kubernetes I am running mesos. Can't you set/configure
> kubernetes to launch the driver in a container mode?
> 
> 
> 	>
> 	> How should we fix it? Should we remove the directory and add back
> the
> 	> keyring file?
> 	>
> 	>
> 	>
> 	> On Tue, Oct 25, 2022 at 9:45 AM Martin Johansen <martin@deploi.no
> <mailto:martin@deploi.no>
> 	> <mailto:martin@deploi.no <mailto:martin@deploi.no> > > wrote:
> 	>
> 	>
> 	>       Yes, we are using the ceph-csi driver in a kubernetes
> cluster. Is
> 	> it that that is causing this?
> 	>
> 	>       Best Regards,
> 	>
> 	>
> 	>       Martin Johansen
> 	>
> 	>
> 	>       On Tue, Oct 25, 2022 at 9:44 AM Marc <Marc@f1-
> outsourcing.eu <mailto:Marc@f1-outsourcing.eu>
> 	> <mailto:Marc@f1-outsourcing.eu <mailto:Marc@f1-outsourcing.eu> >
> > wrote:
> 	>
> 	>
> 	>               >
> 	>               > 1) Why does ceph delete
> /etc/ceph/ceph.client.admin.keyring
> 	> several
> 	>               > times a
> 	>               > day?
> 	>               >
> 	>               > 2) Why was it turned into a directory? It
> contains one file
> 	>               > "ceph.client.admin.keyring.new". This then causes
> an error
> 	> in the ceph
> 	>               > logs
> 	>               > when ceph tries to remove the file: "rm: cannot
> remove
> 	>               > '/etc/ceph/ceph.client.admin.keyring': Is a
> directory".
> 	>               >
> 	>
> 	>               Are you using the ceph-csi driver? The ceph csi
> people just
> 	> delete your existing ceph files and mount your root fs when you
> are not
> 	> running the driver in a container. They seem to think that
> checking for
> 	> files and validating parameters is not necessary.
> 	>
> 
> 

_______________________________________________
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-leave@ceph.io


[prev in list] [next in list] [prev in thread] [next in thread]