[prev in list] [next in list] [prev in thread] [next in thread] 

List:       ceph-users
Subject:    [ceph-users] Re: A practical approach to efficiently store 100 billions small objects in Ceph
From:       Loïc_Dachary <loic () dachary ! org>
Date:       2021-08-31 8:33:23
Message-ID: 135c17f5-d4ce-704b-1df5-c34b59bc71af () dachary ! org
[Download RAW message or body]

Hi,

I incorrectly wrote that EOS[0] was using Ceph and RDB. I edited the object storage \
design[1] to remove that and avoid any confusion. Now I'll try to figure out what led \
me to make this significant mistake. My apologies for misrepresenting EOS.

Cheers

[0] https://eos-web.web.cern.ch/eos-web/
[1] https://wiki.softwareheritage.org/index.php?title=A_practical_approach_to_efficiently_store_100_billions_small_objects_in_Ceph&type=revision&diff=1607&oldid=1590


On 10/03/2021 15:53, Loïc Dachary wrote:
> Bonjour,
> 
> In the past weeks a few mailing list threads[0][1][2] explored the problem of \
> storing billions of small objects in Ceph. There was great feedback (I learned at \
> lot) and it turns out the solution is a rather simple aggregation of the ideas that \
> were suggested during these discussions. It is described in detail here: 
> https://wiki.softwareheritage.org/wiki/A_practical_approach_to_efficiently_store_100_billions_small_objects_in_Ceph
>  
> The next step will be to write and run benchmarks[3]. Although I'm convinced it is \
> a good solution, I've been wrong before and confirmation is required :-) Many \
> thanks to all the participants in the discussions on behalf of the Software \
> Heritage project[4]. 
> Cheers
> 
> [0] Storing 20 billions of immutable objects in Ceph, 75% <16KB \
> https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/JSG2TXKNXPXEKZOJZGYF2ZPTQHOB4LHJ/
>  [1] Small RGW objects and RADOS 64KB minimun size \
> https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/AEMW6O7WVJFMUIX7QGI2KM7HKDSTNIYT/
>  [2] Using RBD to pack billions of small files \
> https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/RHQ5ZCHJISXIXOJSH3TU7DLYVYHRGTAT/
>  [3] https://forge.softwareheritage.org/T3054
> [4] https://www.softwareheritage.org/
> 

-- 
Loïc Dachary, Artisan Logiciel Libre
_______________________________________________
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-leave@ceph.io


[prev in list] [next in list] [prev in thread] [next in thread]