[prev in list] [next in list] [prev in thread] [next in thread]
List: fedora-devel-list
Subject: Re: Has something changed with RPMS?
From: Stephen John Smoogen <smooge () gmail ! com>
Date: 2020-06-03 16:58:01
Message-ID: CANnLRdhRrZ2hbjLW+b5zRi5bxj1xVH2yDkskpRV=Kd__rSiOCQ () mail ! gmail ! com
[Download RAW message or body]
[Attachment #2 (multipart/alternative)]
On Wed, 3 Jun 2020 at 11:38, Richard W.M. Jones <rjones@redhat.com> wrote:
> I should say that there's also the possibility of writing a block
> device plugin which is highly tuned in some way to the Koji use case.
> We've already done discarding flushes and showed that you get all the
> benefit of a RAM disk just by doing that (even when backed by a disk).
>
> Is there anything else specific to Koji builds:
>
> - Prepopulating the filesystem in the block device?
>
> - Making a block device which is highly tuned to the filesystem it
> will contain (eg. keeping metadata in faster storage)?
>
>
Our koji builders are everything from virtual machines using spinning
disks, virtual machines using ssd (very few), virtual machines on iscsi to
actual hardware. We do not have a budget to standardize on anything so
expect that it will always be hardware spanning a 7 year lifetime with some
new stuff to cycle out items. Other architectures are just as diverse and
usually whatever has been 'gifted'.
Any tuning is going to have to take into fact that reality.
> - Sharing / deduplicating?
>
> I collected traces of the access pattern of existing Koji builds, but
> they are huge and I'm not sure how best to analyze them.
>
> Rich.
>
> --
> Richard Jones, Virtualization Group, Red Hat
> http://people.redhat.com/~rjones
> Read my programming and virtualization blog: http://rwmj.wordpress.com
> virt-df lists disk usage of guests without needing to install any
> software inside the virtual machine. Supports Linux and Windows.
> http://people.redhat.com/~rjones/virt-df/
> _______________________________________________
> devel mailing list -- devel@lists.fedoraproject.org
> To unsubscribe send an email to devel-leave@lists.fedoraproject.org
> Fedora Code of Conduct:
> https://docs.fedoraproject.org/en-US/project/code-of-conduct/
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives:
> https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
>
--
Stephen J Smoogen.
[Attachment #5 (text/html)]
<div dir="ltr"><div dir="ltr"><br></div><br><div class="gmail_quote"><div dir="ltr" \
class="gmail_attr">On Wed, 3 Jun 2020 at 11:38, Richard W.M. Jones <<a \
href="mailto:rjones@redhat.com">rjones@redhat.com</a>> wrote:<br></div><blockquote \
class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid \
rgb(204,204,204);padding-left:1ex">I should say that there's also the possibility \
of writing a block<br> device plugin which is highly tuned in some way to the Koji \
use case.<br> We've already done discarding flushes and showed that you get all \
the<br> benefit of a RAM disk just by doing that (even when backed by a disk).<br>
<br>
Is there anything else specific to Koji builds:<br>
<br>
- Prepopulating the filesystem in the block device?<br>
<br>
- Making a block device which is highly tuned to the filesystem it<br>
will contain (eg. keeping metadata in faster storage)?<br>
<br></blockquote><div><br></div><div>Our koji builders are everything from virtual \
machines using spinning disks, virtual machines using ssd (very few), virtual \
machines on iscsi to actual hardware. We do not have a budget to standardize on \
anything so expect that it will always be hardware spanning a 7 year lifetime with \
some new stuff to cycle out items. Other architectures are just as diverse and \
usually whatever has been 'gifted'. </div><div><br></div><div>Any tuning \
is going to have to take into fact that reality.</div><div><br></div><div> \
</div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px \
solid rgb(204,204,204);padding-left:1ex">
- Sharing / deduplicating?<br>
<br>
I collected traces of the access pattern of existing Koji builds, but<br>
they are huge and I'm not sure how best to analyze them.<br>
<br>
Rich.<br>
<br>
-- <br>
Richard Jones, Virtualization Group, Red Hat <a \
href="http://people.redhat.com/~rjones" rel="noreferrer" \
target="_blank">http://people.redhat.com/~rjones</a><br> Read my programming and \
virtualization blog: <a href="http://rwmj.wordpress.com" rel="noreferrer" \
target="_blank">http://rwmj.wordpress.com</a><br> virt-df lists disk usage of guests \
without needing to install any<br> software inside the virtual machine. Supports \
Linux and Windows.<br> <a href="http://people.redhat.com/~rjones/virt-df/" \
rel="noreferrer" target="_blank">http://people.redhat.com/~rjones/virt-df/</a><br> \
_______________________________________________<br> devel mailing list -- <a \
href="mailto:devel@lists.fedoraproject.org" \
target="_blank">devel@lists.fedoraproject.org</a><br> To unsubscribe send an email to \
<a href="mailto:devel-leave@lists.fedoraproject.org" \
target="_blank">devel-leave@lists.fedoraproject.org</a><br> Fedora Code of Conduct: \
<a href="https://docs.fedoraproject.org/en-US/project/code-of-conduct/" \
rel="noreferrer" target="_blank">https://docs.fedoraproject.org/en-US/project/code-of-conduct/</a><br>
List Guidelines: <a href="https://fedoraproject.org/wiki/Mailing_list_guidelines" \
rel="noreferrer" target="_blank">https://fedoraproject.org/wiki/Mailing_list_guidelines</a><br>
List Archives: <a href="https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org" \
rel="noreferrer" target="_blank">https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org</a><br>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" \
class="gmail_signature"><div dir="ltr">Stephen J Smoogen.<br><br></div></div></div>
[Attachment #6 (text/plain)]
_______________________________________________
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-leave@lists.fedoraproject.org
Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic