[prev in list] [next in list] [prev in thread] [next in thread] 

List:       kde-kimageshop
Subject:    Re: Sphinx Application Documentation - Image duplication
From:       Ben Cooksley <bcooksley () kde ! org>
Date:       2023-02-18 22:16:16
Message-ID: CA+XidOH4hpefWMJ2HoCXKsS8Sco57y1-TgOne-Zq3gdjd=s_sA () mail ! gmail ! com
[Download RAW message or body]

On Sun, Feb 19, 2023 at 1:47 AM Julius Künzel <jk.kdedev@smartlab.uber.space>
wrote:

> Hi!
>

Hi Julius,


>
> as the situation especially with Kritas file structre for translated
> images is not as simple, as initially thought, we added rdfind to the
> pipelines today to iterate over all files and create symlinks for those
> with duplicates. This seems to be a simple and powerful solution.
>
> Ben, out of curiosity, can you tell us the new sizes of the websites on
> the server?
>

It has worked excellently:

root@nicoda /srv/www/generated # du -h --max-depth=1 | grep docs
5.0M    ./sysadmin-docs.kde.org
1.6G    ./docs.digikam.org
2.3G    ./docs.krita.org
7.9G    ./docs.kdenlive.org

root@nicoda /srv/www/generated # du -h --max-depth=1 | grep docs
5.0M    ./sysadmin-docs.kde.org
1.6G    ./docs.digikam.org
1.3G    ./docs.krita.org
4.1G    ./docs.kdenlive.org

The vast majority of the size now is due to the *.epub files shipped by
Sphinx, which from what I understand have to contain a copy of everything
and cannot be universal (ie. must be per language)


> Cheers,
> Julius
>

Cheers,
Ben


>
> 16.02.2023 14:01:55 Gilles Caulier <caulier.gilles@gmail.com>:
>
> > Le jeu. 2 févr. 2023 à 06:50, Julius Künzel
> > <jk.kdedev@smartlab.uber.space> a écrit :
> >>
> >> Hi Eugen,
> >>
> >> at least in the Kdenlive docs we do not use translated images at all.
> Also the figure_language_name is to define the pattern from where
> translated images are taken not where they are put to. And we always have
> the problem that Sphinx uses separate build dir for every language so
> unfortunately this does not help at all for the problem Ben exposed.
> >
> > Hi all,
> >
> > Same here in digiKam, as Sphinx configuration is simply copied from
> KDenlive.
> >
> > One note : I replaced GIFa with WEBP animation to optimize space a
> > lot. Even if WEBM is supported by EPUB, WEBM is not supported by
> > Sphinx export as EPUB, but WEBP yes.
> >
> > Best
> >
> > Gilles Caulier
>

[Attachment #3 (text/html)]

<div dir="ltr"><div dir="ltr">On Sun, Feb 19, 2023 at 1:47 AM Julius Künzel &lt;<a \
href="mailto:jk.kdedev@smartlab.uber.space">jk.kdedev@smartlab.uber.space</a>&gt; \
wrote:<br></div><div class="gmail_quote"><blockquote class="gmail_quote" \
style="margin:0px 0px 0px 0.8ex;border-left:1px solid \
rgb(204,204,204);padding-left:1ex">Hi!<br></blockquote><div><br></div><div>Hi \
Julius,</div><div>  </div><blockquote class="gmail_quote" style="margin:0px 0px 0px \
0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"> <br>
as the situation especially with Kritas file structre for translated images is not as \
simple, as initially thought, we added rdfind to the pipelines today to iterate over \
all files and create symlinks for those with duplicates. This seems to be a simple \
and powerful solution.<br> <br>
Ben, out of curiosity, can you tell us the new sizes of the websites on the \
server?<br></blockquote><div><br></div><div>It has worked \
excellently:</div><div><br></div><div><span style="font-family:monospace"><span \
style="font-weight:bold;color:rgb(255,84,84)">root</span><span \
style="font-weight:bold;color:rgb(255,255,84)">@</span><span \
style="font-weight:bold;color:rgb(84,255,255)">nicoda </span><span \
style="font-weight:bold;color:rgb(255,255,84)">/srv/www/generated </span><span \
style="font-weight:bold;color:rgb(255,84,255)"># </span><span \
style="color:rgb(0,0,0)">du -h --max-depth=1 | grep docs </span><br>5.0M       \
./sysadmin-<span style="font-weight:bold;color:rgb(255,84,84)">docs</span><span \
style="color:rgb(0,0,0)">.<a href="http://kde.org">kde.org</a> </span><br>1.6G       \
./<span style="font-weight:bold;color:rgb(255,84,84)">docs</span><span \
style="color:rgb(0,0,0)">.<a href="http://digikam.org">digikam.org</a> \
</span><br>2.3G       ./<span \
style="font-weight:bold;color:rgb(255,84,84)">docs</span><span \
style="color:rgb(0,0,0)">.<a href="http://krita.org">krita.org</a> </span><br>7.9G    \
./<span style="font-weight:bold;color:rgb(255,84,84)">docs</span><span \
style="color:rgb(0,0,0)">.<a \
href="http://kdenlive.org">kdenlive.org</a></span></span></div><div><span \
style="font-family:monospace"><span style="color:rgb(0,0,0)"></span><font \
color="#000000"><br></font><span \
style="font-weight:bold;color:rgb(255,84,84)">root</span><span \
style="font-weight:bold;color:rgb(255,255,84)">@</span><span \
style="font-weight:bold;color:rgb(84,255,255)">nicoda </span><span \
style="font-weight:bold;color:rgb(255,255,84)">/srv/www/generated </span><span \
style="font-weight:bold;color:rgb(255,84,255)"># </span><span \
style="color:rgb(0,0,0)">du -h --max-depth=1 | grep docs </span><br>5.0M       \
./sysadmin-<span style="font-weight:bold;color:rgb(255,84,84)">docs</span><span \
style="color:rgb(0,0,0)">.<a href="http://kde.org">kde.org</a> </span><br>1.6G       \
./<span style="font-weight:bold;color:rgb(255,84,84)">docs</span><span \
style="color:rgb(0,0,0)">.<a href="http://digikam.org">digikam.org</a> \
</span><br>1.3G       ./<span \
style="font-weight:bold;color:rgb(255,84,84)">docs</span><span \
style="color:rgb(0,0,0)">.<a href="http://krita.org">krita.org</a> </span><br>4.1G    \
./<span style="font-weight:bold;color:rgb(255,84,84)">docs</span><span \
style="color:rgb(0,0,0)">.<a \
href="http://kdenlive.org">kdenlive.org</a></span><br></span></div><div>  \
</div><div>The vast majority of the size now is due to the *.epub files shipped by \
Sphinx, which from what I understand have to contain a copy of everything and cannot \
be universal (ie. must be per language)</div><div><br></div><blockquote \
class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid \
rgb(204,204,204);padding-left:1ex"> <br>
Cheers,<br>
Julius<br></blockquote><div><br></div><div>Cheers,</div><div>Ben</div><div>  \
</div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px \
solid rgb(204,204,204);padding-left:1ex"> <br>
16.02.2023 14:01:55 Gilles Caulier &lt;<a href="mailto:caulier.gilles@gmail.com" \
target="_blank">caulier.gilles@gmail.com</a>&gt;:<br> <br>
&gt; Le jeu. 2 févr. 2023 à 06:50, Julius Künzel<br>
&gt; &lt;<a href="mailto:jk.kdedev@smartlab.uber.space" \
target="_blank">jk.kdedev@smartlab.uber.space</a>&gt; a écrit :<br> &gt;&gt; <br>
&gt;&gt; Hi Eugen,<br>
&gt;&gt; <br>
&gt;&gt; at least in the Kdenlive docs we do not use translated images at all. Also \
the figure_language_name is to define the pattern from where translated images are \
taken not where they are put to. And we always have the problem that Sphinx uses \
separate build dir for every language so unfortunately this does not help at all for \
the problem Ben exposed.<br> &gt; <br>
&gt; Hi all,<br>
&gt; <br>
&gt; Same here in digiKam, as Sphinx configuration is simply copied from \
KDenlive.<br> &gt; <br>
&gt; One note : I replaced GIFa with WEBP animation to optimize space a<br>
&gt; lot. Even if WEBM is supported by EPUB, WEBM is not supported by<br>
&gt; Sphinx export as EPUB, but WEBP yes.<br>
&gt; <br>
&gt; Best<br>
&gt; <br>
&gt; Gilles Caulier<br>
</blockquote></div></div>



[prev in list] [next in list] [prev in thread] [next in thread]