[prev in list] [next in list] [prev in thread] [next in thread]
List: info-cyrus
Subject: Some locking (seem to be) problems
From: Egoitz Aurrekoetxea <egoitz () sarenet ! es>
Date: 2021-07-05 12:53:22
Message-ID: 944a6ceb3f376b046e6e03ac8b447f36 () sarenet ! es
[Download RAW message or body]
Good morning,
I'm in the proccess of setting up new Cyrus servers. As we are running
3.0.X, versions we have installed 3.0.15. But we are facing a problem.
We have copied all the data with sync_client in user mode to new
servers. The new servers, are just instances of Cyrus running as like
Fastmails calls teraslots (we have created a new automated managing
system for this slots and it's in proccess of deciding whether we open
it's source). The problem is that when we startup a slot (so a Cyrus
proccess), it seems to become flooded of recoveries like the following :
Jul 5 12:10:17 contenedormx-002 imap[90701]: login:
proxyserv.server.net [1.2.3.4] test1@sonotreal.net plaintext User logged
in
SESSIONID=<slot-002-001.proxyserv.server.net-90701-1625479801-1-8353515761537691283>
Jul 5 12:10:26 contenedormx-002 imap[90701]: client id
sessionid=<slot-002-001.proxyserv.server.net-90701-1625479801-1-8353515761537691283>:
"name" "Mac OS X Mail" "version" "14.0 (3654.100.0.2.22)" "os" "Mac OS
X" "os-version" "11.4 (20F71)" "vendor" "Apple Inc."
Jul 5 12:10:41 contenedormx-002 imap[90701]: skiplist: recovered
/saremail_slots/slot-002-001/bbdd-funcionamiento-cyrus/domain/s/sonotreal.net/user/n/test1.conversations
(3502 records, 382648 bytes) in 1 second
Jul 5 12:10:50 contenedormx-002 imap[90701]: skiplist: checkpointed
/saremail_slots/slot-002-001/bbdd-funcionamiento-cyrus/domain/s/sonotreal.net/user/n/test1.conversations
(3502 records, 367380 bytes) in 9.344 sec
Jul 5 12:11:25 contenedormx-002 imap[90701]: mailbox: longlock
sonotreal.net!user.test1.Enviados for 15.4 seconds
Jul 5 12:11:25 contenedormx-002 imap[90701]: skiplist: longlock
/saremail_slots/slot-002-001/bbdd-funcionamiento-cyrus/domain/s/sonotreal.net/user/n/test1.conversations
for 15.4 seconds
Until server loads due to this recoveries the server is really not
useful because it's extremely slow or non responsibe.....
This Cyrus process has 8000 accounts, some big amount of them with 50GB
accounts (and several of them almost full).
I'm suspecting after each restart, as skiplist_always_checkpoint is on
by default (commit b5581189219812cc1ed15873368fd50ce7cad2ac) that is
causing concurrency and slow checkpoints in the server start. It seems
it does checkpoints every 30 minutes anyway (checkpoint event in
cyrus.conf). I know it's something about 10 years ago... but I can't
figure what else could be... has anyone ever suffered something as
this?. We are running Cyrus in FreeBSD as non root user from the
beggining (listening in 1430 or 1100 ports) and with the ZFS
filesystem... anyone ever has issues with something like that?.
Any help will be very appreciated.
Best regards,
--
EGOITZ AURREKOETXEA
Dpto. de sistemas
944 209 470
Parque Tecnológico. Edificio 103
48170 Zamudio (Bizkaia)
egoitz@sarenet.es
www.sarenet.es [1]
Antes de imprimir este correo electrónico piense si es necesario
hacerlo.
Links:
------
[1] http://www.sarenet.es
------------------------------------------
Cyrus: Info
Permalink: https://cyrus.topicbox.com/groups/info/Tc50be2b108e48a6e-M54f83b50038d817ca3b057f0
Delivery options: https://cyrus.topicbox.com/groups/info/subscription
[Attachment #3 (unknown)]
<html><html><html><head><meta content="text/html; charset=UTF-8" \
http-equiv="Content-Type" /></head><body style="font-size: 10pt; font-family: \
Verdana,Geneva,sans-serif"><p>Good morning,<p><br /><p>I'm in the proccess of \
setting up new Cyrus servers. As we are running 3.0.X, versions we have installed \
3.0.15. But we are facing a problem. We have copied all the data with sync_client in \
user mode to new servers. The new servers, are just instances of Cyrus running as \
like Fastmails calls teraslots (we have created a new automated managing system for \
this slots and it's in proccess of deciding whether we open it's source). The \
problem is that when we startup a slot (so a Cyrus proccess), it seems to become \
flooded of recoveries like the following :<p><br /><p>Jul 5 12:10:17 \
contenedormx-002 imap[90701]: login: proxyserv.server.net [1.2.3.4] \
test1@sonotreal.net plaintext User logged in \
SESSIONID=<slot-002-001.proxyserv.server.net-90701-1625479801-1-8353515761537691283><br \
/>Jul 5 12:10:26 contenedormx-002 imap[90701]: client id \
sessionid=<slot-002-001.proxyserv.server.net-90701-1625479801-1-8353515761537691283>: \
"name" "Mac OS X Mail" "version" "14.0 \
(3654.100.0.2.22)" "os" "Mac OS X" "os-version" \
"11.4 (20F71)" "vendor" "Apple Inc."<br />Jul 5 \
12:10:41 contenedormx-002 imap[90701]: skiplist: recovered \
/saremail_slots/slot-002-001/bbdd-funcionamiento-cyrus/domain/s/sonotreal.net/user/n/test1.conversations \
(3502 records, 382648 bytes) in 1 second<br />Jul 5 12:10:50 contenedormx-002 \
imap[90701]: skiplist: checkpointed \
/saremail_slots/slot-002-001/bbdd-funcionamiento-cyrus/domain/s/sonotreal.net/user/n/test1.conversations \
(3502 records, 367380 bytes) in 9.344 sec<br />Jul 5 12:11:25 contenedormx-002 \
imap[90701]: mailbox: longlock sonotreal.net!user.test1.Enviados for 15.4 seconds<br \
/>Jul 5 12:11:25 contenedormx-002 imap[90701]: skiplist: longlock \
/saremail_slots/slot-002-001/bbdd-funcionamiento-cyrus/domain/s/sonotreal.net/user/n/test1.conversations \
for 15.4 seconds<p><br /><p>Until server loads due to this recoveries the server is \
really not useful because it's extremely slow or non responsibe.....<p><br \
/><p>This Cyrus process has 8000 accounts, some big amount of them with 50GB accounts \
(and several of them almost full).<p><br /><p>I'm suspecting after each restart, \
as <code class="docutils literal"><span \
class="pre">skiplist_always_checkpoint</span></code> is on by default (<span \
class="sha-block">commit <span class="sha \
user-select-contain">b5581189219812cc1ed15873368fd50ce7cad2ac</span></span>) that is \
causing concurrency and slow checkpoints in the server start. It seems it does \
checkpoints every 30 minutes anyway (checkpoint event in cyrus.conf). I know it's \
something about 10 years ago... but I can't figure what else could be... has \
anyone ever suffered something as this?. We are running Cyrus in FreeBSD as non root \
user from the beggining (listening in 1430 or 1100 ports) and with the ZFS \
filesystem... anyone ever has issues with something like that?.<p><br /><p>Any help \
will be very appreciated.<p><br /><p>Best regards,<div>-- <br /><table border="0" \
cellpadding="0" cellspacing="0" class="scale" width="560"><tbody><tr><td align="left" \
valign="top"><table align="left" border="0" cellpadding="0" cellspacing="0" \
class="scale" width="440"><tbody><tr><td align="left" class="firmasarenet" \
style="padding: 0px 0px 0px 0px;" valign="top"><div class="imgsarenet" style="margin: \
0 0 15px 0;"><img alt="sarenet" \
src="https://www.sarenet.es/estaticos/LogoSarenetEmails.png" style="font-family: \
Helvetica, Arial, sans-serif; font-weight: normal; font-size: 22px; line-height: \
22px; color: #e20e30;" /></div><div class="titulosarenet" style="font-family: \
Helvetica, Arial, sans-serif; font-weight: bold; font-size: 15px; line-height: 17px; \
color: #222222;"><strong>Egoitz Aurrekoetxea</strong></div><div class="dptosarenet" \
style="font-family: Helvetica, Arial, sans-serif; font-weight: normal; font-size: \
12px; line-height: 17px; color: #333333;">Dpto. de sistemas</div><div \
class="textosarenet" style="font-family: Helvetica, Arial, sans-serif; font-weight: \
normal; font-size: 12px; line-height: 17px; color: #333333;">944 209 470<br />Parque \
Tecnológico. Edificio 103<br />48170 Zamudio (Bizkaia)</div><div \
class="lnksarenet" style="font-family: Helvetica, Arial, sans-serif; font-weight: \
normal; font-size: 12px; color: #007ac4; line-height: 1.2;"><a \
href="mailto:egoitz@sarenet.es" id="mailto" style="font-size: 12px; color: #007ac4; \
text-decoration: underline;"><label \
id="label_email">egoitz@sarenet.es</label></a></div><div class="lnksarenet" \
style="font-family: Helvetica, Arial, sans-serif; font-weight: normal; font-size: \
12px; color: #007ac4; line-height: 15px;"><a href="http://www.sarenet.es" \
style="font-size: 12px; color: #007ac4; text-decoration: \
underline;">www.sarenet.es</a></div><br /><div class="imprimirsarenet" \
style="font-family: Helvetica, Arial, sans-serif; font-weight: normal; font-size: \
10px; color: #a0c361;">Antes de imprimir este correo electrónico piense si es \
necesario hacerlo.</div></td></tr></tbody></table><table align="right" border="0" \
cellpadding="0" cellspacing="0" class="scale" width="120"><tbody><tr><td height="36" \
style="font-size: 1px; line-height: 36px;"> </td></tr><tr><td align="center" \
style="padding: 0px 0px 0px 0px;" valign="middle"><img alt="25 años" \
height="117" src="https://www.sarenet.es/estaticos/sello-25-sarenet.jpg" \
style="font-family: Helvetica, Arial, sans-serif; background: #EFEFEF; font-weight: \
bold; font-size: 14px; text-align: center; color: #999999; width: 118px;" width="118" \
/></td></tr></tbody></table></td></tr><tr><td height="30" style="font-size: 1px; \
line-height: 30px;"> </td></tr></tbody></table></div><div id="topicbox-footer" \
style="margin:10px 0 0;border-top:1px solid \
#ddd;border-color:rgba(0,0,0,.15);padding:7px 0;">
<strong><a href="https://cyrus.topicbox.com/latest" \
style="color:inherit;text-decoration:none">Cyrus</a></strong> / Info / see
<a href="https://cyrus.topicbox.com/groups/info">discussions</a>
+
<a href="https://cyrus.topicbox.com/groups/info/members">participants</a>
+
<a href="https://cyrus.topicbox.com/groups/info/subscription">delivery options</a>
<a href="https://cyrus.topicbox.com/groups/info/Tc50be2b108e48a6e-M54f83b50038d817ca3b057f0" \
style="float:right">Permalink</a> </div>
</body></html></html></html>
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic