[prev in list] [next in list] [prev in thread] [next in thread]
List: lxc-users
Subject: [lxc-users] OOM kill in LXD when swap not full
From: Pavol Cupka <pavol.cupka () gmail ! com>
Date: 2016-10-24 12:08:02
Message-ID: CAH4oapdMT0euR92EwU0c1X0B5ip9JsXUNBSyWE+FT0PkWTgM2A () mail ! gmail ! com
[Download RAW message or body]
[Attachment #2 (multipart/alternative)]
Hi list,
maybe it is a stupid question, or maybe I just don't understand how it
works. I have a server running Gentoo, a recent kernel - 4.8.3, and lx*
versions as follows.
lxd 2.4.1
lxc 2.0.5
lxcfs 2.0.4
cgmanager 0.41
2GB RAM, 4GB swap and I am running a couple of containers.
My processes get killed by the oom although the swap is nearly unused.
free -mlh
total used free shared buff/cache
available
Mem: 2.0G 363M 273M 29M 1.4G
1.5G
Low: 739M 716M 22M
High: 1.2G 1.0G 250M
Swap: 4.0G 8.5M 4.0G
[126603.521662] Killed process 1135 (nginx) total-vm:61344kB,
anon-rss:4180kB, file-rss:1896kB, shmem-rss:0kB
[126603.563243] Killed process 32057 (nginx) total-vm:61344kB,
anon-rss:4180kB, file-rss:1896kB, shmem-rss:0kB
[126603.605512] Killed process 25231 (pickup) total-vm:38280kB,
anon-rss:472kB, file-rss:4608kB, shmem-rss:0kB
[126603.651911] Killed process 1604 (syslog-ng) total-vm:16852kB,
anon-rss:600kB, file-rss:3400kB, shmem-rss:0kB
[126603.721520] Killed process 2571 (mandb) total-vm:5176kB,
anon-rss:1984kB, file-rss:1852kB, shmem-rss:0kB
[126604.216420] Killed process 4258 (bash) total-vm:6780kB, anon-rss:312kB,
file-rss:2448kB, shmem-rss:0kB
[126604.243154] Killed process 4257 (mosh-server) total-vm:16524kB,
anon-rss:1024kB, file-rss:3156kB, shmem-rss:0kB
[126604.527476] Killed process 4389 (syslog-ng) total-vm:44624kB,
anon-rss:368kB, file-rss:2936kB, shmem-rss:0kB
[126604.679835] Killed process 3134 (init) total-vm:1684kB, anon-rss:44kB,
file-rss:8kB, shmem-rss:0kB
[126605.229347] Killed process 4545 (nginx) total-vm:61344kB,
anon-rss:4352kB, file-rss:2280kB, shmem-rss:4kB
[126605.617913] Killed process 4546 (nginx) total-vm:61344kB,
anon-rss:4352kB, file-rss:2300kB, shmem-rss:4kB
[126605.723802] Killed process 4553 (nginx) total-vm:10328kB,
anon-rss:4468kB, file-rss:1784kB, shmem-rss:0kB
[126606.461064] Killed process 4547 (nginx) total-vm:61344kB,
anon-rss:4368kB, file-rss:3312kB, shmem-rss:4kB
[126606.487237] Killed process 4564 (nginx) total-vm:10328kB,
anon-rss:4468kB, file-rss:1784kB, shmem-rss:0kB
[126606.829193] Killed process 4552 (nginx) total-vm:10328kB,
anon-rss:4468kB, file-rss:1784kB, shmem-rss:0kB
[126607.084117] Killed process 4548 (nginx) total-vm:10328kB,
anon-rss:4468kB, file-rss:1784kB, shmem-rss:0kB
[126607.394812] Killed process 4570 (nginx) total-vm:10328kB,
anon-rss:4468kB, file-rss:1784kB, shmem-rss:0kB
[126607.429775] Killed process 4569 (nginx) total-vm:10328kB,
anon-rss:4468kB, file-rss:1784kB, shmem-rss:0kB
[126607.541393] Killed process 4541 (nginx) total-vm:10328kB,
anon-rss:4468kB, file-rss:1784kB, shmem-rss:0kB
[126607.675852] Killed process 4568 (nginx) total-vm:61344kB,
anon-rss:4180kB, file-rss:1896kB, shmem-rss:0kB
[126607.702717] Killed process 4562 (nginx) total-vm:61344kB,
anon-rss:4180kB, file-rss:1896kB, shmem-rss:0kB
[126607.818157] Killed process 4561 (nginx) total-vm:61344kB,
anon-rss:4180kB, file-rss:1896kB, shmem-rss:0kB
I have soft limit and swap use enabled
limits.memory.enforce: soft
limits.memory.swap: "true"
vm.swappiness = 60 on the host
How can I debug it more? Thank you in advance
Pavol
[Attachment #5 (text/html)]
<div dir="ltr"><div><div><div><div><div><div>Hi list,<br><br></div>maybe it is a \
stupid question, or maybe I just don't understand how it works. I have a server \
running Gentoo, a recent kernel - 4.8.3, and lx* versions as follows.<br></div>lxd \
2.4.1<br></div>lxc 2.0.5<br></div><div>lxcfs 2.0.4<br></div>cgmanager \
0.41<br><br></div>2GB RAM, 4GB swap and I am running a couple of \
containers.<br><br></div>My processes get killed by the oom although the swap is \
nearly unused.<br><br>free -mlh<br> total \
used free shared buff/cache available<br>Mem: \
2.0G 363M 273M 29M 1.4G \
1.5G<br>Low: 739M 716M 22M<br>High: \
1.2G 1.0G 250M<br>Swap: 4.0G \
8.5M 4.0G<br><br><div>[126603.521662] Killed process 1135 (nginx) \
total-vm:61344kB, anon-rss:4180kB, file-rss:1896kB, shmem-rss:0kB<br>[126603.563243] \
Killed process 32057 (nginx) total-vm:61344kB, anon-rss:4180kB, file-rss:1896kB, \
shmem-rss:0kB<br>[126603.605512] Killed process 25231 (pickup) total-vm:38280kB, \
anon-rss:472kB, file-rss:4608kB, shmem-rss:0kB<br>[126603.651911] Killed process 1604 \
(syslog-ng) total-vm:16852kB, anon-rss:600kB, file-rss:3400kB, \
shmem-rss:0kB<br>[126603.721520] Killed process 2571 (mandb) total-vm:5176kB, \
anon-rss:1984kB, file-rss:1852kB, shmem-rss:0kB<br>[126604.216420] Killed process \
4258 (bash) total-vm:6780kB, anon-rss:312kB, file-rss:2448kB, \
shmem-rss:0kB<br>[126604.243154] Killed process 4257 (mosh-server) total-vm:16524kB, \
anon-rss:1024kB, file-rss:3156kB, shmem-rss:0kB<br>[126604.527476] Killed process \
4389 (syslog-ng) total-vm:44624kB, anon-rss:368kB, file-rss:2936kB, \
shmem-rss:0kB<br>[126604.679835] Killed process 3134 (init) total-vm:1684kB, \
anon-rss:44kB, file-rss:8kB, shmem-rss:0kB<br>[126605.229347] Killed process 4545 \
(nginx) total-vm:61344kB, anon-rss:4352kB, file-rss:2280kB, \
shmem-rss:4kB<br>[126605.617913] Killed process 4546 (nginx) total-vm:61344kB, \
anon-rss:4352kB, file-rss:2300kB, shmem-rss:4kB<br>[126605.723802] Killed process \
4553 (nginx) total-vm:10328kB, anon-rss:4468kB, file-rss:1784kB, \
shmem-rss:0kB<br>[126606.461064] Killed process 4547 (nginx) total-vm:61344kB, \
anon-rss:4368kB, file-rss:3312kB, shmem-rss:4kB<br>[126606.487237] Killed process \
4564 (nginx) total-vm:10328kB, anon-rss:4468kB, file-rss:1784kB, \
shmem-rss:0kB<br>[126606.829193] Killed process 4552 (nginx) total-vm:10328kB, \
anon-rss:4468kB, file-rss:1784kB, shmem-rss:0kB<br>[126607.084117] Killed process \
4548 (nginx) total-vm:10328kB, anon-rss:4468kB, file-rss:1784kB, \
shmem-rss:0kB<br>[126607.394812] Killed process 4570 (nginx) total-vm:10328kB, \
anon-rss:4468kB, file-rss:1784kB, shmem-rss:0kB<br>[126607.429775] Killed process \
4569 (nginx) total-vm:10328kB, anon-rss:4468kB, file-rss:1784kB, \
shmem-rss:0kB<br>[126607.541393] Killed process 4541 (nginx) total-vm:10328kB, \
anon-rss:4468kB, file-rss:1784kB, shmem-rss:0kB<br>[126607.675852] Killed process \
4568 (nginx) total-vm:61344kB, anon-rss:4180kB, file-rss:1896kB, \
shmem-rss:0kB<br>[126607.702717] Killed process 4562 (nginx) total-vm:61344kB, \
anon-rss:4180kB, file-rss:1896kB, shmem-rss:0kB<br>[126607.818157] Killed process \
4561 (nginx) total-vm:61344kB, anon-rss:4180kB, file-rss:1896kB, \
shmem-rss:0kB<br><br></div><div>I have soft limit and swap use enabled<br> \
limits.memory.enforce: soft<br> limits.memory.swap: \
"true"<br><br>vm.swappiness = 60 on the host<br><br></div><div>How can I \
debug it more? Thank you in advance<br></div><div>Pavol<br></div></div>
[Attachment #6 (text/plain)]
_______________________________________________
lxc-users mailing list
lxc-users@lists.linuxcontainers.org
http://lists.linuxcontainers.org/listinfo/lxc-users
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic