The template below is mostly useful for bug reports and support questions.
Feel free to remove anything which doesn't apply to you and add more information where it makes sense.
Required information
- Distribution: ubuntu
- Distribution version: 16.04
- The output of "lxc info" or if that fails:
- Kernel version:
- LXC version:
- LXD version:
- Storage backend in use:
config:
core.proxy_http: http://...
core.proxy_https: http://...
storage.zfs_pool_name: lxd
api_extensions:
- id_map
api_status: stable
api_version: "1.0"
auth: trusted
public: false
environment:
addresses: []
architectures:
- x86_64
- i686
certificate: |
-----BEGIN CERTIFICATE-----
...
-----END CERTIFICATE-----
certificate_fingerprint: ...
driver: lxc
driver_version: 2.0.8
kernel: Linux
kernel_architecture: x86_64
kernel_version: 4.4.0-83-generic
server: lxd
server_pid: 2708
server_version: 2.0.10
storage: zfs
storage_version: "5"
Issue description
Suddenly, lxd daemon started consuming 100% cpu. I'm not sure I touched the host or any of its 2 containers for the last few hours.
I've checked https://github.com/lxc/lxd/issues/2964 and it's not similar, strace for the daemon process is blocked:
# strace -p 2708
strace: Process 2708 attached
futex(0x110b2c8, FUTEX_WAIT, 0, NULL
lxc monitor --type=logging outputs only a single entry
metadata:
context: {}
level: dbug
message: 'New events listener: 0ab7232f-bcdb-48bc-ab57-19070f5e9e5c'
timestamp: 2017-07-25T03:39:00.877743118Z
type: logging
There is nothing suspicious in ps fauxww or in the lxd.log.
To me it looks like a deadlock.
kill -3 2708 - I've sent the SIGQUIT signal to the process but not sure where the output was captured :-S journalctl does not have it.
Incomplete
zerkms
All 16 comments
Did you strace the main PID or the thread PID that's using all the CPU?
The way the Go runtime works, you always have a whole bunch of threads between which the go routines are scheduled, so when tracing you need to make sure that you're picking the right thread.
stgraber
on 25 Jul 2017
Yep, my mistake, I did not think about that :-( I strace'd the main process.
zerkms
on 25 Jul 2017
I'd close it then until it appears to me next time, if ever, with a better research.
zerkms
on 25 Jul 2017
I'm experiencing the same lxd behaviour at the moment on my development desktop: it's an ubuntu xenial (with all packages upgraded), lxd 2.0.10-0ubuntu1~16.04.2.
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
1646 root 20 0 1297204 37636 13692 S 104.0 0.3 315:53.35 lxd
that's how the top output looks like.
What would I need to do to provide any useful details?
zerkms
on 3 Oct 2017
- ps fauxww
- curl --unix-socket /var/lib/lxd/unix.socket lxd/1.0/operations?recursion=1 | jq .
- /var/log/lxd/lxd.log
- Take a look at the "lxc monitor" output for anything suspicious (like some kind of event loop)
stgraber
on 3 Oct 2017
Got it, I will do next time - now it settled down itself :-S (but as TIME tells - it happens quite periodically, the machine is running just 2+ days, and lxd took 5 hours of cpu out of that time). I'll report whenever I spot it again, thanks.
zerkms
on 4 Oct 2017
I'm hoping it's our favorite exec issue, if it is, then 2.0.11 will fix that.
stgraber
on 4 Oct 2017
ps fauxww
USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
root 2 0.0 0.0 0 0 ? S 19:25 0:00 [kthreadd]
root 3 0.0 0.0 0 0 ? S 19:25 0:00 \_ [ksoftirqd/0]
root 5 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kworker/0:0H]
root 7 0.1 0.0 0 0 ? S 19:25 0:14 \_ [rcu_sched]
root 8 0.0 0.0 0 0 ? S 19:25 0:00 \_ [rcu_bh]
root 9 0.0 0.0 0 0 ? S 19:25 0:00 \_ [migration/0]
root 10 0.0 0.0 0 0 ? S 19:25 0:00 \_ [watchdog/0]
root 11 0.0 0.0 0 0 ? S 19:25 0:00 \_ [watchdog/1]
root 12 0.0 0.0 0 0 ? S 19:25 0:00 \_ [migration/1]
root 13 0.0 0.0 0 0 ? S 19:25 0:00 \_ [ksoftirqd/1]
root 15 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kworker/1:0H]
root 16 0.0 0.0 0 0 ? S 19:25 0:00 \_ [watchdog/2]
root 17 0.0 0.0 0 0 ? S 19:25 0:00 \_ [migration/2]
root 18 0.0 0.0 0 0 ? S 19:25 0:00 \_ [ksoftirqd/2]
root 20 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kworker/2:0H]
root 21 0.0 0.0 0 0 ? S 19:25 0:00 \_ [watchdog/3]
root 22 0.0 0.0 0 0 ? S 19:25 0:00 \_ [migration/3]
root 23 0.0 0.0 0 0 ? S 19:25 0:00 \_ [ksoftirqd/3]
root 25 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kworker/3:0H]
root 26 0.0 0.0 0 0 ? S 19:25 0:00 \_ [watchdog/4]
root 27 0.0 0.0 0 0 ? S 19:25 0:00 \_ [migration/4]
root 28 0.0 0.0 0 0 ? S 19:25 0:00 \_ [ksoftirqd/4]
root 30 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kworker/4:0H]
root 31 0.0 0.0 0 0 ? S 19:25 0:00 \_ [watchdog/5]
root 32 0.0 0.0 0 0 ? S 19:25 0:00 \_ [migration/5]
root 33 0.0 0.0 0 0 ? S 19:25 0:00 \_ [ksoftirqd/5]
root 35 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kworker/5:0H]
root 36 0.0 0.0 0 0 ? S 19:25 0:00 \_ [watchdog/6]
root 37 0.0 0.0 0 0 ? S 19:25 0:00 \_ [migration/6]
root 38 0.0 0.0 0 0 ? S 19:25 0:00 \_ [ksoftirqd/6]
root 40 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kworker/6:0H]
root 41 0.0 0.0 0 0 ? S 19:25 0:00 \_ [watchdog/7]
root 42 0.0 0.0 0 0 ? S 19:25 0:00 \_ [migration/7]
root 43 0.0 0.0 0 0 ? S 19:25 0:00 \_ [ksoftirqd/7]
root 45 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kworker/7:0H]
root 46 0.0 0.0 0 0 ? S 19:25 0:00 \_ [kdevtmpfs]
root 47 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [netns]
root 48 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [perf]
root 49 0.0 0.0 0 0 ? S 19:25 0:00 \_ [khungtaskd]
root 50 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [writeback]
root 51 0.0 0.0 0 0 ? SN 19:25 0:00 \_ [ksmd]
root 52 0.0 0.0 0 0 ? SN 19:25 0:00 \_ [khugepaged]
root 53 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [crypto]
root 54 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kintegrityd]
root 55 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 56 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kblockd]
root 57 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [ata_sff]
root 58 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [md]
root 59 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [devfreq_wq]
root 70 0.0 0.0 0 0 ? S 19:25 0:00 \_ [kswapd0]
root 71 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [vmstat]
root 72 0.0 0.0 0 0 ? S 19:25 0:00 \_ [fsnotify_mark]
root 73 0.0 0.0 0 0 ? S 19:25 0:00 \_ [ecryptfs-kthrea]
root 89 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kthrotld]
root 90 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [acpi_thermal_pm]
root 91 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 92 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 93 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 94 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 95 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 96 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 97 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 98 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 102 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [ipv6_addrconf]
root 116 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [deferwq]
root 117 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [charger_manager]
root 163 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kpsmoused]
root 180 0.0 0.0 0 0 ? S 19:25 0:00 \_ [scsi_eh_0]
root 181 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [scsi_tmf_0]
root 182 0.0 0.0 0 0 ? S 19:25 0:00 \_ [scsi_eh_1]
root 183 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [scsi_tmf_1]
root 184 0.0 0.0 0 0 ? S 19:25 0:00 \_ [scsi_eh_2]
root 185 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [scsi_tmf_2]
root 186 0.0 0.0 0 0 ? S 19:25 0:00 \_ [scsi_eh_3]
root 187 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [scsi_tmf_3]
root 188 0.0 0.0 0 0 ? S 19:25 0:00 \_ [scsi_eh_4]
root 189 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [scsi_tmf_4]
root 190 0.0 0.0 0 0 ? S 19:25 0:00 \_ [scsi_eh_5]
root 191 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [scsi_tmf_5]
root 198 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [ttm_swap]
root 202 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 204 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 205 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 206 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 220 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 225 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 226 0.0 0.0 0 0 ? S 19:25 0:00 \_ [md0_raid1]
root 228 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 231 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 232 0.0 0.0 0 0 ? D 19:25 0:00 \_ [md1_raid1]
root 233 0.0 0.0 0 0 ? S< 19:25 0:01 \_ [kworker/6:1H]
root 301 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [raid5wq]
root 325 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kdmflush]
root 326 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 338 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 346 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kworker/4:1H]
root 347 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kworker/2:1H]
root 348 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kworker/0:1H]
root 362 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kworker/3:1H]
root 366 0.0 0.0 0 0 ? D 19:25 0:00 \_ [jbd2/dm-0-8]
root 367 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [ext4-rsv-conver]
root 413 0.0 0.0 0 0 ? S 19:25 0:00 \_ [kauditd]
root 433 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kworker/1:1H]
root 446 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [iscsi_eh]
root 453 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [ib_addr]
root 462 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [ib_mcast]
root 463 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [ib_nl_sa_wq]
root 467 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [ib_cm]
root 468 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [iw_cm_wq]
root 470 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [rdma_cm]
root 541 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [edac-poller]
root 577 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kvm-irqfd-clean]
root 844 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [dm_bufio_cache]
root 850 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kdmflush]
root 851 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kdmflush]
root 852 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 853 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 856 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kdmflush]
root 857 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 860 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kdmflush]
root 862 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 915 0.0 0.0 0 0 ? S 19:25 0:00 \_ [jbd2/md0-8]
root 916 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [ext4-rsv-conver]
root 919 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kdmflush]
root 920 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 921 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kcopyd]
root 922 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 923 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [dm-thin]
root 924 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 927 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kdmflush]
root 928 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 948 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kdmflush]
root 954 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 957 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kdmflush]
root 963 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 965 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kdmflush]
root 974 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 976 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kdmflush]
root 984 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 986 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kdmflush]
root 998 0.0 0.0 0 0 ? S 19:25 0:00 \_ [jbd2/dm-7-8]
root 999 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [ext4-rsv-conver]
root 1000 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 1003 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kdmflush]
root 1009 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 1011 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kdmflush]
root 1018 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 1020 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kdmflush]
root 1027 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 1029 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kdmflush]
root 1038 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 1041 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kdmflush]
root 1047 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 1049 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kdmflush]
root 1058 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 1060 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kdmflush]
root 1069 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 1074 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kdmflush]
root 1075 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 1076 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kcopyd]
root 1078 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 1079 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [dm-thin]
root 1080 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 1082 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kdmflush]
root 1083 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 1087 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kdmflush]
root 1098 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 1100 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kdmflush]
root 1116 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 1118 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kdmflush]
root 1128 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 1132 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kdmflush]
root 1139 0.0 0.0 0 0 ? S 19:25 0:00 \_ [jbd2/dm-21-8]
root 1140 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [ext4-rsv-conver]
root 1146 0.0 0.0 0 0 ? S 19:25 0:03 \_ [jbd2/dm-22-8]
root 1147 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [ext4-rsv-conver]
root 1150 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [bioset]
root 1153 0.0 0.0 0 0 ? S 19:25 0:00 \_ [jbd2/dm-23-8]
root 1154 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [ext4-rsv-conver]
root 1161 0.0 0.0 0 0 ? S 19:25 0:00 \_ [jbd2/dm-24-8]
root 1162 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [ext4-rsv-conver]
root 1833 0.0 0.0 0 0 ? S 19:25 0:00 \_ [jbd2/dm-16-8]
root 1834 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [ext4-rsv-conver]
root 2587 0.0 0.0 0 0 ? S 19:25 0:00 \_ [jbd2/dm-13-8]
root 2588 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [ext4-rsv-conver]
root 2589 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kworker/7:1H]
root 4447 0.0 0.0 0 0 ? S 19:25 0:00 \_ [jbd2/dm-17-8]
root 4448 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [ext4-rsv-conver]
root 5461 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [kworker/5:1H]
root 7148 0.0 0.0 0 0 ? S 19:25 0:00 \_ [jbd2/dm-11-8]
root 7149 0.0 0.0 0 0 ? S< 19:25 0:00 \_ [ext4-rsv-conver]
root 15437 0.0 0.0 0 0 ? S< 19:29 0:00 \_ [xfsalloc]
root 15438 0.0 0.0 0 0 ? S< 19:29 0:00 \_ [xfs_mru_cache]
root 15446 0.0 0.0 0 0 ? S 19:29 0:00 \_ [jfsIO]
root 15447 0.0 0.0 0 0 ? S 19:29 0:00 \_ [jfsCommit]
root 15448 0.0 0.0 0 0 ? S 19:29 0:00 \_ [jfsCommit]
root 15449 0.0 0.0 0 0 ? S 19:29 0:00 \_ [jfsCommit]
root 15450 0.0 0.0 0 0 ? S 19:29 0:00 \_ [jfsCommit]
root 15451 0.0 0.0 0 0 ? S 19:29 0:00 \_ [jfsCommit]
root 15452 0.0 0.0 0 0 ? S 19:29 0:00 \_ [jfsCommit]
root 15453 0.0 0.0 0 0 ? S 19:29 0:00 \_ [jfsCommit]
root 15454 0.0 0.0 0 0 ? S 19:29 0:00 \_ [jfsCommit]
root 15455 0.0 0.0 0 0 ? S 19:29 0:00 \_ [jfsSync]
root 21058 0.0 0.0 0 0 ? S 19:40 0:02 \_ [kworker/7:0]
root 21566 0.4 0.0 0 0 ? S 19:44 0:30 \_ [kworker/u16:0]
root 26308 0.0 0.0 0 0 ? S 20:08 0:00 \_ [jbd2/dm-10-8]
root 26309 0.0 0.0 0 0 ? S< 20:08 0:00 \_ [ext4-rsv-conver]
root 26315 0.0 0.0 0 0 ? S 20:08 0:02 \_ [kworker/6:1]
root 30512 0.0 0.0 0 0 ? S 20:20 0:01 \_ [kworker/5:0]
root 31349 0.6 0.0 0 0 ? S 20:27 0:24 \_ [kworker/u16:2]
root 31662 0.0 0.0 0 0 ? S 20:30 0:00 \_ [kworker/5:2]
root 32396 0.5 0.0 0 0 ? S 20:33 0:20 \_ [kworker/u16:1]
root 2823 0.0 0.0 0 0 ? S 20:48 0:00 \_ [kworker/1:2]
root 3263 0.0 0.0 0 0 ? S 20:52 0:00 \_ [kworker/7:2]
root 5530 0.0 0.0 0 0 ? S 21:04 0:00 \_ [kworker/0:1]
root 6113 0.0 0.0 0 0 ? S 21:09 0:00 \_ [kworker/4:1]
root 6860 0.0 0.0 0 0 ? S 21:12 0:00 \_ [kworker/2:0]
root 6891 0.0 0.0 0 0 ? S 21:12 0:00 \_ [kworker/3:1]
root 7644 0.0 0.0 0 0 ? S 21:17 0:00 \_ [kworker/2:1]
root 7645 0.0 0.0 0 0 ? S 21:17 0:00 \_ [kworker/6:2]
root 7676 0.0 0.0 0 0 ? S 21:17 0:00 \_ [kworker/3:0]
root 8430 0.0 0.0 0 0 ? S 21:20 0:00 \_ [kworker/1:0]
root 8480 0.0 0.0 0 0 ? S 21:20 0:00 \_ [kworker/4:2]
root 8849 0.5 0.0 0 0 ? S 21:23 0:03 \_ [kworker/u16:3]
root 8892 0.0 0.0 0 0 ? S 21:24 0:00 \_ [kworker/0:0]
root 10487 0.0 0.0 0 0 ? S 21:32 0:00 \_ [kworker/4:0]
root 1 0.0 0.0 38092 6220 ? Ss 19:25 0:02 /sbin/init
root 430 0.0 0.0 35276 4372 ? Ss 19:25 0:00 /lib/systemd/systemd-journald
root 486 0.0 0.0 176700 1936 ? Ssl 19:25 0:01 /sbin/lvmetad -f
root 492 0.0 0.0 45628 5108 ? Ss 19:25 0:00 /lib/systemd/systemd-udevd
root 930 0.0 0.2 167208 17668 ? SLsl 19:25 0:02 /sbin/dmeventd -f
root 1358 0.0 0.0 29008 2964 ? Ss 19:25 0:00 /usr/sbin/cron -f
root 1363 0.3 0.0 603840 3728 ? Ssl 19:25 0:27 /usr/bin/lxcfs /var/lib/lxcfs/
message+ 1370 0.0 0.0 42896 3864 ? Ss 19:25 0:00 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation
root 1403 0.0 0.0 4400 1360 ? Ss 19:25 0:00 /usr/sbin/acpid
root 1407 0.0 0.0 28628 3148 ? Ss 19:25 0:00 /lib/systemd/systemd-logind
syslog 1410 0.0 0.0 256396 5656 ? Ssl 19:25 0:00 /usr/sbin/rsyslogd -n
root 1429 0.0 0.0 13524 2092 ? Ss 19:25 0:00 /sbin/mdadm --monitor --pid-file /run/mdadm/monitor.pid --daemonise --scan --syslog
root 1527 0.0 0.0 65520 5272 ? Ss 19:25 0:00 /usr/sbin/sshd -D
root 10484 0.0 0.0 95368 6912 ? Ss 21:32 0:00 \_ sshd: ivan [priv]
ivan 10812 0.0 0.0 95368 4152 ? S 21:32 0:00 \_ sshd: ivan@pts/3
ivan 10813 0.0 0.0 21196 3812 pts/3 Ss 21:32 0:00 \_ -bash
root 10821 0.0 0.0 52936 4044 pts/3 S 21:32 0:00 \_ sudo su
root 10822 0.0 0.0 52284 3624 pts/3 S 21:32 0:00 \_ su
root 10823 0.0 0.0 21316 3916 pts/3 S 21:32 0:00 \_ bash
root 11000 0.0 0.0 37860 3972 pts/3 R+ 21:33 0:00 \_ ps fauxww
root 1536 0.0 0.0 5224 156 ? Ss 19:25 0:00 /sbin/iscsid
root 1537 0.0 0.0 5724 3520 ? S<Ls 19:25 0:00 /sbin/iscsid
root 1611 0.0 0.0 15940 1776 tty1 Ss+ 19:25 0:00 /sbin/agetty --noclear tty1 linux
root 1618 0.4 0.1 894244 12332 ? SLsl 19:25 0:36 /usr/sbin/collectd
zabbix 1635 0.0 0.0 92508 2968 ? S 19:25 0:00 /usr/sbin/zabbix_agentd
zabbix 1636 0.0 0.0 92508 2660 ? S 19:25 0:00 \_ /usr/sbin/zabbix_agentd: collector [idle 1 sec]
zabbix 1637 0.0 0.0 94584 5168 ? S 19:25 0:00 \_ /usr/sbin/zabbix_agentd: listener #1 [waiting for connection]
zabbix 1638 0.0 0.0 94584 5172 ? S 19:25 0:00 \_ /usr/sbin/zabbix_agentd: listener #2 [waiting for connection]
zabbix 1639 0.0 0.0 94584 5168 ? S 19:25 0:00 \_ /usr/sbin/zabbix_agentd: listener #3 [waiting for connection]
zabbix 1640 0.0 0.0 94584 5144 ? S 19:25 0:00 \_ /usr/sbin/zabbix_agentd: active checks #1 [idle 1 sec]
ntp 1642 0.0 0.0 110032 5168 ? Ss 19:25 0:00 /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 111:118
root 1764 59.2 0.4 1499376 34216 ? Ssl 19:25 75:53 /usr/bin/lxd --group lxd --logfile=/var/log/lxd/lxd.log
root 1807 0.0 0.0 65408 4416 ? Ss 19:25 0:00 /usr/lib/postfix/sbin/master
postfix 1810 0.0 0.0 67524 4388 ? S 19:25 0:00 \_ qmgr -l -t unix -u
postfix 5687 0.0 0.0 67476 4400 ? S 21:05 0:00 \_ pickup -l -t unix -u -c
root 1821 0.0 0.0 95016 5504 ? Ss 19:25 0:00 [lxc monitor] /var/lib/lxd/containers xxx
100000 1846 0.0 0.0 119328 5468 ? Ss 19:25 0:00 \_ /sbin/init
100000 2006 0.0 0.0 41724 3280 ? Ss 19:25 0:00 \_ /lib/systemd/systemd-udevd
100000 2007 0.0 0.0 35280 4356 ? Ss 19:25 0:00 \_ /lib/systemd/systemd-journald
100104 2146 0.0 0.0 180592 3132 ? Ssl 19:25 0:00 \_ /usr/sbin/rsyslogd -n
100000 2154 0.0 0.0 27736 3036 ? Ss 19:25 0:00 \_ /usr/sbin/cron -f
100107 2157 0.0 0.0 42904 3836 ? Ss 19:25 0:00 \_ /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation
100000 2164 0.0 0.0 20104 1184 ? Ss 19:25 0:00 \_ /lib/systemd/systemd-logind
100000 2295 0.0 0.5 378712 41044 ? Ss 19:25 0:00 \_ php-fpm: master process (/etc/php/7.1/fpm/php-fpm.conf)
100033 2556 0.0 0.0 378712 8048 ? S 19:25 0:00 | \_ php-fpm: pool www
100033 2557 0.0 0.2 381404 24192 ? S 19:25 0:00 | \_ php-fpm: pool www
100000 2316 0.0 0.0 65524 5356 ? Ss 19:25 0:00 \_ /usr/sbin/sshd -D
100000 2381 0.0 0.0 14480 2180 pts/0 Ss+ 19:25 0:00 \_ /sbin/agetty --noclear --keep-baud console 115200 38400 9600 linux
100000 2391 0.0 0.0 856872 5400 ? SLsl 19:25 0:03 \_ /usr/sbin/collectd
100113 2419 0.0 0.0 92528 2896 ? S 19:25 0:00 \_ /usr/sbin/zabbix_agentd
100113 2431 0.0 0.0 92528 2332 ? S 19:25 0:02 | \_ /usr/sbin/zabbix_agentd: collector [idle 1 sec]
100113 2432 0.0 0.0 94604 5100 ? S 19:25 0:00 | \_ /usr/sbin/zabbix_agentd: listener #1 [waiting for connection]
100113 2433 0.0 0.0 94604 5100 ? S 19:25 0:00 | \_ /usr/sbin/zabbix_agentd: listener #2 [waiting for connection]
100113 2434 0.0 0.0 94604 5100 ? S 19:25 0:00 | \_ /usr/sbin/zabbix_agentd: listener #3 [waiting for connection]
100113 2435 0.0 0.0 94604 5152 ? S 19:25 0:00 | \_ /usr/sbin/zabbix_agentd: active checks #1 [idle 1 sec]
100000 2463 0.0 0.0 123272 2408 ? Ss 19:25 0:00 \_ nginx: master process /usr/sbin/nginx -g daemon on; master_process on;
100033 2464 0.0 0.0 123616 3204 ? S 19:25 0:00 | \_ nginx: worker process
100033 2465 0.0 0.0 123616 3204 ? S 19:25 0:00 | \_ nginx: worker process
100033 2466 0.0 0.0 123616 3204 ? S 19:25 0:00 | \_ nginx: worker process
100033 2467 0.0 0.0 123616 3204 ? S 19:25 0:00 | \_ nginx: worker process
100033 2468 0.0 0.0 123616 3204 ? S 19:25 0:00 | \_ nginx: worker process
100033 2469 0.0 0.0 123616 3204 ? S 19:25 0:00 | \_ nginx: worker process
100033 2470 0.0 0.0 123616 5260 ? S 19:25 0:00 | \_ nginx: worker process
100033 2471 0.0 0.0 123616 3204 ? S 19:25 0:00 | \_ nginx: worker process
100000 2558 0.0 0.0 65408 4336 ? Ss 19:25 0:00 \_ /usr/lib/postfix/sbin/master
100112 2567 0.0 0.0 67524 4424 ? S 19:25 0:00 \_ qmgr -l -t unix -u
100112 5689 0.0 0.0 67476 4376 ? S 21:05 0:00 \_ pickup -l -t unix -u -c
root 2577 0.0 0.0 95016 5420 ? Ss 19:25 0:00 [lxc monitor] /var/lib/lxd/containers xxx
100000 2597 0.0 0.0 33124 3628 ? Ss 19:25 0:00 \_ /sbin/init
100000 3379 0.0 0.0 15260 1772 ? S 19:25 0:00 \_ upstart-socket-bridge --daemon
100000 3999 0.0 0.0 19476 180 ? S 19:25 0:00 \_ upstart-udev-bridge --daemon
100000 4031 0.0 0.0 49540 3324 ? Ss 19:25 0:00 \_ /lib/systemd/systemd-udevd --daemon
100103 4069 0.0 0.0 39224 2084 ? Ss 19:25 0:00 \_ dbus-daemon --system --fork
100000 4080 0.0 0.0 35020 2860 ? Ss 19:25 0:00 \_ /lib/systemd/systemd-logind
100000 4085 0.0 0.0 15368 1740 ? S 19:25 0:00 \_ upstart-file-bridge --daemon
100101 4088 0.0 0.0 180144 2848 ? Ssl 19:25 0:00 \_ rsyslogd
100000 4196 0.0 0.0 61372 5324 ? Ss 19:25 0:00 \_ /usr/sbin/sshd -D
100000 4202 0.0 0.0 23656 2456 ? Ss 19:25 0:00 \_ cron
100111 4227 0.1 0.0 30956 3568 ? S 19:25 0:09 \_ /usr/sbin/dnsmasq -x /var/run/dnsmasq/dnsmasq.pid -u dnsmasq -7 /etc/dnsmasq.d,.dpkg-dist,.dpkg-old,.dpkg-new
100000 4249 0.0 0.0 106472 6836 ? Ss 19:25 0:01 \_ /var/cfengine/bin/cf-execd
100000 4256 0.0 0.1 42432 10084 ? Ss 19:25 0:01 \_ /var/cfengine/bin/cf-serverd
100000 4264 0.0 0.1 42424 10236 ? Ss 19:25 0:04 \_ /var/cfengine/bin/cf-monitord
100000 4281 0.0 0.0 85888 2824 ? Ss 19:25 0:00 \_ nginx: master process /usr/sbin/nginx
100033 4282 0.0 0.0 86180 3660 ? S 19:25 0:00 | \_ nginx: worker process
100033 4283 0.0 0.0 86180 3660 ? S 19:25 0:00 | \_ nginx: worker process
100033 4284 0.0 0.0 86180 3660 ? S 19:25 0:00 | \_ nginx: worker process
100033 4285 0.0 0.0 86180 3660 ? S 19:25 0:00 | \_ nginx: worker process
100000 4376 0.0 0.0 25344 2848 ? Ss 19:25 0:00 \_ /usr/lib/postfix/master
100105 4383 0.0 0.0 27460 2928 ? S 19:25 0:00 | \_ qmgr -l -t unix -u
100105 5694 0.0 0.0 27408 2860 ? S 21:05 0:00 | \_ pickup -l -t unix -u -c
100110 4385 0.0 0.0 95420 2892 ? S 19:25 0:00 \_ /usr/sbin/zabbix_agentd
100110 4386 0.0 0.0 95420 2776 ? S 19:25 0:02 | \_ /usr/sbin/zabbix_agentd: collector [idle 1 sec]
100110 4387 0.0 0.0 97492 5016 ? S 19:25 0:00 | \_ /usr/sbin/zabbix_agentd: listener #1 [waiting for connection]
100110 4388 0.0 0.0 97492 5016 ? S 19:25 0:00 | \_ /usr/sbin/zabbix_agentd: listener #2 [waiting for connection]
100110 4389 0.0 0.0 97492 5016 ? S 19:25 0:00 | \_ /usr/sbin/zabbix_agentd: listener #3 [waiting for connection]
100110 4390 0.0 0.0 97492 5088 ? S 19:25 0:00 | \_ /usr/sbin/zabbix_agentd: active checks #1 [idle 1 sec]
100000 4396 0.0 0.0 4328 1024 ? Ss 19:25 0:00 \_ /usr/sbin/collectdmon -P /var/run/collectd.pid -- -C /etc/collectd/collectd.conf
100000 4408 0.0 0.0 1005116 6808 ? SLl 19:25 0:03 \_ collectd -C /etc/collectd/collectd.conf -f
root 4436 0.0 0.0 169804 5324 ? Ss 19:25 0:00 [lxc monitor] /var/lib/lxd/containers xxx
100000 4456 0.0 0.0 37392 5420 ? Ss 19:25 0:00 \_ /sbin/init
100000 4595 0.0 0.0 41720 3312 ? Ss 19:25 0:00 \_ /lib/systemd/systemd-udevd
100000 4598 0.0 0.0 35276 4280 ? Ss 19:25 0:00 \_ /lib/systemd/systemd-journald
100107 4784 0.0 0.0 42900 3876 ? Ss 19:25 0:00 \_ /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation
100104 4791 0.0 0.0 180592 3064 ? Ssl 19:25 0:00 \_ /usr/sbin/rsyslogd -n
100000 4792 0.0 0.0 20100 1116 ? Ss 19:25 0:00 \_ /lib/systemd/systemd-logind
100000 4797 0.0 0.0 27732 2976 ? Ss 19:25 0:00 \_ /usr/sbin/cron -f
100000 4925 0.0 0.0 65520 5536 ? Ss 19:25 0:00 \_ /usr/sbin/sshd -D
100000 5040 0.0 0.0 109276 6472 ? Ss 19:25 0:00 \_ /usr/sbin/squid -YC -f /etc/squid/squid.conf
100013 5043 0.1 0.6 181096 56940 ? S 19:25 0:10 | \_ (squid-1) -YC -f /etc/squid/squid.conf
100013 5091 0.0 0.0 13268 1624 ? S 19:25 0:00 | \_ (unlinkd)
100000 5052 0.0 0.0 14480 2184 pts/2 Ss+ 19:25 0:00 \_ /sbin/agetty --noclear --keep-baud console 115200 38400 9600 linux
100000 5067 0.0 0.0 856872 5392 ? SLsl 19:25 0:03 \_ /usr/sbin/collectd
100113 5095 0.0 0.0 92528 2988 ? S 19:25 0:00 \_ /usr/sbin/zabbix_agentd
100113 5099 0.0 0.0 92528 2392 ? S 19:25 0:01 | \_ /usr/sbin/zabbix_agentd: collector [idle 1 sec]
100113 5100 0.0 0.0 94604 5076 ? S 19:25 0:00 | \_ /usr/sbin/zabbix_agentd: listener #1 [waiting for connection]
100113 5101 0.0 0.0 94604 5076 ? S 19:25 0:00 | \_ /usr/sbin/zabbix_agentd: listener #2 [waiting for connection]
100113 5102 0.0 0.0 94604 5076 ? S 19:25 0:00 | \_ /usr/sbin/zabbix_agentd: listener #3 [waiting for connection]
100113 5103 0.0 0.0 94604 5112 ? S 19:25 0:00 | \_ /usr/sbin/zabbix_agentd: active checks #1 [idle 1 sec]
100000 5451 0.0 0.0 65408 4436 ? Ss 19:25 0:00 \_ /usr/lib/postfix/sbin/master
100112 5459 0.0 0.0 67524 4500 ? S 19:25 0:00 \_ qmgr -l -t unix -u
100112 5704 0.0 0.0 67476 4396 ? S 21:05 0:00 \_ pickup -l -t unix -u -c
root 7137 0.0 0.0 95272 5316 ? Ss 19:25 0:00 [lxc monitor] /var/lib/lxd/containers xxx
100000 7159 0.0 0.0 24068 3040 ? Ss 19:25 0:00 \_ /sbin/init
100000 7275 0.0 0.0 36696 2744 ? Ss 19:25 0:00 \_ sudo -u _statsd /usr/share/statsd/scripts/start
100107 7294 0.0 0.0 4404 736 ? S 19:25 0:00 | \_ /bin/sh /usr/share/statsd/scripts/start
100107 7298 0.4 0.7 707188 60028 ? Sl 19:25 0:31 | \_ statsd
100000 7657 0.0 0.0 15192 200 ? S 19:25 0:00 \_ upstart-socket-bridge --daemon
100000 9553 0.0 0.0 17236 164 ? S 19:25 0:00 \_ upstart-udev-bridge --daemon
100000 9589 0.0 0.0 21340 2168 ? Ss 19:25 0:00 \_ /sbin/udevd --daemon
100000 9594 0.0 0.0 50044 5252 ? Ss 19:25 0:00 \_ /usr/sbin/sshd -D
100102 9599 0.0 0.0 23820 252 ? Ss 19:25 0:00 \_ dbus-daemon --system --fork --activation=upstart
100104 9607 0.0 0.0 173656 2644 ? Sl 19:25 0:00 \_ rsyslogd -c5
100000 9650 0.0 0.0 19116 2144 ? Ss 19:25 0:00 \_ cron
100000 9669 0.4 0.2 138120 19056 ? Sl 19:25 0:31 \_ /usr/bin/python /opt/graphite/bin/carbon-cache.py start
100000 9707 0.0 0.0 102168 6520 ? Ss 19:25 0:01 \_ /var/cfengine/bin/cf-execd
100000 9714 0.0 0.1 38120 10060 ? Ss 19:25 0:01 \_ /var/cfengine/bin/cf-serverd
100000 9721 0.0 0.1 38116 10532 ? Ss 19:25 0:04 \_ /var/cfengine/bin/cf-monitord
100105 9738 0.0 0.0 323224 2552 ? Sl 19:25 0:00 \_ /usr/bin/memcached -m 64 -p 11211 -u memcache -l 127.0.0.1
100000 9855 0.0 0.0 25112 2848 ? Ss 19:25 0:00 \_ /usr/lib/postfix/master
100108 9860 0.0 0.0 27228 2900 ? S 19:25 0:00 | \_ qmgr -l -t fifo -u
100108 5736 0.0 0.0 27176 2924 ? S 21:05 0:00 | \_ pickup -l -t fifo -u -c
100106 9881 0.0 0.0 7420 92 ? S 19:25 0:00 \_ /usr/lib/erlang/erts-5.8.5/bin/epmd -daemon
100106 9904 0.0 0.0 4404 684 ? S 19:25 0:00 \_ /bin/sh /usr/sbin/rabbitmq-server
100106 9944 0.0 6.6 2714644 543600 ? Sl 19:25 0:06 | \_ /usr/lib/erlang/erts-5.8.5/bin/beam.smp -W w -K true -A30 -P 1048576 -- -root /usr/lib/erlang -progname erl -- -home /var/lib/rabbitmq -- -pa /usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/sbin/../ebin -noshell -noinput -s rabbit boot -sname rabbit@graphite -boot start_sasl -kernel inet_default_connect_options [{nodelay,true}] -sasl errlog_type error -sasl sasl_error_logger false -rabbit error_logger {file,"/var/log/rabbitmq/[email protected]"} -rabbit sasl_error_logger {file,"/var/log/rabbitmq/[email protected]"} -rabbit enabled_plugins_file "/etc/rabbitmq/enabled_plugins" -rabbit plugins_dir "/usr/lib/rabbitmq/lib/rabbitmq_server-3.1.5/sbin/../plugins" -rabbit plugins_expand_dir "/var/lib/rabbitmq/mnesia/rabbit@graphite-plugins-expand" -os_mon start_cpu_sup false -os_mon start_disksup false -os_mon start_memsup false -mnesia dir "/var/lib/rabbitmq/mnesia/rabbit@graphite"
100106 10037 0.0 0.0 7384 948 ? Ss 19:25 0:00 | \_ inet_gethost 4
100106 10038 0.0 0.0 9484 1620 ? S 19:25 0:00 | \_ inet_gethost 4
100103 10057 0.0 0.0 88548 2568 ? S 19:25 0:00 \_ /usr/sbin/zabbix_agentd
100103 10062 0.0 0.0 88548 2628 ? S 19:25 0:02 | \_ /usr/sbin/zabbix_agentd: collector [idle 1 sec]
100103 10063 0.0 0.0 90628 4628 ? S 19:25 0:00 | \_ /usr/sbin/zabbix_agentd: listener #1 [waiting for connection]
100103 10064 0.0 0.0 90628 4628 ? S 19:25 0:00 | \_ /usr/sbin/zabbix_agentd: listener #2 [waiting for connection]
100103 10066 0.0 0.0 90628 4628 ? S 19:25 0:00 | \_ /usr/sbin/zabbix_agentd: listener #3 [waiting for connection]
100103 10067 0.0 0.0 90628 4640 ? S 19:25 0:00 | \_ /usr/sbin/zabbix_agentd: active checks #1 [idle 1 sec]
100000 10094 0.0 0.1 95384 9568 ? Ss 19:25 0:00 \_ /usr/sbin/apache2 -k start
100033 10096 0.0 0.0 92976 4276 ? S 19:25 0:00 | \_ /usr/sbin/apache2 -k start
100033 10107 0.0 0.3 179976 26264 ? Sl 19:25 0:00 | \_ (wsgi:graphite) -k start
100033 10108 0.0 0.3 179976 26308 ? Sl 19:25 0:00 | \_ (wsgi:graphite) -k start
100033 10109 0.0 0.3 179680 25828 ? Sl 19:25 0:00 | \_ (wsgi:graphite) -k start
100033 10110 0.0 0.3 179680 25868 ? Sl 19:25 0:00 | \_ (wsgi:graphite) -k start
100033 10111 0.0 0.3 179680 25888 ? Sl 19:25 0:00 | \_ (wsgi:graphite) -k start
100033 10112 0.0 0.1 447756 11624 ? Sl 19:25 0:00 | \_ /usr/sbin/apache2 -k start
100033 10113 0.0 0.1 447756 11624 ? Sl 19:25 0:00 | \_ /usr/sbin/apache2 -k start
100000 10105 0.0 0.0 12756 1832 pts/5 Ss+ 19:25 0:00 \_ /sbin/getty -8 38400 console
root 26296 0.0 0.0 95272 5484 ? Ss 20:08 0:00 [lxc monitor] /var/lib/lxd/containers xxx
100000 26320 0.0 0.0 33108 3588 ? Ss 20:08 0:00 \_ /sbin/init
100000 26776 0.0 0.0 15260 244 ? S 20:08 0:00 \_ upstart-socket-bridge --daemon
100000 27715 0.0 0.0 19476 180 ? S 20:08 0:00 \_ upstart-udev-bridge --daemon
100000 27753 0.0 0.0 49540 3344 ? Ss 20:08 0:00 \_ /lib/systemd/systemd-udevd --daemon
100103 27788 0.0 0.0 39128 2032 ? Ss 20:08 0:00 \_ dbus-daemon --system --fork
100000 27801 0.0 0.0 35020 2884 ? Ss 20:08 0:00 \_ /lib/systemd/systemd-logind
100000 27807 0.0 0.0 15404 1680 ? S 20:08 0:00 \_ upstart-file-bridge --daemon
100101 27845 0.0 0.0 180140 2788 ? Ssl 20:08 0:00 \_ rsyslogd
100000 27894 0.0 0.0 61380 5384 ? Ss 20:08 0:00 \_ /usr/sbin/sshd -D
100000 27905 0.0 0.0 23652 2312 ? Ss 20:08 0:00 \_ cron
100000 27962 0.0 0.2 133632 18056 ? Ss 20:08 0:00 \_ php-fpm: master process (/etc/php5/fpm/php-fpm.conf)
100033 28991 0.0 0.1 134152 11516 ? S 20:11 0:00 | \_ php-fpm: pool www
100033 29531 0.0 0.1 134152 11508 ? S 20:15 0:00 | \_ php-fpm: pool www
100033 10454 0.0 0.1 133912 10920 ? S 21:32 0:00 | \_ php-fpm: pool www
100000 27967 0.0 0.0 102236 6528 ? Ss 20:08 0:01 \_ /var/cfengine/bin/cf-execd
100000 27974 0.0 0.1 38196 10068 ? Ss 20:08 0:01 \_ /var/cfengine/bin/cf-serverd
100000 27982 0.0 0.1 38188 10092 ? Ss 20:08 0:03 \_ /var/cfengine/bin/cf-monitord
100000 28003 0.0 0.0 85888 2940 ? Ss 20:08 0:00 \_ nginx: master process /usr/sbin/nginx
100033 28004 0.0 0.0 86560 4756 ? S 20:08 0:00 | \_ nginx: worker process
100033 28005 0.0 0.0 86212 3560 ? S 20:08 0:00 | \_ nginx: worker process
100033 28006 0.0 0.0 86212 3560 ? S 20:08 0:00 | \_ nginx: worker process
100033 28007 0.0 0.0 86212 3560 ? S 20:08 0:00 | \_ nginx: worker process
100000 28098 0.0 0.0 25340 2776 ? Ss 20:08 0:00 \_ /usr/lib/postfix/master
100105 28103 0.0 0.0 27404 2908 ? S 20:08 0:00 | \_ pickup -l -t unix -u -c
100105 28104 0.0 0.0 27456 2920 ? S 20:08 0:00 | \_ qmgr -l -t unix -u
100000 28105 5.2 0.1 528892 9060 ? Ssl 20:08 4:27 \_ /usr/bin/rrdcached -l unix:/var/run/rrdcached.sock -j /var/lib/rrdcached/journal/ -F -b /var/lib/rrdcached/db/ -B -w 30 -z 15 -p /var/run/rrdcached.pid
100110 28119 0.0 0.0 95420 2888 ? S 20:08 0:00 \_ /usr/sbin/zabbix_agentd
100110 28123 0.0 0.0 95420 2944 ? S 20:08 0:00 | \_ /usr/sbin/zabbix_agentd: collector [idle 1 sec]
100110 28124 0.0 0.0 97492 5144 ? S 20:08 0:00 | \_ /usr/sbin/zabbix_agentd: listener #1 [waiting for connection]
100110 28125 0.0 0.0 97492 5140 ? S 20:08 0:00 | \_ /usr/sbin/zabbix_agentd: listener #2 [waiting for connection]
100110 28126 0.0 0.0 97492 5144 ? S 20:08 0:00 | \_ /usr/sbin/zabbix_agentd: listener #3 [waiting for connection]
100110 28127 0.0 0.0 97492 5080 ? S 20:08 0:00 | \_ /usr/sbin/zabbix_agentd: active checks #1 [idle 1 sec]
100000 28130 5.7 0.2 933456 21000 ? Ssl 20:08 4:52 \_ /usr/sbin/collectd -C /etc/collectd/collectd.conf -P /var/run/collectd.pid
100000 28153 0.0 0.0 12784 1928 pts/4 Ss+ 20:08 0:00 \_ /sbin/getty -8 38400 console
ivan 10486 0.0 0.0 45380 4820 ? Ss 21:32 0:00 /lib/systemd/systemd --user
ivan 10489 0.0 0.0 61544 2280 ? S 21:32 0:00 \_ (sd-pam)
curl --unix-socket /var/lib/lxd/unix.socket lxd/1.0/operations?recursion=1 | jq .
{
"type": "sync",
"status": "Success",
"status_code": 200,
"operation": "",
"error_code": 0,
"error": "",
"metadata": {
"running": [
{
"id": "8c7250f3-4097-445c-9d57-922a88564e33",
"class": "websocket",
"created_at": "2017-10-11T20:08:58.26745849Z",
"updated_at": "2017-10-11T20:08:58.26745849Z",
"status": "Running",
"status_code": 103,
"resources": {
"containers": [
"/1.0/containers/xxx"
]
},
"metadata": {
"fds": {
"0": "70dce34242f79d8645c4be1649f312a211730fc55441eb33fdd65665c56413f5",
"control": "ae710b61edc1c25f0f342f6fc07cf45a1a05e937796d9e519c1f4ff87a5b04a1"
}
},
"may_cancel": false,
"err": ""
}
]
}
}
lxc monitor
metadata:
context: {}
level: dbug
message: 'New events listener: 3d994711-7245-4252-949a-cc5e3c4f5c86'
timestamp: 2017-10-11T21:34:26.078665319Z
type: logging
Those are the outputs from the commands, and I don't see anything suspicious.
BUT
I have done it twice and noticed, that the CPU consumption problem disappears after I run lxc monitor. I observed it twice on 2 entirely different machines that run lxd 2.0.10 but 2 different kernels (4.4 and 4.10 correspondingly).
zerkms
on 11 Oct 2017
Yep, it just has happened again: and lxc monitor instantly "fixed" it.
zerkms
on 13 Oct 2017
lxd 2.0.11 is now available as an update for all LXD users, this will hopefully take care of this.
If you're still hitting this issue after confirming you're running on LXD 2.0.11, let us know ASAP.
Otherwise I'll be closing this issue in a week or so.
stgraber
on 6 Dec 2017
👍2
Oh, that's unlikely to fix the monitor issue though as that'd need lxc 2.0.9 which we're yet to send through the update process, but at least the LXD side would be solved :)
stgraber
on 6 Dec 2017
I tried to perform a series of steps that sometimes could lead to this problem, and after 10 attempts - I could not get it. It does not mean that it's fixed for sure, but at least it means that I cannot reproduce it easily anymore :-) (which is good, thanks :-) )
And the "secret" steps are:
- Start a container
- exec bash into it
- run some command that outputs, eg
top - kill the terminal
Previously with ~30% confidence it lead to the problem, not anymore.
zerkms
on 6 Dec 2017
yeah, that would likely have caused the exec bug that we fixed in 2.0.11, so looks like that fix did help :)
stgraber
on 6 Dec 2017
🎉1
Okay, in that case I'm closing it (since I was the only affected by it, at least nobody else participated in the conversation).
If I spot something odd I'll reopen it.
Thanks! :-)
zerkms
on 6 Dec 2017
:+1:
Thumbs up for release @stgraber
stamster
on 6 Dec 2017
I confirm this has been fixed - no more sucking CPU at 100% after broken pipe! :+1:
stamster
on 7 Dec 2017
Was this page helpful?
0 / 5 - 0 ratings
Related issues
iteco
路
3Comments
killua-eu
路
3Comments
shaun-ba
路
3Comments
purell
路
4Comments
AndreiPashkin
路
5Comments
Most helpful comment
lxd 2.0.11 is now available as an update for all LXD users, this will hopefully take care of this.
If you're still hitting this issue after confirming you're running on LXD 2.0.11, let us know ASAP.
Otherwise I'll be closing this issue in a week or so.