monitoring & logging?

[fredericrous]

Did you get any monitoring working? I used to have traefik v1's traffic only, through grafana+influxdb.

I'm trying to go a little further with using prometheus, cadvisor and loki on traefik 2.

with cadvisor I get the error

E0611 01:24:21.847966       1 manager.go:1147] Failed to create existing container: /docker/2f90ccd411583fd18dfc0533680f5355c5af0d3aee0537981b027b3e1e3e5b54: failed to identify the read-write layer ID for container "2f90ccd411583fd18dfc0533680f5355c5af0d3aee0537981b027b3e1e3e5b54". - open /rootfs/var/lib/docker/image/overlay2/layerdb/mounts/2f90ccd411583fd18dfc0533680f5355c5af0d3aee0537981b027b3e1e3e5b54/mount-id: no such file or directory

if I increase these to v=4. I see a bunch of systemd or dockerd factory errors in the logs
Apparently this guy made it work on qnap but there's nothing special about his compose file https://github.com/fcwu/docker-dashboard-cadvisor-grafana

with loki when I execute the docker plugin install, I get an error from container station

Error response from daemon: rpc error: code = Unknown desc = oci runtime error: container_linux.go:265: starting container process caused "process_linux.go:368: container init caused \"rootfs_linux.go:57: mounting \\\"\\\" to rootfs \\\"/share/CACHEDEV1_DATA/Container/container-station-data/lib/docker/plugins/54d27fabc76daf81718ea514e9d7a35bbaa949c5f4cbf9e6d2ace47fc011177e/rootfs\\\" at \\\"/share/CACHEDEV1_DATA/Container/container-station-data/lib/docker/plugins/54d27fabc76daf81718ea514e9d7a35bbaa949c5f4cbf9e6d2ace47fc011177e/rootfs/data\\\" caused \\\"invalid argument\\\"\""

[gkoerk]

Still working on a good logging solution worth publishing. I'm also working on Promtail + Loki + Grafana, but not sure when I'll finish it. I've had problems with cadvisor in the past with a memory leak.