udp-packet-forwarder and the stack containers are storing too much information

[Michael-Ostrow]

These 2 applications have filled my disk. When I run

docker system df:

TYPE            TOTAL     ACTIVE    SIZE      RECLAIMABLE
Images          7         7         2.195GB   13.05MB (0%)
Containers      7         7         33.46kB   0B (0%)
Local Volumes   7         6         357.1MB   0B (0%)
Build Cache     0         0         0B        0B

docker system df -v:

Images space usage:

REPOSITORY                         TAG                IMAGE ID       CREATED        SIZE      SHARED SIZE   UNIQUE SIZE   CONTAINERS
influxdb                           1.8                c751f5c6b4f1   4 months ago   294.8MB   0B            294.8MB       1
rakwireless/udp-packet-forwarder   latest             4ddbba7e0f3d   4 months ago   211.9MB   0B            211.9MB       1
nodered/node-red                   latest             ec3331bdd5a1   4 months ago   563.5MB   0B            563.5MB       1
grafana/grafana                    latest             46becd7c39d0   4 months ago   422.1MB   7.729MB       414.4MB       1
xoseperez/the-things-stack         latest             2eba08c9670a   5 months ago   474.2MB   7.729MB       466.5MB       1
postgres                           14.3-alpine3.15    5074a23f5ac8   2 years ago    205MB     5.322MB       199.7MB       1
redis                              7.0.0-alpine3.15   9dcd83a87127   2 years ago    36.54MB   5.322MB       31.22MB       1

Containers space usage:

CONTAINER ID   IMAGE                                     COMMAND                  LOCAL VOLUMES   SIZE      CREATED         STATUS                   NAMES
8494a17d60b4   nodered/node-red:latest                   "/data/entrypoint.sh"    0               0B        4 months ago    Up 6 minutes (healthy)   node-red
e823c04124b8   grafana/grafana:latest                    "/run.sh"                1               0B        4 months ago    Up 6 minutes             grafana
a1b0ab86d715   rakwireless/udp-packet-forwarder:latest   "/usr/bin/entry.sh s…"   0               19.4kB    4 months ago    Up 6 minutes             udp-packet-forwarder
6fe850452cb6   influxdb:1.8                              "/entrypoint.sh infl…"   1               0B        4 months ago    Up 6 minutes             influxdb
60556539069e   redis:7.0.0-alpine3.15                    "docker-entrypoint.s…"   1               0B        4 months ago    Up 6 minutes             redis
a21400920907   xoseperez/the-things-stack:latest         "sh start"               2               14kB      5 months ago    Up 6 minutes (healthy)   stack
a4df5b30dd3d   postgres:14.3-alpine3.15                  "docker-entrypoint.s…"   1               63B       13 months ago   Up 6 minutes             postgres

Local Volumes space usage:

VOLUME NAME                                                        LINKS     SIZE
4524865d07bcee718070864a05204a70e5a5cbaa973696162e1b582b21c2d3f5   0         0B
standalone_lorawan_gateway_grafana-storage                         1         1.055MB
standalone_lorawan_gateway_influxdb-storage                        1         220.1MB
standalone_lorawan_gateway_postgres                                1         71.33MB
standalone_lorawan_gateway_redis                                   1         64.68MB
standalone_lorawan_gateway_stack-blob                              1         0B
standalone_lorawan_gateway_stack-data                              1         6.427kB

Build cache usage: 0B

But when digging through the whole disk using "du -h" I find these few lines:

4.0K ./var/lib/docker/containers/a1b0ab86d715da281b5ba531f8c2c3f5cfc9c324dbcfd7f21a8f789bb06e90d8/checkpoints
4.0K ./var/lib/docker/containers/a1b0ab86d715da281b5ba531f8c2c3f5cfc9c324dbcfd7f21a8f789bb06e90d8/mounts
6.0G ./var/lib/docker/containers/a1b0ab86d715da281b5ba531f8c2c3f5cfc9c324dbcfd7f21a8f789bb06e90d8
4.0K ./var/lib/docker/containers/60556539069e3a6c414f3eb652289c74673fbec02fd01da8e6ed4cae355b192b/checkpoints
4.0K ./var/lib/docker/containers/60556539069e3a6c414f3eb652289c74673fbec02fd01da8e6ed4cae355b192b/mounts
35M ./var/lib/docker/containers/60556539069e3a6c414f3eb652289c74673fbec02fd01da8e6ed4cae355b192b
4.0K ./var/lib/docker/containers/a214009209072dbfaa0d6a1573923bf1849faa0cca3cf0ed8d4810f0f73d5db4/checkpoints
4.0K ./var/lib/docker/containers/a214009209072dbfaa0d6a1573923bf1849faa0cca3cf0ed8d4810f0f73d5db4/mounts
8.8G ./var/lib/docker/containers/a214009209072dbfaa0d6a1573923bf1849faa0cca3cf0ed8d4810f0f73d5db4
4.0K ./var/lib/docker/containers/8494a17d60b41ca6cf3c50a2bb1cfa02aa42bf547c0b28d5c15bd7e28863a0be/checkpoints
4.0K ./var/lib/docker/containers/8494a17d60b41ca6cf3c50a2bb1cfa02aa42bf547c0b28d5c15bd7e28863a0be/mounts
56M ./var/lib/docker/containers/8494a17d60b41ca6cf3c50a2bb1cfa02aa42bf547c0b28d5c15bd7e28863a0be
4.0K ./var/lib/docker/containers/a4df5b30dd3d782e29a7ecebeefa8793c9ef5c29c40f6bdc914f64df95a50cd6/checkpoints
4.0K ./var/lib/docker/containers/a4df5b30dd3d782e29a7ecebeefa8793c9ef5c29c40f6bdc914f64df95a50cd6/mounts
872K ./var/lib/docker/containers/a4df5b30dd3d782e29a7ecebeefa8793c9ef5c29c40f6bdc914f64df95a50cd6
4.0K ./var/lib/docker/containers/e823c04124b874e8b01b821b10cf545865c1c346460de0ab631380e6d72a026b/checkpoints
4.0K ./var/lib/docker/containers/e823c04124b874e8b01b821b10cf545865c1c346460de0ab631380e6d72a026b/mounts
23M ./var/lib/docker/containers/e823c04124b874e8b01b821b10cf545865c1c346460de0ab631380e6d72a026b
4.0K ./var/lib/docker/containers/6fe850452cb66c975b87fecc07591afdd0916f04de97f8eb1dc38985f8711799/checkpoints
4.0K ./var/lib/docker/containers/6fe850452cb66c975b87fecc07591afdd0916f04de97f8eb1dc38985f8711799/mounts
1.2G ./var/lib/docker/containers/6fe850452cb66c975b87fecc07591afdd0916f04de97f8eb1dc38985f8711799
16G ./var/lib/docker/containers

You can see there 8.8 G stored in the folder that has the same ID as the stack, and 6.0 GB in the folder that share the same ID as the udp-packet-forwarder

Do you know where all this information is being stored, and if there are any settings I can choose that will change the retention period for these files? The whole application crashes when the disk fills.

Thank you

[xoseperez]

Hi @Michael-Ostrow
That's weird... can you check what's inside those two folders? My guess is that's the logs growing too much... If that's the case you can reset them with truncate -s 0 $(docker inspect --format='{{.LogPath}}' <container_name_or_id>)