From f3e40056eae9ec30ac3ed7891b7271659d9ce80a Mon Sep 17 00:00:00 2001 From: "Onur C. Cakmak" Date: Mon, 27 May 2024 22:27:39 -0400 Subject: [PATCH] docs: Add a note for NixOS and containerd Add a note to remove LimitNOFILE setting in containerd service configuration. This setting causes multiple issues such as slow `ceph status` commands (and failing healthchecks), various timeouts, and mons failing/timing out. Upstream containerd already removed the setting. NixOS hasn't incorporated the change. This note can be removed once https://github.com/NixOS/nixpkgs/pull/313507 makes it to a stable release. Signed-off-by: Onur Cakmak --- .../Getting-Started/Prerequisites/prerequisites.md | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/Documentation/Getting-Started/Prerequisites/prerequisites.md b/Documentation/Getting-Started/Prerequisites/prerequisites.md index 29f67c9f63275..7da69e2ad793c 100644 --- a/Documentation/Getting-Started/Prerequisites/prerequisites.md +++ b/Documentation/Getting-Started/Prerequisites/prerequisites.md @@ -129,3 +129,11 @@ ConfigMap found in operator.yaml: * `CSI_CEPHFS_PLUGIN_VOLUME_MOUNT` * `CSI_RBD_PLUGIN_VOLUME` * `CSI_RBD_PLUGIN_VOLUME_MOUNT` + +If using containerd, remove `LimitNOFILE` from containerd service config to avoid issues like slow ceph commands or mons falling out of quorum. + +```nix +systemd.services.containerd.serviceConfig = { + LimitNOFILE = lib.mkForce null; +}; +```