From b687e2eeafc9489a9874ca934fe2dd6f636bd163 Mon Sep 17 00:00:00 2001 From: Yuri Weinstein Date: Tue, 16 Apr 2024 12:23:46 -0700 Subject: [PATCH 1/2] doc: reef 18.2.4 release note Signed-off-by: Yuri Weinstein --- doc/releases/index.rst | 1 + doc/releases/reef.rst | 426 ++++++++++++++++++++++++++++++++++++++ doc/releases/releases.yml | 2 + 3 files changed, 429 insertions(+) diff --git a/doc/releases/index.rst b/doc/releases/index.rst index 2c3adf60c69eb..8a84e19489681 100644 --- a/doc/releases/index.rst +++ b/doc/releases/index.rst @@ -66,6 +66,7 @@ Release timeline .. _18.2.0: reef#v18-2-0-reef .. _18.2.1: reef#v18-2-1-reef .. _18.2.2: reef#v18-2-2-reef +.. _18.2.4: reef#v18-2-4-reef .. _Quincy: quincy .. _17.2.0: quincy#v17-2-0-quincy diff --git a/doc/releases/reef.rst b/doc/releases/reef.rst index 5149cd20ad063..702b11b400b2d 100644 --- a/doc/releases/reef.rst +++ b/doc/releases/reef.rst @@ -6,6 +6,432 @@ Reef is the 18th stable release of Ceph. It is named after the reef squid (Sepioteuthis). +v18.2.4 Reef +============ + +This is the fourth backport release in the Reef series. We recommend that all users update to this release. + +An early build of this release was accidentally exposed and packaged as 18.2.3 by the Debian project in April. +That 18.2.3 release should not be used. The official release was re-tagged as v18.2.4 to avoid +further confusion. + +Notable Changes +--------------- + +* RADOS: This release fixes a bug (https://tracker.ceph.com/issues/61948) where pre-reef clients were allowed + to connect to the `pg-upmap-primary` (https://docs.ceph.com/en/reef/rados/operations/read-balancer/) + interface despite users having set `require-min-compat-client=reef`, leading to an assert in the osds + and mons. You are susceptible to this bug in reef versions prior to 18.2.3 if 1) you are using an osdmap + generated via the offline osdmaptool with the `--read` option or 2) you have explicitly generated pg-upmap-primary + mappings with the CLI command. Please note that the fix is minimal and does not address corner cases such as + adding a mapping in the middle of an upgrade or in a partially upgraded cluster (related trackers linked + in https://tracker.ceph.com/issues/61948). As such, we recommend removing any existing pg-upmap-primary + mappings until remaining issues are addressed in future point releases. + See https://tracker.ceph.com/issues/61948#note-32 for instructions on how to remove existing + pg-upmap-primary mappings. +* RBD: When diffing against the beginning of time (`fromsnapname == NULL`) in + fast-diff mode (`whole_object == true` with `fast-diff` image feature enabled + and valid), diff-iterate is now guaranteed to execute locally if exclusive + lock is available. This brings a dramatic performance improvement for QEMU + live disk synchronization and backup use cases. +* RADOS: `get_pool_is_selfmanaged_snaps_mode` C++ API has been deprecated + due to being prone to false negative results. Its safer replacement is + `pool_is_in_selfmanaged_snaps_mode`. +* RBD: The option ``--image-id`` has been added to `rbd children` CLI command, + so it can be run for images in the trash. + +Changelog +--------- + +* (reef) node-proxy: improve http error handling in fetch_oob_details (`pr#55538 `_, Guillaume Abrioux) +* [rgw][lc][rgw_lifecycle_work_time] adjust timing if the configured end time is less than the start time (`pr#54866 `_, Oguzhan Ozmen) +* add checking for rgw frontend init (`pr#54844 `_, zhipeng li) +* admin/doc-requirements: bump Sphinx to 5.0.2 (`pr#55191 `_, Nizamudeen A) +* backport of fixes for 63678 and 63694 (`pr#55104 `_, Redouane Kachach) +* backport rook/mgr recent changes (`pr#55706 `_, Redouane Kachach) +* ceph-menv:fix typo in README (`pr#55163 `_, yu.wang) +* ceph-volume: add missing import (`pr#56259 `_, Guillaume Abrioux) +* ceph-volume: fix a bug in _check_generic_reject_reasons (`pr#54705 `_, Kim Minjong) +* ceph-volume: Fix migration from WAL to data with no DB (`pr#55497 `_, Igor Fedotov) +* ceph-volume: fix mpath device support (`pr#53539 `_, Guillaume Abrioux) +* ceph-volume: fix zap_partitions() in devices.lvm.zap (`pr#55477 `_, Guillaume Abrioux) +* ceph-volume: fixes fallback to stat in is_device and is_partition (`pr#54629 `_, Teoman ONAY) +* ceph-volume: update functional testing (`pr#56857 `_, Guillaume Abrioux) +* ceph-volume: use 'no workqueue' options with dmcrypt (`pr#55335 `_, Guillaume Abrioux) +* ceph-volume: Use safe accessor to get TYPE info (`pr#56323 `_, Dillon Amburgey) +* ceph.spec.in: add support for openEuler OS (`pr#56361 `_, liuqinfei) +* ceph.spec.in: remove command-with-macro line (`pr#57357 `_, John Mulligan) +* cephadm/nvmeof: scrape nvmeof prometheus endpoint (`pr#56108 `_, Avan Thakkar) +* cephadm: Add mount for nvmeof log location (`pr#55819 `_, Roy Sahar) +* cephadm: Add nvmeof to autotuner calculation (`pr#56100 `_, Paul Cuzner) +* cephadm: add timemaster to timesync services list (`pr#56307 `_, Florent Carli) +* cephadm: adjust the ingress ha proxy health check interval (`pr#56286 `_, Jiffin Tony Thottan) +* cephadm: create ceph-exporter sock dir if it's not present (`pr#56102 `_, Adam King) +* cephadm: fix get_version for nvmeof (`pr#56099 `_, Adam King) +* cephadm: improve cephadm pull usage message (`pr#56292 `_, Adam King) +* cephadm: remove restriction for crush device classes (`pr#56106 `_, Seena Fallah) +* cephadm: rm podman-auth.json if removing last cluster (`pr#56105 `_, Adam King) +* cephfs-shell: remove distutils Version classes because they're deprecated (`pr#54119 `_, Venky Shankar, Jos Collin) +* cephfs-top: include the missing fields in --dump output (`pr#54520 `_, Jos Collin) +* client/fuse: handle case of renameat2 with non-zero flags (`pr#55002 `_, Leonid Usov, Shachar Sharon) +* client: append to buffer list to save all result from wildcard command (`pr#53893 `_, Rishabh Dave, Jinmyeong Lee, Jimyeong Lee) +* client: call _getattr() for -ENODATA returned _getvxattr() calls (`pr#54404 `_, Jos Collin) +* client: fix leak of file handles (`pr#56122 `_, Xavi Hernandez) +* client: Fix return in removexattr for xattrs from `system.` namespace (`pr#55803 `_, Anoop C S) +* client: queue a delay cap flushing if there are ditry caps/snapcaps (`pr#54466 `_, Xiubo Li) +* client: readdir_r_cb: get rstat for dir only if using rbytes for size (`pr#53359 `_, Pinghao Wu) +* cmake/modules/BuildRocksDB.cmake: inherit parent's CMAKE_CXX_FLAGS (`pr#55502 `_, Kefu Chai) +* cmake: use or turn off liburing for rocksdb (`pr#54122 `_, Casey Bodley, Patrick Donnelly) +* common/options: Set LZ4 compression for bluestore RocksDB (`pr#55197 `_, Mark Nelson) +* common/weighted_shuffle: don't feed std::discrete_distribution with all-zero weights (`pr#55153 `_, Radosław Zarzyński) +* common: resolve config proxy deadlock using refcounted pointers (`pr#54373 `_, Patrick Donnelly) +* DaemonServer.cc: fix config show command for RGW daemons (`pr#55077 `_, Aishwarya Mathuria) +* debian: add ceph-exporter package (`pr#56541 `_, Shinya Hayashi) +* debian: add missing bcrypt to ceph-mgr .requires to fix resulting package dependencies (`pr#54662 `_, Thomas Lamprecht) +* doc/architecture.rst - fix typo (`pr#55384 `_, Zac Dover) +* doc/architecture.rst: improve rados definition (`pr#55343 `_, Zac Dover) +* doc/architecture: correct typo (`pr#56012 `_, Zac Dover) +* doc/architecture: improve some paragraphs (`pr#55399 `_, Zac Dover) +* doc/architecture: remove pleonasm (`pr#55933 `_, Zac Dover) +* doc/cephadm - edit t11ing (`pr#55482 `_, Zac Dover) +* doc/cephadm/services: Improve monitoring.rst (`pr#56290 `_, Anthony D'Atri) +* doc/cephadm: correct nfs config pool name (`pr#55603 `_, Zac Dover) +* doc/cephadm: improve host-management.rst (`pr#56111 `_, Anthony D'Atri) +* doc/cephadm: Improve multiple files (`pr#56130 `_, Anthony D'Atri) +* doc/cephfs/client-auth.rst: correct ``fs authorize cephfs1 /dir1 client.x rw`` (`pr#55246 `_, 叶海丰) +* doc/cephfs: edit add-remove-mds (`pr#55648 `_, Zac Dover) +* doc/cephfs: fix architecture link to correct relative path (`pr#56340 `_, molpako) +* doc/cephfs: Update disaster-recovery-experts.rst to mention Slack (`pr#55044 `_, Dhairya Parmar) +* doc/crimson: cleanup duplicate seastore description (`pr#55730 `_, Rongqi Sun) +* doc/dev: backport zipapp docs to reef (`pr#56161 `_, Zac Dover) +* doc/dev: edit internals.rst (`pr#55852 `_, Zac Dover) +* doc/dev: edit teuthology workflow (`pr#56002 `_, Zac Dover) +* doc/dev: fix spelling in crimson.rst (`pr#55737 `_, Zac Dover) +* doc/dev: osd_internals/snaps.rst: add clone_overlap doc (`pr#56523 `_, Matan Breizman) +* doc/dev: refine "Concepts" (`pr#56660 `_, Zac Dover) +* doc/dev: refine "Concepts" 2 of 3 (`pr#56725 `_, Zac Dover) +* doc/dev: refine "Concepts" 3 of 3 (`pr#56729 `_, Zac Dover) +* doc/dev: refine "Concepts" 4 of 3 (`pr#56740 `_, Zac Dover) +* doc/dev: update leads list (`pr#56603 `_, Zac Dover) +* doc/dev: update leads list (`pr#56589 `_, Zac Dover) +* doc/glossary.rst: add "Monitor Store" (`pr#54743 `_, Zac Dover) +* doc/glossary: add "Crimson" entry (`pr#56073 `_, Zac Dover) +* doc/glossary: add "librados" entry (`pr#56235 `_, Zac Dover) +* doc/glossary: Add "OMAP" to glossary (`pr#55749 `_, Zac Dover) +* doc/glossary: Add link to CRUSH paper (`pr#55557 `_, Zac Dover) +* doc/glossary: improve "MDS" entry (`pr#55849 `_, Zac Dover) +* doc/glossary: improve OSD definitions (`pr#55613 `_, Zac Dover) +* doc/install: add manual RADOSGW install procedure (`pr#55880 `_, Zac Dover) +* doc/install: update "update submodules" (`pr#54961 `_, Zac Dover) +* doc/man/8/mount.ceph.rst: add more mount options (`pr#55754 `_, Xiubo Li) +* doc/man: edit "manipulating the omap key" (`pr#55635 `_, Zac Dover) +* doc/man: edit ceph-osd description (`pr#54551 `_, Zac Dover) +* doc/mgr: credit John Jasen for Zabbix 2 (`pr#56684 `_, Zac Dover) +* doc/mgr: document lack of MSWin NFS 4.x support (`pr#55032 `_, Zac Dover) +* doc/mgr: update zabbix information (`pr#56631 `_, Zac Dover) +* doc/rados/configuration/bluestore-config-ref: Fix lowcase typo (`pr#54694 `_, Adam Kupczyk) +* doc/rados/configuration/osd-config-ref: fix typo (`pr#55678 `_, Pierre Riteau) +* doc/rados/operations: add EC overhead table to erasure-code.rst (`pr#55244 `_, Anthony D'Atri) +* doc/rados/operations: Fix off-by-one errors in control.rst (`pr#55231 `_, tobydarling) +* doc/rados/operations: Improve crush_location docs (`pr#56594 `_, Niklas Hambüchen) +* doc/rados: add "change public network" procedure (`pr#55799 `_, Zac Dover) +* doc/rados: add link to pg blog post (`pr#55611 `_, Zac Dover) +* doc/rados: add PG definition (`pr#55630 `_, Zac Dover) +* doc/rados: edit "client can't connect..." (`pr#54654 `_, Zac Dover) +* doc/rados: edit "Everything Failed! Now What?" (`pr#54665 `_, Zac Dover) +* doc/rados: edit "monitor store failures" (`pr#54659 `_, Zac Dover) +* doc/rados: edit "recovering broken monmap" (`pr#54601 `_, Zac Dover) +* doc/rados: edit "understanding mon_status" (`pr#54579 `_, Zac Dover) +* doc/rados: edit "Using the Monitor's Admin Socket" (`pr#54576 `_, Zac Dover) +* doc/rados: fix broken links (`pr#55680 `_, Zac Dover) +* doc/rados: format sections in tshooting-mon.rst (`pr#54638 `_, Zac Dover) +* doc/rados: improve "Ceph Subsystems" (`pr#54702 `_, Zac Dover) +* doc/rados: improve formatting of log-and-debug.rst (`pr#54746 `_, Zac Dover) +* doc/rados: link to pg setting commands (`pr#55936 `_, Zac Dover) +* doc/rados: ops/pgs: s/power of 2/power of two (`pr#54700 `_, Zac Dover) +* doc/rados: remove PGcalc from docs (`pr#55901 `_, Zac Dover) +* doc/rados: repair stretch-mode.rst (`pr#54762 `_, Zac Dover) +* doc/rados: restore PGcalc tool (`pr#56057 `_, Zac Dover) +* doc/rados: update "stretch mode" (`pr#54756 `_, Michael Collins) +* doc/rados: update common.rst (`pr#56268 `_, Zac Dover) +* doc/rados: update config for autoscaler (`pr#55438 `_, Zac Dover) +* doc/rados: update PG guidance (`pr#55460 `_, Zac Dover) +* doc/radosgw - edit admin.rst "set user rate limit" (`pr#55150 `_, Zac Dover) +* doc/radosgw/admin.rst: use underscores in config var names (`pr#54933 `_, Ville Ojamo) +* doc/radosgw: add confval directives (`pr#55484 `_, Zac Dover) +* doc/radosgw: add gateway starting command (`pr#54833 `_, Zac Dover) +* doc/radosgw: admin.rst - edit "Create a Subuser" (`pr#55020 `_, Zac Dover) +* doc/radosgw: admin.rst - edit "Create a User" (`pr#55004 `_, Zac Dover) +* doc/radosgw: admin.rst - edit sections (`pr#55017 `_, Zac Dover) +* doc/radosgw: edit "Add/Remove a Key" (`pr#55055 `_, Zac Dover) +* doc/radosgw: edit "Enable/Disable Bucket Rate Limit" (`pr#55260 `_, Zac Dover) +* doc/radosgw: edit "read/write global rate limit" admin.rst (`pr#55271 `_, Zac Dover) +* doc/radosgw: edit "remove a subuser" (`pr#55034 `_, Zac Dover) +* doc/radosgw: edit "Usage" admin.rst (`pr#55321 `_, Zac Dover) +* doc/radosgw: edit admin.rst "Get Bucket Rate Limit" (`pr#55253 `_, Zac Dover) +* doc/radosgw: edit admin.rst "get user rate limit" (`pr#55157 `_, Zac Dover) +* doc/radosgw: edit admin.rst "set bucket rate limit" (`pr#55242 `_, Zac Dover) +* doc/radosgw: edit admin.rst - quota (`pr#55082 `_, Zac Dover) +* doc/radosgw: edit admin.rst 1 of x (`pr#55000 `_, Zac Dover) +* doc/radosgw: edit compression.rst (`pr#54985 `_, Zac Dover) +* doc/radosgw: edit front matter - role.rst (`pr#54854 `_, Zac Dover) +* doc/radosgw: edit multisite.rst (`pr#55671 `_, Zac Dover) +* doc/radosgw: edit sections (`pr#55027 `_, Zac Dover) +* doc/radosgw: fix formatting (`pr#54753 `_, Zac Dover) +* doc/radosgw: Fix JSON typo in Principal Tag example code snippet (`pr#54642 `_, Daniel Parkes) +* doc/radosgw: fix verb disagreement - index.html (`pr#55338 `_, Zac Dover) +* doc/radosgw: format "Create a Role" (`pr#54886 `_, Zac Dover) +* doc/radosgw: format commands in role.rst (`pr#54905 `_, Zac Dover) +* doc/radosgw: format POST statements (`pr#54849 `_, Zac Dover) +* doc/radosgw: list supported plugins-compression.rst (`pr#54995 `_, Zac Dover) +* doc/radosgw: update link in rgw-cache.rst (`pr#54805 `_, Zac Dover) +* doc/radosrgw: edit admin.rst (`pr#55073 `_, Zac Dover) +* doc/rbd: add clone mapping command (`pr#56208 `_, Zac Dover) +* doc/rbd: add map information for clone images to rbd-encryption.rst (`pr#56186 `_, N Balachandran) +* doc/rbd: minor changes to the rbd man page (`pr#56256 `_, N Balachandran) +* doc/rbd: repair ordered list (`pr#55732 `_, Zac Dover) +* doc/releases: edit reef.rst (`pr#55064 `_, Zac Dover) +* doc/releases: specify dashboard improvements (`pr#55049 `_, Laura Flores, Zac Dover) +* doc/rgw: edit admin.rst - rate limit management (`pr#55128 `_, Zac Dover) +* doc/rgw: fix Attributes index in CreateTopic example (`pr#55432 `_, Casey Bodley) +* doc/start: add Slack invite link (`pr#56041 `_, Zac Dover) +* doc/start: explain "OSD" (`pr#54559 `_, Zac Dover) +* doc/start: improve MDS explanation (`pr#56466 `_, Zac Dover) +* doc/start: improve MDS explanation (`pr#56426 `_, Zac Dover) +* doc/start: link to mon map command (`pr#56410 `_, Zac Dover) +* doc/start: update release names (`pr#54572 `_, Zac Dover) +* doc: add description of metric fields for cephfs-top (`pr#55511 `_, Neeraj Pratap Singh) +* doc: Add NVMe-oF gateway documentation (`pr#55724 `_, Orit Wasserman) +* doc: add supported file types in cephfs-mirroring.rst (`pr#54822 `_, Jos Collin) +* doc: adding documentation for secure monitoring stack configuration (`pr#56104 `_, Redouane Kachach) +* doc: cephadm/services/osd: fix typo (`pr#56230 `_, Lorenz Bausch) +* doc: Fixes two typos and grammatical errors. Signed-off-by: Sina Ahma… (`pr#54775 `_, Sina Ahmadi) +* doc: fixing doc/cephfs/fs-volumes (`pr#56648 `_, Neeraj Pratap Singh) +* doc: remove releases docs (`pr#56567 `_, Patrick Donnelly) +* doc: specify correct fs type for mkfs (`pr#55282 `_, Vladislav Glagolev) +* doc: update rgw admin api req params for get user info (`pr#55071 `_, Ali Maredia) +* doc:start.rst fix typo in hw-recs (`pr#55505 `_, Eduardo Roldan) +* docs/rados: remove incorrect ceph command (`pr#56495 `_, Taha Jahangir) +* docs/radosgw: edit admin.rst "enable/disable user rate limit" (`pr#55194 `_, Zac Dover) +* docs/rbd: fix typo in arg name (`pr#56262 `_, N Balachandran) +* docs: Add information about OpenNebula integration (`pr#54938 `_, Daniel Clavijo) +* librados: make querying pools for selfmanaged snaps reliable (`pr#55026 `_, Ilya Dryomov) +* librbd: account for discards that truncate in ObjectListSnapsRequest (`pr#56213 `_, Ilya Dryomov) +* librbd: Append one journal event per image request (`pr#54818 `_, Ilya Dryomov, Joshua Baergen) +* librbd: don't report HOLE_UPDATED when diffing against a hole (`pr#54951 `_, Ilya Dryomov) +* librbd: fix regressions in ObjectListSnapsRequest (`pr#54862 `_, Ilya Dryomov) +* librbd: fix split() for SparseExtent and SparseBufferlistExtent (`pr#55665 `_, Ilya Dryomov) +* librbd: improve rbd_diff_iterate2() performance in fast-diff mode (`pr#55427 `_, Ilya Dryomov) +* librbd: return ENOENT from Snapshot::get_timestamp for nonexistent snap_id (`pr#55474 `_, John Agombar) +* make-dist: don't use --continue option for wget (`pr#55091 `_, Casey Bodley) +* MClientRequest: properly handle ceph_mds_request_head_legacy for ext_num_retry, ext_num_fwd, owner_uid, owner_gid (`pr#54407 `_, Alexander Mikhalitsyn) +* mds,cephfs_mirror: add labelled per-client and replication metrics (`issue#63945 `_, `pr#55640 `_, Venky Shankar, Jos Collin) +* mds/client: check the cephx mds auth access in client side (`pr#54468 `_, Xiubo Li, Ramana Raja) +* mds/MDBalancer: ignore queued callbacks if MDS is not active (`pr#54493 `_, Leonid Usov) +* mds/MDSRank: Add set_history_slow_op_size_and_threshold for op_tracker (`pr#53357 `_, Yite Gu) +* mds: accept human readable values for quotas (`issue#55940 `_, `pr#53333 `_, Venky Shankar, Dhairya Parmar, dparmar18) +* mds: add a command to dump directory information (`pr#55987 `_, Jos Collin, Zhansong Gao) +* mds: add balance_automate fs setting (`pr#54952 `_, Patrick Donnelly) +* mds: add debug logs during setxattr ceph.dir.subvolume (`pr#56062 `_, Milind Changire) +* mds: allow all types of mds caps (`pr#52581 `_, Rishabh Dave) +* mds: allow lock state to be LOCK_MIX_SYNC in replica for filelock (`pr#56049 `_, Xiubo Li) +* mds: change priority of mds rss perf counter to useful (`pr#55057 `_, sp98) +* mds: check file layout in mknod (`pr#56031 `_, Xue Yantao) +* mds: check relevant caps for fs include root_squash (`pr#57343 `_, Patrick Donnelly) +* mds: disable `defer_client_eviction_on_laggy_osds' by default (`issue#64685 `_, `pr#56196 `_, Venky Shankar) +* mds: do not evict clients if OSDs are laggy (`pr#52268 `_, Dhairya Parmar, Laura Flores) +* mds: do not simplify fragset (`pr#54895 `_, Milind Changire) +* mds: ensure next replay is queued on req drop (`pr#54313 `_, Patrick Donnelly) +* mds: ensure snapclient is synced before corruption check (`pr#56398 `_, Patrick Donnelly) +* mds: fix issuing redundant reintegrate/migrate_stray requests (`pr#54467 `_, Xiubo Li) +* mds: just wait the client flushes the snap and dirty buffer (`pr#55743 `_, Xiubo Li) +* mds: optionally forbid to use standby for another fs as last resort (`pr#53340 `_, Venky Shankar, Mykola Golub, Luís Henriques) +* mds: relax certain asserts in mdlog replay thread (`issue#57048 `_, `pr#56016 `_, Venky Shankar) +* mds: reverse MDSMap encoding of max_xattr_size/bal_rank_mask (`pr#55669 `_, Patrick Donnelly) +* mds: revert standby-replay trimming changes (`pr#54716 `_, Patrick Donnelly) +* mds: scrub repair does not clear earlier damage health status (`pr#54899 `_, Neeraj Pratap Singh) +* mds: set the loner to true for LOCK_EXCL_XSYN (`pr#54911 `_, Xiubo Li) +* mds: skip sr moves when target is an unlinked dir (`pr#56672 `_, Patrick Donnelly, Dan van der Ster) +* mds: use explicitly sized types for network and disk encoding (`pr#55742 `_, Xiubo Li) +* MDSAuthCaps: minor improvements (`pr#54185 `_, Rishabh Dave) +* MDSAuthCaps: print better error message for perm flag in MDS caps (`pr#54945 `_, Rishabh Dave) +* mgr/(object_format && nfs/export): enhance nfs export update failure response (`pr#55395 `_, Dhairya Parmar, John Mulligan) +* mgr/.dashboard: batch backport of cephfs snapshot schedule management (`pr#55581 `_, Ivo Almeida) +* mgr/cephadm is not defining haproxy tcp healthchecks for Ganesha (`pr#56101 `_, avanthakkar) +* mgr/cephadm: allow grafana and prometheus to only bind to specific network (`pr#56302 `_, Adam King) +* mgr/cephadm: Allow idmap overrides in nfs-ganesha configuration (`pr#56029 `_, Teoman ONAY) +* mgr/cephadm: catch CancelledError in asyncio timeout handler (`pr#56103 `_, Adam King) +* mgr/cephadm: discovery service (port 8765) fails on ipv6 only clusters (`pr#56093 `_, Theofilos Mouratidis) +* mgr/cephadm: fix placement with label and host pattern (`pr#56107 `_, Adam King) +* mgr/cephadm: fix reweighting of OSD when OSD removal is stopped (`pr#56094 `_, Adam King) +* mgr/cephadm: fixups for asyncio based timeout (`pr#55555 `_, Adam King) +* mgr/cephadm: make jaeger-collector a dep for jaeger-agent (`pr#56089 `_, Adam King) +* mgr/cephadm: refresh public_network for config checks before checking (`pr#56325 `_, Adam King) +* mgr/cephadm: support for regex based host patterns (`pr#56221 `_, Adam King) +* mgr/cephadm: support for removing host entry from crush map during host removal (`pr#56092 `_, Adam King) +* mgr/cephadm: update timestamp on repeat daemon/service events (`pr#56090 `_, Adam King) +* mgr/dashboard/frontend:Ceph dashboard supports multiple languages (`pr#56359 `_, TomNewChao) +* mgr/dashboard: Add advanced fieldset component (`pr#56692 `_, Afreen) +* cmake/arrow: don't treat warnings as errors (`pr#57375 `_, Casey Bodley) +* mgr/dashboard: add frontend unit tests for rgw multisite sync status card (`pr#55222 `_, Aashish Sharma) +* mgr/dashboard: add snap schedule M, Y frequencies (`pr#56059 `_, Ivo Almeida) +* mgr/dashboard: add support for editing and deleting rgw roles (`pr#55541 `_, Nizamudeen A) +* mgr/dashboard: add system users to rgw user form (`pr#56471 `_, Pedro Gonzalez Gomez) +* mgr/dashboard: add Table Schema to grafonnet (`pr#56736 `_, Aashish Sharma) +* mgr/dashboard: Allow the user to add the access/secret key on zone edit and not on zone creation (`pr#56472 `_, Aashish Sharma) +* mgr/dashboard: ceph authenticate user from fs (`pr#56254 `_, Pedro Gonzalez Gomez) +* mgr/dashboard: change deprecated grafana URL in daemon logs (`pr#55544 `_, Nizamudeen A) +* mgr/dashboard: chartjs and ng2-charts version upgrade (`pr#55224 `_, Pedro Gonzalez Gomez) +* mgr/dashboard: Consider null values as zero in grafana panels (`pr#54541 `_, Aashish Sharma) +* mgr/dashboard: create cephfs snapshot clone (`pr#55489 `_, Nizamudeen A) +* mgr/dashboard: Create realm sets to default (`pr#55221 `_, Aashish Sharma) +* mgr/dashboard: Create subvol of same name in different group (`pr#55369 `_, Afreen) +* mgr/dashboard: dashboard area chart unit test (`pr#55517 `_, Pedro Gonzalez Gomez) +* mgr/dashboard: debugging make check failure (`pr#56127 `_, Nizamudeen A) +* mgr/dashboard: disable applitools e2e (`pr#56215 `_, Nizamudeen A) +* mgr/dashboard: fix cephfs name validation (`pr#56501 `_, Nizamudeen A) +* mgr/dashboard: fix clone unique validator for name validation (`pr#56550 `_, Nizamudeen A) +* mgr/dashboard: fix e2e failure related to landing page (`pr#55124 `_, Pedro Gonzalez Gomez) +* mgr/dashboard: fix empty tags (`pr#56439 `_, Pedro Gonzalez Gomez) +* mgr/dashboard: fix error while accessing roles tab when policy attached (`pr#55515 `_, Afreen) +* mgr/dashboard: Fix inconsistency in capitalisation of "Multi-site" (`pr#55311 `_, Afreen) +* mgr/dashboard: fix M retention frequency display (`pr#56363 `_, Ivo Almeida) +* mgr/dashboard: fix retention add for subvolume (`pr#56370 `_, Ivo Almeida) +* mgr/dashboard: fix rgw display name validation (`pr#56548 `_, Nizamudeen A) +* mgr/dashboard: fix roles page for roles without policies (`pr#55827 `_, Nizamudeen A) +* mgr/dashboard: fix snap schedule date format (`pr#55815 `_, Ivo Almeida) +* mgr/dashboard: fix snap schedule list toggle cols (`pr#56115 `_, Ivo Almeida) +* mgr/dashboard: fix snap schedule time format (`pr#56154 `_, Ivo Almeida) +* mgr/dashboard: fix subvolume group edit (`pr#55811 `_, Ivo Almeida) +* mgr/dashboard: fix subvolume group edit size (`pr#56385 `_, Ivo Almeida) +* mgr/dashboard: fix the jsonschema issue in install-deps (`pr#55542 `_, Nizamudeen A) +* mgr/dashboard: fix volume creation with multiple hosts (`pr#55786 `_, Pedro Gonzalez Gomez) +* mgr/dashboard: fixed cephfs mount command (`pr#55993 `_, Ivo Almeida) +* mgr/dashboard: fixed nfs attach command (`pr#56387 `_, Ivo Almeida) +* mgr/dashboard: Fixes multisite topology page breadcrumb (`pr#55212 `_, Afreen Misbah) +* mgr/dashboard: get object bucket policies for a bucket (`pr#55361 `_, Nizamudeen A) +* mgr/dashboard: get rgw port from ssl_endpoint (`pr#54764 `_, Nizamudeen A) +* mgr/dashboard: Handle errors for /api/osd/settings (`pr#55704 `_, Afreen) +* mgr/dashboard: increase the number of plottable graphs in charts (`pr#55571 `_, Afreen, Aashish Sharma) +* mgr/dashboard: Locking improvements in bucket create form (`pr#56560 `_, Afreen) +* mgr/dashboard: make ceph logo redirect to dashboard (`pr#56557 `_, Afreen) +* mgr/dashboard: Mark placement targets as non-required (`pr#56621 `_, Afreen) +* mgr/dashboard: replace deprecated table panel in grafana with a newer table panel (`pr#56682 `_, Aashish Sharma) +* mgr/dashboard: replace piechart plugin charts with native pie chart panel (`pr#56654 `_, Aashish Sharma) +* mgr/dashboard: rgw bucket features (`pr#55575 `_, Pedro Gonzalez Gomez) +* mgr/dashboard: rm warning/error threshold for cpu usage (`pr#56443 `_, Nizamudeen A) +* mgr/dashboard: s/active_mds/active_nfs in fs attach form (`pr#56546 `_, Nizamudeen A) +* mgr/dashboard: sanitize dashboard user creation (`pr#56452 `_, Pedro Gonzalez Gomez) +* mgr/dashboard: Show the OSDs Out and Down panels as red whenever an OSD is in Out or Down state in Ceph Cluster grafana dashboard (`pr#54538 `_, Aashish Sharma) +* mgr/dashboard: Simplify authentication protocol (`pr#55689 `_, Daniel Persson) +* mgr/dashboard: subvolume snapshot management (`pr#55186 `_, Nizamudeen A) +* mgr/dashboard: update fedora link for dashboard-cephadm-e2e test (`pr#54718 `_, Adam King) +* mgr/dashboard: upgrade from old 'graph' type panels to the new 'timeseries' panel (`pr#56652 `_, Aashish Sharma) +* mgr/dashboard:Update encryption and tags in bucket form (`pr#56707 `_, Afreen) +* mgr/dashboard:Use advanced fieldset for rbd image (`pr#56710 `_, Afreen) +* mgr/nfs: include pseudo in JSON output when nfs export apply -i fails (`pr#55394 `_, Dhairya Parmar) +* mgr/node-proxy: handle 'None' statuses returned by RedFish (`pr#55999 `_, Guillaume Abrioux) +* mgr/pg_autoscaler: add check for norecover flag (`pr#55078 `_, Aishwarya Mathuria) +* mgr/snap_schedule: add support for monthly snapshots (`pr#55208 `_, Milind Changire) +* mgr/snap_schedule: exceptions management and subvol support (`pr#52751 `_, Milind Changire) +* mgr/volumes: fix `subvolume group rm` error message (`pr#54207 `_, neeraj pratap singh, Neeraj Pratap Singh) +* mgr/volumes: support to reject CephFS clones if cloner threads are not available (`pr#55692 `_, Rishabh Dave, Venky Shankar, Neeraj Pratap Singh) +* mgr: pin pytest to version 7.4.4 (`pr#55362 `_, Laura Flores) +* mon, doc: overriding ec profile requires --yes-i-really-mean-it (`pr#56435 `_, Radoslaw Zarzynski) +* mon, osd, \*: expose upmap-primary in OSDMap::get_features() (`pr#57794 `_, rzarzynski) +* mon/ConfigMonitor: Show localized name in "config dump --format json" output (`pr#53888 `_, Sridhar Seshasayee) +* mon/ConnectionTracker.cc: disregard connection scores from mon_rank = -1 (`pr#55167 `_, Kamoltat) +* mon/OSDMonitor: fix get_min_last_epoch_clean() (`pr#55867 `_, Matan Breizman) +* mon: fix health store size growing infinitely (`pr#55548 `_, Wei Wang) +* mon: fix mds metadata lost in one case (`pr#54316 `_, shimin) +* msg: update MOSDOp() to use ceph_tid_t instead of long (`pr#55424 `_, Lucian Petrut) +* node-proxy: fix RedFishClient.logout() method (`pr#56252 `_, Guillaume Abrioux) +* node-proxy: refactor entrypoint (backport) (`pr#55454 `_, Guillaume Abrioux) +* orch: implement hardware monitoring (`pr#55405 `_, Guillaume Abrioux, Adam King, Redouane Kachach) +* orchestrator: Add summary line to orch device ls output (`pr#56098 `_, Paul Cuzner) +* orchestrator: Fix representation of CPU threads in host ls --detail command (`pr#56097 `_, Paul Cuzner) +* os/bluestore: add bluestore fragmentation micros to prometheus (`pr#54258 `_, Yite Gu) +* os/bluestore: fix free space update after bdev-expand in NCB mode (`pr#55777 `_, Igor Fedotov) +* os/bluestore: get rid off resulting lba alignment in allocators (`pr#54772 `_, Igor Fedotov) +* os/kv_test: Fix estimate functions (`pr#56197 `_, Adam Kupczyk) +* osd/OSD: introduce reset_purged_snaps_last (`pr#53972 `_, Matan Breizman) +* osd/scrub: increasing max_osd_scrubs to 3 (`pr#55173 `_, Ronen Friedman) +* osd: Apply randomly selected scheduler type across all OSD shards (`pr#54981 `_, Sridhar Seshasayee) +* osd: don't require RWEXCL lock for stat+write ops (`pr#54595 `_, Alice Zhao) +* osd: fix Incremental decode for new/old_pg_upmap_primary (`pr#55046 `_, Laura Flores) +* osd: improve OSD robustness (`pr#54783 `_, Igor Fedotov) +* osd: log the number of extents for sparse read (`pr#54606 `_, Xiubo Li) +* osd: Tune snap trim item cost to reflect a PGs' average object size for mClock scheduler (`pr#55040 `_, Sridhar Seshasayee) +* pybind/mgr/devicehealth: replace SMART data if exists for same DATETIME (`pr#54879 `_, Patrick Donnelly) +* pybind/mgr/devicehealth: skip legacy objects that cannot be loaded (`pr#56479 `_, Patrick Donnelly) +* pybind/mgr/mirroring: drop mon_host from peer_list (`pr#55237 `_, Jos Collin) +* pybind/rbd: fix compilation with cython3 (`pr#54807 `_, Mykola Golub) +* python-common/drive_selection: fix limit with existing devices (`pr#56096 `_, Adam King) +* python-common: fix osdspec_affinity check (`pr#56095 `_, Guillaume Abrioux) +* qa/cephadm: testing for extra daemon/container features (`pr#55957 `_, Adam King) +* qa/cephfs: improvements for name generators in test_volumes.py (`pr#54729 `_, Rishabh Dave) +* qa/suites/fs/nfs: use standard health ignorelist (`pr#56392 `_, Patrick Donnelly) +* qa/suites/fs/workload: enable snap_schedule early (`pr#56424 `_, Patrick Donnelly) +* qa/tasks/cephfs/test_misc: switch duration to timeout (`pr#55746 `_, Xiubo Li) +* qa/tests: added the initial reef-p2p suite (`pr#55714 `_, Yuri Weinstein) +* qa/workunits/rbd/cli_generic.sh: narrow race window when checking that rbd_support module command fails after blocklisting the module's client (`pr#54769 `_, Ramana Raja) +* qa: `fs volume rename` requires `fs fail` and `refuse_client_session` set (`issue#64174 `_, `pr#56171 `_, Venky Shankar) +* qa: Add benign cluster warning from ec-inconsistent-hinfo test to ignorelist (`pr#56151 `_, Sridhar Seshasayee) +* qa: add centos_latest (9.stream) and ubuntu_20.04 yamls to supported-all-distro (`pr#54677 `_, Venky Shankar) +* qa: add diff-continuous and compare-mirror-image tests to rbd and krbd suites respectively (`pr#55928 `_, Ramana Raja) +* qa: Add tests to validate synced images on rbd-mirror (`pr#55762 `_, Ilya Dryomov, Ramana Raja) +* qa: bump up scrub status command timeout (`pr#55915 `_, Milind Changire) +* qa: change log-whitelist to log-ignorelist (`pr#56396 `_, Patrick Donnelly) +* qa: correct usage of DEBUGFS_META_DIR in dedent (`pr#56167 `_, Venky Shankar) +* qa: do upgrades from quincy and older reef minor releases (`pr#55590 `_, Patrick Donnelly) +* qa: enhance labeled perf counters test for cephfs-mirror (`pr#56211 `_, Jos Collin) +* qa: Fix fs/full suite (`pr#55829 `_, Kotresh HR) +* qa: fix incorrectly using the wait_for_health() helper (`issue#57985 `_, `pr#54237 `_, Venky Shankar) +* qa: fix rank_asok() to handle errors from asok commands (`pr#55302 `_, Neeraj Pratap Singh) +* qa: remove error string checks and check w/ return value (`pr#55943 `_, Venky Shankar) +* qa: remove vstart runner from radosgw_admin task (`pr#55097 `_, Ali Maredia) +* qa: run kernel_untar_build with newer tarball (`pr#54711 `_, Milind Changire) +* qa: set mds config with `config set` for a particular test (`issue#57087 `_, `pr#56169 `_, Venky Shankar) +* qa: use correct imports to resolve fuse_mount and kernel_mount (`pr#54714 `_, Milind Changire) +* qa: use exisitng ignorelist override list for fs:mirror[-ha] (`issue#62482 `_, `pr#54766 `_, Venky Shankar) +* radosgw-admin: 'zone set' won't overwrite existing default-placement (`pr#55061 `_, Casey Bodley) +* rbd-nbd: fix resize of images mapped using netlink (`pr#55316 `_, Ramana Raja) +* reef backport: rook e2e testing related PRs (`pr#55375 `_, Redouane Kachach) +* RGW - Swift retarget needs bucket set on object (`pr#56004 `_, Daniel Gryniewicz) +* rgw/auth: Fix the return code returned by AuthStrategy (`pr#54794 `_, Pritha Srivastava) +* rgw/beast: Enable SSL session-id reuse speedup mechanism (`pr#56120 `_, Mark Kogan) +* rgw/datalog: RGWDataChangesLog::add_entry() uses null_yield (`pr#55655 `_, Casey Bodley) +* rgw/iam: admin/system users ignore iam policy parsing errors (`pr#54843 `_, Casey Bodley) +* rgw/kafka/amqp: fix race conditionn in async completion handlers (`pr#54736 `_, Yuval Lifshitz) +* rgw/lc: do not add datalog/bilog for some lc actions (`pr#55289 `_, Juan Zhu) +* rgw/lua: fix CopyFrom crash (`pr#54296 `_, Yuval Lifshitz) +* rgw/notification: Kafka persistent notifications not retried and removed even when the broker is down (`pr#56140 `_, kchheda3) +* rgw/putobj: RadosWriter uses part head object for multipart parts (`pr#55621 `_, Casey Bodley) +* rgw/rest: fix url decode of post params for iam/sts/sns (`pr#55356 `_, Casey Bodley) +* rgw/S3select: remove assert from csv-parser, adding updates (`pr#55969 `_, Gal Salomon) +* RGW/STS: when generating keys, take the trailing null character into account (`pr#54127 `_, Oguzhan Ozmen) +* rgw: add headers to guide cache update in 304 response (`pr#55094 `_, Casey Bodley, Ilsoo Byun) +* rgw: Add missing empty checks to the split string in is_string_in_set() (`pr#56347 `_, Matt Benjamin) +* rgw: d3n: fix valgrind reported leak related to libaio worker threads (`pr#54852 `_, Mark Kogan) +* rgw: do not copy olh attributes in versioning suspended bucket (`pr#55606 `_, Juan Zhu) +* rgw: fix cloud-sync multi-tenancy scenario (`pr#54328 `_, Ionut Balutoiu) +* rgw: object lock avoids 32-bit truncation of RetainUntilDate (`pr#54674 `_, Casey Bodley) +* rgw: only buckets with reshardable layouts need to be considered for resharding (`pr#54129 `_, J. Eric Ivancich) +* RGW: pubsub publish commit with etag populated (`pr#56453 `_, Ali Masarwa) +* rgw: RGWSI_SysObj_Cache::remove() invalidates after successful delete (`pr#55716 `_, Casey Bodley) +* rgw: SignatureDoesNotMatch for certain RGW Admin Ops endpoints w/v4 auth (`pr#54791 `_, David.Hall) +* Snapshot schedule show subvolume path (`pr#56419 `_, Ivo Almeida) +* src/common/options: Correct typo in rgw.yaml.in (`pr#55445 `_, Anthony D'Atri) +* src/mount: kernel mount command returning misleading error message (`pr#55300 `_, Neeraj Pratap Singh) +* test/libcephfs: skip flaky timestamp assertion on Windows (`pr#54614 `_, Lucian Petrut) +* test/rgw: increase timeouts in unittest_rgw_dmclock_scheduler (`pr#55790 `_, Casey Bodley) +* test: explicitly link to ceph-common for some libcephfs tests (`issue#57206 `_, `pr#53635 `_, Venky Shankar) +* tools/ceph_objectstore_tool: action_on_all_objects_in_pg to skip pgmeta (`pr#54693 `_, Matan Breizman) +* Tools/rados: Improve Error Messaging for Object Name Resolution (`pr#55112 `_, Nitzan Mordechai) +* tools/rbd: make 'children' command support --image-id (`pr#55617 `_, Mykola Golub) +* use raw_cluster_cmd instead of run_ceph_cmd (`pr#55836 `_, Venky Shankar) +* win32_deps_build.sh: change Boost URL (`pr#55084 `_, Lucian Petrut) + v18.2.2 Reef ============ diff --git a/doc/releases/releases.yml b/doc/releases/releases.yml index d73f5c34d3d68..828b076761c66 100644 --- a/doc/releases/releases.yml +++ b/doc/releases/releases.yml @@ -15,6 +15,8 @@ releases: reef: target_eol: 2025-08-01 releases: + - version: 18.2.4 + released: 2024-07-17 - version: 18.2.2 released: 2024-03-11 - version: 18.2.1 From 21a25f41240b96a1fbc03c2c3b817c96f61f73ab Mon Sep 17 00:00:00 2001 From: Laura Flores Date: Thu, 18 Jul 2024 17:50:17 -0500 Subject: [PATCH 2/2] doc/releases: add release note about thread creation incompatibility Signed-off-by: Laura Flores Signed-off-by: Yuri Weinstein --- doc/releases/reef.rst | 10 +++++++++- doc/releases/releases.yml | 2 +- 2 files changed, 10 insertions(+), 2 deletions(-) diff --git a/doc/releases/reef.rst b/doc/releases/reef.rst index 702b11b400b2d..ca6f2ca4fc96e 100644 --- a/doc/releases/reef.rst +++ b/doc/releases/reef.rst @@ -15,13 +15,19 @@ An early build of this release was accidentally exposed and packaged as 18.2.3 b That 18.2.3 release should not be used. The official release was re-tagged as v18.2.4 to avoid further confusion. +v18.2.4 container images, now based on CentOS 9, may be incompatible on older kernels (e.g., Ubuntu 18.04) due +to differences in thread creation methods. Users upgrading to v18.2.4 container images with older OS versions +may encounter crashes during `pthread_create`. For workarounds, refer to the related tracker. However, we recommend +upgrading your OS to avoid this unsupported combination. +Related tracker: https://tracker.ceph.com/issues/66989 + Notable Changes --------------- * RADOS: This release fixes a bug (https://tracker.ceph.com/issues/61948) where pre-reef clients were allowed to connect to the `pg-upmap-primary` (https://docs.ceph.com/en/reef/rados/operations/read-balancer/) interface despite users having set `require-min-compat-client=reef`, leading to an assert in the osds - and mons. You are susceptible to this bug in reef versions prior to 18.2.3 if 1) you are using an osdmap + and mons. You are susceptible to this bug in Reef versions prior to 18.2.4 if 1) you are using an osdmap generated via the offline osdmaptool with the `--read` option or 2) you have explicitly generated pg-upmap-primary mappings with the CLI command. Please note that the fix is minimal and does not address corner cases such as adding a mapping in the middle of an upgrade or in a partially upgraded cluster (related trackers linked @@ -370,6 +376,7 @@ Changelog * python-common: fix osdspec_affinity check (`pr#56095 `_, Guillaume Abrioux) * qa/cephadm: testing for extra daemon/container features (`pr#55957 `_, Adam King) * qa/cephfs: improvements for name generators in test_volumes.py (`pr#54729 `_, Rishabh Dave) +* qa/distros: remove centos 8 from supported distros (`pr#57932 `_, Guillaume Abrioux, Casey Bodley, Adam King, Laura Flores) * qa/suites/fs/nfs: use standard health ignorelist (`pr#56392 `_, Patrick Donnelly) * qa/suites/fs/workload: enable snap_schedule early (`pr#56424 `_, Patrick Donnelly) * qa/tasks/cephfs/test_misc: switch duration to timeout (`pr#55746 `_, Xiubo Li) @@ -388,6 +395,7 @@ Changelog * qa: Fix fs/full suite (`pr#55829 `_, Kotresh HR) * qa: fix incorrectly using the wait_for_health() helper (`issue#57985 `_, `pr#54237 `_, Venky Shankar) * qa: fix rank_asok() to handle errors from asok commands (`pr#55302 `_, Neeraj Pratap Singh) +* qa: ignore container checkpoint/restore related selinux denials for centos9 (`issue#64616 `_, `pr#56019 `_, Venky Shankar) * qa: remove error string checks and check w/ return value (`pr#55943 `_, Venky Shankar) * qa: remove vstart runner from radosgw_admin task (`pr#55097 `_, Ali Maredia) * qa: run kernel_untar_build with newer tarball (`pr#54711 `_, Milind Changire) diff --git a/doc/releases/releases.yml b/doc/releases/releases.yml index 828b076761c66..d6a18389567a3 100644 --- a/doc/releases/releases.yml +++ b/doc/releases/releases.yml @@ -16,7 +16,7 @@ releases: target_eol: 2025-08-01 releases: - version: 18.2.4 - released: 2024-07-17 + released: 2024-07-24 - version: 18.2.2 released: 2024-03-11 - version: 18.2.1