v2.10.6

liangyepianzhou released this 08 Mar 11:33

· 4460 commits to master since this release

a76ddbe

Broker

Improvements

[improve][broker] Consistently add fine-grain authorization to REST API 22202
[improve] [broker] Do not print an Error log when responding to HTTP-404 when calling Admin API and the topic does not exist. 21995
[improve][proxy] Fix comment about enableProxyStatsEndpoints 21757
[improve][broker][PIP-318] Support not retaining null-key message during topic compaction 21578
[improve] [client] Merge lookup requests for the same topic 21232
[improve] [broker] Let the producer request success at the first time if the previous one is inactive 21220
[improve] [proxy] Not close the socket if lookup failed caused by too many requests 21216
[improve] [broker] Not close the socket if lookup failed caused by bundle unloading or metadata ex 21211
[improve] [broker] Print warn log if ssl handshake error & print ledger id when switch ledger 21201
[improve] [broker] improve read entry error log for troubleshooting 21169
[improve][proxy] Support disabling metrics endpoint 21031
[improve][broker] Improve cache handling for partitioned topic metadata when doing lookup 21063
[improve][broker] Avoid print redirect exception log when get list from bundle 20846
[improve][sql] Fix the wrong format of the logs 20907
[improve][broker] Add consumer-id into the log when doing subscribe. 20568
[improve] [broker] Print warn log if compaction failure 19405
[improve][admin]internalGetMessageById shouldn't be allowed on partitioned topic 19013

Fixes

[fix][sec] Upgrade Jetty to 9.4.54.v20240208 to address CVE-2024-22201 22144
[fix][sec] Upgrade commons-compress to 1.26.0 22086
[fix][broker] Support running docker container with gid != 0 22081
[fix][broker] Sanitize values before logging in apply-config-from-env.py script 22044
[fix][broker][branch-3.1] Avoid PublishRateLimiter use an already closed RateLimiter 22011
[fix] [broker] Replication stopped due to unload topic failed 21947
[fix] [broker] fix write all compacted out entry into compacted topic 21917
[fix] [ml] Fix retry mechanism of deleting ledgers to invalidate 21869
[fix][broker]Fix NonPersistentDispatcherMultipleConsumers ArrayIndexOutOfBoundsException 21856
[fix][broker] Fix String wrong format 21829
[fix] [broker] Update topic policies as much as possible when some ex was thrown 21810
[fix][broker] Fix the wrong value of BrokerSrevice.maxUnackedMsgsPerDispatcher 21765
[fix][sec] Exclude avro from hadoop-client 21719
[fix][test] Fix PerformanceProducer send count error 21706
[fix][broker] Fix the issue of topics possibly being deleted. 21704
[fix][broker] Fix typo in the config key 21690
[fix] [broker] network package lost if enable haProxyProtocolEnabled 21684
[fix][broker] Fix memory leak during topic compaction 21647
[fix][broker] Duplicate LedgerOffloader creation when namespace/topic… 21591
[fix][broker] Correct schema deletion for partitioned topic 21574
[fix][broker] Fix namespace bundle stuck in unloading status (#21445) 21567
[fix][broker] Fix create topic with different auto creation strategies causes race condition 21545
[fix] [ml] Fix orphan scheduled task for ledger create timeout check 21542
[fix] [broker] Fix thousands orphan PersistentTopic caused OOM 21540
[fix][ml] Fix unfinished callback when deleting managed ledger 21530
[fix][broker] Fix setReplicatedSubscriptionStatus incorrect behavior 21510
[fix][broker] Do not write replicated snapshot marker when the topic which is not enable replication 21495
[branch-2.10][fix][proxy] Move status endpoint out of auth coverage 21494
[fix][broker] Avoid pass null role in MultiRolesTokenAuthorizationProvider 21486
[fix][broker] Fix the deadlock when using BookieRackAffinityMapping with rackaware policy 21481
[fix][broker] Fix namespace bundle stuck in unloading status 21445
[fix][broker] Fix MultiRoles token provider NPE when using anonymous clients 21429
[fix][proxy] Move status endpoint out of auth coverage 21428
[fix][sec] Upgrade Netty to 4.1.100 to address CVE-2023-44487 21397
[fix][sec] Bump avro version to 1.11.3 for CVE-2023-39410 21341
[fix][test] Fix flaky test NarUnpackerTest 21328
[fix] [bk-client] Fix bk client MinNumRacksPerWriteQuorum and EnforceMinNumRacksPerWriteQuorum not work problem. 21327
[fix][ml] Fix thread safe issue with RangeCache.put and RangeCache.clear 21302
[fix][sec] Upgrade snappy-java to 1.1.10.5 21280
[fix][txn] Ack all message ids when ack chunk messages with transaction. 21268
[fix][broker][branch-2.10] Fix inconsistent topic policy 21258
[fix] [ml] fix wrong msg backlog of non-durable cursor after trim ledgers 21250
[fix] [ml] Reader can set read-pos to a deleted ledger 21248
[fix][broker]Fixed produce and consume when anonymousUserRole enabled 21237
[fix][broker] Fix inconsistent topic policy 21231
[fix][broker] Fixed reset for AggregatedNamespaceStats 21225
[fix][broker] Make the new exclusive consumer instead the inactive one faster 21183
[fix][broker][branch-2.10] Backport fix UniformLoadShedder selecet wrong overloadbroker and underloadbroker 21182
[Branch-2.10] [imporve] [bookie] Upgrade BookKeeper dependency to 4.14.8 for branch 2.10 21148
[fix][client] Fix repeat consume when using n-ack and batched messages 21116
[fix][client] Avoid ack hole for chunk message 21101
[branch-2.10] [fix] [broker] Fix isolated group not work problem. 21098
[fix] [broker] Fix isolated group not work problem. 21096
[fix][broker] Fix write duplicate entries into the compacted ledger after RawReader reconnects 21081
[fix][client] Fix consumer can't consume resent chunked messages 21070
[fix][broker] Make sure all inflight writes have finished before completion of compaction 21067
[fix][broker] Use MessageDigest.isEqual when comparing digests 21061
[fix][misc] Bump GRPC version to 1.55.3 to fix CVE 21057
[fix] [bk] Correctct the bookie info after ZK client is reconnected 21035
[fix][io] Update test certs for Elasticsearch 21001
[fix][broker] Fix can't stop phase-two of compaction even though messageId read reaches lastReadId 20988
[fix][broker] Fix message loss during topic compaction 20980
[fix][broker] Fix incorrect number of read compacted entries 20978
[fix][broker]Fix chunked messages will be filtered by duplicating 20948
[fix][broker]Check that the super user role is in the MultiRolesTokenAuthorizationProvider plugin 20939
[fix] [log] fix the vague response if topic not found 20932
[fix][broker] fix MessageDeduplication throw NPE when enable broker dedup and set namespace disable deduplication. 20905
[fix] [ml] fix discontinuous ledger deletion 20898
[fix][broker] In replication scenario, remote consumer could not be registered if there has no message was sent 20888
[branch-2.10][fix][broker] Fix inconsensus namespace policies by getPoliciesIfCached 20873
[branch-2.10][fix][broker] Inconsistent behaviour for topic auto_creation 20872
[fix][broker] Fix inconsensus namespace policies by getPoliciesIfCached 20855
[fix][broker] Avoid infinite bundle unloading 20822
[fix][broker] Fix get topic policies as null during clean cache 20763
[fix] [broker] do not filter system topic while shedding. 18949
[improve] Introduce the sync() API to ensure consistency on reads during critical metadata operation paths 18518
[fix][broker] Fix namespace not found will cause request timeout 18512
[fix][io] exclude logback dependency for canal connector 18226

Client

Fixes

[fix][client] Fix ConsumerBuilderImpl#subscribe silent stuck when using pulsar-client:3.0.x with jackson-annotations prior to 2.12.0 21985
[fix] [client] fix reader.hasMessageAvailable return false when incoming queue is not empty 21259
[fix][client] fix same producer/consumer use more than one connection per broker 21144
[fix][client] Fix repeat consume when using n-ack and batched messages 21116
[fix][client] Avoid ack hole for chunk message 21101
[fix][client] Fix consumer can't consume resent chunked messages 21070
[fix] [cli] the variable producerName of BatchMsgContainer is null 20819
[fix][client] fix negative message re-delivery twice issue 20750

Assets 2