node id mismatch when trying to load collection on milvus standalone without docker #35889

ron-gilaad · 2024-09-01T08:09:24Z

ron-gilaad
Sep 1, 2024

Hi, I get nodeID mismatch error when trying to load the wiki50M collection on Milvus standalone without docker:
[2024/08/31 08:35:00.726 +00:00] [INFO] [datacoord/server.go:665] ["data coordinator successfully connected to metadata store"] [metaType=etcd]
[2024/08/31 08:35:00.726 +00:00] [INFO] [dependency/factory.go:85] ["try to init mq"] [standalone=true] [mqType=rocksmq]
[2024/08/31 08:35:00.726 +00:00] [INFO] [msgstream/mq_factory.go:244] ["init rocksmq msgstream success"] [path=/var/lib/milvus/rdb_data]
[2024/08/31 08:35:00.729 +00:00] [WARN] [grpcclient/client.go:490] ["call received grpc error"] [clientRole=rootcoord] [error="rpc error: code = Unknown desc = node not match[expectedNodeID=11][actualNodeID=12]"]
[2024/08/31 08:35:00.729 +00:00] [WARN] [grpcclient/client.go:490] ["call received grpc error"] [clientRole=rootcoord] [error="rpc error: code = Unknown desc = node not match[expectedNodeID=11][actualNodeID=12]"]
[2024/08/31 08:35:00.729 +00:00] [WARN] [retry/retry.go:104] ["start to reset connection because of specific reasons"] [client_role=rootcoord] [error="rpc error: code = Unknown desc = node not match[expectedNodeID=11][actualNodeID=12]"]
[2024/08/31 08:35:00.729 +00:00] [WARN] [retry/retry.go:104] ["start to reset connection because of specific reasons"] [client_role=rootcoord] [error="rpc error: code = Unknown desc = node not match[expectedNodeID=11][actualNodeID=12]"]
[2024/08/31 08:35:00.730 +00:00] [INFO] [grpcclient/client.go:239] ["previous client closed"] [role=rootcoord] [addr=]
[2024/08/31 08:35:00.730 +00:00] [INFO] [grpcclient/client.go:239] ["previous client closed"] [role=rootcoord] [addr=]
[2024/08/31 08:35:00.730 +00:00] [DEBUG] [sessionutil/session_util.go:620] ["SessionUtil GetSessions"] [prefix=rootcoord] [key=rootcoord] [address=172.28.30.32:53100]

Answered by ron-gilaad

Sep 2, 2024

it has been solved by running compact on the segments

View full answer

yhmo · 2024-09-02T04:17:28Z

yhmo
Sep 2, 2024
Collaborator

Similar to this issue: #29489
If your milvus version is smaller than v2.3.7, then you can upgrade to v2.3.7 to try. A full server-side log would be helpful to investigate.

1 reply

ron-gilaad Sep 2, 2024
Author

2024/09/01 11:51:23 maxprocs: Leaving GOMAXPROCS=32: CPU quota undefined
__ _________ _ ____ ______
/ |/ / / /| | / / / / / __/
/ /|/ // // /| |/ / // /\
// /////_/__/
Welcome to use Milvus!
Version: v2.4.2-422-gddcd77423
Built: Sun Aug 11 09:31:41 AM UTC 2024
GitCommit: ddcd77423
GoVersion: go version go1.21.0 linux/amd64
TotalMem: 134789885952
UsedMem: 37433344
open pid file: /run/milvus/standalone.pid
lock pid file: /run/milvus/standalone.pid
[2024/09/01 11:51:23.162 +00:00] [INFO] [roles/roles.go:307] ["starting running Milvus components"]
[2024/09/01 11:51:23.174 +00:00] [DEBUG] [config/refresher.go:67] ["start refreshing configurations"] [source=FileSource]
[2024/09/01 11:51:23.179 +00:00] [DEBUG] [config/refresher.go:67] ["start refreshing configurations"] [source=FileSource]
[2024/09/01 11:51:23.179 +00:00] [INFO] [paramtable/hook_config.go:21] ["hook config"] [hook={}]
{"level":"info","ts":"2024-09-01T11:51:23.182Z","caller":"embed/etcd.go:124","msg":"configuring peer listeners","listen-peer-urls":["http://localhost:2380"]}
{"level":"info","ts":"2024-09-01T11:51:23.183Z","caller":"embed/etcd.go:132","msg":"configuring client listeners","listen-client-urls":["http://0.0.0.0:2379"]}
{"level":"info","ts":"2024-09-01T11:51:23.187Z","caller":"embed/etcd.go:306","msg":"starting an etcd server","etcd-version":"3.5.5","git-sha":"Not provided (use ./build instead of go build)","go-version":"go1.21.0","go-os":"linux","go-arch":"amd64","max-cpu-set":32,"max-cpu-available":32,"member-initialized":true,"name":"default","data-dir":"default.etcd","wal-dir":"","wal-dir-dedicated":"","member-dir":"default.etcd/member","force-new-cluster":false,"heartbeat-interval":"100ms","election-timeout":"1s","initial-election-tick-advance":true,"snapshot-count":100000,"snapshot-catchup-entries":5000,"initial-advertise-peer-urls":["http://localhost:2380"],"listen-peer-urls":["http://localhost:2380"],"advertise-client-urls":["http://0.0.0.0:2379"],"listen-client-urls":["http://0.0.0.0:2379"],"listen-metrics-urls":[],"cors":[""],"host-whitelist":[""],"initial-cluster":"","initial-cluster-state":"new","initial-cluster-token":"","quota-backend-bytes":4294967296,"max-request-bytes":1572864,"max-concurrent-streams":4294967295,"pre-vote":true,"initial-corrupt-check":false,"corrupt-check-time-interval":"0s","compact-check-time-enabled":false,"compact-check-time-interval":"1m0s","auto-compaction-mode":"revision","auto-compaction-retention":"1µs","auto-compaction-interval":"1µs","discovery-url":"","discovery-proxy":"","downgrade-check-interval":"5s"}
:
{"level":"info","ts":"2024-09-01T11:51:23.194Z","caller":"etcdserver/backend.go:81","msg":"opened backend db","path":"default.etcd/member/snap/db","took":"6.344639ms"}
{"level":"info","ts":"2024-09-01T11:51:23.300Z","caller":"etcdserver/server.go:530","msg":"No snapshot found. Recovering WAL from scratch!"}
{"level":"info","ts":"2024-09-01T11:51:23.430Z","caller":"etcdserver/raft.go:529","msg":"restarting local member","cluster-id":"cdf818194e3a8c32","local-member-id":"8e9e05c52164694d","commit-index":63601}
{"level":"info","ts":"2024-09-01T11:51:23.431Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d switched to configuration voters=()"}
{"level":"info","ts":"2024-09-01T11:51:23.432Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d became follower at term 24"}
{"level":"info","ts":"2024-09-01T11:51:23.432Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"newRaft 8e9e05c52164694d [peers: [], term: 24, commit: 63601, applied: 0, lastindex: 63601, lastterm: 24]"}
{"level":"warn","ts":"2024-09-01T11:51:23.432Z","caller":"auth/store.go:1233","msg":"simple token is not cryptographically signed"}
{"level":"info","ts":"2024-09-01T11:51:23.432Z","caller":"mvcc/kvstore.go:323","msg":"restored last compact revision","meta-bucket-name":"meta","meta-bucket-name-key":"finishedCompactRev","restored-compact-revision":60636}
{"level":"info","ts":"2024-09-01T11:51:23.438Z","caller":"mvcc/kvstore.go:393","msg":"kvstore restored","current-rev":62323}
{"level":"info","ts":"2024-09-01T11:51:23.438Z","caller":"etcdserver/quota.go:117","msg":"enabled backend quota","quota-name":"v3-applier","quota-size-bytes":4294967296,"quota-size":"4.3 GB"}
{"level":"info","ts":"2024-09-01T11:51:23.439Z","caller":"etcdserver/server.go:854","msg":"starting etcd server","local-member-id":"8e9e05c52164694d","local-server-version":"3.5.5","cluster-version":"to_be_decided"}
{"level":"info","ts":"2024-09-01T11:51:23.439Z","caller":"etcdserver/server.go:754","msg":"starting initial election tick advance","election-ticks":10}
{"level":"info","ts":"2024-09-01T11:51:23.439Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d switched to configuration voters=(10276657743932975437)"}
{"level":"info","ts":"2024-09-01T11:51:23.439Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"cdf818194e3a8c32","local-member-id":"8e9e05c52164694d","added-peer-id":"8e9e05c52164694d","added-peer-peer-urls":["http://localhost:2380"]}
{"level":"info","ts":"2024-09-01T11:51:23.440Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"cdf818194e3a8c32","local-member-id":"8e9e05c52164694d","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-01T11:51:23.440Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-01T11:51:23.442Z","caller":"embed/etcd.go:275","msg":"now serving peer/client/metrics","local-member-id":"8e9e05c52164694d","initial-advertise-peer-urls":["http://localhost:2380"],"listen-peer-urls":["http://localhost:2380"],"adve:
[2024/09/01 11:51:23.442 +00:00] [INFO] [roles/roles.go:256] [setupPrometheusHTTPServer]
[2024/09/01 11:51:23.443 +00:00] [INFO] [http/server.go:152] ["management listen"] [addr=:9091]
[2024/09/01 11:51:23.443 +00:00] [INFO] [rootcoord/root_coord.go:154] ["update rootcoord state"] [state=Abnormal]
[2024/09/01 11:51:23.443 +00:00] [DEBUG] [rootcoord/service.go:184] ["init params done.."]
[2024/09/01 11:51:23.443 +00:00] [INFO] [etcd/etcd_util.go:47] ["create etcd client"] [useEmbedEtcd=true] [useSSL=false] [endpoints="[localhost:2379]"] [minVersion=1.3]
[2024/09/01 11:51:23.443 +00:00] [DEBUG] [rootcoord/service.go:204] ["etcd connect done ..."]
[2024/09/01 11:51:23.443 +00:00] [DEBUG] [rootcoord/service.go:264] ["start grpc "] [port=53100]
[2024/09/01 11:51:23.444 +00:00] [INFO] [etcd/etcd_util.go:47] ["create etcd client"] [useEmbedEtcd=true] [useSSL=false] [endpoints="[localhost:2379]"] [minVersion=1.3]
[2024/09/01 11:51:23.444 +00:00] [DEBUG] [datacoord/service.go:150] ["network port"] [port=13333]
[2024/09/01 11:51:23.444 +00:00] [INFO] [components/index_coord.go:38] ["IndexCoord running ..."]
[2024/09/01 11:51:23.445 +00:00] [INFO] [etcd/etcd_util.go:47] ["create etcd client"] [useEmbedEtcd=true] [useSSL=false] [endpoints="[localhost:2379]"] [minVersion=1.3]
[2024/09/01 11:51:23.445 +00:00] [DEBUG] [querycoord/service.go:218] [network] [port=19531]
[2024/09/01 11:51:23.445 +00:00] [DEBUG] [querynode/service.go:104] [QueryNode] [port=21123]
[2024/09/01 11:51:23.445 +00:00] [INFO] [etcd/etcd_util.go:47] ["create etcd client"] [useEmbedEtcd=true] [useSSL=false] [endpoints="[localhost:2379]"] [minVersion=1.3]
[2024/09/01 11:51:23.445 +00:00] [DEBUG] [querynode/service.go:124] ["QueryNode connect to etcd successfully"]
[2024/09/01 11:51:23.446 +00:00] [INFO] [etcd/etcd_util.go:47] ["create etcd client"] [useEmbedEtcd=true] [useSSL=false] [endpoints="[localhost:2379]"] [minVersion=1.3]
[2024/09/01 11:51:23.446 +00:00] [INFO] [datanode/service.go:256] ["DataNode address"] [address=172.28.30.32:21124]
[2024/09/01 11:51:23.446 +00:00] [INFO] [datanode/service.go:257] ["DataNode serverID"] [serverID=0]
[2024/09/01 11:51:23.543 +00:00] [DEBUG] [rootcoord/service.go:221] ["grpc init done ..."]
[2024/09/01 11:51:23.543 +00:00] [DEBUG] [rootcoord/service.go:224] ["RootCoord start to create DataCoord client"]
[2024/09/01 11:51:23.544 +00:00] [INFO] [etcd/etcd_util.go:47] ["create etcd client"] [useEmbedEtcd=true] [useSSL=false] [endpoints="[localhost:2379]"] [minVersion=1.3]
[2024/09/01 11:51:23.544 +00:00] [DEBUG] [sessionutil/session_util.go:257] ["Session try to connect to etcd"]
{"level":"info","ts":"2024-09-01T11:51:23.544Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d no leader at term 24; dropping index reading msg"}
{"level":"info","ts":"2024-09-01T11:51:23.545Z","caller":"etcdserver/v3_server.go:832","msg":"first commit in current term: resend:
{"level":"info","ts":"2024-09-01T11:51:23.545Z","caller":"etcdserver/v3_server.go:832","msg":"first commit in current term: resending ReadIndex request"}
{"level":"info","ts":"2024-09-01T11:51:23.545Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d no leader at term 24; dropping index reading msg"}
[2024/09/01 11:51:23.545 +00:00] [INFO] [dependency/factory.go:85] ["try to init mq"] [standalone=true] [mqType=rocksmq]
{"level":"info","ts":"2024-09-01T11:51:23.545Z","caller":"etcdserver/v3_server.go:832","msg":"first commit in current term: resending ReadIndex request"}
{"level":"info","ts":"2024-09-01T11:51:23.545Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d no leader at term 24; dropping index reading msg"}
[2024/09/01 11:51:23.545 +00:00] [DEBUG] [server/global_rmq.go:39] ["initializing global rmq"] [path=/var/lib/milvus/rdb_data]
{"level":"info","ts":"2024-09-01T11:51:23.545Z","caller":"etcdserver/v3_server.go:832","msg":"first commit in current term: resending ReadIndex request"}
{"level":"info","ts":"2024-09-01T11:51:23.545Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d no leader at term 24; dropping index reading msg"}
[2024/09/01 11:51:23.545 +00:00] [DEBUG] [sessionutil/session_util.go:257] ["Session try to connect to etcd"]
{"level":"info","ts":"2024-09-01T11:51:23.546Z","caller":"etcdserver/v3_server.go:832","msg":"first commit in current term: resending ReadIndex request"}
{"level":"info","ts":"2024-09-01T11:51:23.546Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d no leader at term 24; dropping index reading msg"}
[2024/09/01 11:51:23.546 +00:00] [DEBUG] [querynode/service.go:134] [QueryNode] [State=Initializing]
[2024/09/01 11:51:23.546 +00:00] [INFO] [querynodev2/server.go:281] ["QueryNode session info"] [metaPath=by-dev/meta]
[2024/09/01 11:51:23.546 +00:00] [DEBUG] [sessionutil/session_util.go:257] ["Session try to connect to etcd"]
{"level":"info","ts":"2024-09-01T11:51:23.546Z","caller":"etcdserver/v3_server.go:832","msg":"first commit in current term: resending ReadIndex request"}
{"level":"info","ts":"2024-09-01T11:51:23.546Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d no leader at term 24; dropping index reading msg"}
[2024/09/01 11:51:23.546 +00:00] [INFO] [datanode/service.go:266] ["initializing RootCoord client for DataNode"]
[2024/09/01 11:51:23.546 +00:00] [DEBUG] [sessionutil/session_util.go:257] ["Session try to connect to etcd"]
[2024/09/01 11:51:23.546 +00:00] [DEBUG] [server/rocksmq_impl.go:176] ["Start rocksmq"] ["max proc"=32] [parallism=2] ["lru cache"=4294967296]
[2024/09/01 11:51:23.590 +00:00] [DEBUG] [server/rocksmq_retention.go:80] ["Rocksmq retention goroutine start!"]
[2024/09/01 11:51:23.589 +00:00] [INFO] [msgstream/mq_factory.go:244] ["init rocksmq msgstream success"] [path=/var/lib/milvus/rdb
_data]
[2024/09/01 11:51:23.590 +00:00] [DEBUG] [sessionutil/session_util.go:257] ["Session try to connect to etcd"]
{"level":"info","ts":"2024-09-01T11:51:23.638Z","caller":"etcdserver/v3_server.go:832","msg":"first commit in current term: resending ReadIndex request"}
{"level":"info","ts":"2024-09-01T11:51:23.638Z","caller":"etcdserver/v3_server.go:832","msg":"first commit in current term: resending ReadIndex request"}
{"level":"info","ts":"2024-09-01T11:51:23.638Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d no leader at term 24; dropping index reading msg"}
{"level":"info","ts":"2024-09-01T11:51:23.638Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d no leader at term 24; dropping index reading msg"}
{"level":"info","ts":"2024-09-01T11:51:23.639Z","caller":"etcdserver/v3_server.go:832","msg":"first commit in current term: resending ReadIndex request"}
{"level":"info","ts":"2024-09-01T11:51:23.639Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d no leader at term 24; dropping index reading msg"}
{"level":"info","ts":"2024-09-01T11:51:23.639Z","caller":"etcdserver/v3_server.go:832","msg":"first commit in current term: resending ReadIndex request"}
{"level":"info","ts":"2024-09-01T11:51:23.639Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d no leader at term 24; dropping index reading msg"}
{"level":"info","ts":"2024-09-01T11:51:23.639Z","caller":"etcdserver/v3_server.go:832","msg":"first commit in current term: resending ReadIndex request"}
{"level":"info","ts":"2024-09-01T11:51:23.639Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d no leader at term 24; dropping index reading msg"}
{"level":"info","ts":"2024-09-01T11:51:23.640Z","caller":"etcdserver/v3_server.go:832","msg":"first commit in current term: resending ReadIndex request"}
{"level":"info","ts":"2024-09-01T11:51:23.640Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d no leader at term 24; dropping index reading msg"}
{"level":"info","ts":"2024-09-01T11:51:23.640Z","caller":"etcdserver/v3_server.go:832","msg":"first commit in current term: resending ReadIndex request"}
{"level":"info","ts":"2024-09-01T11:51:23.640Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d no leader at term 24; dropping index reading msg"}
{"level":"info","ts":"2024-09-01T11:51:23.640Z","caller":"etcdserver/v3_server.go:832","msg":"first commit in current term: resend:
{"level":"warn","ts":"2024-09-01T11:51:24.533Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"987.963573ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:"health" ","response":"","error":"etcdserver: leader changed"}
{"level":"info","ts":"2024-09-01T11:51:24.533Z","caller":"traceutil/trace.go:171","msg":"trace[1752678320] range","detail":"{range_begin:health; range_end:; }","duration":"988.697598ms","start":"2024-09-01T11:51:23.544Z","end":"2024-09-01T11:51:24.533Z","steps":["trace[1752678320] 'agreement among raft nodes before linearized reading' (duration: 987.960167ms)"],"step_count":1}
{"level":"warn","ts":"2024-09-01T11:51:24.533Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"942.897572ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:"health" ","response":"range_response_count:0 size:6"}
{"level":"warn","ts":"2024-09-01T11:51:24.533Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"987.429069ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:"health" ","response":"range_response_count:0 size:6"}
[2024/09/01 11:51:24.533 +00:00] [WARN] [sessionutil/session_util.go:266] ["retry func failed"] [retried=0] [error="etcdserver: leader changed"]
{"level":"info","ts":"2024-09-01T11:51:24.533Z","caller":"traceutil/trace.go:171","msg":"trace[404159243] range","detail":"{range_begin:health; range_end:; response_count:0; response_revision:62323; }","duration":"943.021412ms","start":"2024-09-01T11:51:23.590Z","end":"2024-09-01T11:51:24.533Z","steps":["trace[404159243] 'agreement among raft nodes before linearized reading' (duration: 942.878266ms)"],"step_count":1}
{"level":"info","ts":"2024-09-01T11:51:24.533Z","caller":"traceutil/trace.go:171","msg":"trace[985889262] range","detail":"{range_begin:health; range_end:; response_count:0; response_revision:62323; }","duration":"987.566384ms","start":"2024-09-01T11:51:23.545Z","end":"2024-09-01T11:51:24.533Z","steps":["trace[985889262] 'agreement among raft nodes before linearized reading' (duration: 987.387893ms)"],"step_count":1}
{"level":"warn","ts":"2024-09-01T11:51:24.533Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"986.98864ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:"health" ","response":"range_response_count:0 size:6"}
[2024/09/01 11:51:24.533 +00:00] [DEBUG] [sessionutil/session_util.go:272] ["Session connect to etcd success"]
{"level":"warn","ts":"2024-09-01T11:51:24.533Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"986.61204ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:"health" ","response":"range_response_count:0 size:6"}
[2024/09/01 11:51:24.533 +00:00] [DEBUG] [sessionutil/session_util.go:272] ["Session connect to etcd success"]
:
tcoord] [address=172.28.30.32:53100]
[2024/09/01 11:51:24.534 +00:00] [DEBUG] [sessionutil/session_util.go:620] ["SessionUtil GetSessions"] [prefix=rootcoord] [key=rootcoord] [address=172.28.30.32:53100]
[2024/09/01 11:51:24.534 +00:00] [DEBUG] [client/client.go:93] ["RootCoordClient GetSessions success"] [address=172.28.30.32:53100] [serverID=23]
[2024/09/01 11:51:24.534 +00:00] [DEBUG] [client/client.go:93] ["RootCoordClient GetSessions success"] [address=172.28.30.32:53100] [serverID=23]
[2024/09/01 11:51:24.534 +00:00] [DEBUG] [sessionutil/session_util.go:373] ["Session get serverID success"] [key=id] [ServerId=24]
[2024/09/01 11:51:24.535 +00:00] [INFO] [sessionutil/session_util.go:289] ["start server"] [name=querynode] [address=172.28.30.32:21123] [id=24]
[2024/09/01 11:51:24.535 +00:00] [DEBUG] [sessionutil/session_util.go:315] [getServerID] [reuse=true]
[2024/09/01 11:51:24.535 +00:00] [INFO] [sessionutil/session_util.go:289] ["start server"] [name=indexcoord] [address=172.28.30.32:13333] [id=24]
[2024/09/01 11:51:24.535 +00:00] [DEBUG] [sessionutil/session_util.go:257] ["Session try to connect to etcd"]
[2024/09/01 11:51:24.535 +00:00] [DEBUG] [sessionutil/session_util.go:272] ["Session connect to etcd success"]
{"level":"info","ts":"2024-09-01T11:51:24.535Z","caller":"embed/serve.go:146","msg":"serving client traffic insecurely; this is strongly discouraged!","address":"0.0.0.0:2379"}
[2024/09/01 11:51:24.535 +00:00] [DEBUG] [sessionutil/session_util.go:315] [getServerID] [reuse=true]
[2024/09/01 11:51:24.535 +00:00] [INFO] [sessionutil/session_util.go:289] ["start server"] [name=datacoord] [address=172.28.30.32:13333] [id=24]
[2024/09/01 11:51:24.535 +00:00] [DEBUG] [sessionutil/session_util.go:257] ["Session try to connect to etcd"]
[2024/09/01 11:51:24.535 +00:00] [DEBUG] [sessionutil/session_util.go:272] ["Session connect to etcd success"]
[2024/09/01 11:51:24.535 +00:00] [INFO] [datacoord/server.go:345] ["init rootcoord client done"]
[2024/09/01 11:51:24.535 +00:00] [INFO] [datacoord/server.go:354] ["init chunk manager factory done"]
[2024/09/01 11:51:24.535 +00:00] [INFO] [datacoord/server.go:652] ["data coordinator connecting to metadata store"] [metaType=etcd]
[2024/09/01 11:51:24.535 +00:00] [INFO] [datacoord/server.go:665] ["data coordinator successfully connected to metadata store"] [metaType=etcd]
[2024/09/01 11:51:24.535 +00:00] [INFO] [sessionutil/session_util.go:1234] ["save server info into file"] [content="querynode-24\n"] [filePath=/tmp/milvus/server_id_115069]
[2024/09/01 11:51:24.535 +00:00] [INFO] [querynodev2/server.go:166] ["QueryNode init session"] [nodeID=24] ["node address"=172.28.30.32:21123]
[2024/09/01 11:51:24.536 +00:00] [INFO] [dependency/factory.go:85] ["try to init mq"] [standalone=true] [mqType=rocksmq]
[2024/09/01 11:51:24.536 +00:00] [INFO] [msgstream/mq_factory.go:244] ["init rocksmq msgstream success"] [path=/var/lib/milvus/rdb_data]
[2024/09/01 11:51:24.538 +00:00] [WARN] [grpcclient/client.go:490] ["call received grpc error"] [clientRole=rootcoord] [error="rpc error: code = Unknown desc = node not match[expectedNodeID=23][actualNodeID=24]"]
[2024/09/01 11:51:24.538 +00:00] [WARN] [grpcclient/client.go:490] ["call received grpc error"] [clientRole=rootcoord] [error="rpc error: code = Unknown desc = node not match[expectedNodeID=23][actualNodeID=24]"]
[2024/09/01 11:51:24.538 +00:00] [WARN] [retry/retry.go:104] ["start to reset connection because of specific reasons"] [client_role=rootcoord] [error="rpc error: code = Unknown desc = node not match[expectedNodeID=23][actualNodeID=24]"]
[2024/09/01 11:51:24.538 +00:00] [WARN] [retry/retry.go:104] ["start to reset connection because of specific reasons"] [client_role=rootcoord] [error="rpc error: code = Unknown desc = node not match[expectedNodeID=23][actualNodeID=24]"]
[2024/09/01 11:51:24.539 +00:00] [DEBUG] [sessionutil/session_util.go:620] ["SessionUtil GetSessions"] [prefix=rootcoord] [key=rootcoord] [address=172.28.30.32:53100]
[2024/09/01 11:51:24.539 +00:00] [DEBUG] [client/client.go:93] ["RootCoordClient GetSessions success"] [address=172.28.30.32:53100] [serverID=23]
[2024/09/01 11:51:24.539 +00:00] [DEBUG] [sessionutil/session_util.go:620] ["SessionUtil GetSessions"] [prefix=rootcoord] [key=rootcoord] [address=172.28.30.32:53100]
[2024/09/01 11:51:24.539 +00:00] [DEBUG] [client/client.go:93] ["RootCoordClient GetSessions success"] [address=172.28.30.32:53100] [serverID=23]
[2024/09/01 11:51:24.539 +00:00] [INFO] [grpcclient/client.go:239] ["previous client closed"] [role=rootcoord] [addr=]
[2024/09/01 11:51:24.539 +00:00] [INFO] [grpcclient/client.go:239] ["previous client closed"] [role=rootcoord] [addr=]
[2024/09/01 11:51:24.539 +00:00] [WARN] [grpcclient/client.go:470] ["retry func failed"] [retried=0] [error="rpc error: code = Unknown desc = node not match[expectedNodeID=23][actualNodeID=24]"]
:

ron-gilaad · 2024-09-02T07:16:01Z

ron-gilaad
Sep 2, 2024
Author

it has been solved by running compact on the segments

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

node id mismatch when trying to load collection on milvus standalone without docker #35889

{{title}}

Replies: 2 comments 1 reply

{{title}}

{{title}}

{{title}}

Select a reply

node id mismatch when trying to load collection on milvus standalone without docker #35889

ron-gilaad Sep 1, 2024

Replies: 2 comments · 1 reply

yhmo Sep 2, 2024 Collaborator

ron-gilaad Sep 2, 2024 Author

ron-gilaad Sep 2, 2024 Author

ron-gilaad
Sep 1, 2024

Replies: 2 comments 1 reply

yhmo
Sep 2, 2024
Collaborator

ron-gilaad Sep 2, 2024
Author

ron-gilaad
Sep 2, 2024
Author