Shardingsphere sharding rule use error in two shardingsphere datasource and different sharding rule

[gavenpeng]

Bug Report

For English only, other languages will not accept.

Before report a bug, make sure you have:

• Searched open and closed GitHub issues.
• Read documentation: ShardingSphere Doc.

Please pay attention on issues you submitted, because we maybe need more details.
If no response anymore and we cannot reproduce it on current information, we will close it.

Please answer these questions before submitting your issue. Thanks!

Version:Shardingsphere5.0.0
Project:ShardingSphere-JDBC

Expected behavior
we config two shardingsphere datasoure with different sharding rule

Actual behavior
the one shardingsphere datasource using the another sharding rule of datasoure while route sql, the business use mybatis plus

Reason analyze (If you can)

Steps to reproduce the behavior, such as: SQL to execute, sharding rule configuration, when exception occur etc.
1 business use two datasource:

   <bean id="commentDataSource" class="com.ximalaya.social.universal.ArenaDataSourceFactory">
        <constructor-arg value="universal-comment-service:social-universal-comment-db:mysql"/>
    </bean>

this data source sharding rule is follow:

rules:
  - !SHARDING
    tables:
      tb_comment:
        actualDataNodes: ds0.tb_comment${0..999}
        tableStrategy:
          standard:
            shardingColumn: id
            shardingAlgorithmName: commentrule
      tb_user_comment:
        actualDataNodes: ds0.tb_user_comment${0..999}
        tableStrategy:
          standard:
            shardingColumn: uid
            shardingAlgorithmName: userCommentrule      
      tb_biz_comment:
        actualDataNodes: ds0.tb_biz_comment${0..999}
        tableStrategy:
          standard:
            shardingColumn: biz_id

    <bean id="likeDataSource" class="com.ximalaya.social.universal.ArenaDataSourceFactory">
        <constructor-arg value="universal-comment-service:social-universal-like-db:mysql"/>
    </bean>

this data source sharding rule is follow:

  - !SHARDING
    tables:
      tb_like:
        actualDataNodes: ds0.tb_like${0..99}
        tableStrategy:
          standard:
            shardingColumn: biz_id
            shardingAlgorithmName: likerule
    shardingAlgorithms:
      likerule:
        type: HASH_MOD
        props:
          sharding-count: 100

2 error:

2023-02-14 23:25:27.536 [ConsumeMessageThread_6] ERROR c.x.a.a.j.s.s.XPaaShardingSpherePreparedStatement - ShardingSphere for source id universal-comment-service:social-universal-like-db:mysql create execution context failed:
org.apache.shardingsphere.infra.exception.ShardingSphereException: `tb_like` single table does not exist sharding rule [tb_comment,tb_user_comment,tb_biz_comment] .
	at org.apache.shardingsphere.sharding.route.engine.type.single.SingleTablesRoutingEngine.fillRouteContext(SingleTablesRoutingEngine.java:88)
	at org.apache.shardingsphere.sharding.route.engine.type.single.SingleTablesRoutingEngine.route(SingleTablesRoutingEngine.java:59)
	at org.apache.shardingsphere.sharding.route.engine.ShardingSQLRouter.createRouteContext(ShardingSQLRouter.java:61)
	at org.apache.shardingsphere.sharding.route.engine.ShardingSQLRouter.createRouteContext(ShardingSQLRouter.java:47)
	at org.apache.shardingsphere.infra.route.engine.impl.PartialSQLRouteExecutor.route(PartialSQLRouteExecutor.java:62)
	at org.apache.shardingsphere.infra.route.engine.SQLRouteEngine.route(SQLRouteEngine.java:52)
	at org.apache.shardingsphere.infra.context.kernel.KernelProcessor.route(KernelProcessor.java:54)
	at org.apache.shardingsphere.infra.context.kernel.KernelProcessor.generateExecutionContext(KernelProcessor.java:46)
	at org.apache.shardingsphere.driver.jdbc.core.statement.ShardingSpherePreparedStatement.createExecutionContext(ShardingSpherePreparedStatement.java:363)
	at com.ximalaya.architecture.arena.jdbc.sharding.statement.XPaaShardingSpherePreparedStatement.createExecutionContext(XPaaShardingSpherePreparedStatement.java:41)
	at org.apache.shardingsphere.driver.jdbc.core.statement.ShardingSpherePreparedStatement.execute(ShardingSpherePreparedStatement.java:271)
	at org.apache.ibatis.executor.statement.PreparedStatementHandler.update(PreparedStatementHandler.java:47)
	at org.apache.ibatis.executor.statement.RoutingStatementHandler.update(RoutingStatementHandler.java:74)
	at sun.reflect.GeneratedMethodAccessor164.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.ibatis.plugin.Plugin.invoke(Plugin.java:64)
	at com.sun.proxy.$Proxy214.update(Unknown Source)
	at org.apache.ibatis.executor.SimpleExecutor.doUpdate(SimpleExecutor.java:50)
	at org.apache.ibatis.executor.BaseExecutor.update(BaseExecutor.java:117)
	at org.apache.ibatis.executor.CachingExecutor.update(CachingExecutor.java:76)
	at sun.reflect.GeneratedMethodAccessor163.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.ibatis.plugin.Invocation.proceed(Invocation.java:49)
	at com.baomidou.mybatisplus.extension.plugins.MybatisPlusInterceptor.intercept(MybatisPlusInterceptor.java:106)
	at org.apache.ibatis.plugin.Plugin.invoke(Plugin.java:62)
	at com.sun.proxy.$Proxy213.update(Unknown Source)
	at org.apache.ibatis.session.defaults.DefaultSqlSession.update(DefaultSqlSession.java:194)
	at org.apache.ibatis.session.defaults.DefaultSqlSession.insert(DefaultSqlSession.java:181)
	at sun.reflect.GeneratedMethodAccessor261.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:427)
	at com.sun.proxy.$Proxy185.insert(Unknown Source)
	at org.mybatis.spring.SqlSessionTemplate.insert(SqlSessionTemplate.java:272)
	at com.baomidou.mybatisplus.core.override.MybatisMapperMethod.execute(MybatisMapperMethod.java:59)
	at com.baomidou.mybatisplus.core.override.MybatisMapperProxy$PlainMethodInvoker.invoke(MybatisMapperProxy.java:148)
	at com.baomidou.mybatisplus.core.override.MybatisMapperProxy.invoke(MybatisMapperProxy.java:89)
	at com.sun.proxy.$Proxy189.insert(Unknown Source)
	at com.ximalaya.social.universal.like.LikeService.hate(LikeService.java:112)
	at com.ximalaya.social.universal.like.sync.TrackCommentHateCreatedSyncProcessor.handle(TrackCommentHateCreatedSyncProcessor.java:27)
	at com.ximalaya.social.universal.like.sync.AbstractTrackCommentLikeSyncProcessor.onMessage(AbstractTrackCommentLikeSyncProcessor.java:40)
	at com.ximalaya.danube.core.consumer.rocket.RocketListener.onMessage(RocketListener.java:15)
	at com.ximalaya.danube.core.consumer.rocket.RocketMessageListenerContainer$2.consumeMessage(RocketMessageListenerContainer.java:254)
	at org.apache.rocketmq.client.impl.consumer.ConsumeMessageConcurrentlyService$ConsumeRequest.run(ConsumeMessageConcurrentlyService.java:412)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at com.alibaba.ttl.TtlRunnable.run(TtlRunnable.java:59)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

and the sourceid config is follows:

this datasource sharding rule logic table is 'tb_like ', but shardingsphere using the anthor data source sharding rule，is appear occasionally,not happend everyone

Example codes for reproduce this issue (such as a github link).

[tuichenchuxin]

The information is not enough, the multiple logical data sources of ShardingSphere are isolated. Are you saying that you have created two sets of configurations and used the two data sources separately, but there will be mistakes?

[gavenpeng]

yes,is mistakes some times ,not happend every one

[tuichenchuxin]

yes,is mistakes some times ,not happend every one

Thank you. But I can't reproduce this error. Can you offer a demo?

[gavenpeng]

we project use shardingsphere config is pulled from paas platform, give me not work if not deploy paas, Can you create a demo by me provider the config? thanks

[gavenpeng]

i looked the router code,found the routers of PartialSQLRouteExecutor init maybe exist problem,the code is follow:

public PartialSQLRouteExecutor(final Collection<ShardingSphereRule> rules, final ConfigurationProperties props) {
        this.props = props;
        routers = OrderedSPIRegistry.getRegisteredServices(rules, SQLRouter.class);
    }

the last invoked the follow code:

public static <K, V extends OrderedSPI<?>> void cacheServices(final Collection<K> types, final Class<V> orderedSPIClass, final Map<K, V> services) {
        CACHED_SERVICES.put(orderedSPIClass, new CachedOrderedServices(types, services));
    }

the CACHED_SERVICES is concurrenthashmap, the orderedSPIClass is sqlRouter classes, when exist multi sharding rule, the CACHED_SERVICES only cache the one rule, i see 5.20 modidyed the key contain rules