Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

dinky mysql full database synchronization error #3445

Closed
3 tasks done
Hello-Linux opened this issue Apr 30, 2024 · 3 comments
Closed
3 tasks done

dinky mysql full database synchronization error #3445

Hello-Linux opened this issue Apr 30, 2024 · 3 comments
Labels
Duplicate This issue or pull request already exists FAQ Frequently Asked Questions Invalid Invalid

Comments

@Hello-Linux
Copy link

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

你好,我使用dinky最新版1.0.0 flink版本1.16.3,配置以及依赖lib包都配置好了,但是启动flink任务的时候发现目标库只有表结构同步过来了,表的数据没有同步过来,并且作业日志exception里面有报错日志

org.apache.flink.streaming.runtime.tasks.StreamTaskException: Cannot instantiate user function.
	at org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperatorFactory(StreamConfig.java:399)
	at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperator(OperatorChain.java:763)
	at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:736)
	at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:676)
	at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:726)
	at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:676)
	at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:726)
	at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:676)
	at org.apache.flink.streaming.runtime.tasks.OperatorChain.<init>(OperatorChain.java:195)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.<init>(RegularOperatorChain.java:60)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:685)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:672)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:935)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:904)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:728)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:550)
	at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.lang.ClassCastException: cannot assign instance of java.lang.invoke.SerializedLambda to field org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.userFunction of type org.apache.flink.api.common.functions.Function in instance of org.apache.flink.streaming.api.operators.StreamFlatMap
	at java.base/java.io.ObjectStreamClass$FieldReflector.setObjFieldValues(Unknown Source)
	at java.base/java.io.ObjectStreamClass$FieldReflector.checkObjectFieldValueTypes(Unknown Source)
	at java.base/java.io.ObjectStreamClass.checkObjFieldValueTypes(Unknown Source)
	at java.base/java.io.ObjectInputStream.defaultCheckFieldValues(Unknown Source)
	at java.base/java.io.ObjectInputStream.readSerialData(Unknown Source)
	at java.base/java.io.ObjectInputStream.readOrdinaryObject(Unknown Source)
	at java.base/java.io.ObjectInputStream.readObject0(Unknown Source)
	at java.base/java.io.ObjectInputStream.defaultReadFields(Unknown Source)
	at java.base/java.io.ObjectInputStream.readSerialData(Unknown Source)
	at java.base/java.io.ObjectInputStream.readOrdinaryObject(Unknown Source)
	at java.base/java.io.ObjectInputStream.readObject0(Unknown Source)
	at java.base/java.io.ObjectInputStream.readObject(Unknown Source)
	at java.base/java.io.ObjectInputStream.readObject(Unknown Source)
	at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:617)
	at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:602)
	at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:589)
	at org.apache.flink.util.InstantiationUtil.readObjectFromConfig(InstantiationUtil.java:543)
	at org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperatorFactory(StreamConfig.java:383)
	... 16 more

What you expected to happen

表数据同步成功

How to reproduce

安装flink1.16.3 flink,后使用docker 部署dinky1.0.0-rc3,把相关的flink cdc lib包拷贝到各自目录下,启动任务后报错

Anything else

No response

Version

1.0.0

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@Hello-Linux Hello-Linux added Bug Something isn't working Waiting for reply Waiting for reply labels Apr 30, 2024
@github-actions github-actions bot changed the title dinky mysql全库同步报错 dinky mysql full database synchronization error Apr 30, 2024
@Zzm0809
Copy link
Contributor

Zzm0809 commented Apr 30, 2024

搜索 issue 列表 有解决方案

@Zzm0809 Zzm0809 added Duplicate This issue or pull request already exists FAQ Frequently Asked Questions Invalid Invalid and removed Bug Something isn't working Waiting for reply Waiting for reply labels Apr 30, 2024
Copy link

Hello @Hello-Linux, thank you for your feedback, but this issue has been reported before. You can search for keywords in the Issue list to view it. Issues are marked as `Duplicate`.

你好 @Hello-Linux, 感谢你的反馈, 但是此问题已经被反馈过了,你可以在 Issue 列表中搜索关键字来查看, Issues 标注为 `Duplicate` 。

@Hello-Linux
Copy link
Author

@Zzm0809 好的我搜索一下

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Duplicate This issue or pull request already exists FAQ Frequently Asked Questions Invalid Invalid
Projects
None yet
Development

No branches or pull requests

2 participants