Releases: DTStack/Taier
v1.4.0
What's Changed
- [feat_1.3_issue#724][taier-data-develop] standalone bugfix by @ghm02708 in #799
- [Improve][CI] Fix ci/cd by @FlechazoW in #793
- [refactor/queue][taier-ui]move queueConfig from rightbar to create config by @mortalYoung in #795
- [feat/website][website]develop website homepage by @mortalYoung in #800
- [1.3_beta][taier-all] fix flink standalone component config by @vainhope in #802
- [1.3_beta][taier-all] fix dirty table by @vainhope in #804
- [fix/workflow][taier-ui]fix lost line in workflow by @mortalYoung in #791
- [fix/flink][taier-ui]fix flink tab saving by @mortalYoung in #803
- [fix/clickhouse][taier-ui]clickhouse and doris as task support syntax highlight by @mortalYoung in #805
- [feat/sparkjar][taier-ui]support sparkjar task by @mortalYoung in #806
- [fix/usePagination][taier-ui]fix pagination get incorrect by @mortalYoung in #809
- [fix/validator][taier-ui]fix validator folder failed in resource by @mortalYoung in #796
- [fix/default][taier-ui]remove default actions and barItems by @mortalYoung in #807
- [fix/folderPicker][taier-ui]fix folderPicker with workflow by @mortalYoung in #797
- [fix/workflow][taier-ui]fix workflow repeated name in validating by @mortalYoung in #808
- feat: improve popup in create by @mortalYoung in #810
- [test/services][taier-ui]improve test coverage by @mortalYoung in #811
- [fix/splitKey][taier-ui]support to get splitKey in array by @mortalYoung in #812
- [feat/taskInfo][taier-ui]support to show dataSource in task info tab by @mortalYoung in #816
- [1.3_beta][taier-all] fix sql by @vainhope in #818
- [fix/schema][taier-ui]remove Schema in contextMenu by @mortalYoung in #819
- [fix/scheduleConf][taier-ui]fix selfReliance won't change by @mortalYoung in #814
- [fix/cluster][taier-ui]improve cluster save by @mortalYoung in #820
- [fix/flinkSource][taier-ui]fix flinkSource alias by @mortalYoung in #817
- [refactor/preview][taier-ui]improve preview table by @mortalYoung in #822
- 1.3 beta by @vainhope in #823
- [issue#798][taier-data-develop] flink udf 回显不正确 by @ghm02708 in #824
- [issue#826][taier-data-develop] replace task_template,init sql revisal by @ghm02708 in #827
- [fix/componentVersion][taier-ui]improve componentVersion label by @mortalYoung in #825
- [fix][taier-data-develop] remove common DataSourceType by @ghm02708 in #828
- Bump molecule from 1.1.0 to 1.2.0 by @mortalYoung in #831
- [refactor/completion][taier-ui]improve completion for editor by @mortalYoung in #830
- 1.3 beta by @vainhope in #832
- [fix/cluster][taier-ui]support more impressive error log by @mortalYoung in #833
- [fix/execute][taier-ui]fix log output panel after executing by @mortalYoung in #834
- [Improve][Common] Upgrade 'flink.version' to 1.12.7 by @FlechazoW in #836
- [fix][taier-data-develop] com.dtstack.chunjun.util.FactoryHelper should be loaded by DtClassloader by @ghm02708 in #837
- [fix][taier-data-develop] standalone log fix by @ghm02708 in #838
- 1.3 beta by @vainhope in #839
- [fix/stream][taier-ui]remove component version filters in stream by @mortalYoung in #840
- [fix/flink][taier-ui]fix validation on flinksql by @mortalYoung in #835
- [1.3_beta][迁移 listFile 方法到 datasource 中] by @poxiao8 in #841
- [doc] [web-site] add task sql doc by @vainhope in #853
- [Fix][sql] change sync datasource query interface by @vainhope in #856
- [fix/dataSource][taier-ui]fix dataSource query failed by @mortalYoung in #860
- [fea_doc][doc] add online web url by @vainhope in #855
- build: reset ui build by @bnyte in #854
- [hotfix][Taier-develop] 向导模式flinksql version 转化问题 by @ghm02708 in #867
- [feat/website][taier-ui]replace case image by @mortalYoung in #870
- [doc/readme][taier]translate README into English by @mortalYoung in #873
- [feat_docker][taier-all] remove unused docker file by @vainhope in #877
- [feat_863][taier-worker-plugin] spark sql proxy auto upload by @jiemotongxue in #866
- [hotfix][taier-docs] taier源码包下载地址不对 by @jiemotongxue in #865
- [feat_doc][taier-all] add precautions.md by @vainhope in #881
- build: specify the node and yarn version of taier-ui(#878) by @bnyte in #882
- [issue_875][taier-all] add upload file size config by @vainhope in #884
- [hotfix_871][taier-worker-plugin] script-core build Dir is error by @jiemotongxue in #872
- [feat/cluster][taier-ui]improve description label in cluster's uploader by @mortalYoung in #886
- [hotfix_datasource][taier-data-develop] fix datasource update time by @vainhope in #894
- [issue_903][sql] fix sync init sql by @vainhope in #906
- [issue_876][sql] adjust spark network time by @vainhope in #904
- [fix/schedule][taier-ui]support render deleted task in schedule by @mortalYoung in #902
- fixed: the ui project cannot download yarn by @bnyte in #901
- [issue_669][taier-data-develop]show schedule job name when task is deleted; scheduling job to autoCanceled rather than submitFaild if task is deleted by @yyl4ever in #905
- [fix/envParams][taier-ui]fix cursor always in first time on envParams by @mortalYoung in #909
- [feat_exception][taier-data-develop] adjust exception message by @vainhope in #916
- [issue_669][taier-data-develop]scheduling job to submitFaild if task is deleted, logic accord with TaskStatusSubmitInterceptor, so we can rerun son jobs. by @yyl4ever in #918
- [fix/testConn][taier-ui]fix message.error in twice by @mortalYoung in #917
- [Bug][taier-datasource、taier-worker-plugin] 对datasource plugin和 worker plugin的spi文件增加 License by @jiemotongxue in #922
- [Feature] Add Oracle Datasource Plugin by @jiemotongxue in #913
- [issue_923][taier-data-develop]cache tip after application start-up, remove left join SQ by @yyl4ever in #926
- Feature: support mysql task by @chyueyi in #925
- feature: supported ftp source reader and target by @bnyte in #915
- [feat/ftp][taier-ui]support ftp in reader and writer by @mortalYoung in #911
- fixed: 1.3.1 increment sql merged(#936) by @bnyte in #937
- [issue_934][taier-schedule] fix hour schedule task fill data only one… by @vainhope in #935
- [issue_939][taier-data-develop] fix new task lost task param fix #939 by @vainhope in #940
- [issue_883][taier-data-develop] fix doris sql query lost column name … by @vainhope in #933
- [issue_920][taier-schedule] fix cluster config standalone deploy get … by @vainhope in #928
- Feat npe by @vainhope in #942
- fixed: ftp target index #938 no initial value given by @bnyte in #943
- fix: table render in FTP target by @mortalYoung in #941
- [fix/dependence][taier-ui]fix tenantName render incorrect by @mortalYoung in #945
- [refactor][taier-ui]parse task variables by editor's value in default by @mortalYoung in #950
- [style/utils][taier-ui]remove unused functions by @mortalYoung in #949
- [fix/create][taier-ui]fix create folder failed by @mortalYoung in https://github...
v1.3.0
What's Changed
- [feat_1.3_issue#724][taier-data-develop] standalone bugfix by @ghm02708 in #799
- [Improve][CI] Fix ci/cd by @FlechazoW in #793
- [refactor/queue][taier-ui]move queueConfig from rightbar to create config by @mortalYoung in #795
- [feat/website][website]develop website homepage by @mortalYoung in #800
- [1.3_beta][taier-all] fix flink standalone component config by @vainhope in #802
- [1.3_beta][taier-all] fix dirty table by @vainhope in #804
- [fix/workflow][taier-ui]fix lost line in workflow by @mortalYoung in #791
- [fix/flink][taier-ui]fix flink tab saving by @mortalYoung in #803
- [fix/clickhouse][taier-ui]clickhouse and doris as task support syntax highlight by @mortalYoung in #805
- [feat/sparkjar][taier-ui]support sparkjar task by @mortalYoung in #806
- [fix/usePagination][taier-ui]fix pagination get incorrect by @mortalYoung in #809
- [fix/validator][taier-ui]fix validator folder failed in resource by @mortalYoung in #796
- [fix/default][taier-ui]remove default actions and barItems by @mortalYoung in #807
- [fix/folderPicker][taier-ui]fix folderPicker with workflow by @mortalYoung in #797
- [fix/workflow][taier-ui]fix workflow repeated name in validating by @mortalYoung in #808
- feat: improve popup in create by @mortalYoung in #810
- [test/services][taier-ui]improve test coverage by @mortalYoung in #811
- [fix/splitKey][taier-ui]support to get splitKey in array by @mortalYoung in #812
- [feat/taskInfo][taier-ui]support to show dataSource in task info tab by @mortalYoung in #816
- [1.3_beta][taier-all] fix sql by @vainhope in #818
- [fix/schema][taier-ui]remove Schema in contextMenu by @mortalYoung in #819
- [fix/scheduleConf][taier-ui]fix selfReliance won't change by @mortalYoung in #814
- [fix/cluster][taier-ui]improve cluster save by @mortalYoung in #820
- [fix/flinkSource][taier-ui]fix flinkSource alias by @mortalYoung in #817
- [refactor/preview][taier-ui]improve preview table by @mortalYoung in #822
- 1.3 beta by @vainhope in #823
- [issue#798][taier-data-develop] flink udf 回显不正确 by @ghm02708 in #824
- [issue#826][taier-data-develop] replace task_template,init sql revisal by @ghm02708 in #827
- [fix/componentVersion][taier-ui]improve componentVersion label by @mortalYoung in #825
- [fix][taier-data-develop] remove common DataSourceType by @ghm02708 in #828
- Bump molecule from 1.1.0 to 1.2.0 by @mortalYoung in #831
- [refactor/completion][taier-ui]improve completion for editor by @mortalYoung in #830
- 1.3 beta by @vainhope in #832
- [fix/cluster][taier-ui]support more impressive error log by @mortalYoung in #833
- [fix/execute][taier-ui]fix log output panel after executing by @mortalYoung in #834
- [Improve][Common] Upgrade 'flink.version' to 1.12.7 by @FlechazoW in #836
- [fix][taier-data-develop] com.dtstack.chunjun.util.FactoryHelper should be loaded by DtClassloader by @ghm02708 in #837
- [fix][taier-data-develop] standalone log fix by @ghm02708 in #838
- 1.3 beta by @vainhope in #839
- [fix/stream][taier-ui]remove component version filters in stream by @mortalYoung in #840
- [fix/flink][taier-ui]fix validation on flinksql by @mortalYoung in #835
- [1.3_beta][迁移 listFile 方法到 datasource 中] by @poxiao8 in #841
- 1.3 beta by @vainhope in #845
New Contributors
Full Changelog: https://github.com/DTStack/Taier/commits/v1.3.0
v1.2.0
Taier1.2版本做了以下更新:
1. 新增工作流
通过可视化的拖动任务节点到画板中,手动连接上下游任务组成依赖关系,形成一个DAG的工作流。
支持任意类型的任务通过工作流拖拽的方式,直接实现配置化编排业务
2. 新增OceanBase SQL
新增OceanBaseSQL 任务,支持OceanBaseSQL的任务调度和运维展示
3. 新增Flink jar任务
支持上传自定义开发的flink jar任务,通过taier提交运行和监控,
4. 数据同步、实时采集支持脏数据管理
数据同步、实时采集支持脏数据管理,可以配置脏数据数量限制和保存方式,可保存至数据库实时查看
5. Hive UDF
Hive SQL 支持udf函数开发配置
6. 控制台
控制台交互和页面全新升级,通过树形结构展示组件配置信息。支持扩展自定义组件进行配置
7. 租户绑定简化
集群和租户绑定简化,移除租户对接集群schema的强制绑定关系,不同类型计算组件无强制依赖,
优化任务开发流程逻辑,支持自定义扩展任务类型,新增了任务和schema绑定关系
感谢所有向 Taier 1.2贡献的朋友
参与者 |
---|
bnyte |
ghm02708 |
kongshan-zhuyu |
LousenJay |
mortalYoung |
QAQ-Jun |
Saltingfish |
vainhope |
v1.1.0
本次上线的Taier1.1版本做了以下更新:
1. Flink 版本升级到1.12
Taier作为一个分布式可视化的DAG任务调度系统,采用Chunjun作为分布式数据同步工具。
1.1版本将Flink版本升级到1.12 ,支持Chunjun 1.12版本中新增的transformer算子,用户在脚本中定义好数据类型以及SQL转换逻辑。
支持Flink 1.12的原生语法及Function
2. 数据同步支持脚本模式、增量同步
数据同步任务除向导模式外,1.1版本新增数据同步脚本模式。
脚本模式通过json的方式配置,无需依赖datasourcex的支持的数据源,直接通过json配置的方式提交任务,
脚本模式的json格式无缝兼容Chunjun的数据格式,用户可以通过脚本模式调试各类数据源的数据同步
3. 新增Hive SQL
新增Hive SQL类型任务,Apache Hive是一个构建于Hadoop顶层的数据仓库,可以将结构化的数据文件映射为一张数据库表,并提供简单的SQL查询功能,可以将SQL语句转换为MapReduce任务进行运行。
Taier1.1版本新增Hive SQL ,支持对接Hive的不同版本
4. 新增Flink SQL、实时采集等实时类型任务
新增实时采集任务,支持将MySQL、Oracle的数据同步至Kafka
新增Flink SQL任务,通过标准SQL语义的开发帮助快速完成数据任务的配置工作
5. 新增实时任务运维
通过实时运维中心查看实时任务的相关指标信息以及任务的详细日志信息
6. 支持Flink UDF、Spark UDF
用户自定义函数(User Defined Function,简称 UDF),是用户除了使用系统函数外,自行创建的函数,用于满足个性化的计算需求。自定义函数在使用上与普通的系统函数类似。
目前Taier1.1版本 Spark SQL 和 Flink SQL 任务均支持自定义函数
7. 暗黑主题
Taier开发界面暗黑主题上线,提供多种主题切换,用户可自行选择
感谢所有向 Taier 1.1贡献的朋友
参与者 |
---|
bnyte |
dtdazhi |
ghm02708 |
jiemotongxue |
kongshan-zhuyu |
LousenJay |
mortalYoung |
QAQ-Jun |
Saltingfish |
vainhope |