Skip to content

[feat_863][taier-worker-plugin] spark sql proxy auto upload#866

Merged
vainhope merged 4 commits intoDTStack:masterfrom
jiemotongxue:feat_sparkJarAutoUpload
Nov 15, 2022
Merged

[feat_863][taier-worker-plugin] spark sql proxy auto upload#866
vainhope merged 4 commits intoDTStack:masterfrom
jiemotongxue:feat_sparkJarAutoUpload

Conversation

@jiemotongxue
Copy link
Collaborator

增加spark uploader 用于传输spark-sql-proxy.jar


public static final String SP = File.separator;

// 默认hdfs resource文件清除频率
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Comment in English, please.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

@jiemotongxue
Copy link
Collaborator Author

spark组件故意填写错误的spark-sql-proxy.jar的路径,测试通过~

image

image

@jiemotongxue jiemotongxue self-assigned this Nov 10, 2022
@jiemotongxue jiemotongxue added feature New feature spark spark labels Nov 10, 2022
Copy link
Member

@FlechazoW FlechazoW left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@jiemotongxue
Copy link
Collaborator Author

@vainhope please review it

Copy link
Member

@FlechazoW FlechazoW left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@vainhope vainhope merged commit b546cdb into DTStack:master Nov 15, 2022
@jiemotongxue jiemotongxue linked an issue Jan 4, 2023 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

feature New feature spark spark

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Improve] taier-sql-proxy.jar 自动上传

3 participants