Are you Interested in integrating XSQL into Scriptis and Linkis?

Question

Are you Interested in integrating XSQL into Scriptis and Linkis?

Opened this issue 5 years ago · 5 comments

Hi, Your project is particularly great, but there are certain thresholds for analysis users. Are you Interested in integrating XSQL into Scriptis and Linkis? .
Scriptis: https://github.com/WeBankFinTech/Scriptis
Linkis: https://github.com/WeBankFinTech/Linkis
I look forward to your reply. Thank you very much.

Answer 1 · 2019-09-06T03:58:48.000Z

@wushengyeyouya do you want to use hive thriftserver2 jdbc？

Answer 2 · 2019-09-06T04:09:03.000Z

Linkis support spark engine, and we can implement a new EngineHook to get the ability of XSQL.
Scriptis can show the metadata of XSQL holded, and submit sql to linkis.

Answer 3 · 2019-09-06T04:15:51.000Z

How does Scriptis&Linkis use spark now? xsql usage is all the same as spark

Answer 4 · 2019-09-06T05:10:49.000Z

Linkis use spark repl to obtain the ability of spark. So we think Scriptis&Linkis is pretty easy to integrate XSQL.

Answer 5 · 2019-09-06T05:20:30.000Z

You can configure spark.sql.catalogImplementation=xsql in spark-defaults.conf，so that spark-shell、spark-sql、spark-submit will enable XSQL syntax�. But above configuration only works in bin version, spark.sql.catalogImplementation=xsql is not allowed in raw spark.