yaooqinn/spark-ranger

security issue: Spark can Run SQL on files directly

Closed this issue · 6 comments

brucemen711 commented

Currenlly, Spark can Run SQL on files directly, for example:
val sqlDF = spark.sql("SELECT * FROM parquet.examples/src/main/resources/users.parquet")

It make some other user can explore data directly from files.
What do you think @yaooqinn ?

yaooqinn commented

use ranger hdfs plugin

brucemen711 commented

But is any conflig between parquet hive table (user table) and hdfs parquet file (user parquet file) if i set diff policy ?

brucemen711 commented

I want custom filter to prevent user do that, any suggestion which class to look for ?

yaooqinn commented

I am not very sure, you can look up the logical plan to see if any pattern you can match to prohibit such behavior

brucemen711 commented

I am not very sure, you can look up the logical plan to see if any pattern you can match to prohibit such behavior

ok, i will give a try.
Thanks

brucemen711 commented

Closed issue as it doesnt relate to this plugin.
Thanks.