Stop using guava

Question

Stop using guava

Closed this issue 5 years ago · 11 comments

or update to a newer version, there are too many dependency issues

Answer 1 · 2019-09-07T10:45:01.000Z

Hi @AceHack, updating to a newer version of Guava would create additional complications in relation to the version that Spark uses by default. We will look into the possibility of removing it all together.

Answer 2 · 2019-09-08T05:41:39.000Z

@cosmincatalin so if you actually look at the lastest spark release without hadoop it does not include Guava at all.
https://www-us.apache.org/dist/spark/spark-2.4.4/spark-2.4.4-bin-without-hadoop.tgz

You can see in the jars folder there is no guava jar.

Thanks and I would love to see just removing it altogether, it causes us so much headache.

Answer 3 · 2019-09-08T11:06:07.000Z

As can be seen here, Guava is still a dependency, even if the distribution for Hadoop does not include it.

Until we decide what to do with Guava looking forward, I think you can try to exclude the Guava dependency when you build your own jar or you can use shading (although I am not very familiar with this technique).

Answer 4 · 2019-09-08T14:34:09.000Z

It’s the distribution for spark server without Hadoop that does not include it to be clear.

Answer 5 · 2019-10-04T13:42:15.000Z

Please remove this, it's now blocking from fixing CVEs in our spark base image. Thanks.

Answer 6 · 2019-10-07T12:52:03.000Z

I've pulled out Guava. See commit 7e12616. It will take a few more days until we release, so we have some time to test.

Answer 7 · 2019-10-07T18:48:16.000Z

@cosmincatalin You are the man!!! That is awesome.

Answer 8 · 2019-10-12T13:25:15.000Z

This is taking longer than expected. We have some problems when publishing to scala 2.12.

Answer 9 · 2019-10-25T08:19:03.000Z

Hi @cosmincatalin can you publish first to scala 2.11 until you resolve the problems with 2.12 ?
And thanks a lot.

Answer 10 · 2019-11-19T09:52:17.000Z

I have just release 0.4.4. Let me know if it is everything you wanted it 😄 and reopen as necessary.

Answer 11 · 2019-11-19T10:04:34.000Z

Unfortunately, there has been a mistake. The Guava patch did not get merged. I will do another try this week and make a new release. Sorry for keeping all of you waiting for so long.