pio train error

Question

pio train error

Closed this issue 9 years ago · 11 comments

I followed steps as decsribed but am getting an error during pio train. I did not see a thread in predictionio forum, so came here to leave comment.

My error:
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/spark/sql/execution/ExistingRdd
at com.mycompany.Algorithm.train(Algorithm.scala:28)
...plus more

In engine.json I only changed appID parameter. Was there more to change?

Thanks.
Patrick

Answer 1 · 2015-10-05T12:18:04.000Z

I encountered the same exception by following the steps described on the template page (https://templates.prediction.io/andrewwuan/PredictionIO-Churn-Prediction-H2O-Sparkling-Water)

Answer 2 · 2015-10-05T13:37:51.000Z

I am not sure if Andrew is aware there are posts here. He has not been active for a while now. Hopefully he checks this post and give us more clarity.

Answer 3 · 2015-10-05T17:50:22.000Z

@phiripatrick663 @indrekots This is due to that old sparkling water library doesn't support Spark version from 1.3 onward. I've just made a new release for my template v0.1.2 and it should resolve this error.

Answer 4 · 2015-10-06T12:31:20.000Z

Now it works as expected. Thanks!

Answer 5 · 2015-10-06T14:13:53.000Z

Thanks for the response Andrew, I will download new version and give feedback.

If you don't mind could you give more specific steps on running the example and what I should expect as a successful result?

Answer 6 · 2015-10-06T17:06:15.000Z

I don't see where to edit my engine.json. File looks different from other engine.json files. Any help please.

Answer 7 · 2015-10-06T17:16:34.000Z

@phiripatrick663 Replace INVALID_APPNAME with your app name (instead of app ID as before).

Answer 8 · 2015-10-06T18:06:38.000Z

I guess my engine.json is not importing correctly. I am getting
"com.mycompany" repeated through out, that's why I did not see where to
make changes. It does not look like the normal .json structure. Where
could this be coming from?
Thanks.

On Tue, Oct 6, 2015, 12:16 PM An Wu notifications@github.com wrote:

@phiripatrick663 https://github.com/phiripatrick663 Replace
INVALID_APPNAME with your app name (instead of app ID as before).

—
Reply to this email directly or view it on GitHub
#2 (comment)
.

Answer 9 · 2015-10-06T18:47:14.000Z

I'm not sure. But checking the template in my repo might help: https://github.com/andrewwuan/PredictionIO-Churn-Prediction-H2O-Sparkling-Water/blob/master/engine.json

Answer 10 · 2015-10-06T20:47:51.000Z

Ok, l may just download that one and post an image of the other one so you
can see what I am seeing.
Thanks.

On Tue, Oct 6, 2015, 1:47 PM An Wu notifications@github.com wrote:

I'm not sure. Buy checking the template in my repo might help:
https://github.com/andrewwuan/PredictionIO-Churn-Prediction-H2O-Sparkling-Water/blob/master/engine.json

—
Reply to this email directly or view it on GitHub
#2 (comment)
.

Answer 11 · 2015-10-14T13:31:07.000Z

Hi Andrew,
Happy to report that template ran without errors. I do need a little assistance though, I have no idea what to expect as a result of the trial query. At first I was not sure how to query it, but made the query into a python file, made it executable and ran. Is that the correct way? Can you give an example of expected result?

Thanks.