nchammas/flintrock

Flintrock got stuck when restarting a Spark cluster on AWS

foolhb opened this issue · 1 comments

foolhb commented
  • Flintrock version: 0.11.0
  • Python version: Python 3.6.8 :: Anaconda, Inc.
  • OS: Mac

I used Flintrock to start a Spark cluster on AWS and stopped it after using it. Then I restarted the cluster using the command: flintrock start --ec2-identity-file ./AWS.pem cluster-name
But it got stuck at "Starting big-spark..." and ended up "[IP address] Could not connect via SSH." The instances were successfully stared, but the Spark seems not stared since I can't access 8080 port of the master instance

I'm not sure if this should be posted here, but I did try to Google for some information but got nothing. Thanks for your help!

Update: I uninstalled the Flintrock in Homebrew and tried pip3 install Flintrock. It works now!

nchammas commented

Hmm, everything else was the same, and you just installed Flintrock with pip instead of Homebrew? That's strange. It should have worked with Homebrew (even though it's an unofficial installation method), but I'm glad you're all set now!