These are some fairly basic instructions which should help you get Screaming Frog up and running in the cloud.
I don't claim that this is the best, most scalable or most efficient way of running SF in the Cloud; the real goal of this little guide is to demonstrate how easy it is to deploy SF in the Cloud, and to hopefully encourage other SEOs out there to try it!
- Set up a Ubuntu VPS - Example uses Digital Ocean.
- Install Screaming Frog + Dependencies - This can either be done manually or by using Fili Wiese's script
- Install Apache - to browse your crawls
- Create Cron Jobs - Configure and Schedule your Crawls
- Sit back and Relax - Get your files using your web browser
Please note that you don't have to use Digital Ocean or any hosting provider in particular, however it's probably sensible to stick with a Ubuntu VPS to minimise any potential compatability issues with Screaming Frog.
Below are some resources which either inspired me or directly helped me write this guide: