go run generate.go go run transform.go go run run.go generate.go - training phase transform.go - extracts links and html elements - main logic of our crawler run.go - testing phase first two commands execute in folder rl the last one exectue in folder rl2