sch-isk-scraper

This is a Golang module / CLi tool for scraping job ads on Schönherz Iskolaszövetkezet

sch-isk-scraper
- Usage
  - CLI
    - City
    - JobType
    - allDetails
  - Module

Usage

CLI

$ go run ./cmd/main.go -city=budapest -jobtype=fejleszto---tesztelo -allDetail

City

possible values for City

budapest
debrecen
kecskemet
miskolc
pecs
szeged

JobType

possible values for JobType:

adminisztrativ
alkalmi---projekt-jellegu
fejleszto---tesztelo
gazdasagi
grafikus---designer
informatikai---support
muszaki
otthonrol-vegezheto
szaktudast-nem-igenylo-18-ev-alatt-
jobs-for-foreign-students

allDetails

allDetails means it's going to fetch all detail pages for the full job description

Module

Example

baseUrl := "https://schonherz.hu"
params := requests.RequestParams{
		IsListing: false,
		JobID:     0,
		JobName:   "",
		City:      options.City,
		JobType:   options.JobType,
	}

	listing, err := requests.FetchListing(params)
	if err != nil {
		log.Fatal(err)
	}

	jobs, err := parser.ReadListing(listing, baseUrl)
	if err != nil {
		log.Fatal(err)
	}

	if options.Full {
		for i := 0; i < len(jobs); i++ {
			doc, err := requests.FetchSingleJob(&jobs[i])
			if err != nil {
				log.Fatal(err)
			}
			parser.ReadOneJob(doc, &jobs[i])
		}
	}