zalando-stups/fullstop

Send Custom User Agent

lukasniemeier-zalando opened this issue · 0 comments

lukasniemeier-zalando commented

Expected behavior

  • fullstop runs a few jobs (I know of the two Fetch*Jobs) that act as web crawlers
  • fullstop should send a custom user-agent header to let web servers know that a crawler arrives

Step needed

  • adapt HttpGetRootCall to send user-agent value fullstop-job (https://github.com/zalando-stups/fullstop)

Dependencies

  • none