/web-assets

Various Web Assets including 1K+ User Agent, 100+ Referers, 1K+ Proxies for web scrapping

web-assets

Various Web Assets including 1K+ User Agent, 50+ Referers, 2.7K+ Proxies for Web Scrapping.

Used on Various programming languages for various projects including Web-Scrapping

User-Agent

1200+ Unique user agent string added and updated

  • Mozilla
  • Chrome
  • Opera
  • Internet Explorer
  • Safari

Referer

100+ referer urls for making request seem to be legit.

Proxy

Proxify your each request

HTTP-Header

Sample HTTP-HEADER for setting in curl or request

Contribute

Please add other User agent and referer strings to make the collection large. Thank you

Credits

User-Agent : @pzb

Proxy list : @TheSpeedX

Check TheSpeedX's Proxy List for Updated List