/configs

Public, free to use, repository with diggers configs for scraping / extracting data from various e-commerce websites and online stores

MIT LicenseMIT

configs

Public, free to use, repository with diggers configs for web scraping various e-commerce websites and online stores

All configs can be used with Diggernaut service to retrieve products information.

  1. You need to create free account at Diggernaut
  2. Login to your account
  3. Create a project with any name and description you want
  4. Get into your new project by clicking it and create new digger with any name
  5. Then you will see 3 options suggested to you, you need to use one where you will use meta-language
  6. Config editor will open and you can simply copy and paste config code and click on save button.
  7. Switch mode for digger from Debug to Active and then run your digger.
  8. Wait for completion.
  9. Download data.
  10. Schedule your runs if required.

List of sites:

  1. abercrombie.com
  2. adidas.com
  3. adidashardware.com
  4. ae.com
  5. alexandermcqueen.com
  6. americanapparel.net
  7. anntaylor.com
  8. anthropologie.com
  9. asos.com
  10. athleta.gap.com
  11. avito.ru
  12. bananarepublic.gap.com
  13. bedbathandbeyond.com
  14. benmeadows.com
  15. betseyjohnson.com
  16. bloomingdales.com
  17. burton.com
  18. cabelas.com
  19. calypsostbarth.com
  20. cartier.com
  21. chanel.com
  22. covergirl.com
  23. debshops.com
  24. desigual.com
  25. diesel.com
  26. dior.com
  27. donnakaran.com
  28. dwell.co.uk
  29. eddiebauer.com
  30. eloquii.com
  31. esteelauder.com
  32. faithfullthebrand.com
  33. farfetch.com
  34. ferragamo.com
  35. footlocker.com
  36. forever21.com
  37. freepeople.com
  38. gap.com
  39. gapfactory.com
  40. gentrynyc.com
  41. gilt.com
  42. global.tommy.com
  43. guess.com
  44. guessbymarciano.guess.com
  45. happysocks.com
  46. hermanmiller.com
  47. hermes.com
  48. hm.com
  49. hollisterco.com
  50. hugoboss.com
  51. ikea.com
  52. jaanuu.com
  53. jcrew.com
  54. joesjeans.com
  55. johnstonmurphy.com
  56. johnvarvatos.com
  57. romwe.com
  58. patagonia.com
  59. vans.com

To be released:

  1. karenwalker.com
  2. karl.com
  3. katespade.com
  4. kennethcole.com
  5. kohls.com
  6. lancome-usa.com
  7. levi.com
  8. llbean.com
  9. lornajane.de
  10. lululemon.com
  11. macys.com
  12. mango.com
  13. marcjacobs.com
  14. marketplace.asos.com
  15. matthewwilliamson.com
  16. maybelline.com
  17. michaelkors.com
  18. nastygal.com
  19. nautica.com
  20. neimanmarcus.com
  21. nike.com
  22. nordstrom.com
  23. oldnavi.gap.com
  24. onekingslane.com
  25. paulsmith.com
  26. pier1.com
  27. potterybarn.com
  28. quiksilver.com
  29. rainbowshops.com
  30. ralphlauren.com
  31. ralphlaurenhome.com
  32. rei.com
  33. revlon.com
  34. revolve.com
  35. riverisland.com
  36. roomandboard.com
  37. rue21.com
  38. scotch-soda.com
  39. sephora.com
  40. shopbop.com
  41. eastdane.com
  42. sonos.com
  43. stellamccartney.com
  44. stevemadden.com
  45. style.com
  46. sunglasshut.com
  47. superdry.com
  48. surlatable.com
  49. target.com
  50. tedbaker.com
  51. timberland.com
  52. tomford.com
  53. topman.com
  54. topshop.com
  55. toysrus.com
  56. uk.tommy.com
  57. underarmour.com
  58. uniqlo.com
  59. urbanoutfitters.com
  60. us.benetton.com
  61. us.burberry.com
  62. us.louisvuitton.com
  63. us.nextdirect.com
  64. us.shein.com
  65. valentino.com
  66. versace.com
  67. victoriassecret.com
  68. vineyardvines.com
  69. walmart.com
  70. westelm.com
  71. whitehouseblackmarket.com
  72. williams-sonoma.com
  73. ysl.com
  74. zalando.de
  75. zappos.com
  76. zara.com
  77. zarahome.com