vifreefly/kimuraframework
Kimurai is a modern web scraping framework written in Ruby which works out of box with Headless Chromium/Firefox, PhantomJS, or simple HTTP requests and allows to scrape and interact with JavaScript rendered websites
RubyMIT
Issues
- 0
- 0
Keep the browser opened
#74 opened by madaarya - 1
uninitialized constant URI::HTTP
#73 opened by bjpcjp - 10
Include Docker support
#14 opened by Tails - 1
Better support for testing
#33 opened by doutatsu - 7
Update Readme to include 'lsof' aptfile
#32 opened by jcohenho - 10
Unable to use Ruby 3.x
#66 opened by baka-san - 0
edriver update
#68 opened by shloimeweinberger - 0
Ruby Gems 1.4 not up to date with GitHub
#67 opened by baka-san - 4
- 9
- 2
- 1
Setting cookies will request a page twice
#63 opened by n-studio - 1
- 1
How to parse pages with HTTP errors (403, 404)
#61 opened by n-studio - 2
Why class instead of instances?
#31 opened by wasabigeek - 1
- 2
Kimurai in RoR with Devise - Get current_user in parse - Pass user info to parse - Completed status in `parse!`
#40 opened by aaongr - 1
How to set language?
#52 opened by heroturtle - 1
- 2
Error when installing on Linux
#57 opened by thanhtoan1196 - 2
Is the project still being maintained?
#54 opened by doutatsu - 1
Passing flag to headless chrome
#23 opened by hwhelchel - 4
Crawl in Sidekiq - Selenium::WebDriver::Error::WebDriverError: not a file: "./bin/chromedriver
#48 opened by Mirk32 - 1
Ruby 2.7.x obsolete warnings
#42 opened by johnphamvan - 0
Some minor warnings when using kimurai
#51 opened by rubyFeedback - 3
Selenium Chrome Heroku
#47 opened by muhammedtufekyapan - 1
How do I click on something that isn't a link?
#49 opened by hjhart - 1
Setting desired_capabilities
#45 opened by givigier - 1
Support custom `max_retries`
#44 opened by yidafu - 0
kimurai setup not passing all necessary arguments to ansible-playbook on Mac OS Catalina
#41 opened by albandum - 4
Issues with using skip_request_errors
#38 opened by doutatsu - 3
- 2
- 1
Broken load balancers support
#36 opened by rodrigopv - 1
Only GET HTTP request is supported?
#34 opened by imtiazwazir - 1
- 1
- 0
- 5
absolute_url corrupts url escaping it
#26 opened by mdesantis - 3
How to limit the search depth level?
#25 opened by killernova - 3
How to save cookies?
#22 opened by CrazybutSolid - 8
How to set encoding?
#20 opened by dccmmtop - 5
- 3
- 3
Pass response callback as block
#13 opened by Tails - 1
Allow declarative page & item definitions
#15 opened by Tails - 1
Wrap the Nokogiri response to reduce boilerplate
#16 opened by Tails - 4
Skip request error after retry
#17 opened by Tails - 1
Create directories before saving item
#18 opened by Tails