/css-selector-tool

A low-code data extractor for websites with built in proxy and parsing capabilities. Great for testing and debugging css selectors

Primary LanguageJavaScript

Picker

An low-code application for testing and experimenting with css selectors. A basic developer console with a built-in HTML parser and proxy.

Warning This app is a work in progress. I'm building this in public. You can follow the progress on Twitter @LinkScrape. See the roadmap below.

About this project

This project as an experiment to see to speed up testing and parsing data from websites.

Demo

demo of how to scrape data from ebay

You can also try out the tool at tools.link.sc

Note on Performance

Warning This app is using the unstable and not production ready. **Expect some weird UI glitches when **. If you see something broken, you can ping me @LinkScrape.

Features

  • Low code
  • AI Assisted Parsing
  • Built-in browser
  • Website fetch
  • CSS selector/highlighter
  • HTML Parser
  • Built in proxy
  • Data extractor
  • Great for web scraping

Roadmap

  • Create sudo browser
  • Proxy requests
  • Renders Javascript
  • Inject CSS selector tool
  • Pink a click css selector
  • HTML Parser
  • Extra data to tables
  • Dark mode
  • Javascript Toggle
  • Added ChatGPT
  • Automatically Generate code
  • Build a better UI

Known Issues

A list of things not working right now:

  1. UI is very basic
  2. Might not work for all websites
  3. CSS Selector tool is not perfect
  4. Difficult to extract link
  5. Javascript rendering does not always work

AI Assisted Parsing

ChatGPT is great at extract and grabbing data. However it has a token size limit (8192). So to help break down the token size. You can select specific elements to pass into the prompt. Using CSS Selector to grab a small subset of elements to parse, allowing ChatGPT to extract data from websites.

Running Locally

  1. Install dependencies using pnpm:
npm install
  1. Copy .env.example to .env.local and update the variables.
cp .env.example .env.local
  1. Start the development server:
npm dev

Star History

Star History Chart