url-extractor

There are 23 repositories under url-extractor topic.

  • patternknife/url-knife

    Extract and decompose URLs (including emails, which are conceptually a part of URLs) with robust patterns.

    Language:JavaScript3404315
  • galer

    dwisiswant0/galer

    A fast tool to fetch URLs from HTML attributes by crawl-in.

    Language:Go20961132

  • r3dxpl0it/Damn-Small-URL-Crawler

    A Minimal Yet Powerful Crawler for Extracting all The Internal/External/Fuzz-able Links from a website

    Language:Python321112

  • eversinc33/urlExtract

    Recursively extract urls from a web page for reconnaissance.

    Language:Go12212

  • httpreserve/tikalinkextract

    Tika based link (URL) extractor for httpreserve

    Language:HTML8491

  • hrbrmstr/drill-twitter-text

    An Apache Drill UDF for working with Twitter tweet text via the twitter-text Java library (https://github.com/twitter/twitter-text/tree/master/java)

    Language:Java6403

  • limit-zero/url-juicer

    🍊🔗 Squeeze some juice from URLs: A URL crawler/extraction library.

    Language:JavaScript5400

  • sp34rh34d/WebRunner

    Web scraping | Website cloner

    Language:Python4103

  • superbeppe98/ebay-listing-matches

    The eBay Listing Matcher is a Python script designed to compare and match eBay listings with parts from an Inventree instance. This script utilizes the eBay Trading API and the Inventree API to gather and process data.

    Language:Python4100

  • akash-rajak/URL-Extractor

    A python script to extract URL from the text or paragraph.

    Language:Python210

  • hobsRKM/article-miner

    Extract article title, description, images, keywords and authors from any URL

    Language:JavaScript2100

  • khalidelboray/SrcSearch

    Extract URLs,endpoints,paths and word-lists form source files

    Language:Raku2101

  • OpenBookPublishers/geturls

    Extact all URLs from anchor and image tags within a html/xhtml page and its children.

    Language:Shell2602

  • SeyedMahmoudMousavi/url-extractor

    Extract urls from your a file or web address

    Language:PHP2200

  • dotdesh71/Website-URL-Scanner

    Website URL Scanner is a simple command-line tool that allows you to scan a website and extract all URLs. It can be useful for various purposes, such as link analysis or checking for broken links.

    Language:Batchfile110

  • KOUISAmine/url-extractor

    Extract http/https URLs from any kind of text content.

    Language:HTML110

  • loneicewolf/RE_QUERY

    A tool I use to search the web efficiently

    120

  • ryanaryap/URL-Extractor

    URL Extractor is a simple Python code designed to extract the domain name from a list of URLs stored in a text file. This application provides a convenient way to extract and process URLs efficiently.

    Language:Python1100

  • zedseven/urlextractor

    A small tool for extracting all urls from a blob of binary data (ex. PDFs).

    Language:Go1201

  • manyfacedllama/email-attachment-url-extractor

    File attachment and URL extractor for EML & MSG files using Python

    Language:Python0100

  • AlteredAdmin/Link-Lifter

    LinkLifter is a Python script that searches for URLs in a given text file or recursively in a directory and its subdirectories. The found URLs, along with the file they are located in, are saved to a CSV file.

    Language:Python10

  • jessicasimplicio/mD-links-lib

    Bootcamp Laboratoria - Produto final do sprint 4. Biblioteca no npm para extracao de links em documento markdown.

    Language:JavaScript20

  • superbeppe98/url-title-extractor

    URL Title Extractor is a Python program that extracts the titles of web pages from a file containing URLs. It uses the requests and BeautifulSoup libraries to extract the title and decode any HTML entities.

    Language:Python10