A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs.

Scraper.AI. Description: Scraper.AI is an automated scraping SaaS that makes extracting data from any webpage as simple as clicking and selecting what you want.

This module fetches (public) pages from GitHub, "scrapes" the html to extract raw data and returns a JSON Object. Usage ...

Scrapy is a BSD-licensed fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. Gitignore · License · Issues 450 · Pull requests 218

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Examples · Parsing a document · Parsing a fragment · Parsing a selector · Selecting elements · Selecting descendent elements · Accessing element attributes.

This project is made for automatic web scraping to make scraping easy. It gets a url or the html content of a web page and a list of sample data.

Colly provides a clean interface to write any kind of crawler/scraper/spider. With Colly you can easily extract structured data from websites. Colly.go · Htmlelement.go · Request.go · Response.go

With this program you can easily scrape and track prices on product at multiple websites. This program can also visualize price over time of the products ...

Scraper is a tool for scraping and visualizing open source data from various code hosting platforms, such as: GitHub.com, GitHub Enterprise, GitLab.com, hosted ...