curl-impersonate: A special build of curl that can impersonate Chrome & Firefox - lwthiker/curl-impersonate

via: https://hckrnews.com/

#curl #http #cli #scraper

Home of Skraper, a brand new retrogaming scraping software using ScreenScraper.fr database.

#scraper #retro #game #rom #cover

Turn any webpage into structured data using LLMs. Contribute to mishushakov/llm-scraper development by creating an account on GitHub.

#llm #html #scraper #extraction #json

Best tool to convert web pages to EPUB. Ideal for compiling research, creating personalized reading lists, or archiving websites.

#epub #html #convert #scraper

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation. - apify/crawlee

#nodejs #crawler #scraper #headless-browser #framework

Self-hosted webscraper. Contribute to jaypyles/Scraperr development by creating an account on GitHub.

#scraper #xpath #self-hosted #python

A social networking service scraper in Python. Contribute to JustAnotherArchivist/snscrape development by creating an account on GitHub.

#osint #crawler #twitter #telegram #python #scraper

Emby/Jellyfin 的一个日本电影刮削器插件，可以从某些网站抓取影片信息。. Contribute to JavScraper/Emby.Plugins.JavScraper development by creating an account on GitHub. #emby #jellyfin #scraper #scanner #metadata

The RSS feed for websites missing it. Contribute to RSS-Bridge/rss-bridge development by creating an account on GitHub. #rss #feed #generator #scraper #self-hosted #pub