gocolly/colly: Elegant Scraper and Crawler Framework for Golang [https://github.com/gocolly/colly] - 2025-04-02 11:15:01 - public:xxx crawler, go, golang, html, lib, library, package, scraping - 8 | id:1518024 -
bjesus/pipet: a swiss-army tool for scraping and extracting data from online assets, made for hackers [https://github.com/bjesus/pipet] - 2024-10-11 09:23:08 - public:xxx curl, web, tools, scraping, crawler, commandline - 6 | id:1506891 -
bluedragonz/bad-bot-blocker: Block bad, possibly even malicious web crawlers (automated bots) using htaccess. [https://github.com/bluedragonz/bad-bot-blocker] - 2024-09-14 11:05:49 - public:xxx bad, bot, crawler, htaccess, list, seo, spiders - 7 | id:1492984 -
Crawlee for Python ยท Fast, reliable crawlers. [https://crawlee.dev/python/] - 2024-07-19 07:36:25 - public:xxx scraping, web, python, browser, automation, crawler - 6 | id:1492570 -
projectdiscovery/katana: A next-generation crawling and spidering framework. [https://github.com/projectdiscovery/katana] - 2024-03-28 09:25:52 - public:xxx crawler, golang, opensource, scraping - 4 | id:1490804 -
semanser/JsonGenius: Get structured JSON data from any page. [https://github.com/semanser/JsonGenius] - 2023-10-14 07:03:03 - public:xxx data, web, parsing, json, crawler - 5 | id:1484885 -
Paterva / Maltego [https://www.paterva.com/web6/] - 2015-02-02 10:27:06 - public:xxx datamining, forensics, intelligence, opensource, scanner, search, security, tools, crawler - 9 | id:126 - scans your network
