ai-crawler-py
Crawl a website starting from a URL, find relevant pages, and extract data – all guided by your natural language prompt.
Live
Open / InstallLast updated September 15, 2026
Description
Crawl a website starting from a URL, find relevant pages, and extract data – all guided by your natural language prompt. An open-source AI framework/SDK by oxylabs, hosted on GitHub.
Community Metrics
Views
3,264
Avg Rating
N/A
Ratings
0
Likes
0
Comments
—
Author
oxylabs
Platform
api
Pricing model
free
Categories
- AI Frameworks
Tags
- ai
- ai-agents
- ai-crawler
- ai-scraping
- ai-studio
- ai-web-crawler
- crawl-agent
- web-crawler
- github
Capabilities
- 3,264 stars
Information
TypeFramework
SourceGitHub
AddedSeptember 3, 2026