CodeCow/Scrapegraph-ai
1
0
Fork 0
mirror of https://github.com/VinciGit00/Scrapegraph-ai.git synced 2026-06-20 21:13:05 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
224ff07032
Scrapegraph-ai/examples/smart_scraper_graph
History
PeriniM c4dba42346
Some checks failed
Code Quality Checks / quality (push) Has been cancelled
Details
Merge branch 'pre/beta' into refactoring-examples
2025-01-12 13:03:33 +01:00
..
ollama Merge branch 'pre/beta' into refactoring-examples 2025-01-12 13:03:33 +01:00
openai docs: improved readme + fix csv scraper imports 2025-01-08 04:16:38 +01:00
.env.example docs: improved readme + fix csv scraper imports 2025-01-08 04:16:38 +01:00
README.md docs: improved readme + fix csv scraper imports 2025-01-08 04:16:38 +01:00

README.md

Smart Scraper Example

This example demonstrates how to use Scrapegraph-ai for intelligent web scraping with automatic content detection and extraction.

Features

  • Intelligent content detection
  • Automatic data extraction
  • Content classification
  • Clean data output

Setup

  1. Install required dependencies
  2. Copy .env.example to .env
  3. Configure your OpenAI API key in the .env file

Usage

from scrapegraphai.graphs import SmartScraperGraph

graph = SmartScraperGraph()
results = graph.scrape("https://example.com")

Environment Variables

Required environment variables:

  • OPENAI_API_KEY: Your OpenAI API key