Commit Graph

456 Commits

Author SHA1 Message Date
Marco Vinciguerra
f315f3a8c0 feat: add new tests 2026-01-20 14:01:09 +01:00
copilot-swe-agent[bot]
cddf497c81 Add NVIDIA LLM integration support
- Created Nvidia wrapper model class in scrapegraphai/models/nvidia.py
- Updated models/__init__.py to export Nvidia class
- Updated abstract_graph.py to use Nvidia wrapper instead of direct ChatNVIDIA import
- Added nvidia as optional dependency in pyproject.toml
- Created example usage file for NVIDIA in examples/smart_scraper_graph/nvidia/

Co-authored-by: VinciGit00 <88108002+VinciGit00@users.noreply.github.com>
2025-11-26 19:56:44 +00:00
Marco Vinciguerra
73403755da feat: add markdownify endpoint 2025-06-13 12:41:21 +02:00
Marco Vinciguerra
94e9ebd280 feat: add scrapegraphai integration 2025-06-13 11:12:09 +02:00
Marco Vinciguerra
e846a14155 fix: bug on generate answer node 2025-06-06 20:42:20 +02:00
CodeBeaver
b09a5838d1 codebeaver/pre/beta-963 - . 2025-04-14 07:50:46 +00:00
Marco Vinciguerra
ff7b33b376 feat: update terms 2025-03-10 11:27:33 +01:00
Marco Vinciguerra
dc0a138a7e run pre commit 2025-01-12 16:35:31 +01:00
PeriniM
c4dba42346 Merge branch 'pre/beta' into refactoring-examples
Some checks failed
Code Quality Checks / quality (push) Has been cancelled
2025-01-12 13:03:33 +01:00
PeriniM
3b9591156d fix: updated ollama structured output 2025-01-12 12:58:36 +01:00
PeriniM
ad693b2bb2 fix: ollama tokenizer limited to 1024 tokens + ollama structured output + fix browser backend 2025-01-12 12:45:49 +01:00
Marco Vinciguerra
1fad1181a6 feat: add example of collab 2025-01-08 12:26:28 +01:00
Marco Vinciguerra
4324a3cb65 Merge branch 'refactoring-examples' of https://github.com/ScrapeGraphAI/Scrapegraph-ai into refactoring-examples 2025-01-08 12:02:21 +01:00
Marco Vinciguerra
ec0bd23210 add extras 2025-01-08 12:02:19 +01:00
PeriniM
14b4b19f60 docs: improved readme + fix csv scraper imports 2025-01-08 04:16:38 +01:00
Marco Vinciguerra
0b582bea66 refactoring examples 2025-01-07 14:48:40 +01:00
Marco Vinciguerra
6797947567 removed examples 2025-01-07 14:00:04 +01:00
PeriniM
01a331afa5 feat: added graph timeout and fixed model_tokens param (#810 #856 #853) 2025-01-06 18:48:55 +01:00
PeriniM
fcbfe78983 feat: ⛏️ enhanced contribution and precommit added 2025-01-06 15:10:35 +01:00
PeriniM
2a15581865 fix: local html handling 2025-01-06 12:04:02 +01:00
PeriniM
5cdf0550fe chore: made some libs optional 2025-01-06 03:42:45 +01:00
PeriniM
54c69a2b0b chore: pandas package is now optional 2025-01-06 02:36:05 +01:00
SwapnilSonker
4914928339 #772 added functionality to change browser to firefox 2024-12-18 09:10:46 +05:30
SwapnilSonker
cbc75add0d #171 imported ChromiumLoader from ScrapegraphAI 2024-12-17 17:43:03 +05:30
SwapnilSonker
fe66e3d28d #171 used ScrapegraphAI library and created a more consistent example. 2024-12-17 15:58:19 +05:30
SwapnilSonker
753737e655 added the example in example/extras #171 2024-12-17 08:08:10 +05:30
Abe Flansburg
a86e7d6210
enhancement: add support for Playwright's storage_state parameter (#832)
* add support for Playwright `storage_state`

* add storage_state param to node_config

* add sleep for testing

* add sleep in _with_js_support for testing

* remove asyncio.sleep() from tests

* fix typo in existing example filename; add auth example

* add example `authenticated_playwright`

* update source link in example to /feed

* add `storage_state` to missing graphs
2024-12-03 09:02:11 +01:00
Marco Vinciguerra
8aa9103f02 feat: add api integration 2024-11-24 10:54:40 +01:00
Marco Vinciguerra
bbc7184e7b add examples for document_scraper
Some checks failed
CodeQL / Analyze (python) (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
2024-11-24 10:27:24 +01:00
Marco Vinciguerra
b84883bfd1 add smartscraper lite 2024-10-21 09:39:17 +02:00
Marco Vinciguerra
2991ca8dd2 add examples smart scraper lite 2024-10-21 09:33:40 +02:00
Marco Vinciguerra
ffa1067f0d
Merge pull request #756 from shenghongtw/pre/beta
The smart_scraper_multi_graph method is too expensive
2024-10-20 10:13:47 +02:00
Federico Aguzzi
9cd9a874f9 chore: fix example
Committing even though this is not the bug we were looking for
2024-10-18 22:35:33 +02:00
Federico Aguzzi
8cb9646a45 Merge branch 'main' into pre/beta 2024-10-18 22:16:39 +02:00
Marco Vinciguerra
3f71f103a7 scrape do key added 2024-10-18 17:11:33 +02:00
roryhaung
da2a3c8ec7 add smart_scraper_multi_lite_graph example 2024-10-18 03:19:00 +08:00
ekinsenler
eaa83edc04 update project requirement and add example 2024-10-16 15:21:23 +03:00
Marco Vinciguerra
488821abfa Update smart_scraper_openai.py 2024-10-16 14:07:01 +02:00
Marco Vinciguerra
e4421ffdcd Merge branch '731-fetchnode-object-has-no-attribute-update_state' into pre/beta 2024-10-12 09:58:20 +02:00
Marco Vinciguerra
3b7b701a89 feat: refactoring of mdscraper 2024-10-11 08:32:41 +02:00
aziz-ullah-khan
6fd9f14b57 Merge remote-tracking branch 'origin' into pre/beta 2024-10-11 10:21:50 +05:00
Marco Vinciguerra
a57da96175 fix: removed pdf_scraper graph and created document scraper 2024-10-08 09:35:47 +02:00
Marco Vinciguerra
a447aeae2a Merge branch 'pre/beta' of https://github.com/ScrapeGraphAI/Scrapegraph-ai into pre/beta 2024-10-08 08:54:22 +02:00
Marco Vinciguerra
a200f595de refactoring of examples 2024-10-08 08:54:18 +02:00
Marco Vinciguerra
402e5c420d
Merge pull request #730 from ScrapeGraphAI/refactoring-of-pr-#729 2024-10-08 08:24:12 +02:00
Marco Vinciguerra
95d00e90d9 Update search_graph_openai.py
Some checks failed
/ build (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
2024-10-07 11:42:01 +02:00
Marco Vinciguerra
eb42c44dc8 refactoring of undected playwrigth 2024-10-07 10:37:21 +02:00
Marco Vinciguerra
e2d1816087
Merge pull request #729 from ekinsenler/selenium
feat: support for undetected_chromedriver with selenium backend
2024-10-07 10:36:01 +02:00
ekinsenler
80ece2179a feat: undected_chromedriver support 2024-10-06 22:50:52 +03:00
Marco Vinciguerra
420c71ba2c feat: refactoring of the conditional node 2024-10-06 09:16:33 +02:00