Commit Graph

117 Commits

Author SHA1 Message Date
PeriniM
fcbfe78983 feat: ⛏️ enhanced contribution and precommit added 2025-01-06 15:10:35 +01:00
PeriniM
2a15581865 fix: local html handling 2025-01-06 12:04:02 +01:00
PeriniM
5cdf0550fe chore: made some libs optional 2025-01-06 03:42:45 +01:00
PeriniM
54c69a2b0b chore: pandas package is now optional 2025-01-06 02:36:05 +01:00
Marco Vinciguerra
d1b2104f28 fix: formatting 2024-12-11 17:18:05 +01:00
Abe Flansburg
a86e7d6210
enhancement: add support for Playwright's storage_state parameter (#832)
* add support for Playwright `storage_state`

* add storage_state param to node_config

* add sleep for testing

* add sleep in _with_js_support for testing

* remove asyncio.sleep() from tests

* fix typo in existing example filename; add auth example

* add example `authenticated_playwright`

* update source link in example to /feed

* add `storage_state` to missing graphs
2024-12-03 09:02:11 +01:00
Marco Vinciguerra
e2af2326f6 fix: fetch node regex
Some checks failed
/ build (push) Has been cancelled
2024-11-21 09:00:45 +01:00
saied71
5100fbb017 add html source support for source 2024-11-11 14:04:52 +03:30
Marco Vinciguerra
b7d5a20ae0
Merge pull request #764 from ScrapeGraphAI/pre/beta 2024-10-26 10:05:15 +02:00
Marco Vinciguerra
4cd5ef296e add docstring files
Some checks failed
CodeQL / Analyze (python) (push) Has been cancelled
/ build (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
2024-10-24 15:28:27 +02:00
Marco Vinciguerra
ae275ec5e8 feat: add integration with scrape.do 2024-10-23 12:08:00 +02:00
Marco Vinciguerra
e9c8402091 Update fetch_node.py 2024-10-10 11:41:32 +02:00
Marco Vinciguerra
39a029ed9a feat: refactoring fetch_node 2024-10-10 11:36:48 +02:00
Marco Vinciguerra
560f079d4c refactoring of the code 2024-09-28 09:02:20 +02:00
Marco Vinciguerra
76ce257efb fix: update to pydantic documentation 2024-09-25 15:12:29 +02:00
Marco Vinciguerra
5a3ece9a1a
Merge branch 'pre/beta' into temp 2024-09-24 12:41:55 +02:00
Marco Vinciguerra
3ea1f20c83
Update fetch_node.py 2024-09-20 21:48:24 +02:00
Marco Vinciguerra
3f45c17022 fix: fetch_node condition
Some checks failed
/ build (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
2024-09-16 09:11:59 +02:00
Marco Vinciguerra
c717bb6d8e Merge branch 'main' into pre/beta 2024-09-16 09:08:37 +02:00
Marco Vinciguerra
438b8127db refctoring of the code 2024-09-15 11:20:08 +02:00
Marco Vinciguerra
fe3aa28fe7 refactoring of the code
Some checks failed
/ build (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
2024-09-11 16:04:43 +02:00
Marco Vinciguerra
167f97040f feat: fetch_node improved
Some checks failed
/ build (push) Has been cancelled
2024-09-07 09:33:57 +02:00
Marco Vinciguerra
f5e7a8bfaf fix of the bug for fetching the code 2024-09-06 16:58:37 +02:00
Marco Vinciguerra
94e69a0515 feat: add scrape_do_integration 2024-09-06 16:51:48 +02:00
Federico Aguzzi
83e71df2e2 fix: set up dynamic imports correctly 2024-08-27 16:54:57 +02:00
Marco Vinciguerra
0d2b7b37e0 update dependenceis 2024-08-21 20:48:47 +02:00
Marco Vinciguerra
8b8d8f09b7 refactoring of the code according to pylint style
Some checks are pending
/ build (push) Waiting to run
Release / Build (push) Waiting to run
Release / Release (push) Blocked by required conditions
2024-08-18 11:51:34 +02:00
Marco Vinciguerra
f0587908e2 Merge branch 'pre/beta' of https://github.com/ScrapeGraphAI/Scrapegraph-ai into pre/beta 2024-08-17 12:21:03 +02:00
Marco Vinciguerra
1d7f30b65b fix: browser-base integration 2024-08-17 12:21:00 +02:00
Federico Aguzzi
5eed0a7654 fix(FetchNode) add OpenAI optimization to GPT models on Azure
closes #547
2024-08-17 10:33:54 +02:00
Marco Vinciguerra
f01b55e89b fix: fetch node 2024-08-10 11:41:51 +02:00
Federico Aguzzi
50edbcc7f8 fix(FetchNode): missing bracket syntax error 2024-08-09 09:37:51 +02:00
Marco Vinciguerra
b6bff0be33
Merge branch 'pre/beta' into mistral-ai-integration 2024-08-07 21:24:18 +02:00
Federico Aguzzi
07720b6e0c fix(FetchNode): handling of missing browser_base key 2024-08-07 15:15:13 +02:00
Matteo Vedovati
bfc6852b77 fix: refactoring of fetch_node adding comment 2024-08-07 13:02:02 +02:00
Matteo Vedovati
1ea2ad8e79 fix: refactoring of fetch_node qixed error 2024-08-07 12:04:54 +02:00
Matteo Vedovati
29ad140fa3 fix: refactoring of fetch_node 2024-08-07 11:56:10 +02:00
Marco Vinciguerra
82e63213ae Merge branch 'pre/beta' of https://github.com/ScrapeGraphAI/Scrapegraph-ai into pre/beta
Some checks failed
/ build (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
2024-08-06 17:07:35 +02:00
Marco Vinciguerra
37dd6e9ba9 update reqs
Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>
2024-08-06 17:07:33 +02:00
Marco Vinciguerra
886bab78e7
Merge branch 'main' into temp-1 2024-08-06 10:04:57 +02:00
Marco Vinciguerra
9355507a2d feat: refactoring of the code 2024-08-02 12:00:00 +02:00
Marco Vinciguerra
be870a4316 Update fetch_node.py
Co-Authored-By: Federico Minutoli <40361744+DiTo97@users.noreply.github.com>
2024-08-01 13:24:48 +02:00
Marco Vinciguerra
968c69e217 fix: fixed bug on fetch_node
Co-Authored-By: Federico Minutoli <40361744+DiTo97@users.noreply.github.com>
2024-08-01 13:23:54 +02:00
Marco Vinciguerra
e21d461710 push 2024-08-01 13:16:49 +02:00
Marco Vinciguerra
5ecdbe715f feat: add integration in the abstract grapgh 2024-08-01 12:51:18 +02:00
Marco Vinciguerra
f6b7c6a430 refactoring
Co-Authored-By: Federico Aguzzi <62149513+f-aguzzi@users.noreply.github.com>
2024-07-29 17:56:32 +02:00
Marco Perini
5c08eea189 docs: prev version
Some checks failed
CodeQL / Analyze (python) (push) Has been cancelled
/ build (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
2024-07-24 23:37:57 +02:00
Marco Vinciguerra
e08b30495d boh
Some checks are pending
CodeQL / Analyze (python) (push) Waiting to run
/ build (push) Waiting to run
Release / Build (push) Waiting to run
Release / Release (push) Blocked by required conditions
2024-07-24 14:33:55 +02:00
Marco Perini
1d41f6eafe
fix: md conversion 2024-07-23 19:27:18 +02:00
Marco Perini
12b5eada6e
fix(md_conversion): add absolute links md, added missing dependency 2024-07-23 15:34:12 +02:00