Abe Flansburg
a86e7d6210
enhancement: add support for Playwright's storage_state parameter ( #832 )
...
* add support for Playwright `storage_state`
* add storage_state param to node_config
* add sleep for testing
* add sleep in _with_js_support for testing
* remove asyncio.sleep() from tests
* fix typo in existing example filename; add auth example
* add example `authenticated_playwright`
* update source link in example to /feed
* add `storage_state` to missing graphs
2024-12-03 09:02:11 +01:00
Marco Vinciguerra
8aa9103f02
feat: add api integration
2024-11-24 10:54:40 +01:00
Marco Vinciguerra
bbc7184e7b
add examples for document_scraper
CodeQL / Analyze (python) (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
2024-11-24 10:27:24 +01:00
Marco Vinciguerra
b84883bfd1
add smartscraper lite
2024-10-21 09:39:17 +02:00
Marco Vinciguerra
2991ca8dd2
add examples smart scraper lite
2024-10-21 09:33:40 +02:00
Marco Vinciguerra
ffa1067f0d
Merge pull request #756 from shenghongtw/pre/beta
...
The smart_scraper_multi_graph method is too expensive
2024-10-20 10:13:47 +02:00
Federico Aguzzi
9cd9a874f9
chore: fix example
...
Committing even though this is not the bug we were looking for
2024-10-18 22:35:33 +02:00
Federico Aguzzi
8cb9646a45
Merge branch 'main' into pre/beta
2024-10-18 22:16:39 +02:00
Marco Vinciguerra
3f71f103a7
scrape do key added
2024-10-18 17:11:33 +02:00
roryhaung
da2a3c8ec7
add smart_scraper_multi_lite_graph example
2024-10-18 03:19:00 +08:00
ekinsenler
eaa83edc04
update project requirement and add example
2024-10-16 15:21:23 +03:00
Marco Vinciguerra
488821abfa
Update smart_scraper_openai.py
2024-10-16 14:07:01 +02:00
Marco Vinciguerra
e4421ffdcd
Merge branch '731-fetchnode-object-has-no-attribute-update_state' into pre/beta
2024-10-12 09:58:20 +02:00
Marco Vinciguerra
3b7b701a89
feat: refactoring of mdscraper
2024-10-11 08:32:41 +02:00
aziz-ullah-khan
6fd9f14b57
Merge remote-tracking branch 'origin' into pre/beta
2024-10-11 10:21:50 +05:00
Marco Vinciguerra
a57da96175
fix: removed pdf_scraper graph and created document scraper
2024-10-08 09:35:47 +02:00
Marco Vinciguerra
a447aeae2a
Merge branch 'pre/beta' of https://github.com/ScrapeGraphAI/Scrapegraph-ai into pre/beta
2024-10-08 08:54:22 +02:00
Marco Vinciguerra
a200f595de
refactoring of examples
2024-10-08 08:54:18 +02:00
Marco Vinciguerra
402e5c420d
Merge pull request #730 from ScrapeGraphAI/refactoring-of-pr-#729
2024-10-08 08:24:12 +02:00
Marco Vinciguerra
95d00e90d9
Update search_graph_openai.py
/ build (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
2024-10-07 11:42:01 +02:00
Marco Vinciguerra
eb42c44dc8
refactoring of undected playwrigth
2024-10-07 10:37:21 +02:00
Marco Vinciguerra
e2d1816087
Merge pull request #729 from ekinsenler/selenium
...
feat: support for undetected_chromedriver with selenium backend
2024-10-07 10:36:01 +02:00
ekinsenler
80ece2179a
feat: undected_chromedriver support
2024-10-06 22:50:52 +03:00
Marco Vinciguerra
420c71ba2c
feat: refactoring of the conditional node
2024-10-06 09:16:33 +02:00
Marco Vinciguerra
c06cafc976
Merge branch 'pre/beta' into cond_node
2024-10-05 19:23:22 +02:00
ekinsenler
f837dc16ce
feat: conditional_node
2024-10-05 01:14:54 +03:00
Marco Vinciguerra
d056c439cd
Create code_generator_graph_togehter.py
2024-10-04 14:16:13 +02:00
Marco Vinciguerra
c91975e0c8
update examples
2024-10-03 15:32:29 +02:00
Marco Vinciguerra
85cb957297
feat: finished basic version of deep scraper
...
Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>
2024-10-03 13:13:04 +02:00
Marco Vinciguerra
4b371f4d94
feat: add deep scraper implementation
...
Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>
2024-10-03 11:38:14 +02:00
Matteo Vedovati
ea3ae1fd6d
fetch multiple links fix
2024-10-02 11:01:23 +02:00
Matteo Vedovati
4cb621feab
fetch node level k implementation
2024-10-02 10:22:21 +02:00
Marco Vinciguerra
d9a8208b08
Merge branch 'pre/beta' into branch_temp
2024-09-29 15:43:59 +02:00
Marco Vinciguerra
9aa8c889fb
fix: removed deep scraper
2024-09-29 15:40:04 +02:00
Marco Vinciguerra
faf25eeba9
Merge branch 'reasoning-branch' into pre/beta
2024-09-27 17:50:29 +02:00
Marco Vinciguerra
b2822f620a
feat: add reasoning integration
2024-09-27 17:45:44 +02:00
Marco Vinciguerra
1e4ee3abdf
Update html_mode.py
2024-09-27 16:42:51 +02:00
Marco Vinciguerra
bdcffd6360
feat: add html_mode to smart_scraper
2024-09-27 16:41:45 +02:00
Marco Vinciguerra
9905be8a37
fix: script creator multi
2024-09-26 10:09:36 +02:00
Marco Vinciguerra
76ce257efb
fix: update to pydantic documentation
2024-09-25 15:12:29 +02:00
Marco Vinciguerra
d55f6bee47
fix: node refiner + examples
2024-09-25 14:53:51 +02:00
Matteo Vedovati
fb879012d3
Add code generator examples
2024-09-25 10:28:11 +02:00
Marco Vinciguerra
bcf02e5f19
add possiibility to save the code
2024-09-24 21:42:45 +02:00
Marco Vinciguerra
5a3ece9a1a
Merge branch 'pre/beta' into temp
2024-09-24 12:41:55 +02:00
Matteo Vedovati
34590664f1
Code generator updated version
2024-09-21 16:36:22 +02:00
Matteo Vedovati
5b579b323f
gode generator v0.1
2024-09-21 11:44:04 +02:00
Marco Vinciguerra
6f0b9d852a
update examples
2024-09-20 15:09:30 +02:00
Marco Vinciguerra
72873c1b38
refactoring of teh code
2024-09-19 12:34:25 +02:00
Marco Vinciguerra
932412e325
fix: update pyproject.toml
2024-09-18 09:59:14 +02:00
Lorenzo Paleari
eb89549248
feat: updated pydantic to v2
2024-09-17 23:08:56 +02:00
