CodeCow/Scrapegraph-ai
1
0
Fork 0
mirror of https://github.com/VinciGit00/Scrapegraph-ai.git synced 2026-07-09 21:19:20 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
2,491 Commits 2 Branches 448 Tags 17 MiB
a0efb09ffb
Commit Graph

1061 Commits

Author SHA1 Message Date
PeriniM
8d9c909923 fix: disallow mailto: (#861) 2025-01-06 04:27:44 +01:00
PeriniM
5be7c497cd chore: chromium browser asnc handling 2025-01-06 04:08:15 +01:00
PeriniM
5cdf0550fe chore: made some libs optional 2025-01-06 03:42:45 +01:00
PeriniM
54c69a2b0b chore: pandas package is now optional 2025-01-06 02:36:05 +01:00
PeriniM
f6009d1abf fix: better playwright installation handling 2025-01-06 02:01:17 +01:00
PeriniM
e374e055d6 fix: selenium import in ChromiumLoader 2025-01-06 00:44:16 +01:00
Marco Vinciguerra
927c99b2e8
Merge pull request #849 from SwapnilSonker/extract/SmartScraperGraph
Some checks failed
/ build (push) Has been cancelled
Details
Release / Build (push) Has been cancelled
Details
Release / Release (push) Has been cancelled
Details 
#710 - just a check added for the detailed logging
 2025-01-05 12:44:24 +01:00
Marco Vinciguerra
d4b26796d9 fix: search graph 2025-01-03 14:00:17 +01:00
Marco Vinciguerra
bfb5b4ca9d
Merge branch 'main' into pre/beta 2025-01-03 13:28:09 +01:00
Marco Vinciguerra
b312251cc5 fix: revert 2025-01-02 14:49:46 +01:00
Marco Vinciguerra
9b16cb987f fix: add model tokens 2024-12-22 16:16:45 +01:00
Marcelo Busana
489adf7006 Add the AbstractGraph run_safe_async and its test 2024-12-21 09:53:56 -03:00
SwapnilSonker
064ebfcdb4 #710 - just a check added for the detailed logging 2024-12-21 09:05:10 +05:30
SwapnilSonker
4914928339 #772 added functionality to change browser to firefox 2024-12-18 09:10:46 +05:30
Georgios Savvidis
e2caee695e
fix: validate URL only if the input type is a URL 2024-12-17 14:20:07 +01:00
SwapnilSonker
84548d081d Resolved merge conflict in scrapegraphai/helpers/models_tokens.py 2024-12-16 20:45:35 +05:30
SwapnilSonker
a4f0f5d16d Add function to select backend (Selenium or other) for issue #171 2024-12-16 20:26:20 +05:30
Marco Vinciguerra
76ac0a2141 fix: pyproject 2024-12-16 11:13:16 +01:00
Marco Vinciguerra
3dcfcd492e fix: pyproject 2024-12-16 11:11:01 +01:00
Marco Vinciguerra
ffdadaed6f fix: context window 2024-12-16 10:54:11 +01:00
Marco Vinciguerra
d1b2104f28 fix: formatting 2024-12-11 17:18:05 +01:00
Marco Vinciguerra
7af81345ce Merge branch 'pre/beta' of https://github.com/ScrapeGraphAI/Scrapegraph-ai into pre/beta 2024-12-08 15:57:52 +01:00
Marco Vinciguerra
2a032d6d7c feat: add new model token 2024-12-08 15:57:51 +01:00
Marco Vinciguerra
c1a217790d
Merge branch 'pre/beta' into temp 2024-12-08 15:54:42 +01:00
Marco Vinciguerra
e16e94bf69 fix: client 2024-12-06 20:51:08 +01:00
Marco Vinciguerra
a6f43d53cb fix: did a quick fix 2024-12-06 13:43:38 +01:00
Marco Vinciguerra
c396dcf93b
Merge branch 'pre/beta' into feat_chromium_scroller 2024-12-06 09:15:35 +01:00
Marco Vinciguerra
7f0e1d2eac
Merge branch 'main' into pre/beta 2024-12-05 22:51:30 +01:00
Alin Cristian Preda
7eeca1b91a quickfix: removed unneccessary line 2024-12-03 21:17:47 +01:00
Alin Cristian Preda
1c8b910562 feat: added scrolling method to chromium docloader 2024-12-03 21:10:42 +01:00
Abe Flansburg
a86e7d6210
enhancement: add support for Playwright's storage_state parameter (#832) 
* add support for Playwright `storage_state`

* add storage_state param to node_config

* add sleep for testing

* add sleep in _with_js_support for testing

* remove asyncio.sleep() from tests

* fix typo in existing example filename; add auth example

* add example `authenticated_playwright`

* update source link in example to /feed

* add `storage_state` to missing graphs
 2024-12-03 09:02:11 +01:00
Marco Vinciguerra
aa7a7e2dae
Pre/beta (#835) 
* fix: error on fetching the code

* feat: revert search function

* feat: add api integration

* ci(release): 1.32.0-beta.1 [skip ci]

## [1.32.0-beta.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.31.1...v1.32.0-beta.1) (2024-11-24)

### Features

* revert search function ([faf0c01](faf0c0123b))

* fix: improved links extraction for parse_node, resolves #822

* ci(release): 1.32.0-beta.2 [skip ci]

## [1.32.0-beta.2](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.32.0-beta.1...v1.32.0-beta.2) (2024-11-25)

### Bug Fixes

* error on fetching the code ([7285ab0](7285ab065b))

* ci(release): 1.32.0-beta.3 [skip ci]

## [1.32.0-beta.3](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.32.0-beta.2...v1.32.0-beta.3) (2024-11-26)

### Bug Fixes

* improved links extraction for parse_node, resolves [#822](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/822) ([7da7bfe](7da7bfe338))

* chore: migrate from rye to uv

* feat: add sdk integration

* ci(release): 1.32.0-beta.4 [skip ci]

## [1.32.0-beta.4](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.32.0-beta.3...v1.32.0-beta.4) (2024-12-02)

### Features

* add api integration ([8aa9103](8aa9103f02))
* add sdk integration ([209b445](209b4456fd))

### chore

* migrate from rye to uv ([5fe528a](5fe528a7e7))

---------

Co-authored-by: semantic-release-bot <semantic-release-bot@martynus.net>
Co-authored-by: Michele_Zenoni <michelezenoni1@gmail.com>
Co-authored-by: Federico Aguzzi <62149513+f-aguzzi@users.noreply.github.com>
 2024-12-02 09:39:26 +01:00
Marco Vinciguerra
1ff7f88249 Merge branch 'api-integration' into pre/beta 2024-12-02 09:35:22 +01:00
Marco Vinciguerra
209b4456fd feat: add sdk integration
Some checks failed
/ build (push) Has been cancelled
Details
2024-11-28 13:23:57 +01:00
Marco Vinciguerra
adddd64fba
Merge pull request #828 from Levyathanus/pre/beta 2024-11-26 08:24:56 +01:00
Marco Vinciguerra
c84ff567d2
Merge pull request #826 from ScrapeGraphAI/fix-runtime-error 
fix: error on fetching the code
 2024-11-25 09:22:35 +01:00
Michele_Zenoni
7da7bfe338 fix: improved links extraction for parse_node, resolves #822 2024-11-24 14:44:48 +01:00
Marco Vinciguerra
8aa9103f02 feat: add api integration 2024-11-24 10:54:40 +01:00
Marco Vinciguerra
faf0c0123b feat: revert search function 2024-11-24 10:02:10 +01:00
Marco Vinciguerra
7285ab065b fix: error on fetching the code 2024-11-24 09:38:16 +01:00
Marco Vinciguerra
f8dd2e2ffa
Merge pull request #815 from ScrapeGraphAI/813-model-not-found-when-using-anthropic 
fix: add new model istance
 2024-11-21 18:26:03 +01:00
Marco Vinciguerra
17f8f7282c
Merge pull request #817 from ScrapeGraphAI/refactoring_fetching 
fix: fetch node regex
 2024-11-21 10:26:53 +01:00
Marco Vinciguerra
e2af2326f6 fix: fetch node regex
Some checks failed
/ build (push) Has been cancelled
Details
2024-11-21 09:00:45 +01:00
Marco Vinciguerra
32ef5547f1 fix: generate answer node timeout 2024-11-20 21:18:38 +01:00
Marco Vinciguerra
c243106552 fix: timeout 2024-11-19 21:01:05 +01:00
Marco Vinciguerra
2f3cafeab0 fix: add new model istance 2024-11-19 20:48:04 +01:00
Marco Vinciguerra
98cf5f1f83
Merge branch 'pre/beta' into main 2024-11-19 07:58:28 +01:00
Michele_Zenoni
d2d0312dc6 fix: try to infer possible provider from the model name, resolves #805 2024-11-17 20:04:30 +01:00
Marco Vinciguerra
49897c4d2e fix: generate answer node 2024-11-16 16:30:57 +01:00
Marco Vinciguerra
1f465e636d feat: refactoring of generate answer node 2024-11-15 14:15:08 +01:00