CodeCow/Scrapegraph-ai
1
0
Fork 0
mirror of https://github.com/VinciGit00/Scrapegraph-ai.git synced 2026-07-01 21:00:48 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
1,851 Commits 2 Branches 448 Tags 17 MiB
eddcb79486
Commit Graph

1851 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
semantic-release-bot
eddcb79486 ci(release): 1.19.0-beta.1 [skip ci] 
## [1.19.0-beta.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.18.1...v1.19.0-beta.1) (2024-09-08)

### Features

* **AbstractGraph:** add adjustable rate limit ([2859fb7](2859fb72d6))
* add scrape_do_integration ([94e69a0](94e69a0515))
* add togheterai ([8f615ad](8f615adef3))
* ConcatNode.py added for heavy merge operations ([bd4b26d](bd4b26d7d7))
* fetch_node improved ([167f970](167f97040f))

### Bug Fixes

* **AbstractGraph:** Bedrock init issues ([63a5d18](63a5d18486)), closes [#633](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/633)
* correctly parsing output when using structured_output ([8e74ac5](8e74ac55a1))
* **ScreenshotScraper:** impose dynamic imports ([b8ef937](b8ef93738e))
* **Ollama:** instance model from correct package ([398b2c5](398b2c556f))
* Parse Node scraping link and img urls allowing OmniScraper to work ([66a3b6d](66a3b6d6a3))
* **SmartScraper:** pass llm_model to ParseNode ([5242166](5242166575))
* **DeepSeek:** proper model initialization ([74dfc69](74dfc693f6))
* Removed link_urls and img_ulrs from FetchNode output ([57337a0](57337a0a8c))
* screenshot scraper ([388630c](388630c0ff))
* screenshot_scraper ([ef7a589](ef7a5891dc))
* **ScreenShotScraper:** static import of optional dependencies ([52fe441](52fe441c5a))
* update generate answernode ([c348f67](c348f674ad))

### chore

* **examples:** create Together AI examples ([34942de](34942deca5))

### CI

* **release:** 1.16.0-beta.1 [skip ci] ([d7f6036](d7f6036f90))
* **release:** 1.16.0-beta.2 [skip ci] ([1c37d5d](1c37d5db1c))
* **release:** 1.16.0-beta.3 [skip ci] ([886c987](886c987172))
* **release:** 1.16.0-beta.4 [skip ci] ([ba5c7ad](ba5c7adcea))
* **release:** 1.17.0-beta.1 [skip ci] ([13efd4e](13efd4e3a4))
* **release:** 1.17.0-beta.10 [skip ci] ([af28885](af2888539e))
* **release:** 1.17.0-beta.11 [skip ci] ([a73fec5](a73fec5a98))
* **release:** 1.17.0-beta.2 [skip ci] ([08afc92](08afc9292e))
* **release:** 1.17.0-beta.3 [skip ci] ([fc55418](fc55418a45))
* **release:** 1.17.0-beta.4 [skip ci] ([5e99071](5e990719cf))
* **release:** 1.17.0-beta.5 [skip ci] ([16ab1bf](16ab1bf3d9))
* **release:** 1.17.0-beta.6 [skip ci] ([50c9c6b](50c9c6bd8c))
* **release:** 1.17.0-beta.7 [skip ci] ([4347afb](4347afb8d4)), closes [#633](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/633)
* **release:** 1.17.0-beta.8 [skip ci] ([85c374e](85c374e4b3))
* **release:** 1.17.0-beta.9 [skip ci] ([77d0fd3](77d0fd3dba))
 2024-09-08 11:13:21 +00:00
Marco Vinciguerra
9f52602d74
Merge pull request #646 from ScrapeGraphAI/temp 
allignement
 2024-09-08 13:11:46 +02:00
Marco Vinciguerra
14c5e6baf9
Merge branch 'pre/beta' into temp 2024-09-08 13:11:37 +02:00
semantic-release-bot
c5ffdef4ff ci(release): 1.18.1 [skip ci] 
## [1.18.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.18.0...v1.18.1) (2024-09-08)

### Bug Fixes

* **browser_base_fetch:** correct function signature and async_mode handling ([007ff08](007ff084c6))
 2024-09-08 09:45:47 +00:00
Marco Vinciguerra
5f09b1f698
Merge pull request #645 from tuhinmallick/main 2024-09-08 11:44:33 +02:00
Tuhin Mallick
007ff084c6
fix(browser_base_fetch): correct function signature and async_mode handling 
- Added missing `async_mode` parameter to the function signature.
 2024-09-08 10:59:04 +02:00
semantic-release-bot
29ef63d85a ci(release): 1.18.0 [skip ci] 
## [1.18.0](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.17.0...v1.18.0) (2024-09-08)

### Features

* **browser_base_fetch:** add async_mode to support both synchronous and asynchronous execution ([d56253d](d56253d183))
 2024-09-08 08:54:33 +00:00
Marco Vinciguerra
e9a74e1644
Merge pull request #644 from tuhinmallick/main 
feat(browser_base_fetch): add async_mode to support both synchronous …
 2024-09-08 10:53:14 +02:00
Marco Vinciguerra
02eed1ac9d
Merge branch 'main' into main 2024-09-08 10:51:31 +02:00
Tuhin Mallick
d56253d183 feat(browser_base_fetch): add async_mode to support both synchronous and asynchronous execution 
- Introduced an async_mode flag to allow users to choose between synchronous and asynchronous fetching using Browserbase.
- Refactored common logic (browserbase initialization and result list) to avoid redundancy.
- Added internal async handling with asyncio.to_thread() for non-blocking execution in async_mode.
- Maintained backward compatibility for existing synchronous functionality.
 2024-09-08 08:49:08 +00:00
semantic-release-bot
cd4ffd761a ci(release): 1.17.0 [skip ci] 
## [1.17.0](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.16.0...v1.17.0) (2024-09-08)

### Features

* **docloaders:** Enhance browser_base_fetch function flexibility ([57fd01f](57fd01f9a7))

### Docs

* **sponsor:** 🅱️ Browserbase sponsor 🅱️ ([a540139](a5401394cc))
 2024-09-08 07:07:13 +00:00
Marco Vinciguerra
7d39019f39
Merge pull request #642 from tuhinmallick/patch-1 2024-09-08 09:06:00 +02:00
Tuhin Mallick
57fd01f9a7
feat(docloaders): Enhance browser_base_fetch function flexibility 
- Update browser_base_fetch to accept single URL or list of URLs
- Add text_content parameter for choosing between text-only and HTML output
- Improve type hinting and function documentation
- Ensure compatibility with latest Browserbase SDK interface
 2024-09-08 01:41:39 +02:00
Marco Perini
a5401394cc
docs(sponsor): 🅱️ Browserbase sponsor 🅱️ 2024-09-08 01:12:29 +02:00
semantic-release-bot
a73fec5a98 ci(release): 1.17.0-beta.11 [skip ci] 
## [1.17.0-beta.11](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.17.0-beta.10...v1.17.0-beta.11) (2024-09-07)

### Features

* add scrape_do_integration ([94e69a0](94e69a0515))
* fetch_node improved ([167f970](167f97040f))
 2024-09-07 15:07:49 +00:00
Federico Aguzzi
9016bb53fb
Merge pull request #639 from ScrapeGraphAI/scrape_do_integration 
Scrape do integration
 2024-09-07 17:06:22 +02:00
semantic-release-bot
af2888539e ci(release): 1.17.0-beta.10 [skip ci] 
## [1.17.0-beta.10](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.17.0-beta.9...v1.17.0-beta.10) (2024-09-07)

### Bug Fixes

* screenshot_scraper ([ef7a589](ef7a5891dc))
 2024-09-07 12:56:49 +00:00
Marco Vinciguerra
ef7a5891dc fix: screenshot_scraper 2024-09-07 14:55:12 +02:00
Marco Vinciguerra
429af8ef2d
Merge pull request #640 from zuanzuanshao/main 
Update abstract_graph.py
 2024-09-07 11:43:39 +02:00
ZuanZuan
cb05f824ce
Update abstract_graph.py 2024-09-07 17:35:03 +08:00
Marco Vinciguerra
167f97040f feat: fetch_node improved
Some checks failed
/ build (push) Has been cancelled
Details
2024-09-07 09:33:57 +02:00
Marco Vinciguerra
8883bced7d asdd proxy integratrion 2024-09-06 17:17:27 +02:00
Marco Vinciguerra
f5e7a8bfaf fix of the bug for fetching the code 2024-09-06 16:58:37 +02:00
Marco Vinciguerra
94e69a0515 feat: add scrape_do_integration 2024-09-06 16:51:48 +02:00
Marco Vinciguerra
9e9c77551f add examples multi concat
Some checks failed
/ build (push) Has been cancelled
Details
Release / Build (push) Has been cancelled
Details
Release / Release (push) Has been cancelled
Details
2024-09-06 16:13:36 +02:00
semantic-release-bot
77d0fd3dba ci(release): 1.17.0-beta.9 [skip ci] 
## [1.17.0-beta.9](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.17.0-beta.8...v1.17.0-beta.9) (2024-09-06)

### Features

* ConcatNode.py added for heavy merge operations ([bd4b26d](bd4b26d7d7))
 2024-09-06 13:54:00 +00:00
Marco Vinciguerra
8b02cb4460
Merge pull request #632 from ekinsenler/concat_node 
feat: Concat node implementation
 2024-09-06 15:52:35 +02:00
semantic-release-bot
85c374e4b3 ci(release): 1.17.0-beta.8 [skip ci] 
## [1.17.0-beta.8](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.17.0-beta.7...v1.17.0-beta.8) (2024-09-06)

### Features

* **AbstractGraph:** add adjustable rate limit ([2859fb7](2859fb72d6))
 2024-09-06 13:04:30 +00:00
Marco Vinciguerra
c382b9d126
Merge pull request #630 from ScrapeGraphAI/595-rate-limit-error 
feat(AbstractGraph): add adjustable rate limit
 2024-09-06 15:03:10 +02:00
Federico Aguzzi
2859fb72d6 feat(AbstractGraph): add adjustable rate limit 2024-09-05 16:31:33 +02:00
semantic-release-bot
4347afb8d4 ci(release): 1.17.0-beta.7 [skip ci] 
## [1.17.0-beta.7](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.17.0-beta.6...v1.17.0-beta.7) (2024-09-05)

### Bug Fixes

* **AbstractGraph:** Bedrock init issues ([63a5d18](63a5d18486)), closes [#633](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/633)
 2024-09-05 08:37:49 +00:00
Marco Vinciguerra
31aff6b932
Merge pull request #636 from ScrapeGraphAI/633-bedrock-support-fix 2024-09-05 10:36:31 +02:00
Federico Aguzzi
63a5d18486 fix(AbstractGraph): Bedrock init issues 
Closes #633
 2024-09-05 10:20:20 +02:00
ekinsenler
c0339d9dc6 fix file name 2024-09-04 20:31:24 +03:00
ekinsenler
f83c3d1ae6 add example for gemini 2024-09-04 20:29:04 +03:00
ekinsenler
bd4b26d7d7 feat: ConcatNode.py added for heavy merge operations 2024-09-04 17:53:32 +03:00
semantic-release-bot
50c9c6bd8c ci(release): 1.17.0-beta.6 [skip ci] 
## [1.17.0-beta.6](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.17.0-beta.5...v1.17.0-beta.6) (2024-09-04)

### Bug Fixes

* **ScreenShotScraper:** static import of optional dependencies ([52fe441](52fe441c5a))
 2024-09-04 13:45:26 +00:00
Marco Vinciguerra
e477a448a6
Merge pull request #631 from ScrapeGraphAI/627-PIL-import-error 
fix(ScreenShotScraper): static import of optional dependencies
 2024-09-04 15:44:09 +02:00
Federico Aguzzi
52fe441c5a fix(ScreenShotScraper): static import of optional dependencies 2024-09-04 15:00:30 +02:00
semantic-release-bot
16ab1bf3d9 ci(release): 1.17.0-beta.5 [skip ci] 
## [1.17.0-beta.5](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.17.0-beta.4...v1.17.0-beta.5) (2024-09-02)

### Bug Fixes

* correctly parsing output when using structured_output ([8e74ac5](8e74ac55a1))
 2024-09-02 16:15:49 +00:00
Marco Vinciguerra
8442700e92
Merge pull request #626 from LorenzoPaleari/598-fix-pydantic-errors 
Fixed pydantic errors when using `with_strctured_output`
 2024-09-02 18:14:36 +02:00
Lorenzo Paleari
8e74ac55a1
fix: correctly parsing output when using structured_output 2024-09-02 17:03:14 +02:00
semantic-release-bot
5e990719cf ci(release): 1.17.0-beta.4 [skip ci] 
## [1.17.0-beta.4](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.17.0-beta.3...v1.17.0-beta.4) (2024-09-02)

### Bug Fixes

* Parse Node scraping link and img urls allowing OmniScraper to work ([66a3b6d](66a3b6d6a3))
* Removed link_urls and img_ulrs from FetchNode output ([57337a0](57337a0a8c))
 2024-09-02 13:14:39 +00:00
Marco Vinciguerra
81af62d35f
Merge pull request #622 from LorenzoPaleari/pre/beta 
ScrapeGraphAI/580-OmniScraperGraph-fix
 2024-09-02 15:13:07 +02:00
semantic-release-bot
fc55418a45 ci(release): 1.17.0-beta.3 [skip ci] 
## [1.17.0-beta.3](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.17.0-beta.2...v1.17.0-beta.3) (2024-09-02)

### Bug Fixes

* **ScreenshotScraper:** impose dynamic imports ([b8ef937](b8ef93738e))
* **SmartScraper:** pass llm_model to ParseNode ([5242166](5242166575))
 2024-09-02 13:12:59 +00:00
Marco Vinciguerra
aed5452d39
Merge pull request #624 from ScrapeGraphAI/fix-import-errors 
Fix ScreenshotScraper dynamic import errors
 2024-09-02 15:11:21 +02:00
Federico Aguzzi
5242166575 fix(SmartScraper): pass llm_model to ParseNode 2024-09-02 15:04:54 +02:00
Federico Aguzzi
b8ef93738e fix(ScreenshotScraper): impose dynamic imports 2024-09-02 15:03:54 +02:00
Lorenzo Paleari
57337a0a8c
fix: Removed link_urls and img_ulrs from FetchNode output 2024-09-02 12:53:40 +02:00
Lorenzo Paleari
66a3b6d6a3
fix: Parse Node scraping link and img urls allowing OmniScraper to work 2024-09-02 12:53:10 +02:00