CodeCow/Scrapegraph-ai
1
0
Fork 0
mirror of https://github.com/VinciGit00/Scrapegraph-ai.git synced 2026-07-04 21:00:36 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
1,681 Commits 2 Branches 448 Tags 17 MiB
ee8f8b31ec
Commit Graph

1681 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Marco Vinciguerra
ee8f8b31ec fix: add claude3.5 sonnet 2024-08-24 21:25:55 +02:00
Marco Vinciguerra
e68654159e Merge branch 'main' of https://github.com/ScrapeGraphAI/Scrapegraph-ai
Some checks failed
CodeQL / Analyze (python) (push) Has been cancelled
Details
Release / Build (push) Has been cancelled
Details
Release / Release (push) Has been cancelled
Details
2024-08-23 11:45:09 +02:00
Marco Vinciguerra
e2e3dda0c5 Update README.md 2024-08-23 11:45:07 +02:00
Marco Vinciguerra
892d354e05
Update README.md 2024-08-23 11:41:35 +02:00
Marco Perini
b3a2d0d65a
docs: added sponsors
Some checks failed
CodeQL / Analyze (python) (push) Has been cancelled
Details
Release / Build (push) Has been cancelled
Details
Release / Release (push) Has been cancelled
Details
2024-08-21 22:12:14 +02:00
semantic-release-bot
5e31b06a7d ci(release): 1.14.0 [skip ci] 
## [1.14.0](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.13.3...v1.14.0) (2024-08-20)

### Features

* add async call ([f60aa3a](f60aa3acde))
* add integration for new module of gpt4o ([982150e](982150e81f))
* Add new feature to support gpt-4o variant models with different pricing ([8551448](855144876d))
* add refactoring of default temperature ([6c3b37a](6c3b37ab00))
* add structured output format ([7d2fc67](7d2fc672c8))
* **GenerateAnswerNode:** built-in structured output through LangChain ([d29338b](d29338b7c2))
* Implemented a filter logic in search_link_node.py ([08e9d9d](08e9d9d6a0))
* refactoring of the code ([5eb3cff](5eb3cff64f))
* update abstract graph ([c77231c](c77231c983))
* update model tokens dict ([0aca287](0aca28732b))

### Bug Fixes

* broken node ([1272273](1272273499))
* browser-base integration ([1d7f30b](1d7f30b65b))
* **models_tokens:** incorrect provider names ([cb6b353](cb6b35397e))
* **ParseNode:** leave room for LLM reply in context window ([683bf57](683bf57d89))
* merge_anwser prompt import ([f17cef9](f17cef94bb))
* model count ([faef318](faef3186f7))
* **AbstractGraph:** pass kwargs to Ernie and Nvidia models ([e6bedb6](e6bedb6701))
* **SearchNode:** prompt ([052f7d5](052f7d5e66))

### chore

* **examples:** add vertex examples, rename genai examples ([1aa9c6e](1aa9c6e73b))
* **examples:** fix import bug in image2text demo ([71438a1](71438a1e86))
* **examples:** update provider names to match tokens dictionary ([ee078cb](ee078cb102))
* **requirements:** update requirements.txt ([7fe181f](7fe181f69b))

### CI

* **release:** 1.13.0-beta.8 [skip ci] ([b470d97](b470d974cf))
* **release:** 1.13.0-beta.9 [skip ci] ([d4c1a1c](d4c1a1c58a))
* **release:** 1.14.0-beta.1 [skip ci] ([40043f3](40043f376e))
* **release:** 1.14.0-beta.10 [skip ci] ([6a08cc8](6a08cc8a43))
* **release:** 1.14.0-beta.11 [skip ci] ([d617750](d61775090a))
* **release:** 1.14.0-beta.12 [skip ci] ([fec3582](fec358253b))
* **release:** 1.14.0-beta.13 [skip ci] ([f4dbe5b](f4dbe5b841))
* **release:** 1.14.0-beta.2 [skip ci] ([7fd921b](7fd921b990))
* **release:** 1.14.0-beta.3 [skip ci] ([3bf9c3c](3bf9c3c9e6))
* **release:** 1.14.0-beta.4 [skip ci] ([7af1e45](7af1e45565))
* **release:** 1.14.0-beta.5 [skip ci] ([db3494d](db3494d377))
* **release:** 1.14.0-beta.6 [skip ci] ([6730797](6730797008))
* **release:** 1.14.0-beta.7 [skip ci] ([a6fcc1e](a6fcc1ea58))
* **release:** 1.14.0-beta.8 [skip ci] ([d639a9e](d639a9e9cc))
* **release:** 1.14.0-beta.9 [skip ci] ([2053693](2053693eba))
 2024-08-20 19:14:21 +00:00
Federico Aguzzi
76493d2fba
Merge pull request #565 from ScrapeGraphAI/pre/beta 
Merge pre/beta into main, release ScrapeGraphAI 1.14
 2024-08-20 21:12:57 +02:00
semantic-release-bot
f4dbe5b841 ci(release): 1.14.0-beta.13 [skip ci] 
## [1.14.0-beta.13](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.14.0-beta.12...v1.14.0-beta.13) (2024-08-20)

### Features

* add async call ([f60aa3a](f60aa3acde))
* refactoring of the code ([5eb3cff](5eb3cff64f))
 2024-08-20 09:35:21 +00:00
Marco Vinciguerra
860fde8a2c
Merge pull request #558 from ScrapeGraphAI/screenshot_scraper 
Screenshot scraper integration
 2024-08-20 11:33:51 +02:00
semantic-release-bot
fec358253b ci(release): 1.14.0-beta.12 [skip ci] 
## [1.14.0-beta.12](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.14.0-beta.11...v1.14.0-beta.12) (2024-08-20)

### Bug Fixes

* **SearchNode:** prompt ([052f7d5](052f7d5e66))
 2024-08-20 09:19:32 +00:00
Federico Aguzzi
0f7d4ac32f
Merge pull request #563 from portoaj/main 
Fixed search prompt
 2024-08-20 11:18:01 +02:00
Federico Aguzzi
d2486469af Merge branch 'pre/beta' into screenshot_scraper 2024-08-20 09:58:34 +02:00
Federico Aguzzi
052f7d5e66 fix(SearchNode): prompt 
Co-Authored-By: Andrew Masek <8219702+portoaj@users.noreply.github.com>
 2024-08-20 09:53:35 +02:00
Federico Aguzzi
dcd12d8815 Merge branch 'pre/beta' into pr/563 2024-08-20 09:51:06 +02:00
Andrew Masek
31931aa300 Make language more general 2024-08-19 20:39:49 -07:00
Andrew Masek
cb5ca90d73 Fixed search prompt 2024-08-19 20:21:50 -07:00
Marco Vinciguerra
fee77d1fe6 Update screenshot_scraper_graph.py
Some checks failed
/ build (push) Has been cancelled
Details
2024-08-19 14:35:13 +02:00
Marco Vinciguerra
f774fe40e5 add try catch and robust integration 2024-08-19 14:24:27 +02:00
semantic-release-bot
d61775090a ci(release): 1.14.0-beta.11 [skip ci] 
## [1.14.0-beta.11](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.14.0-beta.10...v1.14.0-beta.11) (2024-08-19)

### Features

* add structured output format ([7d2fc67](7d2fc672c8))
* **GenerateAnswerNode:** built-in structured output through LangChain ([d29338b](d29338b7c2))

### Bug Fixes

* **ParseNode:** leave room for LLM reply in context window ([683bf57](683bf57d89))
 2024-08-19 12:20:34 +00:00
Marco Vinciguerra
d1f6b9fa3b
Merge pull request #562 from ScrapeGraphAI/support_structured_output_shema_openai 
Support structured output shema openai
 2024-08-19 14:17:08 +02:00
Marco Vinciguerra
7d2fc672c8 feat: add structured output format 2024-08-19 14:15:54 +02:00
Federico Aguzzi
d29338b7c2 feat(GenerateAnswerNode): built-in structured output through LangChain
Some checks failed
/ build (push) Has been cancelled
Details 
Co-Authored-By: Marco Vinciguerra <88108002+VinciGit00@users.noreply.github.com>
 2024-08-19 13:45:37 +02:00
Federico Aguzzi
b48ee825ee Merge branch 'pre/beta' into support_structured_output_shema_openai 2024-08-19 13:31:01 +02:00
Federico Aguzzi
683bf57d89 fix(ParseNode): leave room for LLM reply in context window 2024-08-19 11:33:09 +02:00
semantic-release-bot
6a08cc8a43 ci(release): 1.14.0-beta.10 [skip ci] 
## [1.14.0-beta.10](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.14.0-beta.9...v1.14.0-beta.10) (2024-08-19)

### Features

* Implemented a filter logic in search_link_node.py ([08e9d9d](08e9d9d6a0))
 2024-08-19 09:30:45 +00:00
Marco Vinciguerra
352587eaf9
Merge pull request #561 from ekinsenler/pre/beta 
feat: Implemented a filter logic in search_link_node.py and added a dict entry for the Llama3.1:8b
 2024-08-19 11:29:22 +02:00
Marco Vinciguerra
f60aa3acde feat: add async call
Some checks are pending
/ build (push) Waiting to run
Details
2024-08-19 11:22:40 +02:00
ekinsenler
08e9d9d6a0 feat: Implemented a filter logic in search_link_node.py 
feat: Added dict entry for Llama3.1:8b
 2024-08-19 11:05:31 +03:00
Marco Vinciguerra
0bf79b5926 Update generate_answer_from_image_node.py
Some checks are pending
/ build (push) Waiting to run
Details
2024-08-19 02:21:45 +02:00
Marco Vinciguerra
79fa3f6bd6 add if and cool stuff 2024-08-19 02:01:41 +02:00
Marco Vinciguerra
c72c077eb6 refactoring of the nodes 2024-08-19 01:15:45 +02:00
Marco Vinciguerra
8d6c0b7288 Update generate_answer_node.py
Some checks failed
/ build (push) Has been cancelled
Details
Release / Build (push) Has been cancelled
Details
Release / Release (push) Has been cancelled
Details
2024-08-18 22:01:39 +02:00
Marco Vinciguerra
103c21c86e Update generate_answer_from_image_node.py 2024-08-18 20:54:35 +02:00
Marco Vinciguerra
5eb3cff64f feat: refactoring of the code 2024-08-18 20:53:35 +02:00
Marco Vinciguerra
8e3d5deaaa add screenshot scraper 2024-08-18 19:39:49 +02:00
Marco Vinciguerra
8b8d8f09b7 refactoring of the code according to pylint style
Some checks are pending
/ build (push) Waiting to run
Details
Release / Build (push) Waiting to run
Details
Release / Release (push) Blocked by required conditions
Details
2024-08-18 11:51:34 +02:00
Marco Vinciguerra
ebdb74967d add new model for gpt 2024-08-17 15:00:44 +02:00
Marco Vinciguerra
609316c8e7 Update abstract_graph.py
Some checks are pending
/ build (push) Waiting to run
Details
Release / Build (push) Waiting to run
Details
Release / Release (push) Blocked by required conditions
Details
2024-08-17 14:39:39 +02:00
Marco Vinciguerra
391d051a5e updated 2024-08-17 14:39:19 +02:00
semantic-release-bot
2053693eba ci(release): 1.14.0-beta.9 [skip ci] 
## [1.14.0-beta.9](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.14.0-beta.8...v1.14.0-beta.9) (2024-08-17)

### Features

* update model tokens dict ([0aca287](0aca28732b))
 2024-08-17 12:35:45 +00:00
Marco Vinciguerra
0aca28732b feat: update model tokens dict 2024-08-17 14:34:06 +02:00
Marco Vinciguerra
9098725adf Delete scrape_plain_text_llama3.1_test.py 2024-08-17 14:17:32 +02:00
Marco Vinciguerra
c2c2e6582f Update generate_answer_node.py 2024-08-17 13:30:44 +02:00
Marco Vinciguerra
c6edeeecb1 add new env
Some checks are pending
/ build (push) Waiting to run
Details
Release / Build (push) Waiting to run
Details
Release / Release (push) Blocked by required conditions
Details
2024-08-17 12:29:48 +02:00
semantic-release-bot
d639a9e9cc ci(release): 1.14.0-beta.8 [skip ci] 
## [1.14.0-beta.8](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.14.0-beta.7...v1.14.0-beta.8) (2024-08-17)

### Bug Fixes

* browser-base integration ([1d7f30b](1d7f30b65b))
 2024-08-17 10:22:28 +00:00
Marco Vinciguerra
f0587908e2 Merge branch 'pre/beta' of https://github.com/ScrapeGraphAI/Scrapegraph-ai into pre/beta 2024-08-17 12:21:03 +02:00
Marco Vinciguerra
1d7f30b65b fix: browser-base integration 2024-08-17 12:21:00 +02:00
Marco Vinciguerra
08782ff42d
Merge pull request #555 from ScrapeGraphAI/547-different-prompt_tokens-size-between-azure-openai-and-openai 
fix(FetchNode): add OpenAI markdown optimization to Azure
 2024-08-17 11:35:25 +02:00
Federico Aguzzi
5eed0a7654 fix(FetchNode) add OpenAI optimization to GPT models on Azure 
closes #547
 2024-08-17 10:33:54 +02:00
semantic-release-bot
a6fcc1ea58 ci(release): 1.14.0-beta.7 [skip ci] 
## [1.14.0-beta.7](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.14.0-beta.6...v1.14.0-beta.7) (2024-08-16)

### Bug Fixes

* model count ([faef318](faef3186f7))
 2024-08-16 15:40:26 +00:00