Commit Graph

1700 Commits

Author SHA1 Message Date
Santabot123
90d75498fc updated requirements.txt 2024-08-28 11:46:49 +03:00
Santabot123
aa9e85fdac remove some comments and image 2024-08-28 11:38:56 +03:00
Santabot123
0cf7c44409 correct the typo and updated select_area_with_ipywidget() 2024-08-26 14:51:28 +03:00
Santabot123
b4f8ea420b add __init__.py and docstrings 2024-08-26 13:53:19 +03:00
Santabot123
e11f0cd28d Added text_detection.py and updated screenshot_preparation.py 2024-08-24 18:40:54 +03:00
Santabot123
49ae56ceee Added screenshot preparation script for screenshot scraping 2024-08-23 19:00:14 +03:00
semantic-release-bot
06dc640d44 ci(release): 1.15.0-beta.1 [skip ci]
## [1.15.0-beta.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.14.1-beta.1...v1.15.0-beta.1) (2024-08-23)

### Features

* ligthweigthing the library ([62f32e9](62f32e994b))

### Bug Fixes

* Azure OpenAI issue ([a92b9c6](a92b9c6970))
2024-08-23 10:24:57 +00:00
Marco Vinciguerra
62f32e994b feat: ligthweigthing the library 2024-08-23 12:23:30 +02:00
Marco Vinciguerra
e0a5e731cf
Merge pull request #573 from ScrapeGraphAI/ligthweigthing_library
Ligthweigthing library
2024-08-23 12:22:45 +02:00
Marco Vinciguerra
26de5dd623
Merge branch 'pre/beta' into ligthweigthing_library 2024-08-23 12:22:31 +02:00
Marco Vinciguerra
f7ba1f30de refactoring of the code 2024-08-23 11:33:22 +02:00
Marco Vinciguerra
986c8a198c Update README.md 2024-08-22 11:18:36 +02:00
Marco Vinciguerra
77a6c929be Update pyproject.toml 2024-08-22 10:55:10 +02:00
Marco Vinciguerra
0d2b7b37e0 update dependenceis 2024-08-21 20:48:47 +02:00
Marco Vinciguerra
437e48f357
Merge pull request #567 from goasleep/feature/add_model_instance_info
Some checks failed
/ build (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
2024-08-21 14:17:51 +02:00
Marco Vinciguerra
117fca0b60
Merge pull request #571 from aziz-ullah-khan/pre/beta
Fix: Azure OpenAI issue
2024-08-21 13:37:26 +02:00
smith peng
a8ca1fc910 test:add moonshot example 2024-08-21 19:31:27 +08:00
aziz-ullah-khan
a92b9c6970 Fix: Azure OpenAI issue 2024-08-21 16:18:51 +05:00
smith peng
cb3f191d18 test:add model instance example 2024-08-21 18:54:54 +08:00
semantic-release-bot
1b488715e6 ci(release): 1.14.1-beta.1 [skip ci]
## [1.14.1-beta.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.14.0...v1.14.1-beta.1) (2024-08-21)

### Bug Fixes

* **models_tokens:** add llama2 and llama3 sizes explicitly ([b05ec16](b05ec16b25))
2024-08-21 07:34:37 +00:00
Federico Aguzzi
b05ec16b25 fix(models_tokens): add llama2 and llama3 sizes explicitly 2024-08-21 09:32:59 +02:00
Federico Aguzzi
dd406dff0c style(models_tokens): enforce formatting 2024-08-21 09:29:38 +02:00
FENG PENG
4a9d849632 docs:adjust llm doc explanation 2024-08-21 10:11:34 +08:00
FENG PENG
0fbb4e3de9 docs:add other llm models used 2024-08-21 09:40:47 +08:00
semantic-release-bot
5e31b06a7d ci(release): 1.14.0 [skip ci]
## [1.14.0](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.13.3...v1.14.0) (2024-08-20)

### Features

* add async call ([f60aa3a](f60aa3acde))
* add integration for new module of gpt4o ([982150e](982150e81f))
* Add new feature to support gpt-4o variant models with different pricing ([8551448](855144876d))
* add refactoring of default temperature ([6c3b37a](6c3b37ab00))
* add structured output format ([7d2fc67](7d2fc672c8))
* **GenerateAnswerNode:** built-in structured output through LangChain ([d29338b](d29338b7c2))
* Implemented a filter logic in search_link_node.py ([08e9d9d](08e9d9d6a0))
* refactoring of the code ([5eb3cff](5eb3cff64f))
* update abstract graph ([c77231c](c77231c983))
* update model tokens dict ([0aca287](0aca28732b))

### Bug Fixes

* broken node ([1272273](1272273499))
* browser-base integration ([1d7f30b](1d7f30b65b))
* **models_tokens:** incorrect provider names ([cb6b353](cb6b35397e))
* **ParseNode:** leave room for LLM reply in context window ([683bf57](683bf57d89))
* merge_anwser prompt import ([f17cef9](f17cef94bb))
* model count ([faef318](faef3186f7))
* **AbstractGraph:** pass kwargs to Ernie and Nvidia models ([e6bedb6](e6bedb6701))
* **SearchNode:** prompt ([052f7d5](052f7d5e66))

### chore

* **examples:** add vertex examples, rename genai examples ([1aa9c6e](1aa9c6e73b))
* **examples:** fix import bug in image2text demo ([71438a1](71438a1e86))
* **examples:** update provider names to match tokens dictionary ([ee078cb](ee078cb102))
* **requirements:** update requirements.txt ([7fe181f](7fe181f69b))

### CI

* **release:** 1.13.0-beta.8 [skip ci] ([b470d97](b470d974cf))
* **release:** 1.13.0-beta.9 [skip ci] ([d4c1a1c](d4c1a1c58a))
* **release:** 1.14.0-beta.1 [skip ci] ([40043f3](40043f376e))
* **release:** 1.14.0-beta.10 [skip ci] ([6a08cc8](6a08cc8a43))
* **release:** 1.14.0-beta.11 [skip ci] ([d617750](d61775090a))
* **release:** 1.14.0-beta.12 [skip ci] ([fec3582](fec358253b))
* **release:** 1.14.0-beta.13 [skip ci] ([f4dbe5b](f4dbe5b841))
* **release:** 1.14.0-beta.2 [skip ci] ([7fd921b](7fd921b990))
* **release:** 1.14.0-beta.3 [skip ci] ([3bf9c3c](3bf9c3c9e6))
* **release:** 1.14.0-beta.4 [skip ci] ([7af1e45](7af1e45565))
* **release:** 1.14.0-beta.5 [skip ci] ([db3494d](db3494d377))
* **release:** 1.14.0-beta.6 [skip ci] ([6730797](6730797008))
* **release:** 1.14.0-beta.7 [skip ci] ([a6fcc1e](a6fcc1ea58))
* **release:** 1.14.0-beta.8 [skip ci] ([d639a9e](d639a9e9cc))
* **release:** 1.14.0-beta.9 [skip ci] ([2053693](2053693eba))
2024-08-20 19:14:21 +00:00
Federico Aguzzi
76493d2fba
Merge pull request #565 from ScrapeGraphAI/pre/beta
Merge pre/beta into main, release ScrapeGraphAI 1.14
2024-08-20 21:12:57 +02:00
semantic-release-bot
f4dbe5b841 ci(release): 1.14.0-beta.13 [skip ci]
## [1.14.0-beta.13](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.14.0-beta.12...v1.14.0-beta.13) (2024-08-20)

### Features

* add async call ([f60aa3a](f60aa3acde))
* refactoring of the code ([5eb3cff](5eb3cff64f))
2024-08-20 09:35:21 +00:00
Marco Vinciguerra
860fde8a2c
Merge pull request #558 from ScrapeGraphAI/screenshot_scraper
Screenshot scraper integration
2024-08-20 11:33:51 +02:00
semantic-release-bot
fec358253b ci(release): 1.14.0-beta.12 [skip ci]
## [1.14.0-beta.12](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.14.0-beta.11...v1.14.0-beta.12) (2024-08-20)

### Bug Fixes

* **SearchNode:** prompt ([052f7d5](052f7d5e66))
2024-08-20 09:19:32 +00:00
Federico Aguzzi
0f7d4ac32f
Merge pull request #563 from portoaj/main
Fixed search prompt
2024-08-20 11:18:01 +02:00
Federico Aguzzi
d2486469af Merge branch 'pre/beta' into screenshot_scraper 2024-08-20 09:58:34 +02:00
Federico Aguzzi
052f7d5e66 fix(SearchNode): prompt
Co-Authored-By: Andrew Masek <8219702+portoaj@users.noreply.github.com>
2024-08-20 09:53:35 +02:00
Federico Aguzzi
dcd12d8815 Merge branch 'pre/beta' into pr/563 2024-08-20 09:51:06 +02:00
Andrew Masek
31931aa300 Make language more general 2024-08-19 20:39:49 -07:00
Andrew Masek
cb5ca90d73 Fixed search prompt 2024-08-19 20:21:50 -07:00
Marco Vinciguerra
fee77d1fe6 Update screenshot_scraper_graph.py
Some checks failed
/ build (push) Has been cancelled
2024-08-19 14:35:13 +02:00
Marco Vinciguerra
f774fe40e5 add try catch and robust integration 2024-08-19 14:24:27 +02:00
semantic-release-bot
d61775090a ci(release): 1.14.0-beta.11 [skip ci]
## [1.14.0-beta.11](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.14.0-beta.10...v1.14.0-beta.11) (2024-08-19)

### Features

* add structured output format ([7d2fc67](7d2fc672c8))
* **GenerateAnswerNode:** built-in structured output through LangChain ([d29338b](d29338b7c2))

### Bug Fixes

* **ParseNode:** leave room for LLM reply in context window ([683bf57](683bf57d89))
2024-08-19 12:20:34 +00:00
Marco Vinciguerra
d1f6b9fa3b
Merge pull request #562 from ScrapeGraphAI/support_structured_output_shema_openai
Support structured output shema openai
2024-08-19 14:17:08 +02:00
Marco Vinciguerra
7d2fc672c8 feat: add structured output format 2024-08-19 14:15:54 +02:00
Federico Aguzzi
d29338b7c2 feat(GenerateAnswerNode): built-in structured output through LangChain
Some checks failed
/ build (push) Has been cancelled
Co-Authored-By: Marco Vinciguerra <88108002+VinciGit00@users.noreply.github.com>
2024-08-19 13:45:37 +02:00
Federico Aguzzi
b48ee825ee Merge branch 'pre/beta' into support_structured_output_shema_openai 2024-08-19 13:31:01 +02:00
Federico Aguzzi
683bf57d89 fix(ParseNode): leave room for LLM reply in context window 2024-08-19 11:33:09 +02:00
semantic-release-bot
6a08cc8a43 ci(release): 1.14.0-beta.10 [skip ci]
## [1.14.0-beta.10](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.14.0-beta.9...v1.14.0-beta.10) (2024-08-19)

### Features

* Implemented a filter logic in search_link_node.py ([08e9d9d](08e9d9d6a0))
2024-08-19 09:30:45 +00:00
Marco Vinciguerra
352587eaf9
Merge pull request #561 from ekinsenler/pre/beta
feat: Implemented a filter logic in search_link_node.py and added a dict entry for the Llama3.1:8b
2024-08-19 11:29:22 +02:00
Marco Vinciguerra
f60aa3acde feat: add async call
Some checks are pending
/ build (push) Waiting to run
2024-08-19 11:22:40 +02:00
ekinsenler
08e9d9d6a0 feat: Implemented a filter logic in search_link_node.py
feat: Added dict entry for Llama3.1:8b
2024-08-19 11:05:31 +03:00
Marco Vinciguerra
0bf79b5926 Update generate_answer_from_image_node.py
Some checks are pending
/ build (push) Waiting to run
2024-08-19 02:21:45 +02:00
Marco Vinciguerra
79fa3f6bd6 add if and cool stuff 2024-08-19 02:01:41 +02:00
Marco Vinciguerra
c72c077eb6 refactoring of the nodes 2024-08-19 01:15:45 +02:00