Commit Graph

515 Commits

Author SHA1 Message Date
Marco Vinciguerra
cec5537f2a add new tests
Some checks are pending
/ build (push) Waiting to run
Release / Build (push) Waiting to run
Release / Release (push) Blocked by required conditions
Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>
2024-08-11 17:10:55 +02:00
semantic-release-bot
40043f376e ci(release): 1.14.0-beta.1 [skip ci]
## [1.14.0-beta.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.13.3...v1.14.0-beta.1) (2024-08-11)

### Features

* add refactoring of default temperature ([6c3b37a](6c3b37ab00))

### Bug Fixes

* broken node ([1272273](1272273499))
* merge_anwser prompt import ([f17cef9](f17cef94bb))

### CI

* **release:** 1.13.0-beta.8 [skip ci] ([b470d97](b470d974cf))
* **release:** 1.13.0-beta.9 [skip ci] ([d4c1a1c](d4c1a1c58a))
2024-08-11 11:54:22 +00:00
Matteo Vedovati
9814b6dd85 fixed versioning errors 2024-08-11 10:04:15 +02:00
Marco Vinciguerra
0cda020d48
Merge branch 'pre/beta' into temp 2024-08-10 17:45:52 +02:00
semantic-release-bot
d4c1a1c58a ci(release): 1.13.0-beta.9 [skip ci]
## [1.13.0-beta.9](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.13.0-beta.8...v1.13.0-beta.9) (2024-08-10)

### Features

* add refactoring of default temperature ([6c3b37a](6c3b37ab00))
2024-08-10 10:34:05 +00:00
semantic-release-bot
2333b513aa ci(release): 1.13.3 [skip ci]
## [1.13.3](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.13.2...v1.13.3) (2024-08-10)

### Bug Fixes

* conditional node ([778efd4](778efd4c87))
2024-08-10 10:22:36 +00:00
semantic-release-bot
b7f64b6fe1 ci(release): 1.13.2 [skip ci]
## [1.13.2](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.13.1...v1.13.2) (2024-08-10)

### Bug Fixes

* fetch node ([f01b55e](f01b55e89b))

### chore

* update gemini model to "gemini-pro" ([a7264ce](a7264cebd2))
2024-08-10 09:43:09 +00:00
semantic-release-bot
24e70d5b08 ci(release): 1.13.1 [skip ci]
## [1.13.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.13.0...v1.13.1) (2024-08-09)

### Bug Fixes

* conditional node ([ce00345](ce00345495))
2024-08-09 21:40:24 +00:00
semantic-release-bot
b470d974cf ci(release): 1.13.0-beta.8 [skip ci]
## [1.13.0-beta.8](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.13.0-beta.7...v1.13.0-beta.8) (2024-08-09)

### Bug Fixes

* broken node ([1272273](1272273499))
2024-08-09 15:37:24 +00:00
semantic-release-bot
78593e303a ci(release): 1.13.0 [skip ci]
## [1.13.0](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.12.2...v1.13.0) (2024-08-09)

### Features

* add grok integration ([fa651d4](fa651d4cd9))
* add mistral support ([17f2707](17f2707313))
* update base_graph ([0571b6d](0571b6da55))

### Bug Fixes

* **chunking:** count tokens from words instead of characters ([5ec2de9](5ec2de9e1a)), closes [#513](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/513)
* **FetchNode:** handling of missing browser_base key ([07720b6](07720b6e0c))
* **AbstractGraph:** LangChain warnings handling, Mistral tokens ([786af99](786af992f8))
* **FetchNode:** missing bracket syntax error ([50edbcc](50edbcc7f8))
* refactoring of fetch_node ([29ad140](29ad140fa3))
* refactoring of fetch_node adding comment ([bfc6852](bfc6852b77))
* refactoring of fetch_node qixed error ([1ea2ad8](1ea2ad8e79))
* refactoring of merge_answer_node ([898e5a7](898e5a7af5))

### chore

* **models_tokens:** add mistral models ([5e82432](5e824327c3))
* **mistral:** create examples ([f8ad616](f8ad616e10))
* **examples:** fix Mistral examples ([b0ffc51](b0ffc51e54))
* update requirements for mistral ([9868555](9868555123))

### CI

* **release:** 1.11.0-beta.11 [skip ci] ([579d3f3](579d3f394b))
* **release:** 1.11.0-beta.12 [skip ci] ([cf2a17e](cf2a17ed5d))
* **release:** 1.13.0-beta.1 [skip ci] ([8eb66f6](8eb66f6e22))
* **release:** 1.13.0-beta.2 [skip ci] ([684d01a](684d01a2cb))
* **release:** 1.13.0-beta.3 [skip ci] ([6b053cf](6b053cfc95))
* **release:** 1.13.0-beta.4 [skip ci] ([7f1f750](7f1f7503f7))
* **release:** 1.13.0-beta.5 [skip ci] ([2eba73b](2eba73b784)), closes [#513](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/513)
* **release:** 1.13.0-beta.6 [skip ci] ([e75b574](e75b574b67))
* **release:** 1.13.0-beta.7 [skip ci] ([6e56925](6e56925355))
2024-08-09 08:51:37 +00:00
semantic-release-bot
6e56925355 ci(release): 1.13.0-beta.7 [skip ci]
## [1.13.0-beta.7](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.13.0-beta.6...v1.13.0-beta.7) (2024-08-09)

### Bug Fixes

* generate answer node omni ([b52e4a3](b52e4a390b))
* generate answer node pdf has a bug ([625ca9f](625ca9f22a))

### CI

* **release:** 1.12.1 [skip ci] ([928f704](928f7040ab))
* **release:** 1.12.2 [skip ci] ([ece605e](ece605e3ee))
2024-08-09 08:33:21 +00:00
Marco Vinciguerra
157d59d5c0
Merge branch 'pre/beta' into temp 2024-08-09 10:28:59 +02:00
semantic-release-bot
e75b574b67 ci(release): 1.13.0-beta.6 [skip ci]
## [1.13.0-beta.6](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.13.0-beta.5...v1.13.0-beta.6) (2024-08-09)

### Bug Fixes

* **FetchNode:** missing bracket syntax error ([50edbcc](50edbcc7f8))
2024-08-09 07:39:44 +00:00
semantic-release-bot
2eba73b784 ci(release): 1.13.0-beta.5 [skip ci]
## [1.13.0-beta.5](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.13.0-beta.4...v1.13.0-beta.5) (2024-08-08)

### Bug Fixes

* **chunking:** count tokens from words instead of characters ([5ec2de9](5ec2de9e1a)), closes [#513](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/513)
2024-08-08 09:00:17 +00:00
semantic-release-bot
7f1f7503f7 ci(release): 1.13.0-beta.4 [skip ci]
## [1.13.0-beta.4](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.13.0-beta.3...v1.13.0-beta.4) (2024-08-07)

### Bug Fixes

* refactoring of merge_answer_node ([898e5a7](898e5a7af5))
2024-08-07 19:51:52 +00:00
semantic-release-bot
6b053cfc95 ci(release): 1.13.0-beta.3 [skip ci]
## [1.13.0-beta.3](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.13.0-beta.2...v1.13.0-beta.3) (2024-08-07)

### Features

* add mistral support ([17f2707](17f2707313))

### Bug Fixes

* **FetchNode:** handling of missing browser_base key ([07720b6](07720b6e0c))
* **AbstractGraph:** LangChain warnings handling, Mistral tokens ([786af99](786af992f8))

### chore

* **models_tokens:** add mistral models ([5e82432](5e824327c3))
* **mistral:** create examples ([f8ad616](f8ad616e10))
* **examples:** fix Mistral examples ([b0ffc51](b0ffc51e54))
* update requirements for mistral ([9868555](9868555123))
2024-08-07 19:29:18 +00:00
Marco Vinciguerra
b6bff0be33
Merge branch 'pre/beta' into mistral-ai-integration 2024-08-07 21:24:18 +02:00
semantic-release-bot
ece605e3ee ci(release): 1.12.2 [skip ci]
## [1.12.2](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.12.1...v1.12.2) (2024-08-07)

### Bug Fixes

* generate answer node omni ([b52e4a3](b52e4a390b))
2024-08-07 12:11:25 +00:00
semantic-release-bot
928f7040ab ci(release): 1.12.1 [skip ci]
## [1.12.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.12.0...v1.12.1) (2024-08-07)

### Bug Fixes

* generate answer node pdf has a bug ([625ca9f](625ca9f22a))
2024-08-07 12:08:26 +00:00
semantic-release-bot
684d01a2cb ci(release): 1.13.0-beta.2 [skip ci]
## [1.13.0-beta.2](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.13.0-beta.1...v1.13.0-beta.2) (2024-08-07)

### Bug Fixes

* refactoring of fetch_node ([29ad140](29ad140fa3))
* refactoring of fetch_node adding comment ([bfc6852](bfc6852b77))
* refactoring of fetch_node qixed error ([1ea2ad8](1ea2ad8e79))
2024-08-07 11:55:13 +00:00
Federico Aguzzi
9868555123 chore: update requirements for mistral 2024-08-06 17:23:56 +02:00
semantic-release-bot
8eb66f6e22 ci(release): 1.13.0-beta.1 [skip ci]
## [1.13.0-beta.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.12.0...v1.13.0-beta.1) (2024-08-06)

### Features

* add grok integration ([fa651d4](fa651d4cd9))
* update base_graph ([0571b6d](0571b6da55))

### CI

* **release:** 1.11.0-beta.11 [skip ci] ([579d3f3](579d3f394b))
* **release:** 1.11.0-beta.12 [skip ci] ([cf2a17e](cf2a17ed5d))
2024-08-06 14:52:44 +00:00
Federico Aguzzi
bc9e70031f Merge branch 'main' into pre/beta 2024-08-06 16:50:46 +02:00
semantic-release-bot
4c723858e6 ci(release): 1.12.0 [skip ci]
## [1.12.0](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.11.3...v1.12.0) (2024-08-06)

### Features

* add generate_answer node paralellization ([0c4b290](0c4b2908d9))
* add integration in the abstract grapgh ([5ecdbe7](5ecdbe715f))
* fix tests ([1db164e](1db164e9e6))
* intregration of firebase ([4caed54](4caed545e5))
* pdate models_tokens.py ([377d679](377d679eec))
* refactoring of the code ([9355507](9355507a2d))

### Bug Fixes

* abstract_graph and removed unused embeddings ([0b4cfd6](0b4cfd6522))
* add llama 3.1 ([f336c95](f336c95c2d))
* fixed bug on fetch_node ([968c69e](968c69e217))
* **AbstractGraph:** instantiation of Azure GPT models ([ade28fc](ade28fca2c)), closes [#498](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/498)
* pyproject.toml ([e90fad4](e90fad44ce))
* rebuild pyproject, requirements and lockfiles ([1193984](1193984434))

### chore

* rebuild requirements ([2edad66](2edad66788))
* remove unused import ([88710f1](88710f1a7c))
* set dependency version for vertexai ([971cc2d](971cc2da04))
* update pyproject, rebuild lockfiles ([d6312bf](d6312bfc9b))

### Refactor

* **Ollama:** integrate new LangChain chat init ([d177afb](d177afb68b))
* **OpenAI:** integrate new LangChain chat init ([5e3eb6e](5e3eb6e43d))
* move embeddings code from AbstractGraph to RAGNode ([a94ebcd](a94ebcde00))
* remove LangChain wrappers ([2c5f934](2c5f934f10))
* remove LangChain wrappers for Ollama ([25066b2](25066b2bc5))
* remove redundant LangChain wrappers ([9275486](9275486240))
* remove redundant wrappers for Ernie and Nvidia ([bc2c996](bc2c9967d2))
* reuse code for common interface models ([bb73d91](bb73d916a1))

### CI

* **release:** 1.11.0-beta.1 [skip ci] ([7080a0a](7080a0afd5))
* **release:** 1.11.0-beta.10 [skip ci] ([ee30a83](ee30a83f8a)), closes [#498](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/498)
* **release:** 1.11.0-beta.2 [skip ci] ([bf6d487](bf6d487bbb))
* **release:** 1.11.0-beta.3 [skip ci] ([66f9421](66f9421fc2))
* **release:** 1.11.0-beta.4 [skip ci] ([51db43a](51db43a129))
* **release:** 1.11.0-beta.5 [skip ci] ([b15fd9f](b15fd9f4dc))
* **release:** 1.11.0-beta.6 [skip ci] ([74ed8d0](74ed8d06c5))
* **release:** 1.11.0-beta.7 [skip ci] ([55f706f](55f706f3d5))
* **release:** 1.11.0-beta.8 [skip ci] ([3e07f62](3e07f6273f))
* **release:** 1.11.0-beta.9 [skip ci] ([4440790](4440790f00))
2024-08-06 14:36:55 +00:00
Federico Aguzzi
1193984434 fix: rebuild pyproject, requirements and lockfiles 2024-08-06 16:33:56 +02:00
semantic-release-bot
cf2a17ed5d ci(release): 1.11.0-beta.12 [skip ci]
## [1.11.0-beta.12](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.11.0-beta.11...v1.11.0-beta.12) (2024-08-06)

### Features

* add grok integration ([fa651d4](fa651d4cd9))
2024-08-06 13:19:46 +00:00
semantic-release-bot
579d3f394b ci(release): 1.11.0-beta.11 [skip ci]
## [1.11.0-beta.11](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.11.0-beta.10...v1.11.0-beta.11) (2024-08-06)

### Features

* update base_graph ([0571b6d](0571b6da55))
2024-08-06 12:03:17 +00:00
Marco Vinciguerra
e90fad44ce fix: pyproject.toml
Some checks failed
CodeQL / Analyze (python) (push) Has been cancelled
/ build (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
2024-08-06 10:10:38 +02:00
Marco Vinciguerra
886bab78e7
Merge branch 'main' into temp-1 2024-08-06 10:04:57 +02:00
semantic-release-bot
ee30a83f8a ci(release): 1.11.0-beta.10 [skip ci]
## [1.11.0-beta.10](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.11.0-beta.9...v1.11.0-beta.10) (2024-08-02)

### Bug Fixes

* **AbstractGraph:** instantiation of Azure GPT models ([ade28fc](ade28fca2c)), closes [#498](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/498)
2024-08-02 12:33:59 +00:00
semantic-release-bot
4440790f00 ci(release): 1.11.0-beta.9 [skip ci]
## [1.11.0-beta.9](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.11.0-beta.8...v1.11.0-beta.9) (2024-08-02)

### Features

* refactoring of the code ([9355507](9355507a2d))
2024-08-02 10:01:32 +00:00
semantic-release-bot
3e07f6273f ci(release): 1.11.0-beta.8 [skip ci]
## [1.11.0-beta.8](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.11.0-beta.7...v1.11.0-beta.8) (2024-08-01)

### Features

* add integration in the abstract grapgh ([5ecdbe7](5ecdbe715f))

### Bug Fixes

* fixed bug on fetch_node ([968c69e](968c69e217))
2024-08-01 13:17:34 +00:00
semantic-release-bot
55f706f3d5 ci(release): 1.11.0-beta.7 [skip ci]
## [1.11.0-beta.7](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.11.0-beta.6...v1.11.0-beta.7) (2024-08-01)

### Bug Fixes

* abstract_graph and removed unused embeddings ([0b4cfd6](0b4cfd6522))

### Refactor

* move embeddings code from AbstractGraph to RAGNode ([a94ebcd](a94ebcde00))
* reuse code for common interface models ([bb73d91](bb73d916a1))
2024-08-01 12:53:01 +00:00
semantic-release-bot
74ed8d06c5 ci(release): 1.11.0-beta.6 [skip ci]
## [1.11.0-beta.6](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.11.0-beta.5...v1.11.0-beta.6) (2024-07-31)

### Features

* intregration of firebase ([4caed54](4caed545e5))
2024-07-31 17:51:22 +00:00
Marco Vinciguerra
4caed545e5 feat: intregration of firebase 2024-07-31 19:49:59 +02:00
semantic-release-bot
b15fd9f4dc ci(release): 1.11.0-beta.5 [skip ci]
## [1.11.0-beta.5](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.11.0-beta.4...v1.11.0-beta.5) (2024-07-30)

### Features

* fix tests ([1db164e](1db164e9e6))

### chore

* remove unused import ([88710f1](88710f1a7c))

### Refactor

* **Ollama:** integrate new LangChain chat init ([d177afb](d177afb68b))
* **OpenAI:** integrate new LangChain chat init ([5e3eb6e](5e3eb6e43d))
* remove LangChain wrappers ([2c5f934](2c5f934f10))
* remove LangChain wrappers for Ollama ([25066b2](25066b2bc5))
* remove redundant LangChain wrappers ([9275486](9275486240))
* remove redundant wrappers for Ernie and Nvidia ([bc2c996](bc2c9967d2))
2024-07-30 14:19:46 +00:00
Federico Aguzzi
9275486240 refactor: remove redundant LangChain wrappers
Some checks are pending
/ build (push) Waiting to run
2024-07-29 21:59:39 +02:00
Federico Aguzzi
2edf5a6e85
Merge branch 'main' into temp
Some checks failed
/ build (push) Has been cancelled
2024-07-25 11:57:55 +02:00
Federico Aguzzi
52643d52d0 Merge branch 'main' into temp 2024-07-25 11:53:34 +02:00
semantic-release-bot
51db43a129 ci(release): 1.11.0-beta.4 [skip ci]
## [1.11.0-beta.4](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.11.0-beta.3...v1.11.0-beta.4) (2024-07-25)

### Features

* add generate_answer node paralellization ([0c4b290](0c4b2908d9))

### chore

* rebuild requirements ([2edad66](2edad66788))
2024-07-25 09:50:57 +00:00
Federico Aguzzi
d745564ad1
Merge pull request #485 from ScrapeGraphAI/generate_answer_parallel
merge: generate answer parallel
2024-07-25 11:49:43 +02:00
semantic-release-bot
a7359753d3 ci(release): 1.11.3 [skip ci]
## [1.11.3](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.11.2...v1.11.3) (2024-07-25)

### Bug Fixes

* add llama 3.1 ([f872bdd](f872bdd24f))

### Docs

* prev version ([5c08eea](5c08eea189))
2024-07-25 07:19:01 +00:00
semantic-release-bot
66f9421fc2 ci(release): 1.11.0-beta.3 [skip ci]
## [1.11.0-beta.3](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.11.0-beta.2...v1.11.0-beta.3) (2024-07-25)

### Bug Fixes

* add llama 3.1 ([f336c95](f336c95c2d))
2024-07-25 07:18:11 +00:00
Marco Perini
5c08eea189 docs: prev version
Some checks failed
CodeQL / Analyze (python) (push) Has been cancelled
/ build (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
2024-07-24 23:37:57 +02:00
semantic-release-bot
bf6d487bbb ci(release): 1.11.0-beta.2 [skip ci]
## [1.11.0-beta.2](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.11.0-beta.1...v1.11.0-beta.2) (2024-07-24)

### Features

* pdate models_tokens.py ([377d679](377d679eec))
2024-07-24 13:19:41 +00:00
Marco Vinciguerra
e08b30495d boh
Some checks are pending
CodeQL / Analyze (python) (push) Waiting to run
/ build (push) Waiting to run
Release / Build (push) Waiting to run
Release / Release (push) Blocked by required conditions
2024-07-24 14:33:55 +02:00
Federico Aguzzi
971cc2da04 chore: set dependency version for vertexai 2024-07-23 20:57:11 +02:00
Federico Aguzzi
ddbfbe1205 Merge branch 'pre/beta' into generate_answer_parallel 2024-07-23 20:51:35 +02:00
semantic-release-bot
72ee93a8fe ci(release): 1.11.2 [skip ci]
## [1.11.2](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.11.1...v1.11.2) (2024-07-23)

### Bug Fixes

* md conversion ([1d41f6e](1d41f6eafe))
2024-07-23 17:28:58 +00:00
semantic-release-bot
a711186a0c ci(release): 1.11.1 [skip ci]
## [1.11.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.11.0...v1.11.1) (2024-07-23)

### Bug Fixes

* md conversion ([5a45e9f](5a45e9f2d8))
2024-07-23 16:10:40 +00:00
semantic-release-bot
90347ff870 ci(release): 1.11.0 [skip ci]
## [1.11.0](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.10.4...v1.11.0) (2024-07-23)

### Features

* add new toml ([fcb3220](fcb3220868))
* add nvidia connection ([fc0dadb](fc0dadb8f8))

### Bug Fixes

* **md_conversion:** add absolute links md, added missing dependency ([12b5ead](12b5eada6e))

### chore

* **dependecies:** add script to auto-update requirements ([3289c7b](3289c7bf5e))
* **ci:** set up workflow for requirements auto-update ([295fc28](295fc28ceb))
* update requirements.txt ([c7bac98](c7bac98d2e))
* upgrade dependencies and scripts ([74d142e](74d142eaae))
* **pyproject:** upgrade dependencies ([0425124](0425124c57))

### Docs

* add hero image ([4182e23](4182e23e3b))
* updated readme ([c377ae0](c377ae0544))

### CI

* **release:** 1.10.0-beta.6 [skip ci] ([254bde7](254bde7008))
* **release:** 1.10.0-beta.7 [skip ci] ([1756e85](1756e8522f))
* **release:** 1.10.0-beta.8 [skip ci] ([255e569](255e569172))
2024-07-23 14:16:04 +00:00
semantic-release-bot
7080a0afd5 ci(release): 1.11.0-beta.1 [skip ci]
## [1.11.0-beta.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.10.4...v1.11.0-beta.1) (2024-07-23)

### Features

* add new toml ([fcb3220](fcb3220868))
* add nvidia connection ([fc0dadb](fc0dadb8f8))

### Bug Fixes

* **md_conversion:** add absolute links md, added missing dependency ([12b5ead](12b5eada6e))

### chore

* **dependecies:** add script to auto-update requirements ([3289c7b](3289c7bf5e))
* **ci:** set up workflow for requirements auto-update ([295fc28](295fc28ceb))
* update requirements.txt ([c7bac98](c7bac98d2e))
* upgrade dependencies and scripts ([74d142e](74d142eaae))
* **pyproject:** upgrade dependencies ([0425124](0425124c57))

### Docs

* add hero image ([4182e23](4182e23e3b))
* updated readme ([c377ae0](c377ae0544))

### CI

* **release:** 1.10.0-beta.6 [skip ci] ([254bde7](254bde7008))
* **release:** 1.10.0-beta.7 [skip ci] ([1756e85](1756e8522f))
* **release:** 1.10.0-beta.8 [skip ci] ([255e569](255e569172))
2024-07-23 14:15:37 +00:00
Marco Perini
49b6468fb1
Merge branch 'main' into pre/beta 2024-07-23 16:14:15 +02:00
Marco Perini
639b67ca87
Update pyproject.toml 2024-07-23 15:48:05 +02:00
Marco Perini
b7eae91246
Update pyproject.toml 2024-07-23 15:47:26 +02:00
Marco Perini
0ebc387446
Merge pull request #487 from ScrapeGraphAI/update-generate-answer-node
Update generate answer node
2024-07-23 15:45:20 +02:00
semantic-release-bot
255e569172 ci(release): 1.10.0-beta.8 [skip ci]
## [1.10.0-beta.8](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.10.0-beta.7...v1.10.0-beta.8) (2024-07-23)

### Bug Fixes

* **md_conversion:** add absolute links md, added missing dependency ([12b5ead](12b5eada6e))
2024-07-23 13:35:30 +00:00
Marco Perini
12b5eada6e
fix(md_conversion): add absolute links md, added missing dependency 2024-07-23 15:34:12 +02:00
Marco Vinciguerra
8dd941e39e update generate answer nodes
Co-Authored-By: Federico Aguzzi <62149513+f-aguzzi@users.noreply.github.com>
2024-07-23 12:40:11 +02:00
Federico Aguzzi
d6312bfc9b chore: update pyproject, rebuild lockfiles 2024-07-23 11:46:37 +02:00
semantic-release-bot
1756e8522f ci(release): 1.10.0-beta.7 [skip ci]
## [1.10.0-beta.7](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.10.0-beta.6...v1.10.0-beta.7) (2024-07-23)

### Features

* add nvidia connection ([fc0dadb](fc0dadb8f8))

### chore

* **dependecies:** add script to auto-update requirements ([3289c7b](3289c7bf5e))
* **ci:** set up workflow for requirements auto-update ([295fc28](295fc28ceb))
* update requirements.txt ([c7bac98](c7bac98d2e))
2024-07-23 08:59:14 +00:00
Federico Aguzzi
72ff20d34c Merge branch 'pre/beta' into 479-using-nemotron-from-nvidia 2024-07-23 10:54:38 +02:00
Marco Vinciguerra
d3ae39625c Update pyproject.toml
Co-Authored-By: Federico Minutoli <40361744+DiTo97@users.noreply.github.com>
2024-07-22 20:22:02 +02:00
Federico Aguzzi
74d142eaae chore: upgrade dependencies and scripts
Some checks failed
CodeQL / Analyze (python) (push) Has been cancelled
/ build (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
2024-07-22 18:32:32 +02:00
Marco Vinciguerra
2ae19aee56 update function 2024-07-22 16:50:58 +02:00
semantic-release-bot
09f983b14f ci(release): 1.10.4 [skip ci]
## [1.10.4](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.10.3...v1.10.4) (2024-07-22)

### Bug Fixes

* parse node ([09256f7](09256f7b11))
2024-07-22 14:16:55 +00:00
semantic-release-bot
23b923c18e ci(release): 1.10.3 [skip ci]
## [1.10.3](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.10.2...v1.10.3) (2024-07-22)

### Bug Fixes

* parse_html node have a bug ([71f894e](71f894eee3))
2024-07-22 14:02:44 +00:00
Federico Aguzzi
3289c7bf5e chore(dependecies): add script to auto-update requirements 2024-07-22 13:18:17 +02:00
semantic-release-bot
254bde7008 ci(release): 1.10.0-beta.6 [skip ci]
## [1.10.0-beta.6](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.10.0-beta.5...v1.10.0-beta.6) (2024-07-22)

### Features

* add new toml ([fcb3220](fcb3220868))

### chore

* **pyproject:** upgrade dependencies ([0425124](0425124c57))

### Docs

* **gpt-4o-mini:** added new gpt, fixed chromium lazy loading, ([99dc849](99dc8497d8))
2024-07-22 11:07:52 +00:00
Federico Aguzzi
0425124c57 chore(pyproject): upgrade dependencies 2024-07-22 12:58:18 +02:00
Marco Vinciguerra
fc0dadb8f8 feat: add nvidia connection 2024-07-22 11:56:33 +02:00
semantic-release-bot
da451e5f16 ci(release): 1.10.2 [skip ci]
## [1.10.2](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.10.1...v1.10.2) (2024-07-21)

### Bug Fixes

* telemetry version ([b0418b6](b0418b679c))
2024-07-21 17:25:05 +00:00
semantic-release-bot
03f528a34e ci(release): 1.10.1 [skip ci]
## [1.10.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.10.0...v1.10.1) (2024-07-21)

### Bug Fixes

* abstract_graph moel token bug ([ce6be37](ce6be37fbc))
2024-07-21 16:38:44 +00:00
semantic-release-bot
3a46e72681 ci(release): 1.10.0 [skip ci]
## [1.10.0](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.9.2...v1.10.0) (2024-07-20)

### Features

* add gpt4o omni ([431edb7](431edb7bb2))
* add searchngx integration ([5c92186](5c92186081))
* refactoring_to_md function ([602dd00](602dd00209))

### Bug Fixes

* add gpt o mini for azure ([77777c8](77777c898d))
* parse_node ([07f1e23](07f1e23d23))
* search link node ([cf3ab55](cf3ab5564a))

### chore

* correct search engine name ([7ba2f6a](7ba2f6ae0b))
* remove unused import ([fd1b7cb](fd1b7cb24a))
* **ci:** upgrade lockfiles ([c7b05a4](c7b05a4993))
* upgrade tiktoken ([7314bc3](7314bc3830))

### Docs

* **gpt-4o-mini:** added new gpt, fixed chromium lazy loading, ([99dc849](99dc8497d8))

### CI

* **release:** 1.10.0-beta.1 [skip ci] ([8f619de](8f619de235))
* **release:** 1.10.0-beta.2 [skip ci] ([aa7d4f0](aa7d4f0ebf))
* **release:** 1.10.0-beta.3 [skip ci] ([bf0a2f3](bf0a2f386f))
* **release:** 1.10.0-beta.4 [skip ci] ([a91807a](a91807a20c))
* **release:** 1.10.0-beta.5 [skip ci] ([0d5f925](0d5f9259d8))
* **release:** 1.9.0-beta.3 [skip ci] ([d3e63d9](d3e63d91be))
* **release:** 1.9.0-beta.4 [skip ci] ([2fa04b5](2fa04b5815))
* **release:** 1.9.0-beta.5 [skip ci] ([bb62439](bb624399cf))
* **release:** 1.9.0-beta.6 [skip ci] ([54a69de](54a69de69e))
2024-07-20 18:22:26 +00:00
semantic-release-bot
0d5f9259d8 ci(release): 1.10.0-beta.5 [skip ci]
## [1.10.0-beta.5](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.10.0-beta.4...v1.10.0-beta.5) (2024-07-20)

### Bug Fixes

* parse_node ([07f1e23](07f1e23d23))
2024-07-20 17:42:13 +00:00
semantic-release-bot
a91807a20c ci(release): 1.10.0-beta.4 [skip ci]
## [1.10.0-beta.4](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.10.0-beta.3...v1.10.0-beta.4) (2024-07-20)

### Bug Fixes

* azure models ([03f4a3a](03f4a3aa29))

### CI

* **release:** 1.9.2 [skip ci] ([b4b90b3](b4b90b3c12))
2024-07-20 11:28:57 +00:00
Marco Vinciguerra
3cf7089e3f
Merge branch 'pre/beta' into temp 2024-07-20 13:27:37 +02:00
semantic-release-bot
bf0a2f386f ci(release): 1.10.0-beta.3 [skip ci]
## [1.10.0-beta.3](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.10.0-beta.2...v1.10.0-beta.3) (2024-07-20)

### Bug Fixes

* add gpt o mini for azure ([77777c8](77777c898d))
2024-07-20 11:25:58 +00:00
semantic-release-bot
b4b90b3c12 ci(release): 1.9.2 [skip ci]
## [1.9.2](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.9.1...v1.9.2) (2024-07-20)

### Bug Fixes

* azure models ([03f4a3a](03f4a3aa29))

### chore

* remove unused workflow ([5c6dd8d](5c6dd8de4d))
2024-07-20 11:20:42 +00:00
semantic-release-bot
aa7d4f0ebf ci(release): 1.10.0-beta.2 [skip ci]
## [1.10.0-beta.2](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.10.0-beta.1...v1.10.0-beta.2) (2024-07-19)

### Features

* add gpt4o omni ([431edb7](431edb7bb2))
2024-07-19 08:12:42 +00:00
semantic-release-bot
8f619de235 ci(release): 1.10.0-beta.1 [skip ci]
## [1.10.0-beta.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.9.1...v1.10.0-beta.1) (2024-07-19)

### Features

* add searchngx integration ([5c92186](5c92186081))
* refactoring_to_md function ([602dd00](602dd00209))

### Bug Fixes

* search link node ([cf3ab55](cf3ab5564a))

### chore

* correct search engine name ([7ba2f6a](7ba2f6ae0b))
* remove unused import ([fd1b7cb](fd1b7cb24a))
* remove unused workflow ([5c6dd8d](5c6dd8de4d))
* **ci:** upgrade lockfiles ([c7b05a4](c7b05a4993))
* upgrade tiktoken ([7314bc3](7314bc3830))

### CI

* **release:** 1.9.0-beta.3 [skip ci] ([d3e63d9](d3e63d91be))
* **release:** 1.9.0-beta.4 [skip ci] ([2fa04b5](2fa04b5815))
* **release:** 1.9.0-beta.5 [skip ci] ([bb62439](bb624399cf))
* **release:** 1.9.0-beta.6 [skip ci] ([54a69de](54a69de69e))
2024-07-19 08:10:33 +00:00
Marco Vinciguerra
3a9d556e1b
Merge branch 'pre/beta' into add-openai-supported-model-gpt-4o-mini 2024-07-19 10:08:41 +02:00
Federico Aguzzi
7314bc3830 chore: upgrade tiktoken 2024-07-18 10:56:25 +02:00
semantic-release-bot
54a69de69e ci(release): 1.9.0-beta.6 [skip ci]
## [1.9.0-beta.6](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.9.0-beta.5...v1.9.0-beta.6) (2024-07-17)

### Features

* refactoring_to_md function ([602dd00](602dd00209))
2024-07-17 08:06:07 +00:00
Marco Vinciguerra
602dd00209 feat: refactoring_to_md function 2024-07-16 12:39:48 +02:00
semantic-release-bot
bb624399cf ci(release): 1.9.0-beta.5 [skip ci]
## [1.9.0-beta.5](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.9.0-beta.4...v1.9.0-beta.5) (2024-07-15)

### Bug Fixes

* search link node ([cf3ab55](cf3ab5564a))
2024-07-15 21:07:35 +00:00
semantic-release-bot
2fa04b5815 ci(release): 1.9.0-beta.4 [skip ci]
## [1.9.0-beta.4](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.9.0-beta.3...v1.9.0-beta.4) (2024-07-14)

### Features

* add searchngx integration ([5c92186](5c92186081))

### chore

* correct search engine name ([7ba2f6a](7ba2f6ae0b))
* remove unused import ([fd1b7cb](fd1b7cb24a))
2024-07-14 20:57:09 +00:00
semantic-release-bot
316c7debe9 ci(release): 1.9.1 [skip ci]
## [1.9.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.9.0...v1.9.1) (2024-07-12)

### Bug Fixes

* solve a burr integration ([881290b](881290b506))
2024-07-12 11:49:35 +00:00
semantic-release-bot
d3e63d91be ci(release): 1.9.0-beta.3 [skip ci]
## [1.9.0-beta.3](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.9.0-beta.2...v1.9.0-beta.3) (2024-07-12)

### Bug Fixes

* solve a burr integration ([881290b](881290b506))
2024-07-12 11:49:12 +00:00
semantic-release-bot
40bb0246d3 ci(release): 1.9.0 [skip ci]
## [1.9.0](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.8.0...v1.9.0) (2024-07-09)

### Features

* add fireworks integration ([df0e310](df0e310829))
* add integration for infos ([3bf5f57](3bf5f570a8))
* add integrations for markdown files ([2804434](2804434a9e))
* add vertexai integration ([119514b](119514bdfc))
* improve md prompt recognition ([5fe694b](5fe694b6b4))

### Bug Fixes

* add test ([3a537ee](3a537eec6f))
* fix pyproject.toml ([7570bf8](7570bf8294))

### chore

* **Docker:** fix port number ([afeb81f](afeb81f77a))
* **CI:** fix pylint workflow ([583c321](583c32106e))
* **rye:** rebuild lockfiles ([27c2dd2](27c2dd2351))

### Docs

* **roadmap:** fix urls ([14faba4](14faba4f00))
* **roadmap:** next steps ([3e644f4](3e644f498f))

### CI

* **release:** 1.8.1-beta.1 [skip ci] ([8f9f96f](8f9f96f7e7))
* **release:** 1.9.0-beta.1 [skip ci] ([146432d](146432d476))
* **release:** 1.9.0-beta.2 [skip ci] ([5cb5fbf](5cb5fbf550))
2024-07-09 16:52:52 +00:00
semantic-release-bot
5cb5fbf550 ci(release): 1.9.0-beta.2 [skip ci]
## [1.9.0-beta.2](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.9.0-beta.1...v1.9.0-beta.2) (2024-07-05)

### Bug Fixes

* fix pyproject.toml ([7570bf8](7570bf8294))
2024-07-05 11:09:18 +00:00
Marco Vinciguerra
ff80cbb133 Merge branch 'pre/beta' of https://github.com/ScrapeGraphAI/Scrapegraph-ai into pre/beta
Some checks failed
/ build (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
2024-07-04 21:05:36 +02:00
Marco Vinciguerra
ba782a6af9 add compatibility for versions 2024-07-04 21:04:47 +02:00
semantic-release-bot
146432d476 ci(release): 1.9.0-beta.1 [skip ci]
## [1.9.0-beta.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.8.1-beta.1...v1.9.0-beta.1) (2024-07-04)

### Features

* add fireworks integration ([df0e310](df0e310829))
* add integration for infos ([3bf5f57](3bf5f570a8))
* add integrations for markdown files ([2804434](2804434a9e))
* add vertexai integration ([119514b](119514bdfc))
* improve md prompt recognition ([5fe694b](5fe694b6b4))

### chore

* **Docker:** fix port number ([afeb81f](afeb81f77a))
* **CI:** fix pylint workflow ([583c321](583c32106e))
* **rye:** rebuild lockfiles ([27c2dd2](27c2dd2351))
2024-07-04 17:44:13 +00:00
Federico Aguzzi
104d8692d6
Merge branch 'pre/beta' into support
Some checks failed
/ build (push) Has been cancelled
2024-07-04 18:36:34 +02:00
semantic-release-bot
8f9f96f7e7 ci(release): 1.8.1-beta.1 [skip ci]
## [1.8.1-beta.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.8.0...v1.8.1-beta.1) (2024-07-04)

### Bug Fixes

* add test ([3a537ee](3a537eec6f))

### Docs

* **roadmap:** fix urls ([14faba4](14faba4f00))
* **roadmap:** next steps ([3e644f4](3e644f498f))
2024-07-04 16:35:06 +00:00
Federico Aguzzi
d77a622b05 Merge branch '423-add-vertex-ai-integration' into support 2024-07-04 18:23:22 +02:00
Federico Aguzzi
720f18729b Merge branch 'fireworks_integration' into support 2024-07-04 18:17:38 +02:00
Federico Aguzzi
583c32106e chore(CI): fix pylint workflow 2024-07-04 18:01:34 +02:00
Marco Vinciguerra
119514bdfc feat: add vertexai integration 2024-07-01 12:21:47 +02:00
semantic-release-bot
cb3cb76326 ci(release): 1.8.0 [skip ci]
## [1.8.0](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.7.5...v1.8.0) (2024-06-30)

### Features

* add new search engine avaiability and new tests ([073d226](073d226723))
* add research with bing + test function ([aa2160c](aa2160c108))

### Bug Fixes

* updated for schema changes ([aedda44](aedda44868))

### CI

* **release:** 1.7.0-beta.13 [skip ci] ([ce0a47a](ce0a47aee5))
* **release:** 1.7.0-beta.14 [skip ci] ([ec77ff7](ec77ff7ea4))
* **release:** 1.8.0-beta.1 [skip ci] ([bbfbbd9](bbfbbd93be))
2024-06-30 15:00:03 +00:00
Marco Vinciguerra
30ca15ca28
Merge branch 'md_scraper_integration' into integration_markdown
Some checks failed
/ build (3.10) (push) Has been cancelled
2024-06-30 16:58:37 +02:00
Marco Vinciguerra
b6a78e926f
Merge branch 'main' into temp 2024-06-30 16:54:15 +02:00
semantic-release-bot
e40d10443f ci(release): 1.7.5 [skip ci]
## [1.7.5](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.7.4...v1.7.5) (2024-06-28)

### Bug Fixes

* add new claude model ([4d93641](4d936410cc))
2024-06-28 08:51:17 +00:00
semantic-release-bot
bbfbbd93be ci(release): 1.8.0-beta.1 [skip ci]
## [1.8.0-beta.1](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.7.4...v1.8.0-beta.1) (2024-06-25)

### Features

* add new search engine avaiability and new tests ([073d226](073d226723))
* add research with bing + test function ([aa2160c](aa2160c108))

### Bug Fixes

* updated for schema changes ([aedda44](aedda44868))

### CI

* **release:** 1.7.0-beta.13 [skip ci] ([ce0a47a](ce0a47aee5))
* **release:** 1.7.0-beta.14 [skip ci] ([ec77ff7](ec77ff7ea4))
2024-06-25 08:49:47 +00:00
Marco Vinciguerra
df0e310829 feat: add fireworks integration 2024-06-24 23:11:28 +02:00
semantic-release-bot
62fdbcca52 ci(release): 1.7.4 [skip ci]
## [1.7.4](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.7.3...v1.7.4) (2024-06-21)

### Bug Fixes

* add new model for claude ([599512d](599512d2e5))
2024-06-21 12:09:33 +00:00
Marco Vinciguerra
5d6123847e add new convert function
Some checks are pending
/ build (3.10) (push) Waiting to run
Co-Authored-By: Federico Minutoli <40361744+DiTo97@users.noreply.github.com>
2024-06-20 21:15:16 +02:00
Marco Vinciguerra
8bb560a489 add convert function 2024-06-19 20:17:45 +02:00
semantic-release-bot
a7685921ca ci(release): 1.7.3 [skip ci]
## [1.7.3](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.7.2...v1.7.3) (2024-06-19)

### Bug Fixes

* reduced model tokens ([88f9def](88f9def69d))

### Docs

* **version:** fixed compatible versions ([ecb7601](ecb7601be7))
2024-06-19 17:56:27 +00:00
semantic-release-bot
ec77ff7ea4 ci(release): 1.7.0-beta.14 [skip ci]
## [1.7.0-beta.14](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.7.0-beta.13...v1.7.0-beta.14) (2024-06-19)

### Features

* add new search engine avaiability and new tests ([073d226](073d226723))
* add research with bing + test function ([aa2160c](aa2160c108))
2024-06-19 08:40:20 +00:00
semantic-release-bot
e9fa9d3413 ci(release): 1.7.2 [skip ci]
## [1.7.2](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.7.1...v1.7.2) (2024-06-18)

### Bug Fixes

* total tokens and docs ([c787090](c7870905e1))

### Docs

* fixed readme по русский ([2373073](23730735ba))
2024-06-18 21:23:36 +00:00
semantic-release-bot
ce0a47aee5 ci(release): 1.7.0-beta.13 [skip ci]
## [1.7.0-beta.13](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.7.0-beta.12...v1.7.0-beta.13) (2024-06-18)

### Bug Fixes

* updated for schema changes ([aedda44](aedda44868))
2024-06-18 18:54:59 +00:00
semantic-release-bot
fed9ebbe2d ci(release): 1.7.1 [skip ci]
## [1.7.1](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.7.0...v1.7.1) (2024-06-18)

### Bug Fixes

* add new embedding models ([1d0cbbc](1d0cbbc6d6))
2024-06-18 07:14:41 +00:00
semantic-release-bot
41964c55a0 ci(release): 1.7.0 [skip ci]
## [1.7.0](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.6.1...v1.7.0) (2024-06-17)

### Features

* add caching ([d790361](d79036149a))
* add csv scraper and xml scraper multi ([b408655](b4086550cc))
* add dynamic caching ([7ed2fe8](7ed2fe8ef0))
* **indexify-node:** add example ([5d1fbf8](5d1fbf806a))
* add forcing format as json ([5cfc101](5cfc10178a))
* add json as output ([5d20186](5d20186bf2))
* add json multiscraper ([5bda918](5bda918a39))
* add new chunking function ([e1f045b](e1f045b280))
* add Parse_Node ([e6c7940](e6c7940a57))
* add pdf scraper multi graph ([f5cbd80](f5cbd80c97))
* **merge:** add scriptcreatormulti, rag cache and semchunk ([15421ef](15421eff70))
* **telemetry:** add telemetry module ([080a318](080a318ff6))
* Add tests for RobotsNode and update test setup ([b0511ae](b0511aeaaa))
* Add tests for SmartScraperGraph using sample text and configuration fixtures ([@tejhande](https://github.com/tejhande)) ([c927145](c927145bd0))
* Add tests for SmartScraperGraph using sample text and configuration fixtures ([@tejhande](https://github.com/tejhande)) ([9e7038c](9e7038c596))
* Add tests for SmartScraperGraph using sample text and configuration fixtures ([@tejhande](https://github.com/tejhande)) ([c286b16](c286b1649e))
* Add tests for SmartScraperGraph using sample text and configuration fixtures ([@tejhande](https://github.com/tejhande)) ([08f1be6](08f1be682b))
* **pydantic:** added pydantic output schema ([376f758](376f758a76))
* **append_node:** append node to existing graph ([f8b08e0](f8b08e0b33))
* fix an if ([c8d556d](c8d556da4e))
* **schema:** merge scripts to follow pydantic schema ([5d692bf](5d692bff9e))
* refactoring of abstract graph ([fff89f4](fff89f431f))
* refactoring of an in if ([244aada](244aada2de))
* refactoring of rag node ([7a13a68](7a13a6819f))
* removed a bug ([8de720d](8de720d379))
* removed rag node ([930f673](930f673747))
* **version:** update burr version ([cfa1336](cfa13368f4))
* update fetch node ([1e7f334](1e7f3349f3))

### Bug Fixes

* add chinese embedding model ([03ffebc](03ffebc52d))
* common params ([6b4cdf9](6b4cdf92b8))
* **cache:** correctly pass the node arguments and logging ([c881f64](c881f64209))
* **pdf:** correctly read .pdf files ([203de83](203de83405))
* fix robot node ([2419003](2419003999))
* **node:** fixed generate answer node pydantic schema ([ab00f23](ab00f23d85))
* **schema:** fixed json output ([5c9843f](5c9843f141))
* oneapi model ([4fcb990](4fcb9902fe))
* shallow copy config of create_embedder ([62b372b](62b372b675))
* test for fetch node ([49c7e0e](49c7e0eaab))
* typo in prompt ([4639f0c](4639f0cac5))
* **multi:** updated multi pdf scraper with schema ([91c5b5a](91c5b5af43))

### Docs

* **cache:** added cache_path param ([edddb68](edddb682d0))
* better logging ([283b61f](283b61fafc))
* **scriptcreator:** enhance documentation ([650c3aa](650c3aaa60))
* fix label&logo for github action badges ([071f3d1](071f3d1906))
* refactor graph section and added telemetry ([39bf4c9](39bf4c960d))
* stylize badges in readme ([8696ade](8696adede7))

### Refactor

* add missing schemas and renamed files ([09cb6e9](09cb6e964e))

### Test

* fix tests for fetch node with proper mock&refactor ([17dd936](17dd936af7))

### CI

* **release:** 1.5.3-beta.1 [skip ci] ([6ea1d2c](6ea1d2c4d0))
* **release:** 1.5.3-beta.2 [skip ci] ([b57bcef](b57bcef5c1))
* **release:** 1.5.5-beta.1 [skip ci] ([38d138e](38d138e36f))
* **release:** 1.6.0-beta.1 [skip ci] ([1d217e4](1d217e4ae6))
* **release:** 1.6.0-beta.10 [skip ci] ([4d0d8fa](4d0d8fa453))
* **release:** 1.6.0-beta.11 [skip ci] ([3453ac0](3453ac01f5))
* **release:** 1.6.0-beta.2 [skip ci] ([ed1dc0b](ed1dc0be08))
* **release:** 1.6.0-beta.3 [skip ci] ([b70cb37](b70cb37c62))
* **release:** 1.6.0-beta.4 [skip ci] ([08a14ef](08a14efdd3))
* **release:** 1.6.0-beta.5 [skip ci] ([dde0c7e](dde0c7e27d))
* **release:** 1.6.0-beta.6 [skip ci] ([ac8e7c1](ac8e7c12fe))
* **release:** 1.6.0-beta.7 [skip ci] ([cab5f68](cab5f6828c))
* **release:** 1.6.0-beta.8 [skip ci] ([7a6f016](7a6f016f92))
* **release:** 1.6.0-beta.9 [skip ci] ([ca8aff8](ca8aff8d88))
* **release:** 1.7.0-beta.1 [skip ci] ([84a74b2](84a74b2f79))
* **release:** 1.7.0-beta.10 [skip ci] ([7f3b907](7f3b907410))
* **release:** 1.7.0-beta.11 [skip ci] ([c016efd](c016efd021))
* **release:** 1.7.0-beta.12 [skip ci] ([a794405](a794405471))
* **release:** 1.7.0-beta.2 [skip ci] ([e5bb5ae](e5bb5ae473))
* **release:** 1.7.0-beta.3 [skip ci] ([85a75c8](85a75c893a))
* **release:** 1.7.0-beta.4 [skip ci] ([b4d7532](b4d7532c6c))
* **release:** 1.7.0-beta.5 [skip ci] ([79b8326](79b8326b5b))
* **release:** 1.7.0-beta.6 [skip ci] ([dae3158](dae3158519))
* **release:** 1.7.0-beta.7 [skip ci] ([7da6cd2](7da6cd2ab2))
* **release:** 1.7.0-beta.8 [skip ci] ([a87702f](a87702f107))
* **release:** 1.7.0-beta.9 [skip ci] ([0c5d6e2](0c5d6e2c82))
2024-06-17 13:05:09 +00:00
semantic-release-bot
a794405471 ci(release): 1.7.0-beta.12 [skip ci]
## [1.7.0-beta.12](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.7.0-beta.11...v1.7.0-beta.12) (2024-06-17)

### Bug Fixes

* add chinese embedding model ([03ffebc](03ffebc52d))
2024-06-17 12:19:10 +00:00
semantic-release-bot
c016efd021 ci(release): 1.7.0-beta.11 [skip ci]
## [1.7.0-beta.11](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.7.0-beta.10...v1.7.0-beta.11) (2024-06-17)

### Features

* **telemetry:** add telemetry module ([080a318](080a318ff6))

### Docs

* refactor graph section and added telemetry ([39bf4c9](39bf4c960d))
2024-06-17 12:08:37 +00:00
semantic-release-bot
7f3b907410 ci(release): 1.7.0-beta.10 [skip ci]
## [1.7.0-beta.10](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.7.0-beta.9...v1.7.0-beta.10) (2024-06-17)

### Bug Fixes

* removed duplicate from ollama dictionary ([dcd216e](dcd216e345))

### CI

* **release:** 1.6.1 [skip ci] ([44fbd71](44fbd71742))
2024-06-17 09:04:36 +00:00
Marco Vinciguerra
da93162b53
Merge branch 'pre/beta' into main 2024-06-17 11:02:56 +02:00
semantic-release-bot
0c5d6e2c82 ci(release): 1.7.0-beta.9 [skip ci]
## [1.7.0-beta.9](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.7.0-beta.8...v1.7.0-beta.9) (2024-06-16)

### Bug Fixes

* fix robot node ([2419003](2419003999))
2024-06-16 12:05:59 +00:00
semantic-release-bot
a87702f107 ci(release): 1.7.0-beta.8 [skip ci]
## [1.7.0-beta.8](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.7.0-beta.7...v1.7.0-beta.8) (2024-06-16)

### Bug Fixes

* shallow copy config of create_embedder ([62b372b](62b372b675))

### Refactor

* add missing schemas and renamed files ([09cb6e9](09cb6e964e))
2024-06-16 11:35:48 +00:00
semantic-release-bot
44fbd71742 ci(release): 1.6.1 [skip ci]
## [1.6.1](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.6.0...v1.6.1) (2024-06-15)

### Bug Fixes

* removed duplicate from ollama dictionary ([dcd216e](dcd216e345))
2024-06-15 17:52:28 +00:00
semantic-release-bot
7da6cd2ab2 ci(release): 1.7.0-beta.7 [skip ci]
## [1.7.0-beta.7](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.7.0-beta.6...v1.7.0-beta.7) (2024-06-14)

### Features

* add Parse_Node ([e6c7940](e6c7940a57))

### Bug Fixes

* **pdf:** correctly read .pdf files ([203de83](203de83405))
* **multi:** updated multi pdf scraper with schema ([91c5b5a](91c5b5af43))

### Docs

* better logging ([283b61f](283b61fafc))
2024-06-14 13:24:14 +00:00
semantic-release-bot
dae3158519 ci(release): 1.7.0-beta.6 [skip ci]
## [1.7.0-beta.6](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.7.0-beta.5...v1.7.0-beta.6) (2024-06-13)

### Bug Fixes

* test for fetch node ([49c7e0e](49c7e0eaab))

### Docs

* fix label&logo for github action badges ([071f3d1](071f3d1906))

### Test

* fix tests for fetch node with proper mock&refactor ([17dd936](17dd936af7))
2024-06-13 09:06:15 +00:00
semantic-release-bot
79b8326b5b ci(release): 1.7.0-beta.5 [skip ci]
## [1.7.0-beta.5](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.7.0-beta.4...v1.7.0-beta.5) (2024-06-12)

### Features

* update fetch node ([1e7f334](1e7f3349f3))
2024-06-12 10:14:40 +00:00
semantic-release-bot
b4d7532c6c ci(release): 1.7.0-beta.4 [skip ci]
## [1.7.0-beta.4](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.7.0-beta.3...v1.7.0-beta.4) (2024-06-12)

### Bug Fixes

* common params ([6b4cdf9](6b4cdf92b8))
2024-06-12 01:07:46 +00:00
semantic-release-bot
85a75c893a ci(release): 1.7.0-beta.3 [skip ci]
## [1.7.0-beta.3](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.7.0-beta.2...v1.7.0-beta.3) (2024-06-11)

### Features

* add caching ([d790361](d79036149a))
* add dynamic caching ([7ed2fe8](7ed2fe8ef0))
* add new chunking function ([e1f045b](e1f045b280))
* **merge:** add scriptcreatormulti, rag cache and semchunk ([15421ef](15421eff70))
* **schema:** merge scripts to follow pydantic schema ([5d692bf](5d692bff9e))
* refactoring of rag node ([7a13a68](7a13a6819f))

### Bug Fixes

* **cache:** correctly pass the node arguments and logging ([c881f64](c881f64209))
* **node:** fixed generate answer node pydantic schema ([ab00f23](ab00f23d85))

### Docs

* **cache:** added cache_path param ([edddb68](edddb682d0))
* **scriptcreator:** enhance documentation ([650c3aa](650c3aaa60))
2024-06-11 23:55:32 +00:00
Marco Perini
893aaddc5c
Merge pull request #359 from VinciGit00/semchunk_integration
feat: add new chunking function
2024-06-11 23:16:00 +02:00
semantic-release-bot
e5bb5ae473 ci(release): 1.7.0-beta.2 [skip ci]
## [1.7.0-beta.2](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.7.0-beta.1...v1.7.0-beta.2) (2024-06-10)

### Features

* Add tests for RobotsNode and update test setup ([b0511ae](b0511aeaaa))
* Add tests for SmartScraperGraph using sample text and configuration fixtures ([@tejhande](https://github.com/tejhande)) ([c927145](c927145bd0))
* Add tests for SmartScraperGraph using sample text and configuration fixtures ([@tejhande](https://github.com/tejhande)) ([9e7038c](9e7038c596))
* Add tests for SmartScraperGraph using sample text and configuration fixtures ([@tejhande](https://github.com/tejhande)) ([c286b16](c286b1649e))
* Add tests for SmartScraperGraph using sample text and configuration fixtures ([@tejhande](https://github.com/tejhande)) ([08f1be6](08f1be682b))
2024-06-10 08:41:23 +00:00
semantic-release-bot
84a74b2f79 ci(release): 1.7.0-beta.1 [skip ci]
## [1.7.0-beta.1](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.6.0...v1.7.0-beta.1) (2024-06-09)

### Features

* add csv scraper and xml scraper multi ([b408655](b4086550cc))
* **indexify-node:** add example ([5d1fbf8](5d1fbf806a))
* add forcing format as json ([5cfc101](5cfc10178a))
* add json as output ([5d20186](5d20186bf2))
* add json multiscraper ([5bda918](5bda918a39))
* add pdf scraper multi graph ([f5cbd80](f5cbd80c97))
* **pydantic:** added pydantic output schema ([376f758](376f758a76))
* **append_node:** append node to existing graph ([f8b08e0](f8b08e0b33))
* fix an if ([c8d556d](c8d556da4e))
* refactoring of abstract graph ([fff89f4](fff89f431f))
* refactoring of an in if ([244aada](244aada2de))
* removed a bug ([8de720d](8de720d379))
* removed rag node ([930f673](930f673747))
* **version:** update burr version ([cfa1336](cfa13368f4))

### Bug Fixes

* **schema:** fixed json output ([5c9843f](5c9843f141))
* oneapi model ([4fcb990](4fcb9902fe))
* typo in prompt ([4639f0c](4639f0cac5))

### Docs

* stylize badges in readme ([8696ade](8696adede7))

### CI

* **release:** 1.5.3-beta.1 [skip ci] ([6ea1d2c](6ea1d2c4d0))
* **release:** 1.5.3-beta.2 [skip ci] ([b57bcef](b57bcef5c1))
* **release:** 1.5.5-beta.1 [skip ci] ([38d138e](38d138e36f))
* **release:** 1.6.0-beta.1 [skip ci] ([1d217e4](1d217e4ae6))
* **release:** 1.6.0-beta.10 [skip ci] ([4d0d8fa](4d0d8fa453))
* **release:** 1.6.0-beta.11 [skip ci] ([3453ac0](3453ac01f5))
* **release:** 1.6.0-beta.2 [skip ci] ([ed1dc0b](ed1dc0be08))
* **release:** 1.6.0-beta.3 [skip ci] ([b70cb37](b70cb37c62))
* **release:** 1.6.0-beta.4 [skip ci] ([08a14ef](08a14efdd3))
* **release:** 1.6.0-beta.5 [skip ci] ([dde0c7e](dde0c7e27d))
* **release:** 1.6.0-beta.6 [skip ci] ([ac8e7c1](ac8e7c12fe))
* **release:** 1.6.0-beta.7 [skip ci] ([cab5f68](cab5f6828c))
* **release:** 1.6.0-beta.8 [skip ci] ([7a6f016](7a6f016f92))
* **release:** 1.6.0-beta.9 [skip ci] ([ca8aff8](ca8aff8d88))
2024-06-09 15:07:07 +00:00
Marco Vinciguerra
8bec47eac2
Merge branch 'pre/beta' into all 2024-06-09 17:05:51 +02:00
semantic-release-bot
3453ac01f5 ci(release): 1.6.0-beta.11 [skip ci]
## [1.6.0-beta.11](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.6.0-beta.10...v1.6.0-beta.11) (2024-06-09)

### Bug Fixes

* bug on generate_answer_node ([1d38ed1](1d38ed146a))
* getter ([67d83cf](67d83cff46))
* update openai tts class ([10672d6](10672d6ebb))

### Docs

* add Japanese README ([4559ab6](4559ab6db8))
* update japanese.md ([f0042a8](f0042a8e33))
* update README.md ([871e398](871e398a26))

### Test

* Enhance JSON scraping pipeline test ([d845a1b](d845a1ba7d))

### CI

* **release:** 1.5.5 [skip ci] ([3629215](36292150da))
* **release:** 1.5.6 [skip ci] ([49cdadf](49cdadf117))
* **release:** 1.5.7 [skip ci] ([c17daca](c17daca409))
2024-06-09 15:05:20 +00:00
Marco Vinciguerra
9326637cc3 Merge branch 'main' into pre/beta 2024-06-09 17:04:11 +02:00
semantic-release-bot
58086eef47 ci(release): 1.6.0 [skip ci]
## [1.6.0](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.5.7...v1.6.0) (2024-06-09)

### Features

* Add tests for RobotsNode and update test setup ([dedfa2e](dedfa2eaf0))

### Test

* Enhance JSON scraping pipeline test ([d845a1b](d845a1ba7d))
2024-06-09 15:00:59 +00:00
semantic-release-bot
4d0d8fa453 ci(release): 1.6.0-beta.10 [skip ci]
## [1.6.0-beta.10](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.6.0-beta.9...v1.6.0-beta.10) (2024-06-08)

### Features

* **version:** update burr version ([cfa1336](cfa13368f4))

### Docs

* stylize badges in readme ([8696ade](8696adede7))
2024-06-08 10:11:47 +00:00
Marco Perini
8228225dff
Merge pull request #360 from VinciGit00/burr_integration
Burr integration
2024-06-08 12:10:34 +02:00
Marco Perini
cfa13368f4 feat(version): update burr version
Some checks failed
/ build (3.10) (push) Has been cancelled
2024-06-08 12:06:25 +02:00
Marco Vinciguerra
e1f045b280 feat: add new chunking function 2024-06-08 11:44:09 +02:00
semantic-release-bot
ca8aff8d88 ci(release): 1.6.0-beta.9 [skip ci]
## [1.6.0-beta.9](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.6.0-beta.8...v1.6.0-beta.9) (2024-06-07)

### Features

* **indexify-node:** add example ([5d1fbf8](5d1fbf806a))

### Bug Fixes

* **schema:** fixed json output ([5c9843f](5c9843f141))
2024-06-07 18:28:38 +00:00
semantic-release-bot
c17daca409 ci(release): 1.5.7 [skip ci]
## [1.5.7](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.5.6...v1.5.7) (2024-06-06)

### Bug Fixes

* update openai tts class ([10672d6](10672d6ebb))
2024-06-06 08:02:58 +00:00
semantic-release-bot
49cdadf117 ci(release): 1.5.6 [skip ci]
## [1.5.6](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.5.5...v1.5.6) (2024-06-05)

### Bug Fixes

* getter ([67d83cf](67d83cff46))
2024-06-05 10:03:20 +00:00
semantic-release-bot
7a6f016f92 ci(release): 1.6.0-beta.8 [skip ci]
## [1.6.0-beta.8](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.6.0-beta.7...v1.6.0-beta.8) (2024-06-05)

### Features

* add json as output ([5d20186](5d20186bf2))
2024-06-05 07:21:31 +00:00
semantic-release-bot
36292150da ci(release): 1.5.5 [skip ci]
## [1.5.5](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.5.4...v1.5.5) (2024-06-05)

### Bug Fixes

* bug on generate_answer_node ([1d38ed1](1d38ed146a))

### Docs

* add Japanese README ([4559ab6](4559ab6db8))
* update japanese.md ([f0042a8](f0042a8e33))
* update README.md ([871e398](871e398a26))
2024-06-05 07:18:31 +00:00
semantic-release-bot
cab5f6828c ci(release): 1.6.0-beta.7 [skip ci]
## [1.6.0-beta.7](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.6.0-beta.6...v1.6.0-beta.7) (2024-06-05)

### Features

* **pydantic:** added pydantic output schema ([376f758](376f758a76))
* **append_node:** append node to existing graph ([f8b08e0](f8b08e0b33))
2024-06-05 07:06:33 +00:00
semantic-release-bot
ac8e7c12fe ci(release): 1.6.0-beta.6 [skip ci]
## [1.6.0-beta.6](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.6.0-beta.5...v1.6.0-beta.6) (2024-06-04)

### Features

* refactoring of abstract graph ([fff89f4](fff89f431f))
2024-06-04 17:42:27 +00:00
semantic-release-bot
dde0c7e27d ci(release): 1.6.0-beta.5 [skip ci]
## [1.6.0-beta.5](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.6.0-beta.4...v1.6.0-beta.5) (2024-06-04)

### Features

* refactoring of an in if ([244aada](244aada2de))
2024-06-04 08:02:26 +00:00
semantic-release-bot
08a14efdd3 ci(release): 1.6.0-beta.4 [skip ci]
## [1.6.0-beta.4](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.6.0-beta.3...v1.6.0-beta.4) (2024-06-03)

### Features

* fix an if ([c8d556d](c8d556da4e))
2024-06-03 19:50:50 +00:00
semantic-release-bot
b70cb37c62 ci(release): 1.6.0-beta.3 [skip ci]
## [1.6.0-beta.3](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.6.0-beta.2...v1.6.0-beta.3) (2024-06-03)

### Features

* removed a bug ([8de720d](8de720d379))
2024-06-03 19:46:52 +00:00
semantic-release-bot
ed1dc0be08 ci(release): 1.6.0-beta.2 [skip ci]
## [1.6.0-beta.2](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.6.0-beta.1...v1.6.0-beta.2) (2024-06-03)

### Features

* add csv scraper and xml scraper multi ([b408655](b4086550cc))
* add json multiscraper ([5bda918](5bda918a39))
* add pdf scraper multi graph ([f5cbd80](f5cbd80c97))
* removed rag node ([930f673](930f673747))
2024-06-03 11:27:25 +00:00
semantic-release-bot
1d217e4ae6 ci(release): 1.6.0-beta.1 [skip ci]
## [1.6.0-beta.1](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.5.5-beta.1...v1.6.0-beta.1) (2024-06-02)

### Features

* add forcing format as json ([5cfc101](5cfc10178a))
2024-06-02 10:27:12 +00:00
semantic-release-bot
38d138e36f ci(release): 1.5.5-beta.1 [skip ci]
## [1.5.5-beta.1](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.5.4...v1.5.5-beta.1) (2024-05-31)

### Bug Fixes

* oneapi model ([4fcb990](4fcb9902fe))
* typo in prompt ([4639f0c](4639f0cac5))

### CI

* **release:** 1.5.3-beta.1 [skip ci] ([6ea1d2c](6ea1d2c4d0))
* **release:** 1.5.3-beta.2 [skip ci] ([b57bcef](b57bcef5c1))
2024-05-31 21:09:56 +00:00
semantic-release-bot
29b79cbdf1 ci(release): 1.5.4 [skip ci]
## [1.5.4](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.5.3...v1.5.4) (2024-05-31)

### Bug Fixes

* **3.9:** python 3.9 logging fix ([8be27ba](8be27bad80))
2024-05-31 20:33:32 +00:00
semantic-release-bot
5619bca78e ci(release): 1.5.3 [skip ci]
## [1.5.3](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.5.2...v1.5.3) (2024-05-30)

### Bug Fixes

* typo in generate_screper_node ([c4ce361](c4ce36111f))
2024-05-30 16:51:20 +00:00
semantic-release-bot
7f4a6a6aa4 ci(release): 1.5.2 [skip ci]
## [1.5.2](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.5.1...v1.5.2) (2024-05-26)

### Bug Fixes

* fixed typo ([54e8216](54e82163f0))
* Update __init__.py ([8f2c8d5](8f2c8d5d12))
2024-05-26 14:39:15 +00:00
semantic-release-bot
7f24dd4b2a ci(release): 1.5.1 [skip ci]
## [1.5.1](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.5.0...v1.5.1) (2024-05-26)

### Bug Fixes

* **pdf-example:** added pdf example and coauthor ([a796169](a7961691df))
* **schema:** added schema ([8d76c4b](8d76c4b3cb))
2024-05-26 13:40:33 +00:00
semantic-release-bot
82962365b6 ci(release): 1.5.0 [skip ci]
## [1.5.0](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.4.0...v1.5.0) (2024-05-26)

### Features

* **knowledgegraph:** add knowledge graph node ([0196423](0196423bde))
* add logger integration ([e53766b](e53766b16e))
* **smart-scraper-multi:** add schema to graphs and created SmartScraperMultiGraph ([fc58e2d](fc58e2d3a6))
* **burr:** added burr integration in graphs and optional burr installation ([ac10128](ac10128ff3))
* **base_graph:** alligned with main ([73fa31d](73fa31db0f))
* **burr-bridge:** BurrBridge class to integrate inside BaseGraph ([6cbd84f](6cbd84f254))
* **verbose:** centralized graph logging on debug or warning depending on verbose ([c807695](c807695720))
* **burr:** first burr integration and docs ([19b27bb](19b27bbe85))
* **node:** knowledge graph node ([8c33ea3](8c33ea3fbc))
* **version:** python 3.12 is now supported 🚀 ([5fb9115](5fb9115330))
* **multiple:** quick fix working ([58cc903](58cc903d55))
* **kg:** removed import ([a338383](a338383399))
* **docloaders:** undetected-playwright ([7b3ee4e](7b3ee4e71e))
* **burr-node:** working burr bridge ([654a042](654a042396))
* **multiple_search:** working multiple example ([bed3eed](bed3eed50c))
* **kg:** working rag kg ([c75e6a0](c75e6a06b1))

### Bug Fixes

* error in jsons ([ca436ab](ca436abf3c))
* **pdf_scraper:** fix the pdf scraper gaph ([d00cde6](d00cde6030))
* **local_file:** fixed textual input pdf, csv, json and xml graph ([8d5eb0b](8d5eb0bb0d))
* **kg:** removed unused nodes and utils ([5684578](5684578fab))
* **logger:** set up centralized root logger in base node ([4348d4f](4348d4f4db))
* **logging:** source code citation ([d139480](d1394809d7))
* template names ([b82f33a](b82f33aee7))
* **node-logging:** use centralized logger in each node for logging ([c251cc4](c251cc45d3))
* **web-loader:** use sublogger ([0790ecd](0790ecd208))

### Docs

* **burr:** added dependecies and switched to furo ([819f071](819f071f2d))
* **faq:** added faq section and refined installation ([545374c](545374c17e))
* **graph:** added new graphs and schema ([d27cad5](d27cad5911))
* updated requirements ([e43b801](e43b8018f5))

### CI

* **release:** 1.2.0-beta.1 [skip ci] ([fd3e0aa](fd3e0aa582))
* **release:** 1.3.0-beta.1 [skip ci] ([191db0b](191db0bc77))
* **release:** 1.4.0-beta.1 [skip ci] ([2caddf9](2caddf9a99))
* **release:** 1.4.0-beta.2 [skip ci] ([f1a2523](f1a25233d6))
* **release:** 1.5.0-beta.1 [skip ci] ([e1006f3](e1006f39c4))
* **release:** 1.5.0-beta.2 [skip ci] ([edf221d](edf221dcd9))
* **release:** 1.5.0-beta.3 [skip ci] ([90d5691](90d5691a57))
* **release:** 1.5.0-beta.4 [skip ci] ([15b7682](15b7682967))
* **release:** 1.5.0-beta.5 [skip ci] ([1f51147](1f511476a4))
2024-05-26 07:08:54 +00:00
semantic-release-bot
1f511476a4 ci(release): 1.5.0-beta.5 [skip ci]
## [1.5.0-beta.5](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.5.0-beta.4...v1.5.0-beta.5) (2024-05-26)

### Features

* **version:** python 3.12 is now supported 🚀 ([5fb9115](5fb9115330))

### Docs

* **faq:** added faq section and refined installation ([545374c](545374c17e))
* updated requirements ([e43b801](e43b8018f5))
2024-05-26 06:50:39 +00:00
Marco Perini
5fb9115330 feat(version): python 3.12 is now supported 🚀 2024-05-26 08:49:27 +02:00
semantic-release-bot
15b7682967 ci(release): 1.5.0-beta.4 [skip ci]
## [1.5.0-beta.4](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.5.0-beta.3...v1.5.0-beta.4) (2024-05-25)

### Features

* **burr:** added burr integration in graphs and optional burr installation ([ac10128](ac10128ff3))
* **burr-bridge:** BurrBridge class to integrate inside BaseGraph ([6cbd84f](6cbd84f254))
* **burr:** first burr integration and docs ([19b27bb](19b27bbe85))
* **burr-node:** working burr bridge ([654a042](654a042396))

### Docs

* **burr:** added dependecies and switched to furo ([819f071](819f071f2d))
* **graph:** added new graphs and schema ([d27cad5](d27cad5911))
2024-05-25 12:55:51 +00:00
Marco Perini
f9f6b08753 Merge branch 'pre/beta' into burr_integration 2024-05-25 14:51:07 +02:00
Marco Perini
e65faca3d8 Merge branch 'pre/beta' of https://github.com/VinciGit00/Scrapegraph-ai into pre/beta 2024-05-25 01:05:35 +02:00
Marco Perini
d27cad5911 docs(graph): added new graphs and schema 2024-05-25 01:05:22 +02:00
semantic-release-bot
90d5691a57 ci(release): 1.5.0-beta.3 [skip ci]
## [1.5.0-beta.3](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.5.0-beta.2...v1.5.0-beta.3) (2024-05-24)

### Bug Fixes

* **kg:** removed unused nodes and utils ([5684578](5684578fab))
2024-05-24 22:46:12 +00:00
semantic-release-bot
edf221dcd9 ci(release): 1.5.0-beta.2 [skip ci]
## [1.5.0-beta.2](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.5.0-beta.1...v1.5.0-beta.2) (2024-05-24)

### Bug Fixes

* **pdf_scraper:** fix the pdf scraper gaph ([d00cde6](d00cde6030))
* **local_file:** fixed textual input pdf, csv, json and xml graph ([8d5eb0b](8d5eb0bb0d))
2024-05-24 22:19:25 +00:00
Marco Perini
819f071f2d docs(burr): added dependecies and switched to furo 2024-05-24 22:49:38 +02:00
semantic-release-bot
e1006f39c4 ci(release): 1.5.0-beta.1 [skip ci]
## [1.5.0-beta.1](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.4.0...v1.5.0-beta.1) (2024-05-24)

### Features

* **knowledgegraph:** add knowledge graph node ([0196423](0196423bde))
* add logger integration ([e53766b](e53766b16e))
* **smart-scraper-multi:** add schema to graphs and created SmartScraperMultiGraph ([fc58e2d](fc58e2d3a6))
* **base_graph:** alligned with main ([73fa31d](73fa31db0f))
* **verbose:** centralized graph logging on debug or warning depending on verbose ([c807695](c807695720))
* **node:** knowledge graph node ([8c33ea3](8c33ea3fbc))
* **multiple:** quick fix working ([58cc903](58cc903d55))
* **kg:** removed import ([a338383](a338383399))
* **docloaders:** undetected-playwright ([7b3ee4e](7b3ee4e71e))
* **multiple_search:** working multiple example ([bed3eed](bed3eed50c))
* **kg:** working rag kg ([c75e6a0](c75e6a06b1))

### Bug Fixes

* error in jsons ([ca436ab](ca436abf3c))
* **logger:** set up centralized root logger in base node ([4348d4f](4348d4f4db))
* **logging:** source code citation ([d139480](d1394809d7))
* template names ([b82f33a](b82f33aee7))
* **node-logging:** use centralized logger in each node for logging ([c251cc4](c251cc45d3))
* **web-loader:** use sublogger ([0790ecd](0790ecd208))

### CI

* **release:** 1.2.0-beta.1 [skip ci] ([fd3e0aa](fd3e0aa582))
* **release:** 1.3.0-beta.1 [skip ci] ([191db0b](191db0bc77))
* **release:** 1.4.0-beta.1 [skip ci] ([2caddf9](2caddf9a99))
* **release:** 1.4.0-beta.2 [skip ci] ([f1a2523](f1a25233d6))
2024-05-24 10:41:25 +00:00
Marco Vinciguerra
1774b18059 refactor of embeddings 2024-05-23 12:32:49 +02:00
Marco Vinciguerra
f00ed35f7b
Merge branch 'pre/beta' into patch-1 2024-05-23 11:47:51 +02:00
semantic-release-bot
eb41f0d7b5 ci(release): 1.4.0 [skip ci]
## [1.4.0](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.3.2...v1.4.0) (2024-05-22)

### Features

* Add new models and update existing ones ([58289ec](58289eccc5))
2024-05-22 19:58:10 +00:00
Marco Perini
ac10128ff3 feat(burr): added burr integration in graphs and optional burr installation 2024-05-22 18:30:49 +02:00
semantic-release-bot
ee22b60e37 ci(release): 1.3.2 [skip ci]
## [1.3.2](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.3.1...v1.3.2) (2024-05-22)

### Bug Fixes

* pdf scraper bug ([f2dffe5](f2dffe534f))
2024-05-22 09:56:46 +00:00
PeriniM
654a042396 feat(burr-node): working burr bridge 2024-05-22 00:24:38 +02:00
Marco Perini
6cbd84f254 feat(burr-bridge): BurrBridge class to integrate inside BaseGraph 2024-05-21 19:57:10 +02:00
Marco Vinciguerra
be4237a04d
Merge branch 'pre/beta' into multi_scraper_graph 2024-05-21 13:44:06 +02:00
semantic-release-bot
f15fbc0d52 ci(release): 1.3.1 [skip ci]
## [1.3.1](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.3.0...v1.3.1) (2024-05-21)

### Bug Fixes

* add deepseek embeddings ([659fad7](659fad770a))
2024-05-21 08:38:36 +00:00
semantic-release-bot
f1a25233d6 ci(release): 1.4.0-beta.2 [skip ci]
## [1.4.0-beta.2](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.4.0-beta.1...v1.4.0-beta.2) (2024-05-19)

### Features

* **docloaders:** undetected-playwright ([7b3ee4e](7b3ee4e71e))
2024-05-19 20:28:36 +00:00
Marco Perini
9096da7d47
Merge pull request #269 from QIN2DIM/feat-undetected-playwright
feat(docloaders): undetected-playwright
2024-05-19 22:26:50 +02:00
semantic-release-bot
2caddf9a99 ci(release): 1.4.0-beta.1 [skip ci]
## [1.4.0-beta.1](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.3.0...v1.4.0-beta.1) (2024-05-19)

### Features

* **base_graph:** alligned with main ([73fa31d](73fa31db0f))

### CI

* **release:** 1.2.0-beta.1 [skip ci] ([fd3e0aa](fd3e0aa582))
* **release:** 1.3.0-beta.1 [skip ci] ([191db0b](191db0bc77))
2024-05-19 20:10:37 +00:00
semantic-release-bot
7fd06a6ac5 ci(release): 1.3.0 [skip ci]
## [1.3.0](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.2.4...v1.3.0) (2024-05-19)

### Features

* add new model ([8c7afa7](8c7afa7570))
2024-05-19 20:06:05 +00:00
QIN2DIM
7b3ee4e71e feat(docloaders): undetected-playwright 2024-05-19 18:01:03 +08:00
Marco Perini
0196423bde feat(knowledgegraph): add knowledge graph node 2024-05-17 23:41:44 +02:00
semantic-release-bot
746e7bd343 ci(release): 1.2.4 [skip ci]
## [1.2.4](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.2.3...v1.2.4) (2024-05-17)

### Bug Fixes

* **deepcopy:** switch whether we have obj in the config ([d4d913c](d4d913c8a3))
2024-05-17 08:38:38 +00:00
semantic-release-bot
5a557f9295 ci(release): 1.2.3 [skip ci]
## [1.2.3](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.2.2...v1.2.3) (2024-05-15)

### Bug Fixes

* **deepcopy:** reaplced to shallow copy ([999c930](999c930f42))
2024-05-15 15:36:04 +00:00
semantic-release-bot
3531a68f5b ci(release): 1.2.2 [skip ci]
## [1.2.2](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.2.1...v1.2.2) (2024-05-15)

### Bug Fixes

* come back to the old version ([cc5adef](cc5adefd29))
2024-05-15 13:57:23 +00:00
VinciGit00
cc5adefd29 fix: come back to the old version 2024-05-15 15:54:00 +02:00
semantic-release-bot
d5045abf17 ci(release): 1.2.0 [skip ci]
## [1.2.0](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.1.0...v1.2.0) (2024-05-15)

### Features

* add finalize_node() ([6e7283e](6e7283ed8f))
2024-05-15 13:22:20 +00:00
Marco Vinciguerra
cffcf80a75
Merge branch '88-blockscraper-implementation' into main 2024-05-15 15:20:12 +02:00
semantic-release-bot
51200d6918 ci(release): 1.1.0 [skip ci]
## [1.1.0](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.0.1...v1.1.0) (2024-05-15)

### Features

* add turboscraper (alfa) ([51aa109](51aa109e42))
* new search_graph ([67d5fbf](67d5fbf816))

### Docs

* **rye:** replaced poetry with rye ([efb781f](efb781f950))
2024-05-15 13:18:52 +00:00
semantic-release-bot
a81d2b7a80 ci(release): 1.0.1 [skip ci]
## [1.0.1](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.0.0...v1.0.1) (2024-05-15)

### Bug Fixes

* **searchgraph:** used shallow copy to serialize obj ([096b665](096b665c01))
2024-05-15 13:07:36 +00:00
Marco Perini
096b665c01 fix(searchgraph): used shallow copy to serialize obj 2024-05-15 15:05:47 +02:00
Marco Vinciguerra
24d56af97c
Update pyproject.toml 2024-05-15 14:10:56 +02:00
semantic-release-bot
c0b6f0260f ci(release): 1.0.0 [skip ci]
## [1.0.0](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.11.1...v1.0.0) (2024-05-15)

### ⚠ BREAKING CHANGES

* **package manager:** move from poetry to rye

### chore

* **package manager:** move from poetry to rye ([8fc2510](8fc2510b37)), closes [#198](https://github.com/VinciGit00/Scrapegraph-ai/issues/198)

### Docs

* **main-readme:** fixed some typos ([78d1940](78d1940235))
2024-05-15 11:45:54 +00:00
Federico Aguzzi
8fc2510b37 chore(package manager)!: move from poetry to rye
closes #198
2024-05-15 13:42:58 +02:00
semantic-release-bot
6effe25900 ci(release): 0.11.1 [skip ci]
## [0.11.1](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.11.0...v0.11.1) (2024-05-14)

### Bug Fixes

* **docs:** requirements-dev ([b0a67ba](b0a67ba387))
2024-05-14 16:14:46 +00:00
semantic-release-bot
c55a3b1162 ci(release): 0.11.0 [skip ci]
## [0.11.0](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.10.1...v0.11.0) (2024-05-14)

### Features

* **parallel-exeuction:** add asyncio event loop dispatcher with semaphore for parallel graph instances ([627cbee](627cbeeb20))
* **webdriver-backend:** add dynamic import scripts from module and file ([db2234b](db2234bf5d))
* add gpt-4o ([52a4a3b](52a4a3b22d)), closes [#232](https://github.com/VinciGit00/Scrapegraph-ai/issues/232)
* add new prompt info ([e2350ed](e2350eda62))
* **proxy-rotation:** add parse (IP address) or search (from broker) functionality for proxy rotation ([2170131](217013181d))
* add support for deepseek-chat ([156b67b](156b67b91e)), closes [#222](https://github.com/VinciGit00/Scrapegraph-ai/issues/222)
* Add support for passing pdf path as source ([f10f3b1](f10f3b1438))
* **omni-search:** added omni search graph and updated docs ([fcb3abb](fcb3abb01d))
* added proxy rotation ([0c36a7e](0c36a7ec1f))
* **safe-web-driver:** enchanced the original `AsyncChromiumLoader` web driver with proxy protection and flexible kwargs and backend ([768719c](768719cce8))
* **gpt-4o:** image to text single node test ([90955ca](90955ca52f))
* revert fetch_node ([864aa91](864aa91326))
* **batchsize:** tested different batch sizes and systems ([a8d5e7d](a8d5e7db05))
* update info ([4ed0fb8](4ed0fb89c3))
* **omni-scraper:** working OmniScraperGraph with images ([a296927](a296927624))

### Bug Fixes

* **pytest:** add dependency for mocking testing functions ([2f4fd45](2f4fd45700))
* add json integration ([0ab31c3](0ab31c3fdb))
* Augment the information getting fetched from a webpage ([f8ce3d5](f8ce3d5916))
* bug for claude ([d0167de](d0167dee71))
* **fetch_node:** bug in handling local files ([a6e1813](a6e1813ddd))
* **chromium-loader:** ensure it subclasses langchain's base loader ([b54d984](b54d984c13))
* fixed bugs for csv and xml ([324e977](324e977b85))
* limit python version to < 3.12 ([a37fbbc](a37fbbcbcf))
* **proxy-rotation:** removed duplicated arg and passed the loader_kwarhs correctly to the node ([1e9a564](1e9a564616))
* **fetch-node:** removed isSoup from default ([0c15947](0c1594737f))
* **proxy-rotation:** removed max_shape duplicate ([5d6d996](5d6d996e8f))
* **asyncio:** replaced deepcopy with copy due to serialization problems ([dedc733](dedc733047))

### chore

* update models_tokens.py with new model configurations ([d9752b1](d9752b1619))

### Docs

* add diagram showing general structure/flow of the library ([13ae918](13ae9180ac))
* **refactor:** added proxy-rotation usage and refactor readthedocs ([e256b75](e256b758b2))
* **refactor:** changed example ([c7ec114](c7ec114274))
* **concurrent:** refactor theme and added benchmarck searchgraph ([ced2bbc](ced2bbcdc9))
* update overview diagram with more models ([b441b30](b441b30a5c))

### CI

* **release:** 0.10.0-beta.3 [skip ci] ([ad32298](ad32298e70))
* **release:** 0.10.0-beta.4 [skip ci] ([548bff9](548bff9d77))
* **release:** 0.10.0-beta.5 [skip ci] ([28c9dce](28c9dce7cb))
* **release:** 0.10.0-beta.6 [skip ci] ([460d292](460d292af2))
* **release:** 0.11.0-beta.1 [skip ci] ([63c0dd9](63c0dd9372))
* **release:** 0.11.0-beta.10 [skip ci] ([218b8ed](218b8ede8a)), closes [#232](https://github.com/VinciGit00/Scrapegraph-ai/issues/232)
* **release:** 0.11.0-beta.11 [skip ci] ([8727d03](8727d03384))
* **release:** 0.11.0-beta.2 [skip ci] ([7ae50c0](7ae50c035e))
* **release:** 0.11.0-beta.3 [skip ci] ([106fb12](106fb12531)), closes [#222](https://github.com/VinciGit00/Scrapegraph-ai/issues/222)
* **release:** 0.11.0-beta.4 [skip ci] ([4ccddda](4ccddda5eb))
* **release:** 0.11.0-beta.5 [skip ci] ([353382b](353382b4d3))
* **release:** 0.11.0-beta.6 [skip ci] ([2724d3d](2724d3dd5f))
* **release:** 0.11.0-beta.7 [skip ci] ([f0f7373](f0f73736f7))
* **release:** 0.11.0-beta.8 [skip ci] ([fa4edb4](fa4edb4703))
* **release:** 0.11.0-beta.9 [skip ci] ([d2877d8](d2877d89e5))
2024-05-14 15:14:12 +00:00
semantic-release-bot
8727d03384 ci(release): 0.11.0-beta.11 [skip ci]
## [0.11.0-beta.11](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.11.0-beta.10...v0.11.0-beta.11) (2024-05-14)

### Features

* **omni-search:** added omni search graph and updated docs ([fcb3abb](fcb3abb01d))
* **gpt-4o:** image to text single node test ([90955ca](90955ca52f))
* **omni-scraper:** working OmniScraperGraph with images ([a296927](a296927624))

### Bug Fixes

* **fetch_node:** bug in handling local files ([a6e1813](a6e1813ddd))
2024-05-14 15:10:47 +00:00
semantic-release-bot
218b8ede8a ci(release): 0.11.0-beta.10 [skip ci]
## [0.11.0-beta.10](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.11.0-beta.9...v0.11.0-beta.10) (2024-05-14)

### Features

* add gpt-4o ([52a4a3b](52a4a3b22d)), closes [#232](https://github.com/VinciGit00/Scrapegraph-ai/issues/232)
2024-05-14 09:29:03 +00:00
semantic-release-bot
d2877d89e5 ci(release): 0.11.0-beta.9 [skip ci]
## [0.11.0-beta.9](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.11.0-beta.8...v0.11.0-beta.9) (2024-05-14)

### Bug Fixes

* crash asyncio due dependency version ([2563773](2563773447))

### chore

* update models_tokens.py with new model configurations ([d9752b1](d9752b1619))

### Docs

* fixed speechgraphexample ([4bf90f3](4bf90f32a8))
* fixed unused param and install ([cc28d5a](cc28d5a64f))
* **readme:** improve main readme ([ae5655f](ae5655fdde))
* **concurrent:** refactor theme and added benchmarck searchgraph ([ced2bbc](ced2bbcdc9))
* update instructions to use with LocalAI ([198420c](198420c505))
* Update README.md ([772e064](772e064c55))
* updated sponsor logo ([f8d8d71](f8d8d71589))

### CI

* **release:** 0.10.1 [skip ci] ([d359814](d359814c4a))
2024-05-14 08:37:42 +00:00
VinciGit00
d6f5ca874f Merge branch 'main' into pre/beta 2024-05-14 10:24:29 +02:00
semantic-release-bot
fa4edb4703 ci(release): 0.11.0-beta.8 [skip ci]
## [0.11.0-beta.8](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.11.0-beta.7...v0.11.0-beta.8) (2024-05-13)

### Features

* **parallel-exeuction:** add asyncio event loop dispatcher with semaphore for parallel graph instances ([627cbee](627cbeeb20))
* **batchsize:** tested different batch sizes and systems ([a8d5e7d](a8d5e7db05))

### Bug Fixes

* **asyncio:** replaced deepcopy with copy due to serialization problems ([dedc733](dedc733047))
2024-05-13 21:52:03 +00:00
semantic-release-bot
f0f73736f7 ci(release): 0.11.0-beta.7 [skip ci]
## [0.11.0-beta.7](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.11.0-beta.6...v0.11.0-beta.7) (2024-05-13)

### Bug Fixes

* bug for claude ([d0167de](d0167dee71))

### Docs

* **refactor:** changed example ([c7ec114](c7ec114274))
2024-05-13 11:44:57 +00:00
semantic-release-bot
2724d3dd5f ci(release): 0.11.0-beta.6 [skip ci]
## [0.11.0-beta.6](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.11.0-beta.5...v0.11.0-beta.6) (2024-05-13)

### Bug Fixes

* **fetch-node:** removed isSoup from default ([0c15947](0c1594737f))
2024-05-13 10:11:05 +00:00
semantic-release-bot
353382b4d3 ci(release): 0.11.0-beta.5 [skip ci]
## [0.11.0-beta.5](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.11.0-beta.4...v0.11.0-beta.5) (2024-05-13)

### Features

* **webdriver-backend:** add dynamic import scripts from module and file ([db2234b](db2234bf5d))
* **proxy-rotation:** add parse (IP address) or search (from broker) functionality for proxy rotation ([2170131](217013181d))
* added proxy rotation ([0c36a7e](0c36a7ec1f))
* **safe-web-driver:** enchanced the original `AsyncChromiumLoader` web driver with proxy protection and flexible kwargs and backend ([768719c](768719cce8))

### Bug Fixes

* **pytest:** add dependency for mocking testing functions ([2f4fd45](2f4fd45700))
* **chromium-loader:** ensure it subclasses langchain's base loader ([b54d984](b54d984c13))
* **proxy-rotation:** removed duplicated arg and passed the loader_kwarhs correctly to the node ([1e9a564](1e9a564616))
* **proxy-rotation:** removed max_shape duplicate ([5d6d996](5d6d996e8f))

### Docs

* **refactor:** added proxy-rotation usage and refactor readthedocs ([e256b75](e256b758b2))
2024-05-13 09:19:15 +00:00
Marco Perini
7e8acd8e6a
Merge branch 'pre/beta' into fix/fetch-node-proxybroker 2024-05-13 11:17:37 +02:00
semantic-release-bot
4ccddda5eb ci(release): 0.11.0-beta.4 [skip ci]
## [0.11.0-beta.4](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.11.0-beta.3...v0.11.0-beta.4) (2024-05-12)

### Features

* add new prompt info ([e2350ed](e2350eda62))
2024-05-12 16:10:12 +00:00
semantic-release-bot
106fb12531 ci(release): 0.11.0-beta.3 [skip ci]
## [0.11.0-beta.3](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.11.0-beta.2...v0.11.0-beta.3) (2024-05-12)

### Features

* add support for deepseek-chat ([156b67b](156b67b91e)), closes [#222](https://github.com/VinciGit00/Scrapegraph-ai/issues/222)

### Docs

* add diagram showing general structure/flow of the library ([13ae918](13ae9180ac))
* update overview diagram with more models ([b441b30](b441b30a5c))
2024-05-12 07:14:00 +00:00
semantic-release-bot
d359814c4a ci(release): 0.10.1 [skip ci]
## [0.10.1](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.10.0...v0.10.1) (2024-05-11)

### Bug Fixes

* crash asyncio due dependency version ([2563773](2563773447))

### Docs

* fixed speechgraphexample ([4bf90f3](4bf90f32a8))
* fixed unused param and install ([cc28d5a](cc28d5a64f))
* **readme:** improve main readme ([ae5655f](ae5655fdde))
* update instructions to use with LocalAI ([198420c](198420c505))
* Update README.md ([772e064](772e064c55))
* updated sponsor logo ([f8d8d71](f8d8d71589))
2024-05-11 08:17:32 +00:00
Lorenzo Padoan
2563773447 fix: crash asyncio due dependency version 2024-05-11 10:13:41 +02:00
Federico Minutoli
fc2aa3ac1c Merge branch 'pre/beta' of https://github.com/DiTo97/Scrapegraph-ai into fix/fetch-node-proxybroker 2024-05-10 21:20:40 +02:00
Federico Minutoli
2f4fd45700 fix(pytest): add dependency for mocking testing functions 2024-05-10 21:05:48 +02:00
semantic-release-bot
7ae50c035e ci(release): 0.11.0-beta.2 [skip ci]
## [0.11.0-beta.2](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.11.0-beta.1...v0.11.0-beta.2) (2024-05-10)

### Features

* revert fetch_node ([864aa91](864aa91326))
2024-05-10 13:13:20 +00:00
semantic-release-bot
63c0dd9372 ci(release): 0.11.0-beta.1 [skip ci]
## [0.11.0-beta.1](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.10.0...v0.11.0-beta.1) (2024-05-10)

### Features

* Add support for passing pdf path as source ([f10f3b1](f10f3b1438))
* update info ([4ed0fb8](4ed0fb89c3))

### Bug Fixes

* add json integration ([0ab31c3](0ab31c3fdb))
* Augment the information getting fetched from a webpage ([f8ce3d5](f8ce3d5916))
* fixed bugs for csv and xml ([324e977](324e977b85))
* limit python version to < 3.12 ([a37fbbc](a37fbbcbcf))

### CI

* **release:** 0.10.0-beta.3 [skip ci] ([ad32298](ad32298e70))
* **release:** 0.10.0-beta.4 [skip ci] ([548bff9](548bff9d77))
* **release:** 0.10.0-beta.5 [skip ci] ([28c9dce](28c9dce7cb))
* **release:** 0.10.0-beta.6 [skip ci] ([460d292](460d292af2))
2024-05-10 09:15:24 +00:00
semantic-release-bot
460d292af2 ci(release): 0.10.0-beta.6 [skip ci]
## [0.10.0-beta.6](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.10.0-beta.5...v0.10.0-beta.6) (2024-05-09)

### Bug Fixes

* add json integration ([0ab31c3](0ab31c3fdb))
2024-05-09 19:08:34 +00:00
semantic-release-bot
28c9dce7cb ci(release): 0.10.0-beta.5 [skip ci]
## [0.10.0-beta.5](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.10.0-beta.4...v0.10.0-beta.5) (2024-05-09)

### Bug Fixes

* fixed bugs for csv and xml ([324e977](324e977b85))
2024-05-09 18:49:05 +00:00
semantic-release-bot
548bff9d77 ci(release): 0.10.0-beta.4 [skip ci]
## [0.10.0-beta.4](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.10.0-beta.3...v0.10.0-beta.4) (2024-05-09)

### Features

* Add support for passing pdf path as source ([f10f3b1](f10f3b1438))

### Bug Fixes

* limit python version to < 3.12 ([a37fbbc](a37fbbcbcf))
2024-05-09 18:17:45 +00:00
Marco Vinciguerra
590aab792d
Merge pull request #193 from daniele-roncaglioni/189-poetry-python-version-issue 2024-05-09 15:55:57 +02:00
roncaglionidaniele
a37fbbcbcf fix: limit python version to < 3.12 2024-05-09 15:47:01 +02:00
semantic-release-bot
ad32298e70 ci(release): 0.10.0-beta.3 [skip ci]
## [0.10.0-beta.3](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.10.0-beta.2...v0.10.0-beta.3) (2024-05-09)

### Features

* update info ([4ed0fb8](4ed0fb89c3))
2024-05-09 13:32:21 +00:00
semantic-release-bot
0ca52b1da6 ci(release): 0.10.0 [skip ci]
## [0.10.0](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.9.0...v0.10.0) (2024-05-08)

### Features

* add claude documentation ([5bdee55](5bdee55876))
* add gemini embeddings ([79daa4c](79daa4c112))
* add llava integration ([019b722](019b7223dc))
* add new hugging_face models ([d5547a4](d5547a450c))
* Fix bug for gemini case when embeddings config not passed ([726de28](726de28898))
* fixed custom_graphs example and robots_node ([84fcb44](84fcb44aaa))
* multiple graph instances ([dbb614a](dbb614a8dd))
* **node:** multiple url search in SearchGraph + fixes ([930adb3](930adb38f2))
* refactoring search function ([aeb1acb](aeb1acbf05))

### Bug Fixes

* bug on .toml ([f7d66f5](f7d66f5181))
* **llm:** fixed gemini api_key ([fd01b73](fd01b73b71))
* **examples:** local, mixed models and fixed SearchGraph embeddings problem ([6b71ec1](6b71ec1d2b))
* **examples:** openai std examples ([186c0d0](186c0d035d))
* removed .lock file for deployment ([d4c7d4e](d4c7d4e7fc))

### Docs

* update README.md ([17ec992](17ec992b49))

### CI

* **release:** 0.10.0-beta.1 [skip ci] ([c47a505](c47a505750))
* **release:** 0.10.0-beta.2 [skip ci] ([3f0e069](3f0e0694f3))
* **release:** 0.9.0-beta.2 [skip ci] ([5aa600c](5aa600cb0a))
* **release:** 0.9.0-beta.3 [skip ci] ([da8c72c](da8c72ce13))
* **release:** 0.9.0-beta.4 [skip ci] ([8c5397f](8c5397f67a))
* **release:** 0.9.0-beta.5 [skip ci] ([532adb6](532adb639d))
* **release:** 0.9.0-beta.6 [skip ci] ([8c0b46e](8c0b46eb40))
* **release:** 0.9.0-beta.7 [skip ci] ([6911e21](6911e21584))
* **release:** 0.9.0-beta.8 [skip ci] ([739aaa3](739aaa33c3))
2024-05-08 13:52:51 +00:00
semantic-release-bot
3f0e0694f3 ci(release): 0.10.0-beta.2 [skip ci]
## [0.10.0-beta.2](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.10.0-beta.1...v0.10.0-beta.2) (2024-05-08)

### Bug Fixes

* **examples:** local, mixed models and fixed SearchGraph embeddings problem ([6b71ec1](6b71ec1d2b))
* **examples:** openai std examples ([186c0d0](186c0d035d))
* removed .lock file for deployment ([d4c7d4e](d4c7d4e7fc))

### Docs

* update README.md ([17ec992](17ec992b49))
2024-05-08 13:47:59 +00:00
Marco Perini
186c0d035d fix(examples): openai std examples 2024-05-08 14:56:44 +02:00
Marco Vinciguerra
b326886250
Merge branch '88-blockscraper-implementation' into asdt 2024-05-07 13:27:30 +02:00
semantic-release-bot
c47a505750 ci(release): 0.10.0-beta.1 [skip ci]
## [0.10.0-beta.1](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.9.0...v0.10.0-beta.1) (2024-05-06)

### Features

* add claude documentation ([5bdee55](5bdee55876))
* add gemini embeddings ([79daa4c](79daa4c112))
* add llava integration ([019b722](019b7223dc))
* add new hugging_face models ([d5547a4](d5547a450c))
* Fix bug for gemini case when embeddings config not passed ([726de28](726de28898))
* fixed custom_graphs example and robots_node ([84fcb44](84fcb44aaa))
* multiple graph instances ([dbb614a](dbb614a8dd))
* **node:** multiple url search in SearchGraph + fixes ([930adb3](930adb38f2))
* refactoring search function ([aeb1acb](aeb1acbf05))

### Bug Fixes

* bug on .toml ([f7d66f5](f7d66f5181))
* **llm:** fixed gemini api_key ([fd01b73](fd01b73b71))

### CI

* **release:** 0.9.0-beta.2 [skip ci] ([5aa600c](5aa600cb0a))
* **release:** 0.9.0-beta.3 [skip ci] ([da8c72c](da8c72ce13))
* **release:** 0.9.0-beta.4 [skip ci] ([8c5397f](8c5397f67a))
* **release:** 0.9.0-beta.5 [skip ci] ([532adb6](532adb639d))
* **release:** 0.9.0-beta.6 [skip ci] ([8c0b46e](8c0b46eb40))
* **release:** 0.9.0-beta.7 [skip ci] ([6911e21](6911e21584))
* **release:** 0.9.0-beta.8 [skip ci] ([739aaa3](739aaa33c3))
2024-05-06 12:53:53 +00:00
semantic-release-bot
739aaa33c3 ci(release): 0.9.0-beta.8 [skip ci]
## [0.9.0-beta.8](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.9.0-beta.7...v0.9.0-beta.8) (2024-05-06)

### Features

* add llava integration ([019b722](019b7223dc))
2024-05-06 12:37:57 +00:00
semantic-release-bot
6911e21584 ci(release): 0.9.0-beta.7 [skip ci]
## [0.9.0-beta.7](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.9.0-beta.6...v0.9.0-beta.7) (2024-05-06)

### Bug Fixes

* **llm:** fixed gemini api_key ([fd01b73](fd01b73b71))
2024-05-06 11:24:38 +00:00
semantic-release-bot
8c0b46eb40 ci(release): 0.9.0-beta.6 [skip ci]
## [0.9.0-beta.6](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.9.0-beta.5...v0.9.0-beta.6) (2024-05-06)

### Features

* Fix bug for gemini case when embeddings config not passed ([726de28](726de28898))
2024-05-06 10:31:34 +00:00
semantic-release-bot
532adb639d ci(release): 0.9.0-beta.5 [skip ci]
## [0.9.0-beta.5](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.9.0-beta.4...v0.9.0-beta.5) (2024-05-06)

### Features

* fixed custom_graphs example and robots_node ([84fcb44](84fcb44aaa))
* multiple graph instances ([dbb614a](dbb614a8dd))
* **node:** multiple url search in SearchGraph + fixes ([930adb3](930adb38f2))
2024-05-06 07:54:17 +00:00
semantic-release-bot
8c5397f67a ci(release): 0.9.0-beta.4 [skip ci]
## [0.9.0-beta.4](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.9.0-beta.3...v0.9.0-beta.4) (2024-05-05)

### Features

* add gemini embeddings ([79daa4c](79daa4c112))
2024-05-05 15:57:31 +00:00
semantic-release-bot
da8c72ce13 ci(release): 0.9.0-beta.3 [skip ci]
## [0.9.0-beta.3](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.9.0-beta.2...v0.9.0-beta.3) (2024-05-05)

### Features

* add claude documentation ([5bdee55](5bdee55876))
2024-05-05 00:20:22 +00:00
semantic-release-bot
5aa600cb0a ci(release): 0.9.0-beta.2 [skip ci]
## [0.9.0-beta.2](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.9.0-beta.1...v0.9.0-beta.2) (2024-05-05)

### Features

* refactoring search function ([aeb1acb](aeb1acbf05))

### Bug Fixes

* bug on .toml ([f7d66f5](f7d66f5181))
2024-05-05 00:06:04 +00:00
Marco Perini
8c6dda6e27
Merge pull request #138 from VinciGit00/new-search-function
feat: refactoring search function
2024-05-05 02:02:41 +02:00
semantic-release-bot
14615a73c7 ci(release): 0.9.0-beta.1 [skip ci]
## [0.9.0-beta.1](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.8.0...v0.9.0-beta.1) (2024-05-04)

### Features

* Enable end users to pass model instances of HuggingFaceHub ([7599234](7599234ab9))

### Build

* **deps:** bump tqdm from 4.66.1 to 4.66.3 ([0a17c74](0a17c74e50))
* **deps:** bump tqdm from 4.66.1 to 4.66.3 ([aff6f98](aff6f983b0))

### CI

* **release:** 0.8.0-beta.1 [skip ci] ([d277b34](d277b349a9))
* **release:** 0.8.0-beta.2 [skip ci] ([892500a](892500afe9))
2024-05-04 19:22:02 +00:00
dependabot[bot]
aff6f983b0
build(deps): bump tqdm from 4.66.1 to 4.66.3
Bumps [tqdm](https://github.com/tqdm/tqdm) from 4.66.1 to 4.66.3.
- [Release notes](https://github.com/tqdm/tqdm/releases)
- [Commits](https://github.com/tqdm/tqdm/compare/v4.66.1...v4.66.3)

---
updated-dependencies:
- dependency-name: tqdm
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-05-04 07:45:48 +00:00
semantic-release-bot
af437b1c56 ci(release): 0.8.0 [skip ci]
## [0.8.0](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.7.0...v0.8.0) (2024-05-03)

### Features

* add pdf scraper ([10a9453](10a94530e3))

### CI

* **release:** 0.7.0-beta.3 [skip ci] ([fbb06ab](fbb06ab551))
2024-05-03 20:26:58 +00:00
VinciGit00
f7d66f5181 fix: bug on .toml 2024-05-03 22:01:41 +02:00
semantic-release-bot
38788455f9 ci(release): 0.7.0 [skip ci]
## [0.7.0](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.6.2...v0.7.0) (2024-05-03)

### Features

* add base_node to __init__.py ([cb1cb61](cb1cb616b7))
* Azure implementation + embeddings refactoring ([aa9271e](aa9271e7bc))

### Refactor

* Changed the way embedding model is created in AbstractGraph class and removed handling of embedding model creation from RAGNode. Now AbstractGraph will call a dedicated method for embedding models instead of _create_llm. This makes it easy to use any LLM with any supported embedding model. ([819cbcd](819cbcd3be))

### CI

* **release:** 0.7.0-beta.1 [skip ci] ([98dec36](98dec36c60))
* **release:** 0.7.0-beta.2 [skip ci] ([42fa02e](42fa02e65a))
2024-05-03 19:45:17 +00:00
semantic-release-bot
42fa02e65a ci(release): 0.7.0-beta.2 [skip ci]
## [0.7.0-beta.2](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.7.0-beta.1...v0.7.0-beta.2) (2024-05-03)

### Features

* Azure implementation + embeddings refactoring ([aa9271e](aa9271e7bc))

### Refactor

* Changed the way embedding model is created in AbstractGraph class and removed handling of embedding model creation from RAGNode. Now AbstractGraph will call a dedicated method for embedding models instead of _create_llm. This makes it easy to use any LLM with any supported embedding model. ([819cbcd](819cbcd3be))
2024-05-03 19:41:30 +00:00
VinciGit00
aeb1acbf05 feat: refactoring search function 2024-05-03 21:06:09 +02:00
semantic-release-bot
98dec36c60 ci(release): 0.7.0-beta.1 [skip ci]
## [0.7.0-beta.1](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.6.2...v0.7.0-beta.1) (2024-05-03)

### Features

* add base_node to __init__.py ([cb1cb61](cb1cb616b7))
2024-05-03 12:19:52 +00:00
semantic-release-bot
2f478f861e ci(release): 0.6.2 [skip ci]
## [0.6.2](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.6.1...v0.6.2) (2024-05-02)

### Bug Fixes

* add to requirements.txt langchain-aws = "^0.1.2" ([1afa319](1afa31910d))

### Docs

* **tree:** added roadmap ([c8eeff8](c8eeff873d))
* **roadmap:** open contributions ([4441505](4441505b23))
* typo ([faa3498](faa3498fa7))

### CI

* **release:** 0.6.1-beta.1 [skip ci] ([75a4042](75a4042a23))
2024-05-02 19:07:31 +00:00
Marco Vinciguerra
96ebcfcc35
Merge branch 'pre/beta' into main 2024-05-02 21:05:28 +02:00
semantic-release-bot
2b23a3c771 ci(release): 0.6.1 [skip ci]
## [0.6.1](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.6.0...v0.6.1) (2024-05-02)

### Bug Fixes

* gemini errror ([2ea54ea](2ea54eab1d))
2024-05-02 16:58:06 +00:00
semantic-release-bot
75a4042a23 ci(release): 0.6.1-beta.1 [skip ci]
## [0.6.1-beta.1](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.6.0...v0.6.1-beta.1) (2024-05-02)

### Bug Fixes

* add to requirements.txt langchain-aws = "^0.1.2" ([1afa319](1afa31910d))
2024-05-02 15:58:40 +00:00
Marco Vinciguerra
579a27faf9
Merge pull request #126 from VinciGit00/bedrock_support
feat: bedrock support
2024-05-02 17:57:20 +02:00
semantic-release-bot
35ae76f9ce ci(release): 0.6.0 [skip ci]
## [0.6.0](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.5.2...v0.6.0) (2024-05-02)

### Features

* added node and graph for CSV scraping ([4d542a8](4d542a88f7))
* Allow end users to pass model instances for llm and embedding model ([b86aac2](b86aac2188))
* modified node name ([02d1af0](02d1af006c))

### CI

* **release:** 0.5.0-beta.7 [skip ci] ([40b2a34](40b2a346d5))
* **release:** 0.5.0-beta.8 [skip ci] ([c11331a](c11331a26a))
2024-05-02 15:56:48 +00:00
Marco Vinciguerra
a2d5c75f10
Merge branch 'pre/beta' into main 2024-05-02 17:55:21 +02:00
semantic-release-bot
c11331a26a ci(release): 0.5.0-beta.8 [skip ci]
## [0.5.0-beta.8](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.5.0-beta.7...v0.5.0-beta.8) (2024-05-02)

### Features

* Allow end users to pass model instances for llm and embedding model ([b86aac2](b86aac2188))
2024-05-02 15:00:33 +00:00
VinciGit00
16de49fa08 add integration for bedrock
Co-Authored-By: redrusty2 <15157208+redrusty2@users.noreply.github.com>
2024-05-02 13:47:17 +02:00
semantic-release-bot
15be111422 ci(release): 0.5.2 [skip ci]
## [0.5.2](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.5.1...v0.5.2) (2024-05-02)

### Bug Fixes

* bug on script_creator_graph.py ([4a3bc37](4a3bc37f2f))
2024-05-02 07:25:07 +00:00
semantic-release-bot
55a49a4381 ci(release): 0.5.1 [skip ci]
## [0.5.1](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.5.0...v0.5.1) (2024-05-02)

### Bug Fixes

* examples and graphs ([5cf4e4f](5cf4e4f92f))

### Docs

* added venv suggestion ([ba2b24b](ba2b24b4cd))
* base and fetch node ([e981796](e9817963c8))
* change contributing.md with new ci/cd workflow ([3e91a46](3e91a46522))
* fixed basegraph docstring ([29427c2](29427c2334))
* graphs and helpers docstrings ([0631985](0631985e61))
* refactor examples ([c11fc28](c11fc28896))
* refactor models docstrings ([18c20eb](18c20eb03d))
* refactor nodes docstrings ([1409797](1409797475))
* update utils docstrings ([cf038b3](cf038b33ea))
2024-05-02 07:22:11 +00:00