CodeCow/Scrapegraph-ai
1
0
Fork 0
mirror of https://github.com/VinciGit00/Scrapegraph-ai.git synced 2026-07-12 21:01:56 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
2,293 Commits 2 Branches 448 Tags 17 MiB
5faac9fb46
Commit Graph

515 Commits

Author SHA1 Message Date
semantic-release-bot
950e859b1b ci(release): 1.29.0-beta.1 [skip ci] 
## [1.29.0-beta.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.28.0...v1.29.0-beta.1) (2024-11-04)

### Features

* Serper API integration for Google search ([c218546](c218546a3d))

### Bug Fixes

* resolved outparser issue ([e8cabfd](e8cabfd1ae))

### CI

* **release:** 1.28.0-beta.3 [skip ci] ([65d39bb](65d39bbaf0))
* **release:** 1.28.0-beta.4 [skip ci] ([b90bb00](b90bb00beb))
 2024-11-04 08:10:24 +00:00
Marco Vinciguerra
8d7fd08730
Merge branch 'main' into pre/beta 2024-11-04 09:08:37 +01:00
semantic-release-bot
b90bb00beb ci(release): 1.28.0-beta.4 [skip ci] 
## [1.28.0-beta.4](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.28.0-beta.3...v1.28.0-beta.4) (2024-11-03)

### Bug Fixes

* resolved outparser issue ([e8cabfd](e8cabfd1ae))
 2024-11-03 16:57:13 +00:00
semantic-release-bot
65d39bbaf0 ci(release): 1.28.0-beta.3 [skip ci] 
## [1.28.0-beta.3](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.28.0-beta.2...v1.28.0-beta.3) (2024-11-02)

### Features

* Serper API integration for Google search ([c218546](c218546a3d))
 2024-11-02 17:36:10 +00:00
semantic-release-bot
7b5010f949 ci(release): 1.28.0 [skip ci] 
## [1.28.0](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.27.0...v1.28.0) (2024-11-01)

### Features

* add new mistral models ([6914170](6914170890))
* refactoring of the base_graph ([12a6c18](12a6c18f6a))
* update generate answer ([7172b32](7172b32a0f))

### Bug Fixes

* **AbstractGraph:** manually select model tokens ([f79f399](f79f399ee0)), closes [#768](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/768)

### CI

* **release:** 1.27.0-beta.11 [skip ci] ([3b2cadc](3b2cadce1a))
* **release:** 1.27.0-beta.12 [skip ci] ([62369e3](62369e3e28))
* **release:** 1.27.0-beta.13 [skip ci] ([deed355](deed355551)), closes [#768](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/768)
* **release:** 1.28.0-beta.1 [skip ci] ([8cbe582](8cbe582ea9)), closes [#768](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/768) [#768](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/768)
* **release:** 1.28.0-beta.2 [skip ci] ([7e3598d](7e3598ddfa))
 2024-11-01 09:44:12 +00:00
semantic-release-bot
7e3598ddfa ci(release): 1.28.0-beta.2 [skip ci] 
## [1.28.0-beta.2](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.28.0-beta.1...v1.28.0-beta.2) (2024-10-31)

### Features

* update generate answer ([7172b32](7172b32a0f))
 2024-10-31 09:21:45 +00:00
semantic-release-bot
8cbe582ea9 ci(release): 1.28.0-beta.1 [skip ci] 
## [1.28.0-beta.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.27.0...v1.28.0-beta.1) (2024-10-30)

### Features

* add new mistral models ([6914170](6914170890))
* refactoring of the base_graph ([12a6c18](12a6c18f6a))

### Bug Fixes

* **AbstractGraph:** manually select model tokens ([f79f399](f79f399ee0)), closes [#768](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/768)

### CI

* **release:** 1.27.0-beta.11 [skip ci] ([3b2cadc](3b2cadce1a))
* **release:** 1.27.0-beta.12 [skip ci] ([62369e3](62369e3e28))
* **release:** 1.27.0-beta.13 [skip ci] ([deed355](deed355551)), closes [#768](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/768)
 2024-10-30 08:02:00 +00:00
Marco Vinciguerra
09c967822d
Merge branch 'pre/beta' into main 2024-10-30 09:00:20 +01:00
semantic-release-bot
deed355551 ci(release): 1.27.0-beta.13 [skip ci] 
## [1.27.0-beta.13](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.27.0-beta.12...v1.27.0-beta.13) (2024-10-29)

### Bug Fixes

* **AbstractGraph:** manually select model tokens ([f79f399](f79f399ee0)), closes [#768](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/768)
 2024-10-29 08:02:25 +00:00
semantic-release-bot
62369e3e28 ci(release): 1.27.0-beta.12 [skip ci] 
## [1.27.0-beta.12](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.27.0-beta.11...v1.27.0-beta.12) (2024-10-28)

### Features

* refactoring of the base_graph ([12a6c18](12a6c18f6a))
 2024-10-28 08:59:32 +00:00
semantic-release-bot
3b2cadce1a ci(release): 1.27.0-beta.11 [skip ci] 
## [1.27.0-beta.11](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.27.0-beta.10...v1.27.0-beta.11) (2024-10-27)

### Features

* add new mistral models ([6914170](6914170890))
 2024-10-27 09:23:55 +00:00
semantic-release-bot
3933d64601 ci(release): 1.27.0 [skip ci] 
## [1.27.0](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.7...v1.27.0) (2024-10-26)

### Features

* add conditional node structure to the smart_scraper_graph and implemented a structured way to check condition ([cacd9cd](cacd9cde00))
* add integration with scrape.do ([ae275ec](ae275ec5e8))
* add model integration gpt4 ([51c55eb](51c55eb3a2))
* implement ScrapeGraph class for only web scraping automation ([612c644](612c644623))
* Implement SmartScraperMultiParseMergeFirstGraph class that scrapes a list of URLs and merge the content first and finally generates answers to a given prompt. ([3e3e1b2](3e3e1b2f3a))
* refactoring of export functions ([0ea00c0](0ea00c078f))
* refactoring of get_probable_tags node ([f658092](f658092dff))
* refactoring of ScrapeGraph to SmartScraperLiteGraph ([52b6bf5](52b6bf5fb8))

### Bug Fixes

* fix export function ([c8a000f](c8a000f1d9))
* fix the example variable name ([69ff649](69ff649556))
* remove variable "max_result" not being used in the code ([e76a68a](e76a68a782))

### chore

* fix example ([9cd9a87](9cd9a874f9))

### Test

* Add scrape_graph test ([cdb3c11](cdb3c1100e))
* Add smart_scraper_multi_parse_merge_first_graph test ([464b8b0](464b8b04ea))

### CI

* **release:** 1.26.6-beta.1 [skip ci] ([e0fc457](e0fc457d1a))
* **release:** 1.27.0-beta.1 [skip ci] ([9266a36](9266a36b2e))
* **release:** 1.27.0-beta.10 [skip ci] ([eee131e](eee131e959))
* **release:** 1.27.0-beta.2 [skip ci] ([d84d295](d84d295389))
* **release:** 1.27.0-beta.3 [skip ci] ([f576afa](f576afaf0c))
* **release:** 1.27.0-beta.4 [skip ci] ([3d6bbcd](3d6bbcdaa3))
* **release:** 1.27.0-beta.5 [skip ci] ([5002c71](5002c713d5))
* **release:** 1.27.0-beta.6 [skip ci] ([94b9836](94b9836ef6))
* **release:** 1.27.0-beta.7 [skip ci] ([407f1ce](407f1ce4eb))
* **release:** 1.27.0-beta.8 [skip ci] ([4f1ed93](4f1ed939e6))
* **release:** 1.27.0-beta.9 [skip ci] ([fd57cc7](fd57cc7c12))
 2024-10-26 08:06:36 +00:00
semantic-release-bot
eee131e959 ci(release): 1.27.0-beta.10 [skip ci] 
## [1.27.0-beta.10](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.27.0-beta.9...v1.27.0-beta.10) (2024-10-25)

### Bug Fixes

* fix export function ([c8a000f](c8a000f1d9))
 2024-10-25 06:45:23 +00:00
semantic-release-bot
fd57cc7c12 ci(release): 1.27.0-beta.9 [skip ci] 
## [1.27.0-beta.9](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.27.0-beta.8...v1.27.0-beta.9) (2024-10-24)

### Features

* add model integration gpt4 ([51c55eb](51c55eb3a2))
 2024-10-24 22:39:44 +00:00
semantic-release-bot
4f1ed939e6 ci(release): 1.27.0-beta.8 [skip ci] 
## [1.27.0-beta.8](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.27.0-beta.7...v1.27.0-beta.8) (2024-10-24)

### Bug Fixes

* removed tokenizer ([a184716](a18471688f))

### CI

* **release:** 1.26.7 [skip ci] ([ec9ef2b](ec9ef2bcda))
 2024-10-24 06:55:58 +00:00
Marco Vinciguerra
066e77dbe7
Merge branch 'main' into pre/beta 2024-10-24 08:54:17 +02:00
semantic-release-bot
407f1ce4eb ci(release): 1.27.0-beta.7 [skip ci] 
## [1.27.0-beta.7](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.27.0-beta.6...v1.27.0-beta.7) (2024-10-24)

### Features

* refactoring of get_probable_tags node ([f658092](f658092dff))
 2024-10-24 06:45:14 +00:00
semantic-release-bot
94b9836ef6 ci(release): 1.27.0-beta.6 [skip ci] 
## [1.27.0-beta.6](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.27.0-beta.5...v1.27.0-beta.6) (2024-10-23)

### Features

* add integration with scrape.do ([ae275ec](ae275ec5e8))
 2024-10-23 10:09:36 +00:00
semantic-release-bot
5002c713d5 ci(release): 1.27.0-beta.5 [skip ci] 
## [1.27.0-beta.5](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.27.0-beta.4...v1.27.0-beta.5) (2024-10-22)

### Features

* refactoring of export functions ([0ea00c0](0ea00c078f))
 2024-10-22 07:06:26 +00:00
semantic-release-bot
3d6bbcdaa3 ci(release): 1.27.0-beta.4 [skip ci] 
## [1.27.0-beta.4](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.27.0-beta.3...v1.27.0-beta.4) (2024-10-21)

### Features

* refactoring of ScrapeGraph to SmartScraperLiteGraph ([52b6bf5](52b6bf5fb8))
 2024-10-21 08:14:25 +00:00
semantic-release-bot
f576afaf0c ci(release): 1.27.0-beta.3 [skip ci] 
## [1.27.0-beta.3](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.27.0-beta.2...v1.27.0-beta.3) (2024-10-20)

### Features

* implement ScrapeGraph class for only web scraping automation ([612c644](612c644623))
* Implement SmartScraperMultiParseMergeFirstGraph class that scrapes a list of URLs and merge the content first and finally generates answers to a given prompt. ([3e3e1b2](3e3e1b2f3a))

### Bug Fixes

* fix the example variable name ([69ff649](69ff649556))

### chore

* fix example ([9cd9a87](9cd9a874f9))

### Test

* Add scrape_graph test ([cdb3c11](cdb3c1100e))
* Add smart_scraper_multi_parse_merge_first_graph test ([464b8b0](464b8b04ea))
 2024-10-20 08:15:19 +00:00
semantic-release-bot
ec9ef2bcda ci(release): 1.26.7 [skip ci] 
## [1.26.7](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.6...v1.26.7) (2024-10-19)

### Bug Fixes

* removed tokenizer ([a184716](a18471688f))
 2024-10-19 05:20:39 +00:00
semantic-release-bot
d84d295389 ci(release): 1.27.0-beta.2 [skip ci] 
## [1.27.0-beta.2](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.27.0-beta.1...v1.27.0-beta.2) (2024-10-18)

### Bug Fixes

* refactoring of gpt2 tokenizer ([44c3f9c](44c3f9c989))

### CI

* **release:** 1.26.6 [skip ci] ([a4634c7](a4634c7331))
 2024-10-18 20:18:25 +00:00
Federico Aguzzi
8cb9646a45 Merge branch 'main' into pre/beta 2024-10-18 22:16:39 +02:00
semantic-release-bot
a4634c7331 ci(release): 1.26.6 [skip ci] 
## [1.26.6](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.5...v1.26.6) (2024-10-18)

### Bug Fixes

* refactoring of gpt2 tokenizer ([44c3f9c](44c3f9c989))
 2024-10-18 07:00:26 +00:00
semantic-release-bot
9266a36b2e ci(release): 1.27.0-beta.1 [skip ci] 
## [1.27.0-beta.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.6-beta.1...v1.27.0-beta.1) (2024-10-16)

### Features

* add conditional node structure to the smart_scraper_graph and implemented a structured way to check condition ([cacd9cd](cacd9cde00))
 2024-10-16 15:54:35 +00:00
Marco Vinciguerra
aaa011cc89
Merge pull request #754 from ekinsenler/cond_node_refactor 
feat: add conditional node to the smart_scraper_graph
 2024-10-16 17:53:10 +02:00
ekinsenler
eaa83edc04 update project requirement and add example 2024-10-16 15:21:23 +03:00
semantic-release-bot
e0fc457d1a ci(release): 1.26.6-beta.1 [skip ci] 
## [1.26.6-beta.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.5...v1.26.6-beta.1) (2024-10-14)

### Bug Fixes

* remove variable "max_result" not being used in the code ([e76a68a](e76a68a782))
 2024-10-14 12:14:59 +00:00
semantic-release-bot
931b975d79 ci(release): 1.26.5 [skip ci] 
## [1.26.5](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.4...v1.26.5) (2024-10-13)

### Bug Fixes

* async invocation ([c2179ab](c2179abc60))
 2024-10-13 09:32:08 +00:00
semantic-release-bot
0e4ff09a10 ci(release): 1.26.4 [skip ci] 
## [1.26.4](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.3...v1.26.4) (2024-10-13)

### Bug Fixes

* csv_node ([b208ef7](b208ef792c))
 2024-10-13 08:34:05 +00:00
semantic-release-bot
c833d7969a ci(release): 1.26.3 [skip ci] 
## [1.26.3](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.2...v1.26.3) (2024-10-13)

### Bug Fixes

* generate answer node ([431b209](431b2093be))
 2024-10-13 08:27:00 +00:00
semantic-release-bot
673241a9ca ci(release): 1.26.2 [skip ci] 
## [1.26.2](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.1...v1.26.2) (2024-10-13)

### Bug Fixes

* add new dipendency ([35c44e4](35c44e4d2c))
 2024-10-13 08:18:57 +00:00
Marco Vinciguerra
54b37bbda5 Merge branch 'main' of https://github.com/ScrapeGraphAI/Scrapegraph-ai 2024-10-13 10:17:05 +02:00
Marco Vinciguerra
35c44e4d2c fix: add new dipendency 2024-10-13 10:17:03 +02:00
semantic-release-bot
cd36c2a0f3 ci(release): 1.26.1 [skip ci] 
## [1.26.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.0...v1.26.1) (2024-10-13)

### Bug Fixes

* async tim ([7b07368](7b073686ef))
* typo ([9c62f24](9c62f24e73))
* typo ([c9d6ef5](c9d6ef5915))
 2024-10-13 08:12:23 +00:00
Marco Vinciguerra
9c62f24e73 fix: typo 2024-10-13 10:10:56 +02:00
Marco Vinciguerra
c9d6ef5915 fix: typo 2024-10-13 10:09:04 +02:00
Marco Vinciguerra
c8f821c45d Merge branch 'main' of https://github.com/ScrapeGraphAI/Scrapegraph-ai 2024-10-13 10:07:54 +02:00
Marco Vinciguerra
7b073686ef fix: async tim 2024-10-13 10:07:40 +02:00
semantic-release-bot
70a883fa32 ci(release): 1.26.0 [skip ci] 
## [1.26.0](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.25.2...v1.26.0) (2024-10-13)

### Features

* add deep scraper implementation ([4b371f4](4b371f4d94))
* add google proxy support ([a986523](a986523884))
* add html_mode to smart_scraper ([bdcffd6](bdcffd6360))
* add reasoning integration ([b2822f6](b2822f620a))
* async invocation ([257f393](257f393761))
* conditional_node ([f837dc1](f837dc16ce))
* finished basic version of deep scraper ([85cb957](85cb957297))
* prompt refactoring ([5a2f6d9](5a2f6d9a77))
* refactoring fetch_node ([39a029e](39a029ed9a))
* refactoring of mdscraper ([3b7b701](3b7b701a89))
* refactoring of research web ([26f89d8](26f89d895d))
* refactoring of the conditional node ([420c71b](420c71ba2c))
* undected_chromedriver support ([80ece21](80ece2179a))
* update chromium loader ([4f816f3](4f816f3b04))

### Bug Fixes

* bugs ([026a70b](026a70bd3a))
* import error ([37b6ba0](37b6ba08ae))
* integration with html_mode ([f87ffa1](f87ffa1d8d))
* nodes prompt ([8753537](8753537ecd))
* pyproject.toml ([3b27c5e](3b27c5e88c))
* refactoring prompts ([c655642](c655642577))
* removed pdf_scraper graph and created document scraper ([a57da96](a57da96175))
* search_on_web paremter ([7f03ec1](7f03ec15de))
* typo ([e285127](e28512720c))

### Perf

* Proxy integration in googlesearch ([e828c70](e828c7010a))

### CI

* **release:** 1.22.0-beta.4 [skip ci] ([4330179](4330179cb6))
* **release:** 1.22.0-beta.5 [skip ci] ([6d8f543](6d8f5435d1))
* **release:** 1.22.0-beta.6 [skip ci] ([39f7815](39f78154a6))
* **release:** 1.26.0-beta.1 [skip ci] ([ac31d7f](ac31d7f710))
* **release:** 1.26.0-beta.10 [skip ci] ([0c7ebe2](0c7ebe28ac))
* **release:** 1.26.0-beta.11 [skip ci] ([6d8828a](6d8828aa62))
* **release:** 1.26.0-beta.12 [skip ci] ([44d10aa](44d10aa1c0))
* **release:** 1.26.0-beta.13 [skip ci] ([12f2b99](12f2b9946b))
* **release:** 1.26.0-beta.14 [skip ci] ([eb25725](eb257259f8))
* **release:** 1.26.0-beta.15 [skip ci] ([528a974](528a9746fe))
* **release:** 1.26.0-beta.16 [skip ci] ([04bd2a8](04bd2a87fb))
* **release:** 1.26.0-beta.17 [skip ci] ([f17089c](f17089c123))
* **release:** 1.26.0-beta.2 [skip ci] ([5cedeb8](5cedeb8486))
* **release:** 1.26.0-beta.3 [skip ci] ([4f65be4](4f65be44b5))
* **release:** 1.26.0-beta.4 [skip ci] ([84d7937](84d7937472))
* **release:** 1.26.0-beta.5 [skip ci] ([ea9ed1a](ea9ed1a981))
* **release:** 1.26.0-beta.6 [skip ci] ([4cd21f5](4cd21f500d))
* **release:** 1.26.0-beta.7 [skip ci] ([482f060](482f060c9a))
* **release:** 1.26.0-beta.8 [skip ci] ([38b795e](38b795e48a))
* **release:** 1.26.0-beta.9 [skip ci] ([4dc0699](4dc0699483))
 2024-10-13 07:34:53 +00:00
semantic-release-bot
f17089c123 ci(release): 1.26.0-beta.17 [skip ci] 
## [1.26.0-beta.17](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.0-beta.16...v1.26.0-beta.17) (2024-10-12)

### Features

* async invocation ([257f393](257f393761))
* refactoring of mdscraper ([3b7b701](3b7b701a89))

### Bug Fixes

* bugs ([026a70b](026a70bd3a))
* search_on_web paremter ([7f03ec1](7f03ec15de))
 2024-10-12 07:59:48 +00:00
semantic-release-bot
04bd2a87fb ci(release): 1.26.0-beta.16 [skip ci] 
## [1.26.0-beta.16](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.0-beta.15...v1.26.0-beta.16) (2024-10-11)

### Features

* add google proxy support ([a986523](a986523884))

### Bug Fixes

* typo ([e285127](e28512720c))

### Perf

* Proxy integration in googlesearch ([e828c70](e828c7010a))
 2024-10-11 10:14:12 +00:00
Marco Vinciguerra
e28512720c fix: typo 2024-10-11 12:12:41 +02:00
Marco Vinciguerra
630e6405c8 Merge branch 'pre/beta' of https://github.com/ScrapeGraphAI/Scrapegraph-ai into pre/beta 2024-10-11 12:08:51 +02:00
Marco Vinciguerra
a986523884 feat: add google proxy support 2024-10-11 12:08:50 +02:00
Marco Vinciguerra
0a275d5ac3
Merge pull request #743 from aziz-ullah-khan/pre/beta 
Replacement of Google search to googlesearch-python and integration of Proxy.
 2024-10-11 11:17:29 +02:00
semantic-release-bot
528a9746fe ci(release): 1.26.0-beta.15 [skip ci] 
## [1.26.0-beta.15](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.0-beta.14...v1.26.0-beta.15) (2024-10-11)

### Features

* prompt refactoring ([5a2f6d9](5a2f6d9a77))
 2024-10-11 05:41:14 +00:00
aziz-ullah-khan
6fd9f14b57 Merge remote-tracking branch 'origin' into pre/beta 2024-10-11 10:21:50 +05:00
aziz-ullah-khan
36875b67f1 Merge remote-tracking branch 'refs/remotes/origin/pre/beta' into pre/beta 2024-10-11 10:08:07 +05:00