Commit Graph

2293 Commits

Author SHA1 Message Date
mayurdb
a458ec4b9f Update the prompt for the search_link_node 2024-05-14 16:59:16 +02:00
Marco Perini
a6e1813ddd fix(fetch_node): bug in handling local files 2024-05-14 16:51:10 +02:00
Marco Perini
fcb3abb01d feat(omni-search): added omni search graph and updated docs 2024-05-14 16:26:43 +02:00
VinciGit00
e53766b16e feat: add logger integration 2024-05-14 15:20:39 +02:00
Marco Perini
a296927624 feat(omni-scraper): working OmniScraperGraph with images 2024-05-14 13:46:49 +02:00
Marco Perini
90955ca52f feat(gpt-4o): image to text single node test 2024-05-14 11:43:21 +02:00
semantic-release-bot
218b8ede8a ci(release): 0.11.0-beta.10 [skip ci]
## [0.11.0-beta.10](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.11.0-beta.9...v0.11.0-beta.10) (2024-05-14)

### Features

* add gpt-4o ([52a4a3b](52a4a3b22d)), closes [#232](https://github.com/VinciGit00/Scrapegraph-ai/issues/232)
2024-05-14 09:29:03 +00:00
Marco Perini
8e46799515
Merge pull request #235 from f-aguzzi/pre/beta
feat: add gpt-4o to the model dictionary
2024-05-14 11:27:41 +02:00
Federico Aguzzi
52a4a3b22d feat: add gpt-4o
closes #232
2024-05-14 11:11:34 +02:00
semantic-release-bot
d2877d89e5 ci(release): 0.11.0-beta.9 [skip ci]
## [0.11.0-beta.9](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.11.0-beta.8...v0.11.0-beta.9) (2024-05-14)

### Bug Fixes

* crash asyncio due dependency version ([2563773](2563773447))

### chore

* update models_tokens.py with new model configurations ([d9752b1](d9752b1619))

### Docs

* fixed speechgraphexample ([4bf90f3](4bf90f32a8))
* fixed unused param and install ([cc28d5a](cc28d5a64f))
* **readme:** improve main readme ([ae5655f](ae5655fdde))
* **concurrent:** refactor theme and added benchmarck searchgraph ([ced2bbc](ced2bbcdc9))
* update instructions to use with LocalAI ([198420c](198420c505))
* Update README.md ([772e064](772e064c55))
* updated sponsor logo ([f8d8d71](f8d8d71589))

### CI

* **release:** 0.10.1 [skip ci] ([d359814](d359814c4a))
2024-05-14 08:37:42 +00:00
VinciGit00
5914fa8c64 Update poetry.lock 2024-05-14 10:36:21 +02:00
VinciGit00
d6f5ca874f Merge branch 'main' into pre/beta 2024-05-14 10:24:29 +02:00
Marco Perini
4fd8a39d5b Merge branch 'pre/beta' of https://github.com/VinciGit00/Scrapegraph-ai into pre/beta 2024-05-14 02:21:57 +02:00
Marco Perini
ced2bbcdc9 docs(concurrent): refactor theme and added benchmarck searchgraph 2024-05-14 02:21:46 +02:00
semantic-release-bot
fa4edb4703 ci(release): 0.11.0-beta.8 [skip ci]
## [0.11.0-beta.8](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.11.0-beta.7...v0.11.0-beta.8) (2024-05-13)

### Features

* **parallel-exeuction:** add asyncio event loop dispatcher with semaphore for parallel graph instances ([627cbee](627cbeeb20))
* **batchsize:** tested different batch sizes and systems ([a8d5e7d](a8d5e7db05))

### Bug Fixes

* **asyncio:** replaced deepcopy with copy due to serialization problems ([dedc733](dedc733047))
2024-05-13 21:52:03 +00:00
Marco Perini
df918fa8e6
Merge pull request #231 from arsaboo/models
chore: update models_tokens.py with new model configurations
2024-05-13 23:51:45 +02:00
Marco Perini
62a74a5737
Merge pull request #213 from DiTo97/feat/parallel-node-execution
feat(parallel-exeuction): parallel asyncio event loop dispatcher
2024-05-13 23:50:48 +02:00
Marco Perini
367dea5cbd
Merge branch 'pre/beta' into feat/parallel-node-execution 2024-05-13 23:50:40 +02:00
Marco Perini
a8d5e7db05 feat(batchsize): tested different batch sizes and systems 2024-05-13 23:49:48 +02:00
Alok Saboo
d9752b1619 chore: update models_tokens.py with new model configurations 2024-05-13 17:22:32 -04:00
VinciGit00
c0d26d61d7 ad bedrocl 2024-05-13 20:17:03 +02:00
Marco Vinciguerra
28ab8da1fd
Merge pull request #229 from JGalego/feat/custom-aws-creds
feat: Custom AWS credentials
2024-05-13 20:14:28 +02:00
JGalego
859c5d5ba5 Refactored to include custom AWS client for bedrock; Added missing Anthropic class 2024-05-13 17:57:53 +01:00
Marco Perini
dedc733047 fix(asyncio): replaced deepcopy with copy due to serialization problems 2024-05-13 18:46:34 +02:00
Marco Vinciguerra
f3d44c09ae
Merge pull request #228 from JGalego/fix/bedrock-support
fix: Amazon Bedrock Support
2024-05-13 14:57:23 +02:00
semantic-release-bot
f0f73736f7 ci(release): 0.11.0-beta.7 [skip ci]
## [0.11.0-beta.7](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.11.0-beta.6...v0.11.0-beta.7) (2024-05-13)

### Bug Fixes

* bug for claude ([d0167de](d0167dee71))

### Docs

* **refactor:** changed example ([c7ec114](c7ec114274))
2024-05-13 11:44:57 +00:00
VinciGit00
d0167dee71 fix: bug for claude 2024-05-13 13:43:42 +02:00
JGalego
39be38f292 Fixed anthropic/bedrock conflict; Removed duplicate class Claude; Updated BedrockEmbeddings class 2024-05-13 12:35:42 +01:00
VinciGit00
7c91f9f94c add examples for deepseek 2024-05-13 12:56:57 +02:00
Marco Perini
60ed80ff66 Merge branch 'pre/beta' of https://github.com/VinciGit00/Scrapegraph-ai into pre/beta 2024-05-13 12:28:11 +02:00
Marco Perini
c7ec114274 docs(refactor): changed example 2024-05-13 12:28:03 +02:00
semantic-release-bot
2724d3dd5f ci(release): 0.11.0-beta.6 [skip ci]
## [0.11.0-beta.6](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.11.0-beta.5...v0.11.0-beta.6) (2024-05-13)

### Bug Fixes

* **fetch-node:** removed isSoup from default ([0c15947](0c1594737f))
2024-05-13 10:11:05 +00:00
Marco Perini
0c1594737f fix(fetch-node): removed isSoup from default 2024-05-13 12:09:55 +02:00
semantic-release-bot
353382b4d3 ci(release): 0.11.0-beta.5 [skip ci]
## [0.11.0-beta.5](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.11.0-beta.4...v0.11.0-beta.5) (2024-05-13)

### Features

* **webdriver-backend:** add dynamic import scripts from module and file ([db2234b](db2234bf5d))
* **proxy-rotation:** add parse (IP address) or search (from broker) functionality for proxy rotation ([2170131](217013181d))
* added proxy rotation ([0c36a7e](0c36a7ec1f))
* **safe-web-driver:** enchanced the original `AsyncChromiumLoader` web driver with proxy protection and flexible kwargs and backend ([768719c](768719cce8))

### Bug Fixes

* **pytest:** add dependency for mocking testing functions ([2f4fd45](2f4fd45700))
* **chromium-loader:** ensure it subclasses langchain's base loader ([b54d984](b54d984c13))
* **proxy-rotation:** removed duplicated arg and passed the loader_kwarhs correctly to the node ([1e9a564](1e9a564616))
* **proxy-rotation:** removed max_shape duplicate ([5d6d996](5d6d996e8f))

### Docs

* **refactor:** added proxy-rotation usage and refactor readthedocs ([e256b75](e256b758b2))
2024-05-13 09:19:15 +00:00
Marco Vinciguerra
fc56d6b7e4
Update README.md 2024-05-13 11:18:36 +02:00
Marco Perini
b8079f8759
Merge pull request #211 from DiTo97/fix/fetch-node-proxybroker
feat: flexible web driver and proxy broker in fetch node
2024-05-13 11:17:51 +02:00
Marco Perini
7e8acd8e6a
Merge branch 'pre/beta' into fix/fetch-node-proxybroker 2024-05-13 11:17:37 +02:00
Marco Perini
0c36a7ec1f feat: added proxy rotation 2024-05-13 11:04:56 +02:00
Marco Perini
e256b758b2 docs(refactor): added proxy-rotation usage and refactor readthedocs 2024-05-13 11:03:33 +02:00
Marco Perini
5d6d996e8f fix(proxy-rotation): removed max_shape duplicate 2024-05-13 07:26:43 +02:00
VinciGit00
30758b4b99 Create smart_scarper_deepseek.py 2024-05-12 20:27:35 +02:00
Marco Perini
1e9a564616 fix(proxy-rotation): removed duplicated arg and passed the loader_kwarhs correctly to the node 2024-05-12 18:39:03 +02:00
semantic-release-bot
4ccddda5eb ci(release): 0.11.0-beta.4 [skip ci]
## [0.11.0-beta.4](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.11.0-beta.3...v0.11.0-beta.4) (2024-05-12)

### Features

* add new prompt info ([e2350ed](e2350eda62))
2024-05-12 16:10:12 +00:00
Marco Vinciguerra
f359d5cda4
Merge pull request #224 from VinciGit00/fixing-prompts
feat: add new prompt info
2024-05-12 18:08:54 +02:00
VinciGit00
e2350eda62 feat: add new prompt info 2024-05-12 11:14:30 +02:00
semantic-release-bot
106fb12531 ci(release): 0.11.0-beta.3 [skip ci]
## [0.11.0-beta.3](https://github.com/VinciGit00/Scrapegraph-ai/compare/v0.11.0-beta.2...v0.11.0-beta.3) (2024-05-12)

### Features

* add support for deepseek-chat ([156b67b](156b67b91e)), closes [#222](https://github.com/VinciGit00/Scrapegraph-ai/issues/222)

### Docs

* add diagram showing general structure/flow of the library ([13ae918](13ae9180ac))
* update overview diagram with more models ([b441b30](b441b30a5c))
2024-05-12 07:14:00 +00:00
Marco Vinciguerra
e004c7c70e
Merge pull request #223 from f-aguzzi/pre/beta
feat: add support for deepseek-chat
2024-05-12 09:12:47 +02:00
Federico Aguzzi
156b67b91e feat: add support for deepseek-chat
closes #222
2024-05-12 01:00:11 +02:00
Marco Vinciguerra
3b9ec9b1f5
Merge pull request #220 from daniele-roncaglioni/102-library-overview-diagram
docs: add diagram showing general structure/flow of the library
2024-05-11 14:17:22 +02:00
roncaglionidaniele
b441b30a5c docs: update overview diagram with more models 2024-05-11 14:15:55 +02:00