Commit Graph

131 Commits

Author SHA1 Message Date
Marco Vinciguerra
1ef63217dd add deepseek embeddings 2024-05-21 10:41:01 +02:00
Marco Vinciguerra
659fad770a fix: add deepseek embeddings 2024-05-21 10:36:40 +02:00
Marco Perini
d4d913c8a3 fix(deepcopy): switch whether we have obj in the config 2024-05-17 10:36:39 +02:00
Marco Perini
999c930f42 fix(deepcopy): reaplced to shallow copy 2024-05-15 16:00:42 +02:00
VinciGit00
cc5adefd29 fix: come back to the old version 2024-05-15 15:54:00 +02:00
VinciGit00
5587a64d23 fix: removed unused 2024-05-15 15:51:27 +02:00
Marco Vinciguerra
22cd9e3605
Merge branch 'search_link_context' into main 2024-05-15 15:16:57 +02:00
Marco Perini
096b665c01 fix(searchgraph): used shallow copy to serialize obj 2024-05-15 15:05:47 +02:00
Marco Perini
a6e1813ddd fix(fetch_node): bug in handling local files 2024-05-14 16:51:10 +02:00
Marco Perini
fcb3abb01d feat(omni-search): added omni search graph and updated docs 2024-05-14 16:26:43 +02:00
Marco Perini
a296927624 feat(omni-scraper): working OmniScraperGraph with images 2024-05-14 13:46:49 +02:00
VinciGit00
d6f5ca874f Merge branch 'main' into pre/beta 2024-05-14 10:24:29 +02:00
JGalego
859c5d5ba5 Refactored to include custom AWS client for bedrock; Added missing Anthropic class 2024-05-13 17:57:53 +01:00
Marco Vinciguerra
f3d44c09ae
Merge pull request #228 from JGalego/fix/bedrock-support
fix: Amazon Bedrock Support
2024-05-13 14:57:23 +02:00
VinciGit00
d0167dee71 fix: bug for claude 2024-05-13 13:43:42 +02:00
JGalego
39be38f292 Fixed anthropic/bedrock conflict; Removed duplicate class Claude; Updated BedrockEmbeddings class 2024-05-13 12:35:42 +01:00
Marco Perini
7e8acd8e6a
Merge branch 'pre/beta' into fix/fetch-node-proxybroker 2024-05-13 11:17:37 +02:00
Marco Perini
1e9a564616 fix(proxy-rotation): removed duplicated arg and passed the loader_kwarhs correctly to the node 2024-05-12 18:39:03 +02:00
Federico Aguzzi
156b67b91e feat: add support for deepseek-chat
closes #222
2024-05-12 01:00:11 +02:00
mayurdb
8f1fbe7e10 minor changes 2024-05-11 16:52:36 +05:30
mayurdb
df271b6451 Add search link node that can find out relevant links in the webpage 2024-05-11 16:39:55 +05:30
Eric Page
0683e78e78
Merge branch 'pre/beta' into fix-GenerateScraperGraph 2024-05-11 01:59:28 +02:00
Eric Page
24c3b0580c Removed nonfunctional RAG node from ScriptCreatorGraph 2024-05-11 01:38:40 +02:00
VinciGit00
0ab31c3fdb fix: add json integration 2024-05-09 21:07:07 +02:00
VinciGit00
324e977b85 fix: fixed bugs for csv and xml 2024-05-09 20:46:46 +02:00
Shubham Kamboj
f10f3b1438 feat: Add support for passing pdf path as source 2024-05-09 21:55:05 +05:30
VinciGit00
94156755d1 Update abstract_graph.py 2024-05-09 12:29:39 +02:00
VinciGit00
403979337c Update abstract_graph.py 2024-05-09 10:46:31 +02:00
VinciGit00
0bb68d1500 Merge branch 'main' of https://github.com/VinciGit00/Scrapegraph-ai 2024-05-09 10:31:21 +02:00
VinciGit00
8272d736a6 add tokenizatio for mxbai-embed-large 2024-05-08 21:50:42 +02:00
VinciGit00
4ed0fb89c3 feat: update info 2024-05-08 21:25:03 +02:00
VinciGit00
e7d39a5daf fixed gemini embeddings 2024-05-08 21:24:17 +02:00
Marco Perini
6b71ec1d2b fix(examples): local, mixed models and fixed SearchGraph embeddings problem 2024-05-08 15:36:26 +02:00
VinciGit00
2258fe5ac0 add new search graph examples 2024-05-06 22:31:48 +02:00
VinciGit00
67d5fbf816 feat: new search_graph 2024-05-06 22:09:18 +02:00
VinciGit00
5a67bca0db Merge branch 'pre/beta' into pr/161 2024-05-06 14:50:04 +02:00
Cem Uzunoglu
2ac9e16dd9 Fixed accidental reformatting. 2024-05-06 15:09:56 +03:00
Cem Uzunoglu
e264e92e72 Added support for Claude 3 models from Anthropic 2024-05-06 14:34:35 +03:00
Shubham Kamboj
726de28898 feat: Fix bug for gemini case when embeddings config not passed 2024-05-06 15:40:03 +05:30
VinciGit00
51aa109e42 feat: add turboscraper (alfa) 2024-05-06 11:59:14 +02:00
VinciGit00
80053a2358 Merge branch 'pre/beta' of https://github.com/VinciGit00/Scrapegraph-ai into pre/beta 2024-05-06 10:07:56 +02:00
VinciGit00
389b52aabb removed examples 2024-05-06 10:07:31 +02:00
Marco Perini
930adb38f2 feat(node): multiple url search in SearchGraph + fixes
Implemented GraphIteratorNode and MergeAnswersNode to create multiple istances of a graph and merge the scraped content from multiple pages
2024-05-06 00:30:09 +02:00
Marco Perini
1c4ba91620 exposed abstract_graph allowing the user to create new graphs 2024-05-05 22:05:11 +02:00
Marco Perini
84fcb44aaa feat: fixed custom_graphs example and robots_node 2024-05-05 22:02:24 +02:00
Marco Perini
36a1522bba
Merge pull request #153 from VinciGit00/google_embeddings
feat: add gemini embeddings
2024-05-05 17:54:07 +02:00
Eric Page
cc27b21c3f
Merge branch 'pre/beta' into pass-common-params-graph 2024-05-05 16:18:32 +02:00
Eric Page
3ae2ea1dbd Miscellaneous "llm" -> "llm_model" refactors 2024-05-05 15:58:50 +02:00
Eric Page
a53e95cbf0 Corrected graphs to use common params 2024-05-05 14:36:16 +02:00
Eric Page
8d0e109a70 Added overwrite keyword to set_common_params` 2024-05-05 14:32:58 +02:00