CodeCow/Scrapegraph-ai
1
0
Fork 0
mirror of https://github.com/VinciGit00/Scrapegraph-ai.git synced 2026-06-25 21:11:11 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
722 Commits 2 Branches 448 Tags 17 MiB
4e62689eaa
Commit Graph

105 Commits

Author SHA1 Message Date
VinciGit00
0ab31c3fdb fix: add json integration 2024-05-09 21:07:07 +02:00
VinciGit00
324e977b85 fix: fixed bugs for csv and xml 2024-05-09 20:46:46 +02:00
Shubham Kamboj
f10f3b1438 feat: Add support for passing pdf path as source 2024-05-09 21:55:05 +05:30
VinciGit00
94156755d1 Update abstract_graph.py 2024-05-09 12:29:39 +02:00
VinciGit00
403979337c Update abstract_graph.py 2024-05-09 10:46:31 +02:00
VinciGit00
8272d736a6 add tokenizatio for mxbai-embed-large 2024-05-08 21:50:42 +02:00
VinciGit00
4ed0fb89c3 feat: update info 2024-05-08 21:25:03 +02:00
VinciGit00
e7d39a5daf fixed gemini embeddings 2024-05-08 21:24:17 +02:00
Marco Perini
6b71ec1d2b fix(examples): local, mixed models and fixed SearchGraph embeddings problem 2024-05-08 15:36:26 +02:00
VinciGit00
2258fe5ac0 add new search graph examples 2024-05-06 22:31:48 +02:00
VinciGit00
5a67bca0db Merge branch 'pre/beta' into pr/161 2024-05-06 14:50:04 +02:00
Cem Uzunoglu
2ac9e16dd9 Fixed accidental reformatting. 2024-05-06 15:09:56 +03:00
Cem Uzunoglu
e264e92e72 Added support for Claude 3 models from Anthropic 2024-05-06 14:34:35 +03:00
Shubham Kamboj
726de28898 feat: Fix bug for gemini case when embeddings config not passed 2024-05-06 15:40:03 +05:30
VinciGit00
80053a2358 Merge branch 'pre/beta' of https://github.com/VinciGit00/Scrapegraph-ai into pre/beta 2024-05-06 10:07:56 +02:00
VinciGit00
389b52aabb removed examples 2024-05-06 10:07:31 +02:00
Marco Perini
930adb38f2 feat(node): multiple url search in SearchGraph + fixes 
Implemented GraphIteratorNode and MergeAnswersNode to create multiple istances of a graph and merge the scraped content from multiple pages
 2024-05-06 00:30:09 +02:00
Marco Perini
1c4ba91620 exposed abstract_graph allowing the user to create new graphs 2024-05-05 22:05:11 +02:00
Marco Perini
84fcb44aaa feat: fixed custom_graphs example and robots_node 2024-05-05 22:02:24 +02:00
Marco Perini
36a1522bba
Merge pull request #153 from VinciGit00/google_embeddings 
feat: add gemini embeddings
 2024-05-05 17:54:07 +02:00
Eric Page
cc27b21c3f
Merge branch 'pre/beta' into pass-common-params-graph 2024-05-05 16:18:32 +02:00
Eric Page
3ae2ea1dbd Miscellaneous "llm" -> "llm_model" refactors 2024-05-05 15:58:50 +02:00
Eric Page
a53e95cbf0 Corrected graphs to use common params 2024-05-05 14:36:16 +02:00
Eric Page
8d0e109a70 Added overwrite keyword to set_common_params` 2024-05-05 14:32:58 +02:00
VinciGit00
79daa4c112 feat: add gemini embeddings 2024-05-05 11:40:44 +02:00
Eric Page
4dc6049e76 Simplified create graph functions using common params 2024-05-05 10:40:04 +02:00
Eric Page
444a13a6a6 Created set_common_params function 2024-05-05 10:15:37 +02:00
Eric Page
2178485b3d Adjusted graphs to reflect node_config change 2024-05-05 09:47:13 +02:00
Marco Perini
0ab7272fd7
Merge branch 'pre/beta' into 133-support-claude3-haiku-and-others-using-litellm 2024-05-05 02:15:15 +02:00
VinciGit00
2878695d5f fix: trailing whitespace 2024-05-04 21:26:19 +02:00
Shubham Kamboj
fd59f282a8 Bug fixes 2024-05-04 22:18:54 +05:30
Shubham Kamboj
d830d1371b Resolve merge conflicts 2024-05-04 22:01:40 +05:30
Shubham Kamboj
7599234ab9 feat: Enable end users to pass model instances of HuggingFaceHub 2024-05-04 21:42:57 +05:30
VinciGit00
10a94530e3 feat: add pdf scraper 2024-05-03 21:42:02 +02:00
VinciGit00
39f64e5d48 add claude model 2024-05-03 17:17:31 +02:00
S4mpl3r
819cbcd3be refactor: Changed the way embedding model is created in AbstractGraph class and removed handling of embedding model creation from RAGNode. Now AbstractGraph will call a dedicated method for embedding models instead of _create_llm. This makes it easy to use any LLM with any supported embedding model. 2024-05-03 16:14:27 +03:30
Marco Vinciguerra
579a27faf9
Merge pull request #126 from VinciGit00/bedrock_support 
feat: bedrock support
 2024-05-02 17:57:20 +02:00
Marco Vinciguerra
a2d5c75f10
Merge branch 'pre/beta' into main 2024-05-02 17:55:21 +02:00
Shubham Kamboj
b86aac2188 feat: Allow end users to pass model instances for llm and embedding model 2024-05-02 20:09:23 +05:30
VinciGit00
16de49fa08 add integration for bedrock 
Co-Authored-By: redrusty2 <15157208+redrusty2@users.noreply.github.com>
 2024-05-02 13:47:17 +02:00
VinciGit00
4a3bc37f2f fix: bug on script_creator_graph.py 2024-05-02 09:23:46 +02:00
VinciGit00
5cf4e4f92f fix: examples and graphs 2024-05-02 09:20:46 +02:00
Marco Perini
29427c2334 docs: fixed basegraph docstring 2024-05-02 01:05:20 +02:00
Marco Perini
c11fc28896 docs: refactor examples 2024-05-02 00:44:19 +02:00
Marco Perini
0631985e61 docs: graphs and helpers docstrings 2024-05-02 00:23:38 +02:00
Marco Perini
02d1af006c feat: modified node name 2024-05-01 21:33:25 +02:00
VinciGit00
276ac8b40c changed name 2024-05-01 20:17:01 +02:00
VinciGit00
7c1b5796d7 add csv scraper 2024-05-01 17:20:04 +02:00
EURAC\marperini
2dd7817cfb feat: added verbose flag to suppress print statements 2024-04-30 15:31:57 +02:00
Marco Perini
d592d27bb4
Merge pull request #115 from VinciGit00/101-scrape-json-files 
feat: add xml scraper and json scraper
 2024-04-30 14:29:57 +02:00