CodeCow/Scrapegraph-ai
1
0
Fork 0
mirror of https://github.com/VinciGit00/Scrapegraph-ai.git synced 2026-07-12 21:01:56 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
2,293 Commits 2 Branches 448 Tags 17 MiB
5faac9fb46
Commit Graph

145 Commits

Author SHA1 Message Date
Marco Vinciguerra
3cf7089e3f
Merge branch 'pre/beta' into temp 2024-07-20 13:27:37 +02:00
Marco Vinciguerra
77777c898d fix: add gpt o mini for azure 2024-07-20 13:20:16 +02:00
Marco Vinciguerra
03f4a3aa29 fix: azure models 2024-07-20 13:19:21 +02:00
Kernick
4f079cfc74
Fixed a typo in the model name 2024-07-18 21:06:16 +03:00
Kernick
b91020ce56
Update models_tokens.py with gpt-4o-mini 
OpenAI added a new available model - gpt-4o-mini. Adding this model to the supported models, so it would be possible to use it with the Scrapegraph-ai.
 2024-07-18 21:03:55 +03:00
Federico Aguzzi
104d8692d6
Merge branch 'pre/beta' into support
Some checks failed
/ build (push) Has been cancelled
Details
2024-07-04 18:36:34 +02:00
Federico Aguzzi
1bbd25a63f
Merge pull request #407 from ScrapeGraphAI/404-split-unit-testing-from-src 
Merge #404 (split unit testing from src)
 2024-07-04 18:33:45 +02:00
Federico Aguzzi
d77a622b05 Merge branch '423-add-vertex-ai-integration' into support 2024-07-04 18:23:22 +02:00
Federico Aguzzi
720f18729b Merge branch 'fireworks_integration' into support 2024-07-04 18:17:38 +02:00
Federico Aguzzi
2ab7ddc95a
Merge pull request #405 from ScrapeGraphAI/integration_markdown 
Integration markdown
 2024-07-04 18:13:12 +02:00
Marco Vinciguerra
119514bdfc feat: add vertexai integration 2024-07-01 12:21:47 +02:00
Marco Vinciguerra
30ca15ca28
Merge branch 'md_scraper_integration' into integration_markdown
Some checks failed
/ build (3.10) (push) Has been cancelled
Details
2024-06-30 16:58:37 +02:00
Marco Vinciguerra
5d2e592a67 add new claude models
Some checks failed
CodeQL / Analyze (python) (push) Has been cancelled
Details
/ build (3.10) (push) Has been cancelled
Details
Release / Build (push) Has been cancelled
Details
Release / Release (push) Has been cancelled
Details
2024-06-28 10:53:40 +02:00
Marco Vinciguerra
4d936410cc fix: add new claude model 2024-06-28 10:50:01 +02:00
Marco Vinciguerra
ff4ccb94a1 add claude 3.5 integration
Some checks failed
CodeQL / Analyze (python) (push) Has been cancelled
Details
/ build (3.10) (push) Has been cancelled
Details
Release / Build (push) Has been cancelled
Details
Release / Release (push) Has been cancelled
Details
2024-06-25 11:21:06 +02:00
Marco Vinciguerra
df0e310829 feat: add fireworks integration 2024-06-24 23:11:28 +02:00
Marco Vinciguerra
afd46ac77b fixed generate_answer_node
Some checks are pending
/ build (3.10) (push) Waiting to run
Details
2024-06-22 11:31:54 +02:00
Marco Vinciguerra
599512d2e5 fix: add new model for claude 2024-06-21 14:08:10 +02:00
Marco Vinciguerra
5d6123847e add new convert function
Some checks are pending
/ build (3.10) (push) Waiting to run
Details 
Co-Authored-By: Federico Minutoli <40361744+DiTo97@users.noreply.github.com>
 2024-06-20 21:15:16 +02:00
Marco Vinciguerra
5664eb292b Update generate_answer_node_prompts.py 2024-06-20 11:57:11 +02:00
Marco Vinciguerra
88f9def69d fix: reduced model tokens 2024-06-19 19:55:13 +02:00
Marco Vinciguerra
79a2f51c34 add new models tokens 2024-06-19 10:42:41 +02:00
Marco Vinciguerra
40b4b2d939 add new models tokens 2024-06-19 10:42:00 +02:00
Marco Vinciguerra
1d0cbbc6d6 fix: add new embedding models 2024-06-18 09:13:15 +02:00
Marco Vinciguerra
03ffebc52d fix: add chinese embedding model 2024-06-17 14:17:44 +02:00
Marco Vinciguerra
da93162b53
Merge branch 'pre/beta' into main 2024-06-17 11:02:56 +02:00
Marco Vinciguerra
dcd216e345 fix: removed duplicate from ollama dictionary 
Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>
 2024-06-15 19:51:20 +02:00
Marco Vinciguerra
58a257f05b update model tokens
Some checks are pending
/ build (3.10) (push) Waiting to run
Details
Release / Build (push) Waiting to run
Details
Release / Release (push) Blocked by required conditions
Details
2024-06-12 12:41:58 +02:00
Marco Vinciguerra
9326637cc3 Merge branch 'main' into pre/beta 2024-06-09 17:04:11 +02:00
duke147
2b2b910a37 support ernie 2024-06-05 19:02:34 +08:00
Marco Perini
376f758a76 feat(pydantic): added pydantic output schema 2024-06-04 23:07:49 +02:00
Marco Vinciguerra
4fcb9902fe fix: oneapi model 2024-05-29 18:24:09 +02:00
Marco Vinciguerra
3c7dedf9c8
Merge pull request #305 from VinciGit00/pdf_fix 
Pdf fix
 2024-05-26 15:39:21 +02:00
Marco Perini
8d76c4b3cb fix(schema): added schema 2024-05-26 10:51:48 +02:00
Marco Vinciguerra
b6f1766bd1 add OneAPI integration 
Co-Authored-By: Federico Aguzzi <62149513+f-aguzzi@users.noreply.github.com>
Co-Authored-By: wangdongpeng1 <74647183+wangdongpeng1@users.noreply.github.com>
 2024-05-24 13:46:40 +02:00
Marco Vinciguerra
b913b51cca Merge branch 'logger-integration' into pre/beta 2024-05-24 12:39:14 +02:00
Marco Vinciguerra
b6f7b647f8
Merge pull request #290 from VinciGit00/pre/beta 
Pre/beta
 2024-05-23 11:48:44 +02:00
Marco Vinciguerra
f00ed35f7b
Merge branch 'pre/beta' into patch-1 2024-05-23 11:47:51 +02:00
Marco Vinciguerra
0ba3a594fc Update models_tokens.py 2024-05-23 11:43:54 +02:00
Alok Saboo
58289eccc5 feat: Add new models and update existing ones 2024-05-22 15:07:27 -04:00
Marco Vinciguerra
ca436abf3c fix: error in jsons 2024-05-21 14:35:48 +02:00
Marco Vinciguerra
be4237a04d
Merge branch 'pre/beta' into multi_scraper_graph 2024-05-21 13:44:06 +02:00
JGalego
9e92b03913 Added missing Titan text embedding models 2024-05-20 16:56:41 +01:00
Mobin Chowdhury
7f30da9930
Update models_tokens.py 2024-05-18 23:32:27 +06:00
Marco Vinciguerra
5701afe927 add new import 2024-05-18 10:36:41 +02:00
Marco Vinciguerra
a0125b7e90 add orca mini integration 2024-05-18 09:31:40 +02:00
Marco Perini
58cc903d55 feat(multiple): quick fix working 2024-05-18 05:57:43 +02:00
Marco Vinciguerra
ff53771f87 add falcon model 2024-05-18 03:01:08 +02:00
Marco Vinciguerra
b82f33aee7 fix: template names 2024-05-18 02:42:25 +02:00
Marco Vinciguerra
05e511e36f add new prompts 2024-05-18 00:22:52 +02:00
Marco Perini
8c33ea3fbc feat(node): knowledge graph node 2024-05-17 18:40:58 +02:00
Marco Vinciguerra
3453f72397 add graph 2024-05-17 18:23:50 +02:00
VinciGit00
befa48c912 update lock 2024-05-15 21:28:56 +02:00
Federico Aguzzi
52a4a3b22d feat: add gpt-4o 
closes #232
 2024-05-14 11:11:34 +02:00
VinciGit00
d6f5ca874f Merge branch 'main' into pre/beta 2024-05-14 10:24:29 +02:00
Alok Saboo
d9752b1619 chore: update models_tokens.py with new model configurations 2024-05-13 17:22:32 -04:00
Federico Aguzzi
156b67b91e feat: add support for deepseek-chat 
closes #222
 2024-05-12 01:00:11 +02:00
VinciGit00
8272d736a6 add tokenizatio for mxbai-embed-large 2024-05-08 21:50:42 +02:00
Marco Vinciguerra
97c3fffaf3
Merge pull request #162 from f-aguzzi/patch-1 
feat: add new hugging_face models
 2024-05-06 14:43:29 +02:00
Marco Vinciguerra
f6442ccca3
Merge pull request #157 from VinciGit00/llava_integration 2024-05-06 14:34:32 +02:00
Federico Aguzzi
d5547a450c
feat: add new hugging_face models 2024-05-06 14:28:58 +02:00
VinciGit00
8c7c3e3ced Merge branch 'pre/beta' of https://github.com/VinciGit00/Scrapegraph-ai into pre/beta 2024-05-06 13:29:32 +02:00
VinciGit00
ac0a2e52fb Update models_tokens.py 2024-05-06 13:29:31 +02:00
Shubham Kamboj
726de28898 feat: Fix bug for gemini case when embeddings config not passed 2024-05-06 15:40:03 +05:30
VinciGit00
89a1f99778 add lava integration for ollama 2024-05-06 12:03:39 +02:00
Marco Vinciguerra
2a8ff0f65d
Merge branch 'main' into pre/beta 2024-05-04 21:20:40 +02:00
Shubham Kamboj
7599234ab9 feat: Enable end users to pass model instances of HuggingFaceHub 2024-05-04 21:42:57 +05:30
Tamas Darvas
1630c66a58
Update models_tokens.py with ollama/nomic-embed-text 2024-05-04 09:36:19 +02:00
Marco Vinciguerra
96ebcfcc35
Merge branch 'pre/beta' into main 2024-05-02 21:05:28 +02:00
VinciGit00
2ea54eab1d fix: gemini errror 2024-05-02 18:56:37 +02:00
Marco Vinciguerra
579a27faf9
Merge pull request #126 from VinciGit00/bedrock_support 
feat: bedrock support
 2024-05-02 17:57:20 +02:00
Marco Vinciguerra
a2d5c75f10
Merge branch 'pre/beta' into main 2024-05-02 17:55:21 +02:00
Shubham Kamboj
b86aac2188 feat: Allow end users to pass model instances for llm and embedding model 2024-05-02 20:09:23 +05:30
VinciGit00
16de49fa08 add integration for bedrock 
Co-Authored-By: redrusty2 <15157208+redrusty2@users.noreply.github.com>
 2024-05-02 13:47:17 +02:00
Marco Perini
0631985e61 docs: graphs and helpers docstrings 2024-05-02 00:23:38 +02:00
VinciGit00
e0ffc838b0 feat: add cluade integration 2024-04-30 10:08:54 +02:00
EURAC\marperini
dbbf10fc77 feat(llm): implemented groq model 2024-04-30 02:32:14 +02:00
VinciGit00
4f10ac302e fixed gemma model 2024-04-29 11:06:30 +02:00
VinciGit00
ab72db3b50 if the conf is not present preset to 8192 the context window 2024-04-29 10:26:34 +02:00
VinciGit00
9b9a9f204c handling the agent model 2024-04-24 13:13:46 +02:00
VinciGit00
adf89e5e1b add new info for robot node 2024-04-24 10:14:26 +02:00
Lorenzo Padoan
12dcc5065a ADD benchmarks m2 max llama3 2024-04-23 12:28:51 +02:00
VinciGit00
8aa2cadb00 add integration for llama3 2024-04-21 13:11:10 +02:00
VinciGit00
78a1e7aec4 new model 2024-04-09 13:54:10 +02:00
Marco Vinciguerra
b4e640879d
Merge branch 'main' into refactoring_examples_folder 2024-04-09 11:46:34 +02:00
VinciGit00
cec4c43c64 add new local models context window 2024-04-09 10:23:38 +02:00
VinciGit00
0ffefdd170 refactoring if examples ffolder 2024-04-08 22:28:55 +02:00
EURAC\marperini
a601695fd5 updated nodes metadata 2024-04-08 15:23:23 +02:00
EURAC\marperini
dee1a42629 fixed token models, added mistral support 2024-04-08 15:21:06 +02:00
Perinim
7d3190a636 fixed example graphs and utils files 2024-03-18 10:20:23 +01:00
Perinim
9d31db2d35 working smart scraper example 2024-03-12 11:06:08 +01:00
VinciGit00
ae929393b9 refactoring for pylint score 2024-02-22 10:19:10 +01:00
Perinim
b0c75dc7ed created rag example 2024-02-21 19:15:38 +01:00
VinciGit00
7390dba0ab removed dict info and put in another file 2024-02-19 13:50:30 +01:00
VinciGit00
71bd53d254 refactoring of the code, add tests and examples 2024-02-19 11:54:36 +01:00