CodeCow/Scrapegraph-ai
1
0
Fork 0
mirror of https://github.com/VinciGit00/Scrapegraph-ai.git synced 2026-06-23 21:00:30 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
454 Commits 2 Branches 448 Tags 17 MiB
9898bfb071
Commit Graph

138 Commits

Author SHA1 Message Date
Lorenzo Padoan
12dcc5065a ADD benchmarks m2 max llama3 2024-04-23 12:28:51 +02:00
VinciGit00
261ecbf3a5 fixed typos in the doc 2024-04-22 21:32:06 +02:00
VinciGit00
3960e56d29 fixed typos in the doc 2024-04-22 21:31:23 +02:00
VinciGit00
74d7ef614a refactor of conbert to json function 2024-04-21 20:30:56 +02:00
Alok Saboo
6cbf992870 chore: Remove .csv extension from filename in convert_to_csv.py 2024-04-21 14:13:34 -04:00
VinciGit00
8aa2cadb00 add integration for llama3 2024-04-21 13:11:10 +02:00
EURAC\marperini
ac099e2763 fixed ollama embedder params 2024-04-21 01:21:09 +02:00
VinciGit00
13669cc1ab revert to old naming 2024-04-19 13:43:51 +02:00
VinciGit00
a2349e56af recatoring of nodes excluive for openai 2024-04-19 13:21:48 +02:00
VinciGit00
3f95801737 Merge branch 'main' of https://github.com/VinciGit00/Scrapegraph-ai 2024-04-19 10:36:40 +02:00
EURAC\marperini
c032131692 fixed chunk response 2024-04-17 15:20:45 +02:00
Marco Perini
b14527c08d
Merge branch 'main' into refactor_generate_answer_node 2024-04-17 12:08:43 +02:00
EURAC\marperini
c237e63631 removed unused variable 2024-04-17 12:05:51 +02:00
Marco Perini
edc439fd01
Merge pull request #64 from VinciGit00/generateScraperbranch 
add generateScraperBranch
 2024-04-17 11:51:06 +02:00
EURAC\marperini
b2d170cd86 refactored and fixed single chunk bug 2024-04-17 11:50:19 +02:00
EURAC\marperini
bdac2df4bb fixed single chunk bug 2024-04-17 11:34:10 +02:00
Andrea Rota
b0e446f014 feat: apply remove to the document before updating the state 2024-04-17 11:24:56 +02:00
EURAC\marperini
d5f1c82c91 Merge remote-tracking branch 'origin/refactor_genrerate_answer_node' 2024-04-17 10:55:28 +02:00
Marco Vinciguerra
4703a0b94c
Update remover.py 2024-04-16 12:27:17 +02:00
VinciGit00
4233430518 add integration on the fetch node 2024-04-16 12:19:23 +02:00
VinciGit00
9661c77ebe add minimizer function 2024-04-16 12:07:43 +02:00
Marco Vinciguerra
3fc18b2110
Update generate_answer_node.py 2024-04-16 12:00:33 +02:00
Matteo Vedovati
9c3b490b03
Update generate_scraper_node.py 2024-04-16 10:21:49 +02:00
VinciGit00
372981f153 Update generate_answer_node.py 2024-04-16 10:09:35 +02:00
VinciGit00
c56640034e add return statement and new answers 2024-04-15 10:49:02 +02:00
VinciGit00
8334737f10 Update generate_answer_node.py 2024-04-15 10:44:03 +02:00
VinciGit00
724aee6b23 add informations on prompt 2024-04-15 10:43:40 +02:00
VinciGit00
8fc41873a7 refactoring of generate answer node 2024-04-14 21:53:15 +02:00
VinciGit00
876223da56 add generateScraperBranch 
Co-Authored-By: Matteo Mei <52063123+FattiMei@users.noreply.github.com>
 2024-04-14 13:18:50 +02:00
Lorenzo Padoan
849f411844
Merge pull request #61 from VinciGit00/anti_malicious 
add anti not scraping task
 2024-04-12 13:47:10 +02:00
VinciGit00
e0978c53b3 Merge branch 'main' into ollama_integration 2024-04-12 13:00:35 +02:00
VinciGit00
3640434f5c add utils 2024-04-12 12:59:15 +02:00
Marco Perini
dde9eeec87
Merge pull request #60 from VinciGit00/huggingface_integration 
add hugginface integration (embeddings, models ...)
 2024-04-11 22:40:05 +02:00
VinciGit00
77581876b5 add anti not scrapong task 2024-04-11 19:31:54 +02:00
VinciGit00
dc149e6f63 fixing bug on rag node 2024-04-11 19:26:38 +02:00
EURAC\marperini
74ec928f96 added execution info of the graph, time, price etc 2024-04-11 14:29:32 +02:00
VinciGit00
53e317d46b add hugginface integration 2024-04-11 12:43:06 +02:00
EURAC\marperini
982f142f20 fixed embedder_model config for local models 2024-04-10 11:00:52 +02:00
EURAC\marperini
8b915e3ec6 fixed issue ollama embeddings 2024-04-10 09:29:03 +02:00
ftoppi
26616d25b1
abstract_graph.py: allow user to set Ollama model_tokens in config 2024-04-09 21:27:15 +02:00
VinciGit00
78a1e7aec4 new model 2024-04-09 13:54:10 +02:00
Marco Vinciguerra
b4e640879d
Merge branch 'main' into refactoring_examples_folder 2024-04-09 11:46:34 +02:00
VinciGit00
992e7f862f add models avaiables 2024-04-09 10:33:45 +02:00
VinciGit00
cec4c43c64 add new local models context window 2024-04-09 10:23:38 +02:00
VinciGit00
0ffefdd170 refactoring if examples ffolder 2024-04-08 22:28:55 +02:00
EURAC\marperini
a601695fd5 updated nodes metadata 2024-04-08 15:23:23 +02:00
EURAC\marperini
dee1a42629 fixed token models, added mistral support 2024-04-08 15:21:06 +02:00
EURAC\marperini
17add20c13 implemented node_config, add embedder model choice, add azure endpoint, refactor graphs and exmaples 2024-04-08 12:18:32 +02:00
EURAC\marperini
6a83c2306d docker compose working ollama implementation 2024-04-07 11:08:08 +02:00
VinciGit00
6dc4c6dec4 Merge branch 'main' into research_branch 2024-04-06 14:44:56 +02:00