Commit Graph

2293 Commits

Author SHA1 Message Date
VinciGit00
4233430518 add integration on the fetch node 2024-04-16 12:19:23 +02:00
VinciGit00
9661c77ebe add minimizer function 2024-04-16 12:07:43 +02:00
Marco Vinciguerra
3fc18b2110
Update generate_answer_node.py 2024-04-16 12:00:33 +02:00
VinciGit00
93372c5120 refactor of the readme 2024-04-16 11:58:04 +02:00
Marco Vinciguerra
7b9a49cc98
Merge pull request #67 from vedovati-matteo/generateScraperbranch
Update generate_scraper_node.py
2024-04-16 10:23:59 +02:00
Matteo Vedovati
9c3b490b03
Update generate_scraper_node.py 2024-04-16 10:21:49 +02:00
VinciGit00
372981f153 Update generate_answer_node.py 2024-04-16 10:09:35 +02:00
VinciGit00
c56640034e add return statement and new answers 2024-04-15 10:49:02 +02:00
VinciGit00
8334737f10 Update generate_answer_node.py 2024-04-15 10:44:03 +02:00
VinciGit00
724aee6b23 add informations on prompt 2024-04-15 10:43:40 +02:00
VinciGit00
8fc41873a7 refactoring of generate answer node 2024-04-14 21:53:15 +02:00
Marco Vinciguerra
4c74e019ca
Update README.md 2024-04-14 20:19:47 +02:00
Marco Vinciguerra
feefaf850b
Update README.md 2024-04-14 20:19:32 +02:00
Marco Vinciguerra
9394ee01d5
Update readme.md 2024-04-14 16:40:30 +02:00
VinciGit00
876223da56 add generateScraperBranch
Co-Authored-By: Matteo Mei <52063123+FattiMei@users.noreply.github.com>
2024-04-14 13:18:50 +02:00
Marco Vinciguerra
7268ebd7bf
Update readme.md 2024-04-13 21:44:48 +02:00
Marco Vinciguerra
069a42bf07
Update readme.md 2024-04-12 21:47:14 +02:00
Marco Vinciguerra
e4c4f04e31
Merge pull request #62 from FattiMei/patch-1
Update readme.md with benchmark on ubuntu system
2024-04-12 21:46:30 +02:00
Matteo Mei
c660c334dd
Update readme.md with benchmark on ubuntu system
Added results from running `benchmark.py` on a ubuntu laptop without docker
2024-04-12 21:44:05 +02:00
VinciGit00
b2b21e55b1 add benchmark comparison 2024-04-12 20:26:24 +02:00
VinciGit00
68f1ca1b78 add embeddings in the example 2024-04-12 14:55:11 +02:00
Lorenzo Padoan
849f411844
Merge pull request #61 from VinciGit00/anti_malicious
add anti not scraping task
2024-04-12 13:47:10 +02:00
VinciGit00
a17e35c3de Merge branch 'main' of https://github.com/VinciGit00/Scrapegraph-ai 2024-04-12 13:30:25 +02:00
VinciGit00
a8b452cb2c refactoring of the folders 2024-04-12 13:29:58 +02:00
Marco Vinciguerra
0d1c2a3563
Merge pull request #59 from VinciGit00/ollama_integration
add examples for Local models
2024-04-12 13:09:29 +02:00
VinciGit00
e0978c53b3 Merge branch 'main' into ollama_integration 2024-04-12 13:00:35 +02:00
VinciGit00
3640434f5c add utils 2024-04-12 12:59:15 +02:00
VinciGit00
60a2377bff add inputs 2024-04-12 12:53:54 +02:00
VinciGit00
8e08652d8a removed unused file and removed unused documentation 2024-04-12 11:05:52 +02:00
VinciGit00
8ff27bec24 add new version 2024-04-11 23:01:58 +02:00
Marco Perini
dde9eeec87
Merge pull request #60 from VinciGit00/huggingface_integration
add hugginface integration (embeddings, models ...)
2024-04-11 22:40:05 +02:00
VinciGit00
77581876b5 add anti not scrapong task 2024-04-11 19:31:54 +02:00
VinciGit00
dc149e6f63 fixing bug on rag node 2024-04-11 19:26:38 +02:00
VinciGit00
87d911b7bb removed files and refactoring of actions 2024-04-11 18:18:22 +02:00
EURAC\marperini
7d521ef1c8 Merge branch 'main' of https://github.com/VinciGit00/Scrapegraph-ai 2024-04-11 14:29:43 +02:00
EURAC\marperini
74ec928f96 added execution info of the graph, time, price etc 2024-04-11 14:29:32 +02:00
VinciGit00
53e317d46b add hugginface integration 2024-04-11 12:43:06 +02:00
VinciGit00
f3766955fd add examples 2024-04-11 12:17:04 +02:00
Marco Vinciguerra
4e57b56517
Merge pull request #57 from ftoppi/ftoppi-dockerfile 2024-04-10 14:19:06 +02:00
ftoppi
b04f5784bb
Create Dockerfile 2024-04-10 14:11:05 +02:00
VinciGit00
4ef1564e18 Update smart_scraper_gemini.py 2024-04-10 12:49:55 +02:00
VinciGit00
06c173dedc add new version fixing embeddings 2024-04-10 12:25:24 +02:00
EURAC\marperini
982f142f20 fixed embedder_model config for local models 2024-04-10 11:00:52 +02:00
VinciGit00
ac67ae1f72 add new version 2024-04-10 09:49:01 +02:00
Marco Perini
698169fef8
Update README.md 2024-04-10 09:36:51 +02:00
EURAC\marperini
8b915e3ec6 fixed issue ollama embeddings 2024-04-10 09:29:03 +02:00
Marco Vinciguerra
ceff90ed85
Update README.md 2024-04-09 23:10:54 +02:00
VinciGit00
6af4ba4a45 fixed readme 2024-04-09 23:06:06 +02:00
Marco Vinciguerra
9989327c5a
Merge pull request #55 from ftoppi/ftoppi-issue-53 2024-04-09 22:41:38 +02:00
ftoppi
64d8e7c3b6
smart_scraper_local.py: Allow using a remote Ollama #53
Since you pass `config["llm"]` to langchain ChatOllama(), it's only a matter of adding a new parameter `base_url`.
2024-04-09 22:28:02 +02:00