CodeCow/Scrapegraph-ai
1
0
Fork 0
mirror of https://github.com/VinciGit00/Scrapegraph-ai.git synced 2026-06-23 21:00:30 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
405 Commits 2 Branches 448 Tags 17 MiB
e68ea31a3c
Commit Graph

112 Commits

Author SHA1 Message Date
Marco Perini
edc439fd01
Merge pull request #64 from VinciGit00/generateScraperbranch 
add generateScraperBranch
 2024-04-17 11:51:06 +02:00
Marco Vinciguerra
9394ee01d5
Update readme.md 2024-04-14 16:40:30 +02:00
VinciGit00
876223da56 add generateScraperBranch 
Co-Authored-By: Matteo Mei <52063123+FattiMei@users.noreply.github.com>
 2024-04-14 13:18:50 +02:00
Marco Vinciguerra
7268ebd7bf
Update readme.md 2024-04-13 21:44:48 +02:00
Marco Vinciguerra
069a42bf07
Update readme.md 2024-04-12 21:47:14 +02:00
Matteo Mei
c660c334dd
Update readme.md with benchmark on ubuntu system 
Added results from running `benchmark.py` on a ubuntu laptop without docker
 2024-04-12 21:44:05 +02:00
VinciGit00
b2b21e55b1 add benchmark comparison 2024-04-12 20:26:24 +02:00
VinciGit00
68f1ca1b78 add embeddings in the example 2024-04-12 14:55:11 +02:00
VinciGit00
a17e35c3de Merge branch 'main' of https://github.com/VinciGit00/Scrapegraph-ai 2024-04-12 13:30:25 +02:00
VinciGit00
a8b452cb2c refactoring of the folders 2024-04-12 13:29:58 +02:00
VinciGit00
e0978c53b3 Merge branch 'main' into ollama_integration 2024-04-12 13:00:35 +02:00
VinciGit00
3640434f5c add utils 2024-04-12 12:59:15 +02:00
VinciGit00
60a2377bff add inputs 2024-04-12 12:53:54 +02:00
VinciGit00
8e08652d8a removed unused file and removed unused documentation 2024-04-12 11:05:52 +02:00
VinciGit00
87d911b7bb removed files and refactoring of actions 2024-04-11 18:18:22 +02:00
EURAC\marperini
7d521ef1c8 Merge branch 'main' of https://github.com/VinciGit00/Scrapegraph-ai 2024-04-11 14:29:43 +02:00
EURAC\marperini
74ec928f96 added execution info of the graph, time, price etc 2024-04-11 14:29:32 +02:00
VinciGit00
f3766955fd add examples 2024-04-11 12:17:04 +02:00
VinciGit00
4ef1564e18 Update smart_scraper_gemini.py 2024-04-10 12:49:55 +02:00
EURAC\marperini
982f142f20 fixed embedder_model config for local models 2024-04-10 11:00:52 +02:00
EURAC\marperini
8b915e3ec6 fixed issue ollama embeddings 2024-04-10 09:29:03 +02:00
ftoppi
64d8e7c3b6
smart_scraper_local.py: Allow using a remote Ollama #53 
Since you pass `config["llm"]` to langchain ChatOllama(), it's only a matter of adding a new parameter `base_url`.
 2024-04-09 22:28:02 +02:00
VinciGit00
8ef49a03e0 fixed local llm examples 2024-04-09 21:48:19 +02:00
ftoppi
65c572afe1
smart_scraper_local.py: example of arbitrary model_tokens 2024-04-09 21:30:00 +02:00
VinciGit00
ee533b8d74 add examples for local models and gemini models 2024-04-09 11:43:51 +02:00
VinciGit00
f954097387 add avaiable models 2024-04-09 10:34:35 +02:00
VinciGit00
0ffefdd170 refactoring if examples ffolder 2024-04-08 22:28:55 +02:00
VinciGit00
958b2a4a79 add new version + refactoring of the code 2024-04-08 18:24:59 +02:00
EURAC\marperini
dee1a42629 fixed token models, added mistral support 2024-04-08 15:21:06 +02:00
EURAC\marperini
17add20c13 implemented node_config, add embedder model choice, add azure endpoint, refactor graphs and exmaples 2024-04-08 12:18:32 +02:00
EURAC\marperini
6a83c2306d docker compose working ollama implementation 2024-04-07 11:08:08 +02:00
EURAC\marperini
72859d52b8 fixed variable name 2024-04-06 20:08:50 +02:00
VinciGit00
6dc4c6dec4 Merge branch 'main' into research_branch 2024-04-06 14:44:56 +02:00
VinciGit00
a5fc71f34e fixed internet research 2024-04-06 14:39:19 +02:00
EURAC\marperini
57a53bd6af refactor examples 2024-04-06 13:22:42 +02:00
EURAC\marperini
c2709aa50c working search graph 2024-04-06 13:01:04 +02:00
VinciGit00
d1afd2bd69 add xml parsing example 2024-04-05 20:42:37 +02:00
VinciGit00
4c3ea8f4ac fixed image_to_tex_node and refactoring 2024-04-03 12:53:12 +02:00
Marco Vinciguerra
b67af93946
Update scrape_plain_text.py 2024-03-29 19:17:18 +01:00
VinciGit00
5e38c2e298 add superclasse for graphs 2024-03-28 20:46:17 +01:00
VinciGit00
a28ca993de refactoring of examples folder 2024-03-27 21:41:21 +01:00
VinciGit00
587dfa5c68 refactoring of the saving functions 2024-03-26 14:15:36 +01:00
VinciGit00
be36ab8707 add new type of scraping through text 2024-03-24 21:22:26 +01:00
VinciGit00
e25f74ddc8 fixed bug for scraping from node + add example 2024-03-18 22:53:52 +01:00
VinciGit00
1afb950751 refactoring of code, add example on the readme 2024-03-18 14:35:47 +01:00
Perinim
cae38a0d67 fixed bugs after merge 2024-03-18 11:30:14 +01:00
Perinim
b5bdd4e729 Merge remote-tracking branch 'origin/main' into refactoring_nodes 2024-03-18 11:07:42 +01:00
Perinim
7d3190a636 fixed example graphs and utils files 2024-03-18 10:20:23 +01:00
Perinim
b547972968 fixed custom_graph, graph_builder and trulens_evaluator 2024-03-18 09:12:59 +01:00
Perinim
52934bf007 implemented graph_config, fixed smart_scraper and speech graph 2024-03-17 20:35:04 +01:00