Marco Vinciguerra
|
6d783755ce
|
add benchmark
|
2024-06-19 21:11:15 +02:00 |
|
Marco Perini
|
0cb46f5f30
|
Merge pull request #392 from VinciGit00/391-switch-between-search-engines
/ build (3.10) (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
feat: add new search engine avaiability and new tests
|
2024-06-18 23:46:28 +02:00 |
|
Jason Vertrees
|
aedda44868
|
fix: updated for schema changes
docs: updated for schema changes
|
2024-06-18 13:31:10 -05:00 |
|
Marco Vinciguerra
|
073d226723
|
feat: add new search engine avaiability and new tests
|
2024-06-18 14:35:13 +02:00 |
|
Marco Perini
|
080a318ff6
|
feat(telemetry): add telemetry module
|
2024-06-17 13:00:33 +02:00 |
|
Marco Vinciguerra
|
2419003999
|
fix: fix robot node
/ build (3.10) (push) Waiting to run
Release / Build (push) Waiting to run
Release / Release (push) Blocked by required conditions
|
2024-06-16 14:04:36 +02:00 |
|
Marco Perini
|
9b0e62742b
|
changed source to text
|
2024-06-14 15:24:50 +02:00 |
|
Marco Perini
|
12f4386552
|
Merge branch 'pre/beta' into 349-problem-with-scrapegraphaigraphspdf_scraper_graphpy
|
2024-06-14 15:22:43 +02:00 |
|
Marco Perini
|
203de83405
|
fix(pdf): correctly read .pdf files
|
2024-06-14 15:20:30 +02:00 |
|
Marco Perini
|
91c5b5af43
|
fix(multi): updated multi pdf scraper with schema
|
2024-06-14 14:59:12 +02:00 |
|
Marco Perini
|
283b61fafc
|
docs: better logging
|
2024-06-13 18:13:47 +02:00 |
|
Marco Vinciguerra
|
e45f159a31
|
enhanced performance and readibility
|
2024-06-12 14:59:10 +02:00 |
|
Marco Vinciguerra
|
58a257f05b
|
update model tokens
/ build (3.10) (push) Waiting to run
Release / Build (push) Waiting to run
Release / Release (push) Blocked by required conditions
|
2024-06-12 12:41:58 +02:00 |
|
Marco Perini
|
a10b060409
|
Merge pull request #361 from VinciGit00/multi_scraper_implementation
Multi scraper implementation
|
2024-06-12 00:49:18 +02:00 |
|
Marco Perini
|
5d692bff9e
|
feat(schema): merge scripts to follow pydantic schema
|
2024-06-12 00:48:08 +02:00 |
|
Marco Vinciguerra
|
9326637cc3
|
Merge branch 'main' into pre/beta
|
2024-06-09 17:04:11 +02:00 |
|
Marco Vinciguerra
|
bde02492c0
|
add examples
|
2024-06-09 15:26:56 +02:00 |
|
Marco Vinciguerra
|
fe8083fe48
|
Update pdf_scraper_graph_haiku.py
/ build (3.10) (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
|
2024-06-09 10:02:29 +02:00 |
|
Marco Vinciguerra
|
5dc6165881
|
add example
CodeQL / Analyze (python) (push) Has been cancelled
/ build (3.10) (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
|
2024-06-09 09:25:37 +02:00 |
|
Marco Vinciguerra
|
c14fb88fca
|
add examples
/ build (3.10) (push) Has been cancelled
|
2024-06-09 08:58:47 +02:00 |
|
Marco Vinciguerra
|
cb00c4fb17
|
changed model
|
2024-06-08 12:22:50 +02:00 |
|
Marco Vinciguerra
|
1981230e6f
|
add multi scraper integration
|
2024-06-08 12:13:18 +02:00 |
|
Marco Perini
|
f41a755519
|
Merge pull request #356 from VinciGit00/321-integration-with-indexify
fixed pydantic schema
|
2024-06-07 20:27:25 +02:00 |
|
Marco Vinciguerra
|
dd2b3a8f59
|
add examples
/ build (3.10) (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
|
2024-06-05 21:08:00 +02:00 |
|
Marco Perini
|
5d1fbf806a
|
feat(indexify-node): add example
/ build (3.10) (push) Has been cancelled
|
2024-06-05 18:45:37 +02:00 |
|
Marco Vinciguerra
|
95725789ff
|
add earnie example
|
2024-06-05 13:21:32 +02:00 |
|
Marco Vinciguerra
|
4f53b09bf1
|
add examples for schema
/ build (3.10) (push) Waiting to run
Release / Build (push) Waiting to run
Release / Release (push) Blocked by required conditions
|
2024-06-05 10:43:57 +02:00 |
|
Marco Vinciguerra
|
74fd530914
|
Merge branch 'pre/beta' into 332-pydantic-schema-validation
|
2024-06-05 09:05:19 +02:00 |
|
Marco Perini
|
376f758a76
|
feat(pydantic): added pydantic output schema
|
2024-06-04 23:07:49 +02:00 |
|
Marco Vinciguerra
|
fff89f431f
|
feat: refactoring of abstract graph
|
2024-06-04 19:41:11 +02:00 |
|
Marco Vinciguerra
|
8de720d379
|
feat: removed a bug
|
2024-06-03 21:45:37 +02:00 |
|
Marco Vinciguerra
|
1dde43cdeb
|
add new examples
|
2024-06-03 21:03:13 +02:00 |
|
Marco Perini
|
79ace115c7
|
Merge pull request #323 from VinciGit00/refactoring-pdf_scraper
Refactoring pdf scraper and json scrape
|
2024-06-03 13:26:11 +02:00 |
|
Marco Vinciguerra
|
743dfe1191
|
add all possible examples
|
2024-06-03 12:19:43 +02:00 |
|
Marco Vinciguerra
|
b4086550cc
|
feat: add csv scraper and xml scraper multi
|
2024-06-02 22:57:33 +02:00 |
|
Marco Vinciguerra
|
fa9722d2b9
|
add examples
|
2024-06-02 14:43:02 +02:00 |
|
Marco Vinciguerra
|
5cfc10178a
|
feat: add forcing format as json
|
2024-06-02 12:24:54 +02:00 |
|
Marco Vinciguerra
|
1fe49753b9
|
add openai and oneapi examples
|
2024-06-01 13:46:15 +02:00 |
|
Marco Vinciguerra
|
5bda918a39
|
feat: add json multiscraper
|
2024-06-01 12:04:19 +02:00 |
|
Marco Vinciguerra
|
4d42d7bfc6
|
add example
|
2024-06-01 11:20:24 +02:00 |
|
Marco Vinciguerra
|
f5cbd80c97
|
feat: add pdf scraper multi graph
|
2024-06-01 09:52:21 +02:00 |
|
Marco Vinciguerra
|
1aa8c86b61
|
removed unused file
|
2024-05-29 19:15:56 +02:00 |
|
Marco Vinciguerra
|
3b90ebd9a8
|
add new examples
|
2024-05-29 10:41:37 +02:00 |
|
Marco Vinciguerra
|
58dfe9b658
|
add examples of usage
|
2024-05-28 09:11:14 +02:00 |
|
Marco Vinciguerra
|
004d03a0ff
|
add examples
|
2024-05-27 12:50:51 +02:00 |
|
Marco Vinciguerra
|
f4a253b513
|
removed unused file
|
2024-05-27 11:40:51 +02:00 |
|
Marco Perini
|
54e82163f0
|
fix: fixed typo
|
2024-05-26 16:38:10 +02:00 |
|
Marco Vinciguerra
|
3c7dedf9c8
|
Merge pull request #305 from VinciGit00/pdf_fix
Pdf fix
|
2024-05-26 15:39:21 +02:00 |
|
arsaboo
|
a7961691df
|
fix(pdf-example): added pdf example and coauthor
|
2024-05-26 15:09:49 +02:00 |
|
Marco Vinciguerra
|
fb74a5207e
|
update one_api example with schema
|
2024-05-26 12:22:53 +02:00 |
|
Marco Vinciguerra
|
1d958be44d
|
Merge pull request #303 from VinciGit00/295-scrapegraph-ai接入oneapi模型qwen-turbo
add OneAPI integration
|
2024-05-26 12:17:34 +02:00 |
|
Marco Vinciguerra
|
ecd98b2a45
|
add sche,a example
|
2024-05-26 12:15:48 +02:00 |
|
Marco Vinciguerra
|
40a99fa2f9
|
Update pdf_scraper_ollama.py
|
2024-05-26 11:02:08 +02:00 |
|
Marco Vinciguerra
|
a22be474f5
|
add example
|
2024-05-26 11:01:10 +02:00 |
|
Marco Perini
|
8d76c4b3cb
|
fix(schema): added schema
|
2024-05-26 10:51:48 +02:00 |
|
Marco Perini
|
5684578fab
|
fix(kg): removed unused nodes and utils
|
2024-05-25 00:44:14 +02:00 |
|
Marco Perini
|
a4ee757507
|
Merge branch 'pre/beta' into pdf_scraper_refactoring
|
2024-05-25 00:16:38 +02:00 |
|
Marco Perini
|
8d5eb0bb0d
|
fix(local_file): fixed textual input pdf, csv, json and xml graph
|
2024-05-25 00:13:47 +02:00 |
|
Marco Vinciguerra
|
b6f1766bd1
|
add OneAPI integration
Co-Authored-By: Federico Aguzzi <62149513+f-aguzzi@users.noreply.github.com>
Co-Authored-By: wangdongpeng1 <74647183+wangdongpeng1@users.noreply.github.com>
|
2024-05-24 13:46:40 +02:00 |
|
Marco Vinciguerra
|
b913b51cca
|
Merge branch 'logger-integration' into pre/beta
|
2024-05-24 12:39:14 +02:00 |
|
Marco Vinciguerra
|
b377467b29
|
add info
|
2024-05-23 12:51:08 +02:00 |
|
Marco Vinciguerra
|
be4237a04d
|
Merge branch 'pre/beta' into multi_scraper_graph
|
2024-05-21 13:44:06 +02:00 |
|
Marco Perini
|
fc58e2d3a6
|
feat(smart-scraper-multi): add schema to graphs and created SmartScraperMultiGraph
|
2024-05-21 13:13:27 +02:00 |
|
JGalego
|
60584921ca
|
Updated JSON scraper example prompt
|
2024-05-20 16:55:28 +01:00 |
|
JGalego
|
7e5ff4e410
|
Added bedrock examples
|
2024-05-20 16:49:20 +01:00 |
|
Marco Vinciguerra
|
5701afe927
|
add new import
|
2024-05-18 10:36:41 +02:00 |
|
Marco Perini
|
c75e6a06b1
|
feat(kg): working rag kg
|
2024-05-18 10:26:25 +02:00 |
|
Marco Perini
|
58cc903d55
|
feat(multiple): quick fix working
|
2024-05-18 05:57:43 +02:00 |
|
Marco Perini
|
bed3eed50c
|
feat(multiple_search): working multiple example
|
2024-05-18 01:51:12 +02:00 |
|
Marco Vinciguerra
|
05e511e36f
|
add new prompts
|
2024-05-18 00:22:52 +02:00 |
|
Marco Perini
|
0196423bde
|
feat(knowledgegraph): add knowledge graph node
|
2024-05-17 23:41:44 +02:00 |
|
Marco Perini
|
8c33ea3fbc
|
feat(node): knowledge graph node
|
2024-05-17 18:40:58 +02:00 |
|
Marco Vinciguerra
|
3453f72397
|
add graph
|
2024-05-17 18:23:50 +02:00 |
|
Marco Vinciguerra
|
02745a4f63
|
Merge branch 'main' into pre/beta
|
2024-05-17 10:40:19 +02:00 |
|
VinciGit00
|
9483afddd3
|
revert
|
2024-05-16 12:34:02 +02:00 |
|
Mayur Bhosale
|
1e0b2f7e70
|
Merge branch 'pre/beta' into nDeep
|
2024-05-15 23:36:23 +02:00 |
|
mayurdb
|
d60438cc89
|
Add a n-level deep search support
|
2024-05-15 23:32:15 +02:00 |
|
VinciGit00
|
ba8a4f7122
|
removed duplicates
|
2024-05-15 21:47:39 +02:00 |
|
VinciGit00
|
befa48c912
|
update lock
|
2024-05-15 21:28:56 +02:00 |
|
VinciGit00
|
cc5adefd29
|
fix: come back to the old version
|
2024-05-15 15:54:00 +02:00 |
|
VinciGit00
|
29d284e497
|
Merge branch 'main' into logger-integration
|
2024-05-15 15:28:20 +02:00 |
|
Marco Vinciguerra
|
cffcf80a75
|
Merge branch '88-blockscraper-implementation' into main
|
2024-05-15 15:20:12 +02:00 |
|
VinciGit00
|
a4700bfc75
|
add robot node
|
2024-05-15 12:00:32 +02:00 |
|
Marco Perini
|
a6e1813ddd
|
fix(fetch_node): bug in handling local files
|
2024-05-14 16:51:10 +02:00 |
|
Marco Perini
|
fcb3abb01d
|
feat(omni-search): added omni search graph and updated docs
|
2024-05-14 16:26:43 +02:00 |
|
Marco Perini
|
a296927624
|
feat(omni-scraper): working OmniScraperGraph with images
|
2024-05-14 13:46:49 +02:00 |
|
Marco Perini
|
90955ca52f
|
feat(gpt-4o): image to text single node test
|
2024-05-14 11:43:21 +02:00 |
|
VinciGit00
|
d6f5ca874f
|
Merge branch 'main' into pre/beta
|
2024-05-14 10:24:29 +02:00 |
|
Marco Perini
|
367dea5cbd
|
Merge branch 'pre/beta' into feat/parallel-node-execution
|
2024-05-13 23:50:40 +02:00 |
|
VinciGit00
|
c0d26d61d7
|
ad bedrocl
|
2024-05-13 20:17:03 +02:00 |
|
Marco Perini
|
dedc733047
|
fix(asyncio): replaced deepcopy with copy due to serialization problems
|
2024-05-13 18:46:34 +02:00 |
|
VinciGit00
|
7c91f9f94c
|
add examples for deepseek
|
2024-05-13 12:56:57 +02:00 |
|
Marco Perini
|
c7ec114274
|
docs(refactor): changed example
|
2024-05-13 12:28:03 +02:00 |
|
Marco Perini
|
0c1594737f
|
fix(fetch-node): removed isSoup from default
|
2024-05-13 12:09:55 +02:00 |
|
Marco Perini
|
7e8acd8e6a
|
Merge branch 'pre/beta' into fix/fetch-node-proxybroker
|
2024-05-13 11:17:37 +02:00 |
|
Marco Perini
|
0c36a7ec1f
|
feat: added proxy rotation
|
2024-05-13 11:04:56 +02:00 |
|
Marco Perini
|
5d6d996e8f
|
fix(proxy-rotation): removed max_shape duplicate
|
2024-05-13 07:26:43 +02:00 |
|
VinciGit00
|
30758b4b99
|
Create smart_scarper_deepseek.py
|
2024-05-12 20:27:35 +02:00 |
|
Marco Perini
|
1e9a564616
|
fix(proxy-rotation): removed duplicated arg and passed the loader_kwarhs correctly to the node
|
2024-05-12 18:39:03 +02:00 |
|
mayurdb
|
8f1fbe7e10
|
minor changes
|
2024-05-11 16:52:36 +05:30 |
|
mayurdb
|
df271b6451
|
Add search link node that can find out relevant links in the webpage
|
2024-05-11 16:39:55 +05:30 |
|
Eric Page
|
0683e78e78
|
Merge branch 'pre/beta' into fix-GenerateScraperGraph
|
2024-05-11 01:59:28 +02:00 |
|
Eric Page
|
67d8fec6b3
|
Minor typo fix for clarity
|
2024-05-11 00:05:13 +02:00 |
|
VinciGit00
|
7b07fdf2b5
|
add groq example
|
2024-05-09 10:33:33 +02:00 |
|
VinciGit00
|
0bb68d1500
|
Merge branch 'main' of https://github.com/VinciGit00/Scrapegraph-ai
|
2024-05-09 10:31:21 +02:00 |
|
Marco Perini
|
6b71ec1d2b
|
fix(examples): local, mixed models and fixed SearchGraph embeddings problem
|
2024-05-08 15:36:26 +02:00 |
|
Marco Perini
|
186c0d035d
|
fix(examples): openai std examples
|
2024-05-08 14:56:44 +02:00 |
|
Marco Vinciguerra
|
b326886250
|
Merge branch '88-blockscraper-implementation' into asdt
|
2024-05-07 13:27:30 +02:00 |
|
VinciGit00
|
2258fe5ac0
|
add new search graph examples
|
2024-05-06 22:31:48 +02:00 |
|
VinciGit00
|
5a67bca0db
|
Merge branch 'pre/beta' into pr/161
|
2024-05-06 14:50:04 +02:00 |
|
Cem Uzunoglu
|
e264e92e72
|
Added support for Claude 3 models from Anthropic
|
2024-05-06 14:34:35 +03:00 |
|
Marco Perini
|
edfaf3fa53
|
accessibility tree
|
2024-05-06 10:08:19 +02:00 |
|
VinciGit00
|
d9a4ab2d05
|
Delete custom_search_graph.py
|
2024-05-06 09:47:29 +02:00 |
|
Marco Perini
|
930adb38f2
|
feat(node): multiple url search in SearchGraph + fixes
Implemented GraphIteratorNode and MergeAnswersNode to create multiple istances of a graph and merge the scraped content from multiple pages
|
2024-05-06 00:30:09 +02:00 |
|
Marco Perini
|
dbb614a8dd
|
feat: multiple graph instances
|
2024-05-05 23:51:04 +02:00 |
|
Marco Perini
|
16f53c52fd
|
add example custom search graph
|
2024-05-05 22:03:55 +02:00 |
|
Marco Perini
|
84fcb44aaa
|
feat: fixed custom_graphs example and robots_node
|
2024-05-05 22:02:24 +02:00 |
|
Eric Page
|
cc27b21c3f
|
Merge branch 'pre/beta' into pass-common-params-graph
|
2024-05-05 16:18:32 +02:00 |
|
Eric Page
|
f10a44a1dd
|
Resolved key error "llm" -> "llm_model"
|
2024-05-05 16:13:05 +02:00 |
|
Eric Page
|
3ae2ea1dbd
|
Miscellaneous "llm" -> "llm_model" refactors
|
2024-05-05 15:58:50 +02:00 |
|
Shubham Kamboj
|
d830d1371b
|
Resolve merge conflicts
|
2024-05-04 22:01:40 +05:30 |
|
Shubham Kamboj
|
7599234ab9
|
feat: Enable end users to pass model instances of HuggingFaceHub
|
2024-05-04 21:42:57 +05:30 |
|
Marco Perini
|
aa9271e7bc
|
feat: Azure implementation + embeddings refactoring
|
2024-05-03 21:40:01 +02:00 |
|
S4mpl3r
|
819cbcd3be
|
refactor: Changed the way embedding model is created in AbstractGraph class and removed handling of embedding model creation from RAGNode. Now AbstractGraph will call a dedicated method for embedding models instead of _create_llm. This makes it easy to use any LLM with any supported embedding model.
|
2024-05-03 16:14:27 +03:30 |
|
Marco Perini
|
1219caa4ff
|
Merge pull request #130 from VinciGit00/main
reallignment
|
2024-05-03 10:37:10 +02:00 |
|
VinciGit00
|
431b495baa
|
add examples for azure
|
2024-05-02 22:30:20 +02:00 |
|
VinciGit00
|
967108dfd3
|
add example on readme
|
2024-05-02 19:14:09 +02:00 |
|
VinciGit00
|
2ea54eab1d
|
fix: gemini errror
|
2024-05-02 18:56:37 +02:00 |
|
Marco Vinciguerra
|
a2d5c75f10
|
Merge branch 'pre/beta' into main
|
2024-05-02 17:55:21 +02:00 |
|
Shubham Kamboj
|
b86aac2188
|
feat: Allow end users to pass model instances for llm and embedding model
|
2024-05-02 20:09:23 +05:30 |
|
VinciGit00
|
5cf4e4f92f
|
fix: examples and graphs
|
2024-05-02 09:20:46 +02:00 |
|
Marco Perini
|
c11fc28896
|
docs: refactor examples
|
2024-05-02 00:44:19 +02:00 |
|
VinciGit00
|
276ac8b40c
|
changed name
|
2024-05-01 20:17:01 +02:00 |
|
VinciGit00
|
7c1b5796d7
|
add csv scraper
|
2024-05-01 17:20:04 +02:00 |
|
VinciGit00
|
5ae67f5d3b
|
add new groq example
|
2024-05-01 12:48:32 +02:00 |
|
EURAC\marperini
|
2dd7817cfb
|
feat: added verbose flag to suppress print statements
|
2024-04-30 15:31:57 +02:00 |
|
Marco Perini
|
d592d27bb4
|
Merge pull request #115 from VinciGit00/101-scrape-json-files
feat: add xml scraper and json scraper
|
2024-04-30 14:29:57 +02:00 |
|
EURAC\marperini
|
8fba7e5490
|
feat(refactor): changed variable names
|
2024-04-30 14:28:30 +02:00 |
|
VinciGit00
|
59594cbc2f
|
add grow example
|
2024-04-30 13:57:24 +02:00 |
|
VinciGit00
|
e3d0194dc9
|
fix: script generator and add new benchmarks
|
2024-04-30 11:51:04 +02:00 |
|
VinciGit00
|
da2c82a2a2
|
add json and xml scraper
|
2024-04-30 10:52:22 +02:00 |
|
EURAC\marperini
|
42ab0aa1d2
|
feat(fetch): added playwright support
|
2024-04-30 04:02:58 +02:00 |
|
EURAC\marperini
|
dbbf10fc77
|
feat(llm): implemented groq model
|
2024-04-30 02:32:14 +02:00 |
|
VinciGit00
|
f8917320b3
|
add xml_example
|
2024-04-29 16:15:24 +02:00 |
|
VinciGit00
|
deb920a33e
|
fixing json and example
|
2024-04-29 16:11:57 +02:00 |
|
VinciGit00
|
45b2317ab7
|
add json examples
|
2024-04-29 11:16:48 +02:00 |
|
EURAC\marperini
|
6e7283ed8f
|
feat: add finalize_node()
|
2024-04-29 10:05:04 +02:00 |
|
VinciGit00
|
9cd516507c
|
fix: bug with fetch node
|
2024-04-27 21:23:35 +02:00 |
|
VinciGit00
|
adbc08f27b
|
fix: robot node and proxyes
|
2024-04-27 19:07:37 +02:00 |
|
EURAC\marperini
|
e778d27169
|
added tree metadata
|
2024-04-26 15:17:44 +02:00 |
|
VinciGit00
|
cd8d3e7a4f
|
refactoring of the graphs
|
2024-04-26 11:08:56 +02:00 |
|
VinciGit00
|
e714a59c2e
|
refactoring of engine
|
2024-04-25 19:22:12 +02:00 |
|
VinciGit00
|
1056cff50d
|
fixed bug on custom graph
|
2024-04-25 09:13:48 +02:00 |
|
VinciGit00
|
a73496df9b
|
refactoring of nodes
|
2024-04-24 21:13:27 +02:00 |
|
VinciGit00
|
9b9a9f204c
|
handling the agent model
|
2024-04-24 13:13:46 +02:00 |
|
Marco Vinciguerra
|
b8a342ec90
|
Update Readme.md
|
2024-04-23 13:21:54 +02:00 |
|
Lorenzo Padoan
|
12dcc5065a
|
ADD benchmarks m2 max llama3
|
2024-04-23 12:28:51 +02:00 |
|
VinciGit00
|
3c90d2f4fe
|
add info for gemini example
|
2024-04-22 22:52:40 +02:00 |
|
VinciGit00
|
8aa2cadb00
|
add integration for llama3
|
2024-04-21 13:11:10 +02:00 |
|
EURAC\marperini
|
ac099e2763
|
fixed ollama embedder params
|
2024-04-21 01:21:09 +02:00 |
|
VinciGit00
|
d3e2eb6ea5
|
add new benchmarks
|
2024-04-20 22:49:25 +02:00 |
|
VinciGit00
|
3f95801737
|
Merge branch 'main' of https://github.com/VinciGit00/Scrapegraph-ai
|
2024-04-19 10:36:40 +02:00 |
|
VinciGit00
|
1107630d27
|
add new test for script generator
|
2024-04-18 10:39:53 +02:00 |
|
Lorenzo Padoan
|
625b0d7498
|
ADD benchmark of my lovely mac 💝💫⭐💖💗💕 †
💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕💝💫⭐💖💗💕
|
2024-04-17 22:25:08 +02:00 |
|
VinciGit00
|
bd004db80a
|
add benchmarks and benchmarks results
|
2024-04-17 20:30:24 +02:00 |
|
Marco Perini
|
edc439fd01
|
Merge pull request #64 from VinciGit00/generateScraperbranch
add generateScraperBranch
|
2024-04-17 11:51:06 +02:00 |
|
Marco Vinciguerra
|
9394ee01d5
|
Update readme.md
|
2024-04-14 16:40:30 +02:00 |
|
VinciGit00
|
876223da56
|
add generateScraperBranch
Co-Authored-By: Matteo Mei <52063123+FattiMei@users.noreply.github.com>
|
2024-04-14 13:18:50 +02:00 |
|
Marco Vinciguerra
|
7268ebd7bf
|
Update readme.md
|
2024-04-13 21:44:48 +02:00 |
|
Marco Vinciguerra
|
069a42bf07
|
Update readme.md
|
2024-04-12 21:47:14 +02:00 |
|
Matteo Mei
|
c660c334dd
|
Update readme.md with benchmark on ubuntu system
Added results from running `benchmark.py` on a ubuntu laptop without docker
|
2024-04-12 21:44:05 +02:00 |
|
VinciGit00
|
b2b21e55b1
|
add benchmark comparison
|
2024-04-12 20:26:24 +02:00 |
|
VinciGit00
|
68f1ca1b78
|
add embeddings in the example
|
2024-04-12 14:55:11 +02:00 |
|
VinciGit00
|
a17e35c3de
|
Merge branch 'main' of https://github.com/VinciGit00/Scrapegraph-ai
|
2024-04-12 13:30:25 +02:00 |
|
VinciGit00
|
a8b452cb2c
|
refactoring of the folders
|
2024-04-12 13:29:58 +02:00 |
|
VinciGit00
|
e0978c53b3
|
Merge branch 'main' into ollama_integration
|
2024-04-12 13:00:35 +02:00 |
|
VinciGit00
|
3640434f5c
|
add utils
|
2024-04-12 12:59:15 +02:00 |
|
VinciGit00
|
60a2377bff
|
add inputs
|
2024-04-12 12:53:54 +02:00 |
|
VinciGit00
|
8e08652d8a
|
removed unused file and removed unused documentation
|
2024-04-12 11:05:52 +02:00 |
|
VinciGit00
|
87d911b7bb
|
removed files and refactoring of actions
|
2024-04-11 18:18:22 +02:00 |
|
EURAC\marperini
|
7d521ef1c8
|
Merge branch 'main' of https://github.com/VinciGit00/Scrapegraph-ai
|
2024-04-11 14:29:43 +02:00 |
|
EURAC\marperini
|
74ec928f96
|
added execution info of the graph, time, price etc
|
2024-04-11 14:29:32 +02:00 |
|
VinciGit00
|
f3766955fd
|
add examples
|
2024-04-11 12:17:04 +02:00 |
|
VinciGit00
|
4ef1564e18
|
Update smart_scraper_gemini.py
|
2024-04-10 12:49:55 +02:00 |
|
EURAC\marperini
|
982f142f20
|
fixed embedder_model config for local models
|
2024-04-10 11:00:52 +02:00 |
|
EURAC\marperini
|
8b915e3ec6
|
fixed issue ollama embeddings
|
2024-04-10 09:29:03 +02:00 |
|
ftoppi
|
64d8e7c3b6
|
smart_scraper_local.py: Allow using a remote Ollama #53
Since you pass `config["llm"]` to langchain ChatOllama(), it's only a matter of adding a new parameter `base_url`.
|
2024-04-09 22:28:02 +02:00 |
|
VinciGit00
|
8ef49a03e0
|
fixed local llm examples
|
2024-04-09 21:48:19 +02:00 |
|
ftoppi
|
65c572afe1
|
smart_scraper_local.py: example of arbitrary model_tokens
|
2024-04-09 21:30:00 +02:00 |
|
VinciGit00
|
ee533b8d74
|
add examples for local models and gemini models
|
2024-04-09 11:43:51 +02:00 |
|
VinciGit00
|
f954097387
|
add avaiable models
|
2024-04-09 10:34:35 +02:00 |
|
VinciGit00
|
0ffefdd170
|
refactoring if examples ffolder
|
2024-04-08 22:28:55 +02:00 |
|
VinciGit00
|
958b2a4a79
|
add new version + refactoring of the code
|
2024-04-08 18:24:59 +02:00 |
|
EURAC\marperini
|
dee1a42629
|
fixed token models, added mistral support
|
2024-04-08 15:21:06 +02:00 |
|
EURAC\marperini
|
17add20c13
|
implemented node_config, add embedder model choice, add azure endpoint, refactor graphs and exmaples
|
2024-04-08 12:18:32 +02:00 |
|
EURAC\marperini
|
6a83c2306d
|
docker compose working ollama implementation
|
2024-04-07 11:08:08 +02:00 |
|
EURAC\marperini
|
72859d52b8
|
fixed variable name
|
2024-04-06 20:08:50 +02:00 |
|
VinciGit00
|
6dc4c6dec4
|
Merge branch 'main' into research_branch
|
2024-04-06 14:44:56 +02:00 |
|
VinciGit00
|
a5fc71f34e
|
fixed internet research
|
2024-04-06 14:39:19 +02:00 |
|
EURAC\marperini
|
57a53bd6af
|
refactor examples
|
2024-04-06 13:22:42 +02:00 |
|