Commit Graph

493 Commits

Author SHA1 Message Date
Marco Vinciguerra
119514bdfc feat: add vertexai integration 2024-07-01 12:21:47 +02:00
Marco Vinciguerra
79a2f51c34 add new models tokens 2024-06-19 10:42:41 +02:00
Marco Vinciguerra
40b4b2d939 add new models tokens 2024-06-19 10:42:00 +02:00
Marco Perini
0cb46f5f30
Merge pull request #392 from VinciGit00/391-switch-between-search-engines
Some checks failed
/ build (3.10) (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
feat: add new search engine avaiability and new tests
2024-06-18 23:46:28 +02:00
Marco Vinciguerra
aa2160c108 feat: add research with bing + test function
Some checks failed
/ build (3.10) (push) Has been cancelled
2024-06-18 21:28:29 +02:00
Jason Vertrees
aedda44868 fix: updated for schema changes
docs: updated for schema changes
2024-06-18 13:31:10 -05:00
Marco Vinciguerra
073d226723 feat: add new search engine avaiability and new tests 2024-06-18 14:35:13 +02:00
Marco Vinciguerra
48ff87f20a Merge branch 'pre/beta' of https://github.com/VinciGit00/Scrapegraph-ai into pre/beta 2024-06-17 14:17:46 +02:00
Marco Vinciguerra
03ffebc52d fix: add chinese embedding model 2024-06-17 14:17:44 +02:00
Marco Perini
080a318ff6 feat(telemetry): add telemetry module 2024-06-17 13:00:33 +02:00
Marco Vinciguerra
da93162b53
Merge branch 'pre/beta' into main 2024-06-17 11:02:56 +02:00
shubihu
d8d5cd267a
Update abstract_graph.py
fix: Incorrect API Key Error with OpenAI Proxy
2024-06-17 16:26:33 +08:00
Marco Perini
4c8becc721 overwrite common params to affect nodes config
Some checks failed
/ build (3.10) (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
2024-06-16 15:19:40 +02:00
Marco Vinciguerra
2419003999 fix: fix robot node
Some checks are pending
/ build (3.10) (push) Waiting to run
Release / Build (push) Waiting to run
Release / Release (push) Blocked by required conditions
2024-06-16 14:04:36 +02:00
Marco Vinciguerra
3d34ea65df
Merge pull request #384 from liaoliaojun/fix/merge
fix: TypeError ‘Model provided by the configuration not supported’
2024-06-16 13:34:43 +02:00
Marco Vinciguerra
dcd216e345 fix: removed duplicate from ollama dictionary
Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>
2024-06-15 19:51:20 +02:00
liaoliaojun
62b372b675 fix: shallow copy config of create_embedder 2024-06-15 17:53:13 +08:00
Marco Perini
09cb6e964e refactor: add missing schemas and renamed files
Some checks are pending
/ build (3.10) (push) Waiting to run
Release / Build (push) Waiting to run
Release / Release (push) Blocked by required conditions
2024-06-14 15:38:46 +02:00
Marco Perini
12f4386552
Merge branch 'pre/beta' into 349-problem-with-scrapegraphaigraphspdf_scraper_graphpy 2024-06-14 15:22:43 +02:00
Marco Perini
203de83405 fix(pdf): correctly read .pdf files 2024-06-14 15:20:30 +02:00
Marco Perini
91c5b5af43 fix(multi): updated multi pdf scraper with schema 2024-06-14 14:59:12 +02:00
Marco Vinciguerra
7a34562d50 refactoring of merging answers nodes 2024-06-13 21:41:54 +02:00
Marco Perini
283b61fafc docs: better logging 2024-06-13 18:13:47 +02:00
Marco Vinciguerra
a6757aca57
Merge pull request #380 from Kshitij-Jande/main
Strip out the scheme from the proxy server address URI.
2024-06-13 13:23:26 +02:00
Kshitij Jande
2a9ab69f4b Strip out the scheme from the server address URI 2024-06-13 12:18:41 +05:30
Marco Vinciguerra
1705046cc7 Update pdf_scraper_graph.py 2024-06-12 18:00:12 +02:00
Marco Vinciguerra
dc1340e302 Update generate_answer_pdf_node.py 2024-06-12 15:47:04 +02:00
Marco Vinciguerra
e45f159a31 enhanced performance and readibility 2024-06-12 14:59:10 +02:00
Marco Vinciguerra
58a257f05b update model tokens
Some checks are pending
/ build (3.10) (push) Waiting to run
Release / Build (push) Waiting to run
Release / Release (push) Blocked by required conditions
2024-06-12 12:41:58 +02:00
Marco Vinciguerra
e6c7940a57 feat: add Parse_Node 2024-06-12 12:29:14 +02:00
Marco Vinciguerra
5065aa00e1
Merge branch 'pre/beta' into supercoder-327 2024-06-12 12:12:15 +02:00
supercoder-dev
d0e300af72
Update fetch_node.py 2024-06-12 14:32:01 +05:30
supercoder-dev
879c94a2b5
Update cleanup_html.py 2024-06-12 14:30:02 +05:30
supercoder-dev
828bdeedce
Update smart_scraper_graph.py 2024-06-12 14:28:33 +05:30
Marco Perini
6b4cdf92b8 fix: common params 2024-06-12 03:06:21 +02:00
Marco Perini
ab00f23d85 fix(node): fixed generate answer node pydantic schema 2024-06-12 01:40:49 +02:00
Marco Perini
a10b060409
Merge pull request #361 from VinciGit00/multi_scraper_implementation
Multi scraper implementation
2024-06-12 00:49:18 +02:00
Marco Perini
5d692bff9e feat(schema): merge scripts to follow pydantic schema 2024-06-12 00:48:08 +02:00
Marco Perini
893aaddc5c
Merge pull request #359 from VinciGit00/semchunk_integration
feat: add new chunking function
2024-06-11 23:16:00 +02:00
Marco Perini
589da1d695
Merge pull request #351 from VinciGit00/faiss_integration
Faiss integration
2024-06-11 23:15:23 +02:00
Marco Perini
c881f64209 fix(cache): correctly pass the node arguments and logging 2024-06-11 22:56:09 +02:00
Marco Vinciguerra
fa951b4c8b
Merge pull request #368 from stevenmichaelthomas/wait-for-network-idle
Add the ability to specify load state
2024-06-11 19:59:23 +02:00
Steven Thomas
8f405ff87a Add the ability to specify load state 2024-06-11 11:22:39 -04:00
Marco Vinciguerra
81f89d88be
Update search_link_node.py 2024-06-10 16:14:24 +02:00
Marco Vinciguerra
9326637cc3 Merge branch 'main' into pre/beta 2024-06-09 17:04:11 +02:00
Marco Vinciguerra
1981230e6f add multi scraper integration 2024-06-08 12:13:18 +02:00
Marco Perini
8228225dff
Merge pull request #360 from VinciGit00/burr_integration
Burr integration
2024-06-08 12:10:34 +02:00
Marco Vinciguerra
e1f045b280 feat: add new chunking function 2024-06-08 11:44:09 +02:00
Marco Vinciguerra
543b48764a add default folder for the cache
Some checks failed
/ build (3.10) (push) Has been cancelled
2024-06-07 09:47:21 +02:00
Marco Vinciguerra
d79036149a feat: add caching
Some checks are pending
/ build (3.10) (push) Waiting to run
2024-06-06 21:35:52 +02:00