Commit Graph

44 Commits

Author SHA1 Message Date
aziz-ullah-khan
c218546a3d feat: Serper API integration for Google search 2024-11-02 15:02:08 +05:00
Marco Vinciguerra
db4b7cd3d1 refactoring of the code 2024-10-15 11:21:04 +02:00
aziz-ullah-khan
36875b67f1 Merge remote-tracking branch 'refs/remotes/origin/pre/beta' into pre/beta 2024-10-11 10:08:07 +05:00
aziz-ullah-khan
46195d65ca Update: proxy integration in googlesearch 2024-10-11 10:04:28 +05:00
Marco Vinciguerra
d0e5671caf removed unused example 2024-10-09 08:46:48 +02:00
Marco Vinciguerra
560f079d4c refactoring of the code 2024-09-28 09:02:20 +02:00
Marco Vinciguerra
bc881b4aaa refctoring of the code
Some checks failed
CodeQL / Analyze (python) (push) Has been cancelled
/ build (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
2024-09-23 08:37:52 +02:00
Lorenzo Paleari
a92dddb3e0
fix: update all nodes that were using MergeNode or IteratorNode 2024-09-13 04:19:40 +02:00
Lorenzo Paleari
039ba2e95a
fix: Fixed pydantic error on SearchGraphs
Changed instatiation location of iterated graph classes
2024-09-13 01:56:58 +02:00
roryhaung
57a58e162e docs: Updated the graph_config in the documentation. 2024-09-12 14:50:02 +08:00
Marco Vinciguerra
fe3aa28fe7 refactoring of the code
Some checks failed
/ build (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
2024-09-11 16:04:43 +02:00
smith peng
8422463ca6 feat:expose the search engine params to user 2024-09-02 14:28:39 +08:00
smith peng
cd07418474 fix: deepcopy fail for coping model_instance config 2024-08-31 16:26:11 +08:00
Marco Vinciguerra
8b2c266aff refactoring of the code
Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>
2024-08-10 17:44:35 +02:00
Marco Vinciguerra
66a29bc5cc refactoring of the openai examples
Some checks are pending
/ build (push) Waiting to run
Release / Build (push) Waiting to run
Release / Release (push) Blocked by required conditions
Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>
2024-08-05 20:54:53 +02:00
Marco Vinciguerra
0dfa5bf07e
Merge branch 'pre/beta' into main 2024-06-25 10:47:15 +02:00
Maorsg
f75e0835fc added a function to the search_graph class to allow user to return URLs considered in the search 2024-06-24 21:31:28 -04:00
Jason Vertrees
aedda44868 fix: updated for schema changes
docs: updated for schema changes
2024-06-18 13:31:10 -05:00
Marco Perini
080a318ff6 feat(telemetry): add telemetry module 2024-06-17 13:00:33 +02:00
Marco Perini
376f758a76 feat(pydantic): added pydantic output schema 2024-06-04 23:07:49 +02:00
Marco Perini
fc58e2d3a6 feat(smart-scraper-multi): add schema to graphs and created SmartScraperMultiGraph 2024-05-21 13:13:27 +02:00
Marco Perini
d4d913c8a3 fix(deepcopy): switch whether we have obj in the config 2024-05-17 10:36:39 +02:00
Marco Perini
999c930f42 fix(deepcopy): reaplced to shallow copy 2024-05-15 16:00:42 +02:00
VinciGit00
cc5adefd29 fix: come back to the old version 2024-05-15 15:54:00 +02:00
Marco Perini
096b665c01 fix(searchgraph): used shallow copy to serialize obj 2024-05-15 15:05:47 +02:00
Marco Perini
6b71ec1d2b fix(examples): local, mixed models and fixed SearchGraph embeddings problem 2024-05-08 15:36:26 +02:00
VinciGit00
80053a2358 Merge branch 'pre/beta' of https://github.com/VinciGit00/Scrapegraph-ai into pre/beta 2024-05-06 10:07:56 +02:00
VinciGit00
389b52aabb removed examples 2024-05-06 10:07:31 +02:00
Marco Perini
930adb38f2 feat(node): multiple url search in SearchGraph + fixes
Implemented GraphIteratorNode and MergeAnswersNode to create multiple istances of a graph and merge the scraped content from multiple pages
2024-05-06 00:30:09 +02:00
Eric Page
a53e95cbf0 Corrected graphs to use common params 2024-05-05 14:36:16 +02:00
Eric Page
4dc6049e76 Simplified create graph functions using common params 2024-05-05 10:40:04 +02:00
Eric Page
2178485b3d Adjusted graphs to reflect node_config change 2024-05-05 09:47:13 +02:00
Marco Perini
0631985e61 docs: graphs and helpers docstrings 2024-05-02 00:23:38 +02:00
EURAC\marperini
2dd7817cfb feat: added verbose flag to suppress print statements 2024-04-30 15:31:57 +02:00
EURAC\marperini
42ab0aa1d2 feat(fetch): added playwright support 2024-04-30 04:02:58 +02:00
VinciGit00
cd8d3e7a4f refactoring of the graphs 2024-04-26 11:08:56 +02:00
EURAC\marperini
74ec928f96 added execution info of the graph, time, price etc 2024-04-11 14:29:32 +02:00
VinciGit00
0ffefdd170 refactoring if examples ffolder 2024-04-08 22:28:55 +02:00
EURAC\marperini
dee1a42629 fixed token models, added mistral support 2024-04-08 15:21:06 +02:00
EURAC\marperini
17add20c13 implemented node_config, add embedder model choice, add azure endpoint, refactor graphs and exmaples 2024-04-08 12:18:32 +02:00
EURAC\marperini
6a83c2306d docker compose working ollama implementation 2024-04-07 11:08:08 +02:00
EURAC\marperini
c2709aa50c working search graph 2024-04-06 13:01:04 +02:00
VinciGit00
5e38c2e298 add superclasse for graphs 2024-03-28 20:46:17 +01:00
VinciGit00
7d0fd74bfc add search graph 2024-03-28 16:54:01 +01:00