31 Commits

Author	SHA1	Message	Date
Marco Vinciguerra	0ea00c078f	feat: refactoring of export functions	2024-10-21 10:30:21 +02:00
Marco Vinciguerra	d55f6bee47	fix: node refiner + examples	2024-09-25 14:53:51 +02:00
Matteo Vedovati	ce841e21fb	Code generation refactoring	2024-09-24 19:04:43 +02:00
Marco Vinciguerra	5a3ece9a1a	Merge branch 'pre/beta' into temp	2024-09-24 12:41:55 +02:00
Matteo Vedovati	5b579b323f	gode generator v0.1	2024-09-21 11:44:04 +02:00
Lorenzo Paleari	8a37c6b793	feat: added Bedrock and Mistral to exec info	2024-09-18 02:02:38 +02:00
Lorenzo Paleari	e657113ebc	fix: Refactor code to use CustomOpenAiCallbackManager for exclusive access to get_openai_callback	2024-09-14 02:06:52 +02:00
Marco Vinciguerra	1a7f21fbf3	feat: removed semchunk and used tikton	2024-09-10 14:03:52 +02:00
Marco Vinciguerra	380174d490	add chunking functionn	2024-09-10 13:52:15 +02:00
Marco Vinciguerra	1e466cd2a8	Merge branch 'pre/beta' into screenshot-scraper-fix	2024-09-02 12:43:32 +02:00
Tom Robinson	a8b0e4a359	updated token calculation on parsenode	2024-09-02 08:01:21 +01:00
Marco Vinciguerra	a0d21137b7	refactoring of folders	2024-08-30 12:17:21 +02:00
Marco Vinciguerra	8bb560a489	add convert function	2024-06-19 20:17:45 +02:00
Marco Perini	5684578fab	fix(kg): removed unused nodes and utils	2024-05-25 00:44:14 +02:00
Marco Vinciguerra	b913b51cca	Merge branch 'logger-integration' into pre/beta	2024-05-24 12:39:14 +02:00
Marco Perini	c75e6a06b1	feat(kg): working rag kg	2024-05-18 10:26:25 +02:00
Marco Perini	0196423bde	feat(knowledgegraph): add knowledge graph node	2024-05-17 23:41:44 +02:00
VinciGit00	e53766b16e	feat: add logger integration	2024-05-14 15:20:39 +02:00
Marco Perini	7e8acd8e6a	Merge branch 'pre/beta' into fix/fetch-node-proxybroker	2024-05-13 11:17:37 +02:00
mayurdb	300fd5d253	Fetch links in the page while parsing html	2024-05-11 09:46:51 +05:30
Federico Minutoli	fc2aa3ac1c	Merge branch 'pre/beta' of https://github.com/DiTo97/Scrapegraph-ai into fix/fetch-node-proxybroker	2024-05-10 21:20:40 +02:00
Federico Minutoli	217013181d	feat(proxy-rotation): add parse (IP address) or search (from broker) functionality for proxy rotation ... the broker has been made fully configurable for anonymity level, admissible locations, scheme and max shape not to waste resources, unlike the original `free-proxy` package. other options have been explored (e.g., `proxybroker`, `proxybroker2`) due to their built-in proxy server and rotation capabilities, but the former is no longer maintained, and the latter has issue with any python version outside of python 3.9	2024-05-10 21:09:48 +02:00
Marco Perini	864aa91326	feat: revert fetch_node	2024-05-10 15:11:54 +02:00
VinciGit00	adbc08f27b	fix: robot node and proxyes	2024-04-27 19:07:37 +02:00
VinciGit00	b754dd909c	fix: changed proxy function	2024-04-27 14:40:50 +02:00
VinciGit00	f6077d1f98	feat: add new proxy rotation function	2024-04-27 13:31:53 +02:00
EURAC\marperini	74ec928f96	added execution info of the graph, time, price etc	2024-04-11 14:29:32 +02:00
VinciGit00	71bd53d254	refactoring of the code, add tests and examples	2024-02-19 11:54:36 +01:00
PeriniM	da16360b1f	working text2speech and image2text	2024-02-19 06:26:50 +01:00
PeriniM	49c22ae155	implemented graphbuilder class	2024-02-19 03:39:50 +01:00
PeriniM	20398a3059	dev: refactor dict on graph state	2024-02-18 23:36:16 +01:00