528 Commits

Author	SHA1	Message	Date
Matteo Vedovati	7411ff061c	Revert "initial creation of FetchNodeLevelK and DescriptionNode" ... This reverts commit 336bf705ec.	2024-09-30 12:21:26 +02:00
Matteo Vedovati	336bf705ec	initial creation of FetchNodeLevelK and DescriptionNode	2024-09-30 12:18:30 +02:00
Matteo Vedovati	89de5b6cba	Stating anew	2024-09-30 12:10:40 +02:00
Marco Vinciguerra	ea27b2499e	add empyt nodes	2024-09-30 11:52:14 +02:00
Marco Vinciguerra	d9a8208b08	Merge branch 'pre/beta' into branch_temp	2024-09-29 15:43:59 +02:00
Marco Vinciguerra	560f079d4c	refactoring of the code	2024-09-28 09:02:20 +02:00
Marco Vinciguerra	b2822f620a	feat: add reasoning integration	2024-09-27 17:45:44 +02:00
Marco Vinciguerra	7c39b06640	update for pylint	2024-09-27 09:34:56 +02:00
Matteo Vedovati	afa9aa3fe7	import refactoring	2024-09-26 18:37:40 +02:00
Matteo Vedovati	b7b3e9660f	reasoning node refactoring	2024-09-26 18:33:22 +02:00
Matteo Vedovati	0b12589664	reasoning node prompt refinement	2024-09-26 18:28:26 +02:00
Matteo Vedovati	3228f7dafb	Update reasoning_node.py	2024-09-26 18:10:37 +02:00
Matteo Vedovati	e2fe39c093	Reasoning node created	2024-09-26 17:59:50 +02:00
Marco Vinciguerra	d0976ddda9	Merge branch 'main' into temp-1	2024-09-25 17:45:45 +02:00
Marco Vinciguerra	76ce257efb	fix: update to pydantic documentation	2024-09-25 15:12:29 +02:00
Marco Vinciguerra	d55f6bee47	fix: node refiner + examples	2024-09-25 14:53:51 +02:00
Matteo Vedovati	ce841e21fb	Code generation refactoring	2024-09-24 19:04:43 +02:00
Matteo Vedovati	2d2c7194be	Template refactoring	2024-09-24 18:33:12 +02:00
Matteo Vedovati	d6a77029bb	Validator fixed	2024-09-24 18:12:50 +02:00
Matteo Vedovati	8578bf17d5	Merge pull request #8 from VinciGit00/patch-5 ... Update generate_code_node.py	2024-09-24 17:33:13 +02:00
Matteo Vedovati	b0d9b37bac	Merge pull request #7 from VinciGit00/patch-4 ... Update html_analyzer_node.py	2024-09-24 17:32:56 +02:00
Marco Vinciguerra	54ebb39732	Update generate_code_node.py	2024-09-24 17:00:18 +02:00
Marco Vinciguerra	d38a50115f	Update html_analyzer_node.py	2024-09-24 16:59:33 +02:00
Marco Vinciguerra	04ac7362d4	i don't like comments	2024-09-24 16:57:52 +02:00
Marco Vinciguerra	ceede46673	fix: parse_node	2024-09-24 15:27:20 +02:00
Matteo Vedovati	cd55c92b4e	Merge branch 'pre/beta' into pre/beta	2024-09-24 12:47:38 +02:00
Matteo Vedovati	84abaa6dfe	Merge pull request #5 from ScrapeGraphAI/temp ... Pre/beta	2024-09-24 12:46:28 +02:00
Matteo Vedovati	df90770779	Update generate_code_node.py	2024-09-24 12:44:55 +02:00
Marco Vinciguerra	5a3ece9a1a	Merge branch 'pre/beta' into temp	2024-09-24 12:41:55 +02:00
Marco Vinciguerra	36a8a1c872	refining and refactoring of the code	2024-09-24 12:36:10 +02:00
Marco Vinciguerra	bc881b4aaa	refctoring of the code	2024-09-23 08:37:52 +02:00
Marco Vinciguerra	de10b281ba	feat: update search_link_graph	2024-09-23 08:26:36 +02:00
Marco Vinciguerra	8ce08baf01	fix: graph Iterator node	2024-09-22 22:25:01 +02:00
Marco Vinciguerra	69880b680a	Update generate_answer_node.py	2024-09-22 21:16:16 +02:00
Marco Vinciguerra	7eda6bc06b	fix: issue about parser	2024-09-22 18:55:05 +02:00
Marco Vinciguerra	f9b121f765	fix: chat for bedrock	2024-09-22 16:47:19 +02:00
Marco Vinciguerra	9b3695db53	Update search_link_node.py	2024-09-22 10:37:25 +02:00
Marco Vinciguerra	c5a3f893f1	refactoring of node names	2024-09-22 10:35:43 +02:00
Matteo Vedovati	2ff0f0113f	Added logs	2024-09-21 18:46:16 +02:00
Matteo Vedovati	34590664f1	Code generator updated version	2024-09-21 16:36:22 +02:00
Matteo Vedovati	afa00d1594	Reasoning loop created	2024-09-21 13:02:16 +02:00
Matteo Vedovati	5b579b323f	gode generator v0.1	2024-09-21 11:44:04 +02:00
Marco Vinciguerra	86f68770e9	fix: removed faiss	2024-09-21 08:25:22 +02:00
Marco Vinciguerra	3ea1f20c83	Update fetch_node.py	2024-09-20 21:48:24 +02:00
Matteo Vedovati	eb9c77c2d5	code generator graph fixed	2024-09-19 18:09:27 +02:00
Matteo Vedovati	0f4b011814	generate code node added	2024-09-19 18:05:28 +02:00
Matteo Vedovati	470e768372	Update code generator graph	2024-09-19 14:45:56 +02:00
Marco Vinciguerra	72873c1b38	refactoring of teh code	2024-09-19 12:34:25 +02:00
Matteo Vedovati	a2490e370a	html analyzer node added	2024-09-19 11:01:47 +02:00
Matteo Vedovati	330c22fd5e	Update prompt_refiner_node.py	2024-09-19 10:40:18 +02:00
Lorenzo Paleari	eb89549248	feat: updated pydantic to v2	2024-09-17 23:08:56 +02:00
Lorenzo Paleari	28b85a3b16	refactor: Output parser code	2024-09-17 23:07:16 +02:00
Marco Vinciguerra	3f45c17022	fix: fetch_node condition	2024-09-16 09:11:59 +02:00
Marco Vinciguerra	c717bb6d8e	Merge branch 'main' into pre/beta	2024-09-16 09:08:37 +02:00
Marco Vinciguerra	438b8127db	refctoring of the code	2024-09-15 11:20:08 +02:00
Marco Vinciguerra	2ae26e96a0	Merge pull request #664 from LorenzoPaleari/598-fix-pydantic-validation-error ... 598 - Fix pydantic validation error	2024-09-13 09:00:17 +02:00
Lorenzo Paleari	66ea166438	fix: Added support for nested structure	2024-09-13 04:18:53 +02:00
Lorenzo Paleari	039ba2e95a	fix: Fixed pydantic error on SearchGraphs ... Changed instatiation location of iterated graph classes	2024-09-13 01:56:58 +02:00
Lorenzo Paleari	c3d1b7c200	fix: OmniScraerGraph working. ... Added url scraping capability to ParseNode	2024-09-13 01:47:39 +02:00
Matteo Vedovati	2a760a1c6f	initial promptrefiner prompt	2024-09-12 21:17:46 +02:00
Matteo Vedovati	42318a1441	Creation of PromptRefiner	2024-09-12 18:35:19 +02:00
Matteo Vedovati	9862425fb1	JsonDescriptorNode created	2024-09-12 18:04:37 +02:00
Marco Vinciguerra	4a16f14b25	Merge pull request #660 from tm-robinson/651-add-tokenization-for-ollama-and-mistral ... 651 add tokenization for ollama and mistral	2024-09-12 10:22:20 +02:00
Marco Vinciguerra	c64ce88db8	refactoting of imports	2024-09-12 10:16:15 +02:00
Tom Robinson	da9726f738	updates to tokenization for #651 to implement for mistral and ollama	2024-09-12 08:28:30 +01:00
Marco Vinciguerra	fe3aa28fe7	refactoring of the code	2024-09-11 16:04:43 +02:00
Marco Vinciguerra	1a7f21fbf3	feat: removed semchunk and used tikton	2024-09-10 14:03:52 +02:00
Marco Vinciguerra	380174d490	add chunking functionn	2024-09-10 13:52:15 +02:00
Federico Aguzzi	4c14fd79b2	Merge pull request #650 from ScrapeGraphAI/637-it-can´t-scrape-urls-from-the-source ... fix: parse node	2024-09-10 11:19:24 +02:00
Marco Vinciguerra	947ebd2895	fix: parse node	2024-09-10 08:41:08 +02:00
Federico Aguzzi	32a102af3c	Merge pull request #648 from ScrapeGraphAI/637-it-can´t-scrape-urls-from-the-source ... 637 it can´t scrape urls from the source	2024-09-09 12:04:46 +02:00
Federico Aguzzi	8a0d46b714	Merge pull request #641 from ScrapeGraphAI/urls_search_graph ... feat: return urls in searchgraph	2024-09-09 12:03:36 +02:00
Marco Vinciguerra	f2bb22d8e9	fix: temporary fix for parse_node	2024-09-09 11:42:33 +02:00
Marco Vinciguerra	fc738cacac	Update parse_node.py	2024-09-08 11:54:11 +02:00
Federico Aguzzi	9016bb53fb	Merge pull request #639 from ScrapeGraphAI/scrape_do_integration ... Scrape do integration	2024-09-07 17:06:22 +02:00
Marco Vinciguerra	ef7a5891dc	fix: screenshot_scraper	2024-09-07 14:55:12 +02:00
Marco Vinciguerra	afb6eb7e47	feat: return urls in searchgraph	2024-09-07 11:43:10 +02:00
Marco Vinciguerra	167f97040f	feat: fetch_node improved	2024-09-07 09:33:57 +02:00
Marco Vinciguerra	f5e7a8bfaf	fix of the bug for fetching the code	2024-09-06 16:58:37 +02:00
Marco Vinciguerra	94e69a0515	feat: add scrape_do_integration	2024-09-06 16:51:48 +02:00
Marco Vinciguerra	8b02cb4460	Merge pull request #632 from ekinsenler/concat_node ... feat: Concat node implementation	2024-09-06 15:52:35 +02:00
ekinsenler	bd4b26d7d7	feat: ConcatNode.py added for heavy merge operations	2024-09-04 17:53:32 +03:00
Lorenzo Paleari	8e74ac55a1	fix: correctly parsing output when using structured_output	2024-09-02 17:03:14 +02:00
Lorenzo Paleari	66a3b6d6a3	fix: Parse Node scraping link and img urls allowing OmniScraper to work	2024-09-02 12:53:10 +02:00
Marco Vinciguerra	e741602996	Merge branch 'pre/beta' into 543-ScriptCreatorGraph-only-use-first-chunk	2024-09-02 11:35:53 +02:00
Marco Vinciguerra	1bcc0bff0a	Merge pull request #620 from goasleep/feature/export_search_engine ... feat:expose the search engine params to user	2024-09-02 11:27:59 +02:00
Tom Robinson	3d265a8631	change GenerateScraperNode to only use first chunk	2024-09-02 08:21:19 +01:00
Tom Robinson	a8b0e4a359	updated token calculation on parsenode	2024-09-02 08:01:21 +01:00
smith peng	8422463ca6	feat:expose the search engine params to user	2024-09-02 14:28:39 +08:00
Marco Vinciguerra	0e0b280bde	Merge branch 'pre/beta' into temp	2024-09-01 11:53:51 +02:00
Marco Vinciguerra	c348f674ad	fix: update generate answernode	2024-08-30 11:37:44 +02:00
elijahbenizzy	25d8fd2e72	Fixes node expression validator error message to make it easier to debug missing keys	2024-08-29 13:24:47 -07:00
Federico Aguzzi	83e71df2e2	fix: set up dynamic imports correctly	2024-08-27 16:54:57 +02:00
Marco Vinciguerra	26de5dd623	Merge branch 'pre/beta' into ligthweigthing_library	2024-08-23 12:22:31 +02:00
Marco Vinciguerra	f7ba1f30de	refactoring of the code	2024-08-23 11:33:22 +02:00
Marco Vinciguerra	0d2b7b37e0	update dependenceis	2024-08-21 20:48:47 +02:00
Federico Aguzzi	d2486469af	Merge branch 'pre/beta' into screenshot_scraper	2024-08-20 09:58:34 +02:00
Marco Vinciguerra	f774fe40e5	add try catch and robust integration	2024-08-19 14:24:27 +02:00
Federico Aguzzi	d29338b7c2	feat(GenerateAnswerNode): built-in structured output through LangChain ... Co-Authored-By: Marco Vinciguerra <88108002+VinciGit00@users.noreply.github.com>	2024-08-19 13:45:37 +02:00
Federico Aguzzi	b48ee825ee	Merge branch 'pre/beta' into support_structured_output_shema_openai	2024-08-19 13:31:01 +02:00