528 Commits

Author	SHA1	Message	Date
Marco Perini	79ace115c7	Merge pull request #323 from VinciGit00/refactoring-pdf_scraper ... Refactoring pdf scraper and json scrape	2024-06-03 13:26:11 +02:00
Marco Vinciguerra	5cfc10178a	feat: add forcing format as json	2024-06-02 12:24:54 +02:00
Marco Vinciguerra	5bda918a39	feat: add json multiscraper	2024-06-01 12:04:19 +02:00
Marco Vinciguerra	f5cbd80c97	feat: add pdf scraper multi graph	2024-06-01 09:52:21 +02:00
Marco Vinciguerra	25352a56f9	Merge branch 'pre/beta' into temp	2024-05-31 23:08:24 +02:00
Marco Vinciguerra	930f673747	feat: removed rag node	2024-05-31 21:03:48 +02:00
Marco Vinciguerra	c4ce36111f	fix: typo in generate_screper_node	2024-05-30 18:50:04 +02:00
Johan Karlsson	4639f0cac5	fix: typo in prompt	2024-05-30 13:47:59 +02:00
Marco Perini	8d76c4b3cb	fix(schema): added schema	2024-05-26 10:51:48 +02:00
Marco Perini	5684578fab	fix(kg): removed unused nodes and utils	2024-05-25 00:44:14 +02:00
Marco Perini	a4ee757507	Merge branch 'pre/beta' into pdf_scraper_refactoring	2024-05-25 00:16:38 +02:00
Marco Perini	8d5eb0bb0d	fix(local_file): fixed textual input pdf, csv, json and xml graph	2024-05-25 00:13:47 +02:00
Marco Vinciguerra	b913b51cca	Merge branch 'logger-integration' into pre/beta	2024-05-24 12:39:14 +02:00
Federico Minutoli	c251cc45d3	fix(node-logging): use centralized logger in each node for logging	2024-05-24 01:09:49 +02:00
Federico Minutoli	4348d4f4db	fix(logger): set up centralized root logger in base node	2024-05-24 01:09:26 +02:00
Marco Vinciguerra	909af8d912	refactor gen answ node	2024-05-23 13:45:23 +02:00
Marco Vinciguerra	b377467b29	add info	2024-05-23 12:51:08 +02:00
Marco Vinciguerra	f00ed35f7b	Merge branch 'pre/beta' into patch-1	2024-05-23 11:47:51 +02:00
Marco Vinciguerra	f2dffe534f	fix: pdf scraper bug	2024-05-22 11:54:55 +02:00
Marco Vinciguerra	be4237a04d	Merge branch 'pre/beta' into multi_scraper_graph	2024-05-21 13:44:06 +02:00
Marco Perini	fc58e2d3a6	feat(smart-scraper-multi): add schema to graphs and created SmartScraperMultiGraph	2024-05-21 13:13:27 +02:00
JGalego	3ffa896c39	Fixed model ID -> model name conversion	2024-05-20 17:35:55 +01:00
JGalego	05ecc3ae20	Added missing logic to extract model_name from model_id	2024-05-20 17:17:11 +01:00
Marco Perini	a338383399	feat(kg): removed import	2024-05-18 10:30:29 +02:00
Marco Perini	58cc903d55	feat(multiple): quick fix working	2024-05-18 05:57:43 +02:00
Marco Vinciguerra	6f62b0560a	Merge branch 'multi_scraper_graph' of https://github.com/VinciGit00/Scrapegraph-ai into multi_scraper_graph	2024-05-18 02:42:27 +02:00
Marco Vinciguerra	b82f33aee7	fix: template names	2024-05-18 02:42:25 +02:00
Marco Perini	bed3eed50c	feat(multiple_search): working multiple example	2024-05-18 01:51:12 +02:00
Marco Vinciguerra	05e511e36f	add new prompts	2024-05-18 00:22:52 +02:00
Marco Perini	0196423bde	feat(knowledgegraph): add knowledge graph node	2024-05-17 23:41:44 +02:00
Marco Perini	8c33ea3fbc	feat(node): knowledge graph node	2024-05-17 18:40:58 +02:00
Marco Vinciguerra	3453f72397	add graph	2024-05-17 18:23:50 +02:00
Marco Vinciguerra	02745a4f63	Merge branch 'main' into pre/beta	2024-05-17 10:40:19 +02:00
VinciGit00	9e9f8f09d5	removed max depth	2024-05-16 12:39:08 +02:00
VinciGit00	9483afddd3	revert	2024-05-16 12:34:02 +02:00
Mayur Bhosale	1e0b2f7e70	Merge branch 'pre/beta' into nDeep	2024-05-15 23:36:23 +02:00
mayurdb	d60438cc89	Add a n-level deep search support	2024-05-15 23:32:15 +02:00
VinciGit00	ba8a4f7122	removed duplicates	2024-05-15 21:47:39 +02:00
VinciGit00	4fe58d9ba4	fix logger	2024-05-15 16:12:13 +02:00
VinciGit00	cc5adefd29	fix: come back to the old version	2024-05-15 15:54:00 +02:00
VinciGit00	29d284e497	Merge branch 'main' into logger-integration	2024-05-15 15:28:20 +02:00
Marco Vinciguerra	008f8d9eae	Merge pull request #248 from VinciGit00/main ... reallignment	2024-05-15 15:20:53 +02:00
Marco Vinciguerra	cffcf80a75	Merge branch '88-blockscraper-implementation' into main	2024-05-15 15:20:12 +02:00
Marco Vinciguerra	22cd9e3605	Merge branch 'search_link_context' into main	2024-05-15 15:16:57 +02:00
mayurdb	0b71b9a1e8	Add a new graph traversal that allows more than one edges out of a graph	2024-05-15 13:46:19 +02:00
VinciGit00	a4700bfc75	add robot node	2024-05-15 12:00:32 +02:00
VinciGit00	05890835f5	refactoring of loggers	2024-05-15 10:54:53 +02:00
Marco Vinciguerra	932df8d491	Merge pull request #238 from VinciGit00/gpt4-omni	2024-05-14 17:09:23 +02:00
mayurdb	a458ec4b9f	Update the prompt for the search_link_node	2024-05-14 16:59:16 +02:00
Marco Perini	a6e1813ddd	fix(fetch_node): bug in handling local files	2024-05-14 16:51:10 +02:00
VinciGit00	e53766b16e	feat: add logger integration	2024-05-14 15:20:39 +02:00
Marco Perini	a296927624	feat(omni-scraper): working OmniScraperGraph with images	2024-05-14 13:46:49 +02:00
Marco Perini	90955ca52f	feat(gpt-4o): image to text single node test	2024-05-14 11:43:21 +02:00
Marco Perini	367dea5cbd	Merge branch 'pre/beta' into feat/parallel-node-execution	2024-05-13 23:50:40 +02:00
Marco Perini	a8d5e7db05	feat(batchsize): tested different batch sizes and systems	2024-05-13 23:49:48 +02:00
Marco Perini	dedc733047	fix(asyncio): replaced deepcopy with copy due to serialization problems	2024-05-13 18:46:34 +02:00
Marco Perini	0c1594737f	fix(fetch-node): removed isSoup from default	2024-05-13 12:09:55 +02:00
Marco Perini	7e8acd8e6a	Merge branch 'pre/beta' into fix/fetch-node-proxybroker	2024-05-13 11:17:37 +02:00
Marco Perini	1e9a564616	fix(proxy-rotation): removed duplicated arg and passed the loader_kwarhs correctly to the node	2024-05-12 18:39:03 +02:00
VinciGit00	e2350eda62	feat: add new prompt info	2024-05-12 11:14:30 +02:00
mayurdb	9a67a26cd3	Update documentation	2024-05-11 16:57:22 +05:30
mayurdb	df271b6451	Add search link node that can find out relevant links in the webpage	2024-05-11 16:39:55 +05:30
Marco Vinciguerra	b752499fab	Merge pull request #217 from mayurdb/fetchLinkFix ... Fetch links in the page while parsing html	2024-05-11 09:42:40 +02:00
mayurdb	300fd5d253	Fetch links in the page while parsing html	2024-05-11 09:46:51 +05:30
Eric Page	0683e78e78	Merge branch 'pre/beta' into fix-GenerateScraperGraph	2024-05-11 01:59:28 +02:00
Eric Page	aac51ba290	Removed dead code, allows GenerateScraperNode to generate scraper with ... one chunk of context	2024-05-11 01:34:51 +02:00
Eric Page	40884747c7	Added parse_html option in parse_node	2024-05-11 00:32:01 +02:00
Federico Minutoli	627cbeeb20	feat(parallel-exeuction): add asyncio event loop dispatcher with semaphore for parallel graph instances ... TODO: still untested	2024-05-11 00:13:27 +02:00
Federico Minutoli	fc2aa3ac1c	Merge branch 'pre/beta' of https://github.com/DiTo97/Scrapegraph-ai into fix/fetch-node-proxybroker	2024-05-10 21:20:40 +02:00
Federico Minutoli	768719cce8	feat(safe-web-driver): enchanced the original AsyncChromiumLoader web driver with proxy protection and flexible kwargs and backend ... the original class prevents passing kwargs down to the playwright backend, making some config unfeasible, including passing a proxy server to the web driver. the new class has backward compatibility with the original, but 1) allows any kwarg to be passed down to the web driver, 2) allows specifying the web driver backend (only playwright is supported for now) in case more (e.g., selenium) will be supported in the future and 3) automatically fetches a suitable proxy if one is not passed already	2024-05-10 21:13:38 +02:00
Marco Perini	864aa91326	feat: revert fetch_node	2024-05-10 15:11:54 +02:00
Marco Vinciguerra	99adc9799f	Merge branch 'pre/beta' into fetchNodeFix	2024-05-10 11:13:54 +02:00
mayurdb	f8ce3d5916	fix: Augment the information getting fetched from a webpage	2024-05-10 13:28:53 +05:30
VinciGit00	0ab31c3fdb	fix: add json integration	2024-05-09 21:07:07 +02:00
VinciGit00	324e977b85	fix: fixed bugs for csv and xml	2024-05-09 20:46:46 +02:00
Shubham Kamboj	f10f3b1438	feat: Add support for passing pdf path as source	2024-05-09 21:55:05 +05:30
Marco Perini	6b71ec1d2b	fix(examples): local, mixed models and fixed SearchGraph embeddings problem	2024-05-08 15:36:26 +02:00
Marco Perini	186c0d035d	fix(examples): openai std examples	2024-05-08 14:56:44 +02:00
Marco Vinciguerra	b326886250	Merge branch '88-blockscraper-implementation' into asdt	2024-05-07 13:27:30 +02:00
VinciGit00	67d5fbf816	feat: new search_graph	2024-05-06 22:09:18 +02:00
VinciGit00	5a67bca0db	Merge branch 'pre/beta' into pr/161	2024-05-06 14:50:04 +02:00
VinciGit00	51aa109e42	feat: add turboscraper (alfa)	2024-05-06 11:59:14 +02:00
VinciGit00	5e1d5db6da	Update search_internet_node.py	2024-05-06 10:09:17 +02:00
VinciGit00	80053a2358	Merge branch 'pre/beta' of https://github.com/VinciGit00/Scrapegraph-ai into pre/beta	2024-05-06 10:07:56 +02:00
VinciGit00	389b52aabb	removed examples	2024-05-06 10:07:31 +02:00
VinciGit00	88d999e15b	add website content	2024-05-06 09:36:32 +02:00
Marco Perini	930adb38f2	feat(node): multiple url search in SearchGraph + fixes ... Implemented GraphIteratorNode and MergeAnswersNode to create multiple istances of a graph and merge the scraped content from multiple pages	2024-05-06 00:30:09 +02:00
Marco Perini	dbb614a8dd	feat: multiple graph instances	2024-05-05 23:51:04 +02:00
Marco Perini	84fcb44aaa	feat: fixed custom_graphs example and robots_node	2024-05-05 22:02:24 +02:00
Lorenzo Padoan	e1b9d69360	dev basic class blockindentifier	2024-05-05 17:36:30 +02:00
Eric Page	cc27b21c3f	Merge branch 'pre/beta' into pass-common-params-graph	2024-05-05 16:18:32 +02:00
Eric Page	3ae2ea1dbd	Miscellaneous "llm" -> "llm_model" refactors	2024-05-05 15:58:50 +02:00
VinciGit00	cb1bd00a19	removed unused node	2024-05-05 09:40:35 +02:00
Eric Page	729d5d7597	Changed node_config["llm"] to node_config["llm_model"]	2024-05-05 09:36:11 +02:00
Eric Page	c2c61625b3	Corrected logic of update_config function in base_node.py	2024-05-05 06:37:31 +02:00
Eric Page	b7539d4725	Added update_config function to base_node.py	2024-05-05 06:25:43 +02:00
Shubham Kamboj	fd59f282a8	Bug fixes	2024-05-04 22:18:54 +05:30
Shubham Kamboj	d830d1371b	Resolve merge conflicts	2024-05-04 22:01:40 +05:30
Shubham Kamboj	7599234ab9	feat: Enable end users to pass model instances of HuggingFaceHub	2024-05-04 21:42:57 +05:30
Marco Perini	df293fdfd2	Merge pull request #139 from VinciGit00/pdf_scraper_graph_introduction ... feat: add pdf scraper	2024-05-03 21:45:09 +02:00
VinciGit00	10a94530e3	feat: add pdf scraper	2024-05-03 21:42:02 +02:00
Marco Perini	aa9271e7bc	feat: Azure implementation + embeddings refactoring	2024-05-03 21:40:01 +02:00
Marco Vinciguerra	2abe05a0cf	Merge pull request #135 from S4mpl3r/feature	2024-05-03 16:49:07 +02:00
S4mpl3r	819cbcd3be	refactor: Changed the way embedding model is created in AbstractGraph class and removed handling of embedding model creation from RAGNode. Now AbstractGraph will call a dedicated method for embedding models instead of _create_llm. This makes it easy to use any LLM with any supported embedding model.	2024-05-03 16:14:27 +03:30
Marco Perini	cb1cb616b7	feat: add base_node to __init__.py ... Useful for people to create custom nodes	2024-05-03 14:18:12 +02:00
Marco Vinciguerra	579a27faf9	Merge pull request #126 from VinciGit00/bedrock_support ... feat: bedrock support	2024-05-02 17:57:20 +02:00
Marco Vinciguerra	a2d5c75f10	Merge branch 'pre/beta' into main	2024-05-02 17:55:21 +02:00
Shubham Kamboj	b86aac2188	feat: Allow end users to pass model instances for llm and embedding model	2024-05-02 20:09:23 +05:30
VinciGit00	16de49fa08	add integration for bedrock ... Co-Authored-By: redrusty2 <15157208+redrusty2@users.noreply.github.com>	2024-05-02 13:47:17 +02:00
Marco Perini	0631985e61	docs: graphs and helpers docstrings	2024-05-02 00:23:38 +02:00
Marco Perini	1409797475	docs: refactor nodes docstrings	2024-05-01 23:17:57 +02:00
Marco Perini	4d542a88f7	feat: added node and graph for CSV scraping	2024-05-01 21:34:40 +02:00
Marco Perini	02d1af006c	feat: modified node name	2024-05-01 21:33:25 +02:00
Marco Perini	e9817963c8	docs: base and fetch node	2024-05-01 21:30:06 +02:00
VinciGit00	7c1b5796d7	add csv scraper	2024-05-01 17:20:04 +02:00
EURAC\marperini	2dd7817cfb	feat: added verbose flag to suppress print statements	2024-04-30 15:31:57 +02:00
Marco Perini	d592d27bb4	Merge pull request #115 from VinciGit00/101-scrape-json-files ... feat: add xml scraper and json scraper	2024-04-30 14:29:57 +02:00
EURAC\marperini	42ab0aa1d2	feat(fetch): added playwright support	2024-04-30 04:02:58 +02:00
VinciGit00	deb920a33e	fixing json and example	2024-04-29 16:11:57 +02:00
VinciGit00	0b25d9a977	Update search_link_node.py	2024-04-29 15:49:46 +02:00
EURAC\marperini	6e7283ed8f	feat: add finalize_node()	2024-04-29 10:05:04 +02:00
PeriniM	7f1c3b7d83	fix: added missing dependecies ... include python v3.9.0 and change deprecated method langchain	2024-04-28 20:29:23 +02:00
VinciGit00	9cd516507c	fix: bug with fetch node	2024-04-27 21:23:35 +02:00
VinciGit00	adbc08f27b	fix: robot node and proxyes	2024-04-27 19:07:37 +02:00
VinciGit00	b754dd909c	fix: changed proxy function	2024-04-27 14:40:50 +02:00
VinciGit00	f6077d1f98	feat: add new proxy rotation function	2024-04-27 13:31:53 +02:00
Marco Vinciguerra	922aa96b37	Merge branch 'pre/beta' into search_links_node	2024-04-26 19:23:42 +02:00
VinciGit00	a73496df9b	refactoring of nodes	2024-04-24 21:13:27 +02:00
VinciGit00	e68b707e0d	changed color and return type	2024-04-24 17:29:49 +02:00
EURAC\marperini	ae49dee985	fixed robots_node and add test	2024-04-24 16:12:53 +02:00
VinciGit00	9b9a9f204c	handling the agent model	2024-04-24 13:13:46 +02:00
VinciGit00	adf89e5e1b	add new info for robot node	2024-04-24 10:14:26 +02:00
VinciGit00	8ab603220d	changed node name	2024-04-24 10:02:09 +02:00
VinciGit00	726efb7f00	add new info	2024-04-23 20:51:39 +02:00
VinciGit00	8ef9dec2e2	add new node	2024-04-23 20:23:35 +02:00
VinciGit00	261ecbf3a5	fixed typos in the doc	2024-04-22 21:32:06 +02:00
VinciGit00	3960e56d29	fixed typos in the doc	2024-04-22 21:31:23 +02:00
VinciGit00	9e3dddcb44	add nodes that search all the links	2024-04-22 18:22:40 +02:00
EURAC\marperini	ac099e2763	fixed ollama embedder params	2024-04-21 01:21:09 +02:00
VinciGit00	13669cc1ab	revert to old naming	2024-04-19 13:43:51 +02:00
VinciGit00	a2349e56af	recatoring of nodes excluive for openai	2024-04-19 13:21:48 +02:00
VinciGit00	3f95801737	Merge branch 'main' of https://github.com/VinciGit00/Scrapegraph-ai	2024-04-19 10:36:40 +02:00
EURAC\marperini	c032131692	fixed chunk response	2024-04-17 15:20:45 +02:00
Marco Perini	b14527c08d	Merge branch 'main' into refactor_generate_answer_node	2024-04-17 12:08:43 +02:00
EURAC\marperini	c237e63631	removed unused variable	2024-04-17 12:05:51 +02:00
Marco Perini	edc439fd01	Merge pull request #64 from VinciGit00/generateScraperbranch ... add generateScraperBranch	2024-04-17 11:51:06 +02:00
EURAC\marperini	b2d170cd86	refactored and fixed single chunk bug	2024-04-17 11:50:19 +02:00
EURAC\marperini	bdac2df4bb	fixed single chunk bug	2024-04-17 11:34:10 +02:00
Andrea Rota	b0e446f014	feat: apply remove to the document before updating the state	2024-04-17 11:24:56 +02:00
EURAC\marperini	d5f1c82c91	Merge remote-tracking branch 'origin/refactor_genrerate_answer_node'	2024-04-17 10:55:28 +02:00
VinciGit00	4233430518	add integration on the fetch node	2024-04-16 12:19:23 +02:00
Marco Vinciguerra	3fc18b2110	Update generate_answer_node.py	2024-04-16 12:00:33 +02:00
Matteo Vedovati	9c3b490b03	Update generate_scraper_node.py	2024-04-16 10:21:49 +02:00
VinciGit00	372981f153	Update generate_answer_node.py	2024-04-16 10:09:35 +02:00
VinciGit00	c56640034e	add return statement and new answers	2024-04-15 10:49:02 +02:00
VinciGit00	8334737f10	Update generate_answer_node.py	2024-04-15 10:44:03 +02:00
VinciGit00	724aee6b23	add informations on prompt	2024-04-15 10:43:40 +02:00
VinciGit00	8fc41873a7	refactoring of generate answer node	2024-04-14 21:53:15 +02:00
VinciGit00	876223da56	add generateScraperBranch ... Co-Authored-By: Matteo Mei <52063123+FattiMei@users.noreply.github.com>	2024-04-14 13:18:50 +02:00
Lorenzo Padoan	849f411844	Merge pull request #61 from VinciGit00/anti_malicious ... add anti not scraping task	2024-04-12 13:47:10 +02:00
Marco Perini	dde9eeec87	Merge pull request #60 from VinciGit00/huggingface_integration ... add hugginface integration (embeddings, models ...)	2024-04-11 22:40:05 +02:00
VinciGit00	77581876b5	add anti not scrapong task	2024-04-11 19:31:54 +02:00
VinciGit00	dc149e6f63	fixing bug on rag node	2024-04-11 19:26:38 +02:00
EURAC\marperini	74ec928f96	added execution info of the graph, time, price etc	2024-04-11 14:29:32 +02:00
VinciGit00	53e317d46b	add hugginface integration	2024-04-11 12:43:06 +02:00
EURAC\marperini	8b915e3ec6	fixed issue ollama embeddings	2024-04-10 09:29:03 +02:00
VinciGit00	cec4c43c64	add new local models context window	2024-04-09 10:23:38 +02:00
EURAC\marperini	dee1a42629	fixed token models, added mistral support	2024-04-08 15:21:06 +02:00
EURAC\marperini	17add20c13	implemented node_config, add embedder model choice, add azure endpoint, refactor graphs and exmaples	2024-04-08 12:18:32 +02:00
EURAC\marperini	6a83c2306d	docker compose working ollama implementation	2024-04-07 11:08:08 +02:00
VinciGit00	6dc4c6dec4	Merge branch 'main' into research_branch	2024-04-06 14:44:56 +02:00
VinciGit00	a5fc71f34e	fixed internet research	2024-04-06 14:39:19 +02:00
EURAC\marperini	57a53bd6af	refactor examples	2024-04-06 13:22:42 +02:00
EURAC\marperini	c2709aa50c	working search graph	2024-04-06 13:01:04 +02:00
VinciGit00	3269b4aaa7	fixing infos for the pr	2024-04-03 13:33:17 +02:00
VinciGit00	4c3ea8f4ac	fixed image_to_tex_node and refactoring	2024-04-03 12:53:12 +02:00
VinciGit00	db6d988b2d	refactoring for pylint	2024-04-01 13:41:50 +02:00
VinciGit00	5e38c2e298	add superclasse for graphs	2024-03-28 20:46:17 +01:00
VinciGit00	b8a3590235	add SearcInetnetNode	2024-03-28 13:14:39 +01:00
VinciGit00	be36ab8707	add new type of scraping through text	2024-03-24 21:22:26 +01:00
VinciGit00	e25f74ddc8	fixed bug for scraping from node + add example	2024-03-18 22:53:52 +01:00
VinciGit00	1afb950751	refactoring of code, add example on the readme	2024-03-18 14:35:47 +01:00
Perinim	cae38a0d67	fixed bugs after merge	2024-03-18 11:30:14 +01:00
Perinim	b5bdd4e729	Merge remote-tracking branch 'origin/main' into refactoring_nodes	2024-03-18 11:07:42 +01:00
Perinim	7d3190a636	fixed example graphs and utils files	2024-03-18 10:20:23 +01:00
Perinim	52934bf007	implemented graph_config, fixed smart_scraper and speech graph	2024-03-17 20:35:04 +01:00
Perinim	f27e0b4c5f	removed fetch_html and fetch_text (merged)	2024-03-17 17:01:29 +01:00
Perinim	875a7cc4f0	refactored RagNode and GenerateAnswerNode	2024-03-17 16:48:58 +01:00
Perinim	3585cd81e5	refactor fetch node	2024-03-17 12:02:35 +01:00
Perinim	20d7b69008	refactored BaseNode and ParseNode	2024-03-17 11:40:35 +01:00
Lorenzo Padoan	d0f4b0159f	DEV gemini support for simple custom graph ... -Not supported yet smartscrapergrapn with gemini	2024-03-14 19:35:04 +01:00
Perinim	538133dfff	added parse input string function	2024-03-13 19:34:51 +01:00
VinciGit00	a849315182	add new tests and refactoring of code	2024-03-12 21:40:09 +01:00
Perinim	308c2d28c8	fixed text input example	2024-03-12 12:22:47 +01:00
Perinim	aeff434878	fixed docstring	2024-03-12 11:53:03 +01:00
Perinim	9d31db2d35	working smart scraper example	2024-03-12 11:06:08 +01:00
Lorenzo Padoan	03e6881f00	Merge pull request #37 from VinciGit00/refactor-fetch-node ... Refactor fetch node, add integration for preprocessing	2024-03-08 17:51:19 +01:00
VinciGit00	cffd954446	add integration in the fetch for preprocessing	2024-03-08 17:46:36 +01:00
VinciGit00	ce8bc08b3a	refactoring of remove function and implement it in the fetch node	2024-03-08 09:43:09 +01:00
VinciGit00	cd176ff76c	removed prints	2024-03-05 18:07:21 +01:00
VinciGit00	6663c9c5bc	removed the duplicates	2024-03-05 14:59:48 +01:00
VinciGit00	ff7f8105bb	add multiple merging generate answer node	2024-03-05 14:50:31 +01:00
VinciGit00	ab71a6bc5a	fixed documentation and fetch_text_node	2024-03-03 18:50:03 +01:00
VinciGit00	e29454e5df	add doc for the text node	2024-03-03 12:32:26 +01:00
VinciGit00	a0c77491bf	add new progresbbar and finished the node	2024-03-02 20:51:29 +01:00
VinciGit00	1250aeeb8e	add the node for reading the html as a txt	2024-03-02 13:32:34 +01:00
VinciGit00	f4d5941831	refctoring of RAG node	2024-02-29 10:29:39 +01:00
Marco Perini	5735f3ec7f	Merge branch 'main' into refactoring-parse-html	2024-02-28 17:57:28 +01:00
VinciGit00	89d193392d	refactor of parse_html_node	2024-02-27 17:02:06 +01:00
VinciGit00	cd405e4202	removed llm req	2024-02-27 12:28:46 +01:00
VinciGit00	a7c7526bf1	refactoring of parse_html node	2024-02-26 20:14:53 +01:00
VinciGit00	582c99d879	refactoring of the classes of constructors	2024-02-25 12:35:54 +01:00
VinciGit00	043ab48466	add integration for the RAG for ParseHTMLNode	2024-02-25 11:24:44 +01:00
VinciGit00	fc0f0957e1	add integration for the RAG for ParseHTMLNode	2024-02-25 11:12:44 +01:00
VinciGit00	ae929393b9	refactoring for pylint score	2024-02-22 10:19:10 +01:00
Perinim	b0c75dc7ed	created rag example	2024-02-21 19:15:38 +01:00
Perinim	a626401f8a	merged multiple chunks answer	2024-02-21 18:43:38 +01:00
Perinim	a17971b7ed	implemented parallelrunnables	2024-02-21 18:17:34 +01:00
Perinim	15b468473b	working test rag	2024-02-21 17:02:10 +01:00
PeriniM	4e3005db0a	implemented summary graph	2024-02-19 07:18:28 +01:00
PeriniM	da16360b1f	working text2speech and image2text	2024-02-19 06:26:50 +01:00
PeriniM	3ed5fd5e48	added openai wrapper and examples	2024-02-19 04:45:43 +01:00
PeriniM	49c22ae155	implemented graphbuilder class	2024-02-19 03:39:50 +01:00
PeriniM	20398a3059	dev: refactor dict on graph state	2024-02-18 23:36:16 +01:00
VinciGit00	dc442b9ebd	refactoring of fetch node	2024-02-18 21:41:42 +01:00
VinciGit00	f8bb32919b	refactoring of the example and add 2 new nodes	2024-02-18 20:36:45 +01:00
VinciGit00	e57ec7002a	add new node	2024-02-17 21:42:43 +01:00
VinciGit00	2a234f2e4d	refactoring of the code changing the name	2024-02-14 20:35:30 +01:00