152 Commits

Author	SHA1	Message	Date
Marco Vinciguerra	99adc9799f	Merge branch 'pre/beta' into fetchNodeFix	2024-05-10 11:13:54 +02:00
mayurdb	f8ce3d5916	fix: Augment the information getting fetched from a webpage	2024-05-10 13:28:53 +05:30
VinciGit00	0ab31c3fdb	fix: add json integration	2024-05-09 21:07:07 +02:00
VinciGit00	324e977b85	fix: fixed bugs for csv and xml	2024-05-09 20:46:46 +02:00
Shubham Kamboj	f10f3b1438	feat: Add support for passing pdf path as source	2024-05-09 21:55:05 +05:30
Marco Perini	6b71ec1d2b	fix(examples): local, mixed models and fixed SearchGraph embeddings problem	2024-05-08 15:36:26 +02:00
Marco Perini	186c0d035d	fix(examples): openai std examples	2024-05-08 14:56:44 +02:00
VinciGit00	5a67bca0db	Merge branch 'pre/beta' into pr/161	2024-05-06 14:50:04 +02:00
VinciGit00	5e1d5db6da	Update search_internet_node.py	2024-05-06 10:09:17 +02:00
VinciGit00	80053a2358	Merge branch 'pre/beta' of https://github.com/VinciGit00/Scrapegraph-ai into pre/beta	2024-05-06 10:07:56 +02:00
VinciGit00	389b52aabb	removed examples	2024-05-06 10:07:31 +02:00
VinciGit00	88d999e15b	add website content	2024-05-06 09:36:32 +02:00
Marco Perini	930adb38f2	feat(node): multiple url search in SearchGraph + fixes ... Implemented GraphIteratorNode and MergeAnswersNode to create multiple istances of a graph and merge the scraped content from multiple pages	2024-05-06 00:30:09 +02:00
Marco Perini	dbb614a8dd	feat: multiple graph instances	2024-05-05 23:51:04 +02:00
Marco Perini	84fcb44aaa	feat: fixed custom_graphs example and robots_node	2024-05-05 22:02:24 +02:00
Eric Page	cc27b21c3f	Merge branch 'pre/beta' into pass-common-params-graph	2024-05-05 16:18:32 +02:00
Eric Page	3ae2ea1dbd	Miscellaneous "llm" -> "llm_model" refactors	2024-05-05 15:58:50 +02:00
VinciGit00	cb1bd00a19	removed unused node	2024-05-05 09:40:35 +02:00
Eric Page	729d5d7597	Changed node_config["llm"] to node_config["llm_model"]	2024-05-05 09:36:11 +02:00
Eric Page	c2c61625b3	Corrected logic of update_config function in base_node.py	2024-05-05 06:37:31 +02:00
Eric Page	b7539d4725	Added update_config function to base_node.py	2024-05-05 06:25:43 +02:00
Shubham Kamboj	fd59f282a8	Bug fixes	2024-05-04 22:18:54 +05:30
Shubham Kamboj	d830d1371b	Resolve merge conflicts	2024-05-04 22:01:40 +05:30
Shubham Kamboj	7599234ab9	feat: Enable end users to pass model instances of HuggingFaceHub	2024-05-04 21:42:57 +05:30
Marco Perini	df293fdfd2	Merge pull request #139 from VinciGit00/pdf_scraper_graph_introduction ... feat: add pdf scraper	2024-05-03 21:45:09 +02:00
VinciGit00	10a94530e3	feat: add pdf scraper	2024-05-03 21:42:02 +02:00
Marco Perini	aa9271e7bc	feat: Azure implementation + embeddings refactoring	2024-05-03 21:40:01 +02:00
Marco Vinciguerra	2abe05a0cf	Merge pull request #135 from S4mpl3r/feature	2024-05-03 16:49:07 +02:00
S4mpl3r	819cbcd3be	refactor: Changed the way embedding model is created in AbstractGraph class and removed handling of embedding model creation from RAGNode. Now AbstractGraph will call a dedicated method for embedding models instead of _create_llm. This makes it easy to use any LLM with any supported embedding model.	2024-05-03 16:14:27 +03:30
Marco Perini	cb1cb616b7	feat: add base_node to __init__.py ... Useful for people to create custom nodes	2024-05-03 14:18:12 +02:00
Marco Vinciguerra	579a27faf9	Merge pull request #126 from VinciGit00/bedrock_support ... feat: bedrock support	2024-05-02 17:57:20 +02:00
Marco Vinciguerra	a2d5c75f10	Merge branch 'pre/beta' into main	2024-05-02 17:55:21 +02:00
Shubham Kamboj	b86aac2188	feat: Allow end users to pass model instances for llm and embedding model	2024-05-02 20:09:23 +05:30
VinciGit00	16de49fa08	add integration for bedrock ... Co-Authored-By: redrusty2 <15157208+redrusty2@users.noreply.github.com>	2024-05-02 13:47:17 +02:00
Marco Perini	0631985e61	docs: graphs and helpers docstrings	2024-05-02 00:23:38 +02:00
Marco Perini	1409797475	docs: refactor nodes docstrings	2024-05-01 23:17:57 +02:00
Marco Perini	4d542a88f7	feat: added node and graph for CSV scraping	2024-05-01 21:34:40 +02:00
Marco Perini	02d1af006c	feat: modified node name	2024-05-01 21:33:25 +02:00
Marco Perini	e9817963c8	docs: base and fetch node	2024-05-01 21:30:06 +02:00
VinciGit00	7c1b5796d7	add csv scraper	2024-05-01 17:20:04 +02:00
EURAC\marperini	2dd7817cfb	feat: added verbose flag to suppress print statements	2024-04-30 15:31:57 +02:00
Marco Perini	d592d27bb4	Merge pull request #115 from VinciGit00/101-scrape-json-files ... feat: add xml scraper and json scraper	2024-04-30 14:29:57 +02:00
EURAC\marperini	42ab0aa1d2	feat(fetch): added playwright support	2024-04-30 04:02:58 +02:00
VinciGit00	deb920a33e	fixing json and example	2024-04-29 16:11:57 +02:00
VinciGit00	0b25d9a977	Update search_link_node.py	2024-04-29 15:49:46 +02:00
PeriniM	7f1c3b7d83	fix: added missing dependecies ... include python v3.9.0 and change deprecated method langchain	2024-04-28 20:29:23 +02:00
VinciGit00	9cd516507c	fix: bug with fetch node	2024-04-27 21:23:35 +02:00
VinciGit00	adbc08f27b	fix: robot node and proxyes	2024-04-27 19:07:37 +02:00
VinciGit00	b754dd909c	fix: changed proxy function	2024-04-27 14:40:50 +02:00
VinciGit00	f6077d1f98	feat: add new proxy rotation function	2024-04-27 13:31:53 +02:00