408 Commits

Author	SHA1	Message	Date
aziz-ullah-khan	c218546a3d	feat: Serper API integration for Google search	2024-11-02 15:02:08 +05:00
Marco Vinciguerra	09c967822d	Merge branch 'pre/beta' into main	2024-10-30 09:00:20 +01:00
Federico Aguzzi	f79f399ee0	fix(AbstractGraph): manually select model tokens ... closes #768	2024-10-28 14:51:39 +01:00
Marco Vinciguerra	12a6c18f6a	feat: refactoring of the base_graph	2024-10-28 09:58:03 +01:00
Marco Vinciguerra	b7d5a20ae0	Merge pull request #764 from ScrapeGraphAI/pre/beta	2024-10-26 10:05:15 +02:00
Marco Vinciguerra	4cd5ef296e	add docstring files	2024-10-24 15:28:27 +02:00
Marco Vinciguerra	52b6bf5fb8	feat: refactoring of ScrapeGraph to SmartScraperLiteGraph	2024-10-21 10:12:53 +02:00
Marco Vinciguerra	ffa1067f0d	Merge pull request #756 from shenghongtw/pre/beta ... The smart_scraper_multi_graph method is too expensive	2024-10-20 10:13:47 +02:00
Federico Aguzzi	8cb9646a45	Merge branch 'main' into pre/beta	2024-10-18 22:16:39 +02:00
roryhaung	3e8f047ab6	Renamed smart_scraper_multi_abstract_graph back to smart_scraper_multi_graph.	2024-10-18 03:10:57 +08:00
roryhaung	974f88a77e	rename SmartScraperMultiGraph to SmartScraperMultiLiteGraph	2024-10-18 03:01:59 +08:00
roryhaung	6dbac93668	rename the SmartScraperMultiParseMergeFirstGraph to SmartScraperMultiGraph	2024-10-18 01:52:39 +08:00
roryhaung	78bd40c3b5	modify the graph name	2024-10-18 01:51:26 +08:00
roryhaung	dfc67c670d	rename the smart_scraper_multi_parse_merge_first_graph to smart_scraper_multi_graph,so delete this file	2024-10-18 01:49:54 +08:00
roryhaung	94d8042c2a	rename smart_scraper_multi_graph to smart_scraper_multi_abstract_graph	2024-10-18 01:39:42 +08:00
roryhaung	69ff649556	fix: fix the example variable name	2024-10-18 01:36:29 +08:00
roryhaung	9b78e2d755	Merge branch 'pre/beta' of https://github.com/shenghongtw/Scrapegraph-ai into pre/beta	2024-10-17 03:20:46 +08:00
Marco Vinciguerra	aaa011cc89	Merge pull request #754 from ekinsenler/cond_node_refactor ... feat: add conditional node to the smart_scraper_graph	2024-10-16 17:53:10 +02:00
roryhaung	3e3e1b2f3a	feat: Implement SmartScraperMultiParseMergeFirstGraph class that scrapes a list of URLs and merge the content first and finally generates answers to a given prompt. ... (Different from the SmartScraperMultiGraph is that in this case the content is merged before to be processed by the llm.)	2024-10-16 19:38:53 +08:00
roryhaung	612c644623	feat: implement ScrapeGraph class for only web scraping automation	2024-10-16 18:37:50 +08:00
ekinsenler	038d2ef916	refactor cond node structure to fit with the new implementation	2024-10-15 15:23:05 +03:00
ekinsenler	cacd9cde00	feat: add conditional node structure to the smart_scraper_graph and implemented a structured way to check condition	2024-10-15 14:23:02 +03:00
Marco Vinciguerra	db4b7cd3d1	refactoring of the code	2024-10-15 11:21:04 +02:00
roryhaung	e76a68a782	fix: remove variable "max_result" not being used in the code	2024-10-13 23:04:27 +08:00
aziz-ullah-khan	36875b67f1	Merge remote-tracking branch 'refs/remotes/origin/pre/beta' into pre/beta	2024-10-11 10:08:07 +05:00
aziz-ullah-khan	46195d65ca	Update: proxy integration in googlesearch	2024-10-11 10:04:28 +05:00
Marco Vinciguerra	91ede933f8	refactoring of the code	2024-10-10 14:08:13 +02:00
Marco Vinciguerra	7797631eac	Merge branch 'pre/beta' of https://github.com/ScrapeGraphAI/Scrapegraph-ai into pre/beta	2024-10-09 08:46:51 +02:00
Marco Vinciguerra	d0e5671caf	removed unused example	2024-10-09 08:46:48 +02:00
Marco Vinciguerra	a57da96175	fix: removed pdf_scraper graph and created document scraper	2024-10-08 09:35:47 +02:00
Marco Vinciguerra	a200f595de	refactoring of examples	2024-10-08 08:54:18 +02:00
Marco Vinciguerra	37b6ba08ae	fix: import error	2024-10-07 10:22:17 +02:00
Marco Vinciguerra	420c71ba2c	feat: refactoring of the conditional node	2024-10-06 09:16:33 +02:00
Marco Vinciguerra	c06cafc976	Merge branch 'pre/beta' into cond_node	2024-10-05 19:23:22 +02:00
ekinsenler	f837dc16ce	feat: conditional_node	2024-10-05 01:14:54 +03:00
Marco Vinciguerra	85cb957297	feat: finished basic version of deep scraper ... Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>	2024-10-03 13:13:04 +02:00
Marco Vinciguerra	4b371f4d94	feat: add deep scraper implementation ... Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>	2024-10-03 11:38:14 +02:00
Matteo Vedovati	f755d56bb1	updated parse node	2024-10-02 12:28:48 +02:00
Matteo Vedovati	ea3ae1fd6d	fetch multiple links fix	2024-10-02 11:01:23 +02:00
Matteo Vedovati	4cb621feab	fetch node level k implementation	2024-10-02 10:22:21 +02:00
Marco Vinciguerra	d9a8208b08	Merge branch 'pre/beta' into branch_temp	2024-09-29 15:43:59 +02:00
Marco Vinciguerra	9aa8c889fb	fix: removed deep scraper	2024-09-29 15:40:04 +02:00
Marco Vinciguerra	560f079d4c	refactoring of the code	2024-09-28 09:02:20 +02:00
Marco Vinciguerra	f87ffa1d8d	fix: integration with html_mode	2024-09-27 18:31:42 +02:00
Marco Vinciguerra	faf25eeba9	Merge branch 'reasoning-branch' into pre/beta	2024-09-27 17:50:29 +02:00
Marco Vinciguerra	b2822f620a	feat: add reasoning integration	2024-09-27 17:45:44 +02:00
Marco Vinciguerra	bdcffd6360	feat: add html_mode to smart_scraper	2024-09-27 16:41:45 +02:00
Marco Vinciguerra	9905be8a37	fix: script creator multi	2024-09-26 10:09:36 +02:00
Marco Vinciguerra	d0976ddda9	Merge branch 'main' into temp-1	2024-09-25 17:45:45 +02:00
Marco Vinciguerra	d55f6bee47	fix: node refiner + examples	2024-09-25 14:53:51 +02:00