CodeCow/Scrapegraph-ai
1
0
Fork 0
mirror of https://github.com/VinciGit00/Scrapegraph-ai.git synced 2026-07-12 21:01:56 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
2,293 Commits 2 Branches 448 Tags 17 MiB
5faac9fb46
Commit Graph

72 Commits

Author SHA1 Message Date
Federico Aguzzi
8cb9646a45 Merge branch 'main' into pre/beta 2024-10-18 22:16:39 +02:00
ekinsenler
038d2ef916 refactor cond node structure to fit with the new implementation 2024-10-15 15:23:05 +03:00
ekinsenler
cacd9cde00 feat: add conditional node structure to the smart_scraper_graph and implemented a structured way to check condition 2024-10-15 14:23:02 +03:00
Marco Vinciguerra
db4b7cd3d1 refactoring of the code 2024-10-15 11:21:04 +02:00
Marco Vinciguerra
d9a8208b08
Merge branch 'pre/beta' into branch_temp 2024-09-29 15:43:59 +02:00
Marco Vinciguerra
560f079d4c refactoring of the code 2024-09-28 09:02:20 +02:00
Marco Vinciguerra
f87ffa1d8d fix: integration with html_mode 2024-09-27 18:31:42 +02:00
Marco Vinciguerra
faf25eeba9
Merge branch 'reasoning-branch' into pre/beta 2024-09-27 17:50:29 +02:00
Marco Vinciguerra
b2822f620a feat: add reasoning integration 2024-09-27 17:45:44 +02:00
Marco Vinciguerra
bdcffd6360 feat: add html_mode to smart_scraper 2024-09-27 16:41:45 +02:00
roryhaung
57a58e162e docs: Updated the graph_config in the documentation. 2024-09-12 14:50:02 +08:00
Marco Vinciguerra
fe3aa28fe7 refactoring of the code
Some checks failed
/ build (push) Has been cancelled
Details
Release / Build (push) Has been cancelled
Details
Release / Release (push) Has been cancelled
Details
2024-09-11 16:04:43 +02:00
Marco Vinciguerra
94e69a0515 feat: add scrape_do_integration 2024-09-06 16:51:48 +02:00
Marco Vinciguerra
81af62d35f
Merge pull request #622 from LorenzoPaleari/pre/beta 
ScrapeGraphAI/580-OmniScraperGraph-fix
 2024-09-02 15:13:07 +02:00
Federico Aguzzi
5242166575 fix(SmartScraper): pass llm_model to ParseNode 2024-09-02 15:04:54 +02:00
Lorenzo Paleari
57337a0a8c
fix: Removed link_urls and img_ulrs from FetchNode output 2024-09-02 12:53:40 +02:00
Marco Vinciguerra
1d7f30b65b fix: browser-base integration 2024-08-17 12:21:00 +02:00
Marco Vinciguerra
8b2c266aff refactoring of the code 
Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>
 2024-08-10 17:44:35 +02:00
Federico Aguzzi
fd1b7cb24a chore: remove unused import
Some checks failed
/ build (push) Has been cancelled
Details
2024-07-14 22:36:43 +02:00
Marco Vinciguerra
a7249685cb removed rag node 2024-07-14 10:24:38 +02:00
Marco Vinciguerra
3bf5f570a8 feat: add integration for infos 2024-07-01 21:19:16 +02:00
Marco Vinciguerra
9b45ebcdcf modify fetch node with no cut mode 2024-06-28 14:38:36 +02:00
Marco Vinciguerra
d1c3de777f fixed a bug 2024-06-21 14:14:43 +02:00
Marco Vinciguerra
7af411aa99 add trigger 
Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>
 2024-06-21 13:36:27 +02:00
Jason Vertrees
aedda44868 fix: updated for schema changes 
docs: updated for schema changes
 2024-06-18 13:31:10 -05:00
Marco Perini
080a318ff6 feat(telemetry): add telemetry module 2024-06-17 13:00:33 +02:00
Marco Perini
12f4386552
Merge branch 'pre/beta' into 349-problem-with-scrapegraphaigraphspdf_scraper_graphpy 2024-06-14 15:22:43 +02:00
Marco Perini
283b61fafc docs: better logging 2024-06-13 18:13:47 +02:00
Marco Vinciguerra
e6c7940a57 feat: add Parse_Node 2024-06-12 12:29:14 +02:00
Marco Vinciguerra
5065aa00e1
Merge branch 'pre/beta' into supercoder-327 2024-06-12 12:12:15 +02:00
supercoder-dev
828bdeedce
Update smart_scraper_graph.py 2024-06-12 14:28:33 +05:30
Marco Vinciguerra
74fd530914
Merge branch 'pre/beta' into 332-pydantic-schema-validation 2024-06-05 09:05:19 +02:00
Marco Perini
376f758a76 feat(pydantic): added pydantic output schema 2024-06-04 23:07:49 +02:00
Marco Vinciguerra
930f673747 feat: removed rag node 2024-05-31 21:03:48 +02:00
Marco Perini
fc58e2d3a6 feat(smart-scraper-multi): add schema to graphs and created SmartScraperMultiGraph 2024-05-21 13:13:27 +02:00
Marco Perini
bed3eed50c feat(multiple_search): working multiple example 2024-05-18 01:51:12 +02:00
VinciGit00
cc5adefd29 fix: come back to the old version 2024-05-15 15:54:00 +02:00
Marco Vinciguerra
22cd9e3605
Merge branch 'search_link_context' into main 2024-05-15 15:16:57 +02:00
Marco Perini
a6e1813ddd fix(fetch_node): bug in handling local files 2024-05-14 16:51:10 +02:00
Marco Perini
1e9a564616 fix(proxy-rotation): removed duplicated arg and passed the loader_kwarhs correctly to the node 2024-05-12 18:39:03 +02:00
VinciGit00
51aa109e42 feat: add turboscraper (alfa) 2024-05-06 11:59:14 +02:00
Eric Page
a53e95cbf0 Corrected graphs to use common params 2024-05-05 14:36:16 +02:00
Eric Page
4dc6049e76 Simplified create graph functions using common params 2024-05-05 10:40:04 +02:00
Eric Page
2178485b3d Adjusted graphs to reflect node_config change 2024-05-05 09:47:13 +02:00
VinciGit00
5cf4e4f92f fix: examples and graphs 2024-05-02 09:20:46 +02:00
Marco Perini
0631985e61 docs: graphs and helpers docstrings 2024-05-02 00:23:38 +02:00
EURAC\marperini
2dd7817cfb feat: added verbose flag to suppress print statements 2024-04-30 15:31:57 +02:00
EURAC\marperini
42ab0aa1d2 feat(fetch): added playwright support 2024-04-30 04:02:58 +02:00
VinciGit00
cd8d3e7a4f refactoring of the graphs 2024-04-26 11:08:56 +02:00
VinciGit00
e714a59c2e refactoring of engine 2024-04-25 19:22:12 +02:00