Commit Graph

13 Commits

Author SHA1 Message Date
Marco Perini
7e8acd8e6a
Merge branch 'pre/beta' into fix/fetch-node-proxybroker 2024-05-13 11:17:37 +02:00
mayurdb
300fd5d253 Fetch links in the page while parsing html 2024-05-11 09:46:51 +05:30
Federico Minutoli
fc2aa3ac1c Merge branch 'pre/beta' of https://github.com/DiTo97/Scrapegraph-ai into fix/fetch-node-proxybroker 2024-05-10 21:20:40 +02:00
Federico Minutoli
217013181d feat(proxy-rotation): add parse (IP address) or search (from broker) functionality for proxy rotation
the broker has been made fully configurable for anonymity level, admissible locations, scheme and max shape not to waste resources, unlike the original `free-proxy` package.

other options have been explored (e.g., `proxybroker`, `proxybroker2`) due to their built-in proxy server and rotation capabilities, but the former is no longer maintained, and the latter has issue with any python version outside of python 3.9
2024-05-10 21:09:48 +02:00
Marco Perini
864aa91326 feat: revert fetch_node 2024-05-10 15:11:54 +02:00
VinciGit00
adbc08f27b fix: robot node and proxyes 2024-04-27 19:07:37 +02:00
VinciGit00
b754dd909c fix: changed proxy function 2024-04-27 14:40:50 +02:00
VinciGit00
f6077d1f98 feat: add new proxy rotation function 2024-04-27 13:31:53 +02:00
EURAC\marperini
74ec928f96 added execution info of the graph, time, price etc 2024-04-11 14:29:32 +02:00
VinciGit00
71bd53d254 refactoring of the code, add tests and examples 2024-02-19 11:54:36 +01:00
PeriniM
da16360b1f working text2speech and image2text 2024-02-19 06:26:50 +01:00
PeriniM
49c22ae155 implemented graphbuilder class 2024-02-19 03:39:50 +01:00
PeriniM
20398a3059 dev: refactor dict on graph state 2024-02-18 23:36:16 +01:00