CodeCow/Scrapegraph-ai
1
0
Fork 0
mirror of https://github.com/VinciGit00/Scrapegraph-ai.git synced 2026-06-17 21:08:25 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
217013181d
Scrapegraph-ai/tests
History
Federico Minutoli 217013181d feat(proxy-rotation): add parse (IP address) or search (from broker) functionality for proxy rotation 
the broker has been made fully configurable for anonymity level, admissible locations, scheme and max shape not to waste resources, unlike the original `free-proxy` package.

other options have been explored (e.g., `proxybroker`, `proxybroker2`) due to their built-in proxy server and rotation capabilities, but the former is no longer maintained, and the latter has issue with any python version outside of python 3.9
2024-05-10 21:09:48 +02:00
..
graphs Merge branch 'pre/beta' into main 2024-05-02 17:55:21 +02:00
nodes fix: examples and graphs 2024-05-02 09:20:46 +02:00
utils feat(proxy-rotation): add parse (IP address) or search (from broker) functionality for proxy rotation 2024-05-10 21:09:48 +02:00
Readme.md refactoring of nodes 2024-04-24 21:13:27 +02:00

Readme.md

Test section

Regarding the tests for the folder graphs and nodes it was created a specific repo as a example (link of the repo). The test website is hosted here. Remember to activating Ollama and having installed the LLM on your pc

For running the tests run the command:

pytest