Commit Graph

41 Commits

Author SHA1 Message Date
Marco Vinciguerra
b913b51cca Merge branch 'logger-integration' into pre/beta 2024-05-24 12:39:14 +02:00
Marco Vinciguerra
3453f72397 add graph 2024-05-17 18:23:50 +02:00
VinciGit00
a4700bfc75 add robot node 2024-05-15 12:00:32 +02:00
VinciGit00
d6f5ca874f Merge branch 'main' into pre/beta 2024-05-14 10:24:29 +02:00
VinciGit00
76b0e39db0 update tests 2024-05-11 12:23:50 +02:00
Federico Minutoli
217013181d feat(proxy-rotation): add parse (IP address) or search (from broker) functionality for proxy rotation
the broker has been made fully configurable for anonymity level, admissible locations, scheme and max shape not to waste resources, unlike the original `free-proxy` package.

other options have been explored (e.g., `proxybroker`, `proxybroker2`) due to their built-in proxy server and rotation capabilities, but the former is no longer maintained, and the latter has issue with any python version outside of python 3.9
2024-05-10 21:09:48 +02:00
Federico Minutoli
db2234bf5d feat(webdriver-backend): add dynamic import scripts from module and file 2024-05-10 21:06:05 +02:00
Marco Vinciguerra
a2d5c75f10
Merge branch 'pre/beta' into main 2024-05-02 17:55:21 +02:00
VinciGit00
5cf4e4f92f fix: examples and graphs 2024-05-02 09:20:46 +02:00
VinciGit00
7c1b5796d7 add csv scraper 2024-05-01 17:20:04 +02:00
VinciGit00
45b2317ab7 add json examples 2024-04-29 11:16:48 +02:00
VinciGit00
9cd516507c fix: bug with fetch node 2024-04-27 21:23:35 +02:00
VinciGit00
a73496df9b refactoring of nodes 2024-04-24 21:13:27 +02:00
EURAC\marperini
ae49dee985 fixed robots_node and add test 2024-04-24 16:12:53 +02:00
VinciGit00
8aa2cadb00 add integration for llama3 2024-04-21 13:11:10 +02:00
VinciGit00
a2349e56af recatoring of nodes excluive for openai 2024-04-19 13:21:48 +02:00
VinciGit00
7815473b6d Update script_generator_test.py 2024-04-19 10:37:22 +02:00
VinciGit00
3f95801737 Merge branch 'main' of https://github.com/VinciGit00/Scrapegraph-ai 2024-04-19 10:36:40 +02:00
VinciGit00
1107630d27 add new test for script generator 2024-04-18 10:39:53 +02:00
Marco Perini
b14527c08d
Merge branch 'main' into refactor_generate_answer_node 2024-04-17 12:08:43 +02:00
Andrea Rota
b0e446f014 feat: apply remove to the document before updating the state 2024-04-17 11:24:56 +02:00
VinciGit00
4a63e2a692 refactoring of the tests 2024-04-16 21:55:13 +02:00
Lorenzo Padoan
d0f4b0159f DEV gemini support for simple custom graph
-Not supported yet smartscrapergrapn with gemini
2024-03-14 19:35:04 +01:00
VinciGit00
a849315182 add new tests and refactoring of code 2024-03-12 21:40:09 +01:00
VinciGit00
5f20299cf3 add tests 2024-03-07 13:22:21 +01:00
VinciGit00
ac692d3aff add readme for tests 2024-03-06 21:21:21 +01:00
VinciGit00
f4d5941831 refctoring of RAG node 2024-02-29 10:29:39 +01:00
VinciGit00
a46f45de14 add tests 2024-02-27 12:07:04 +01:00
VinciGit00
71bd53d254 refactoring of the code, add tests and examples 2024-02-19 11:54:36 +01:00
VinciGit00
074c6faf83 Merge branch 'refactoring-root-folder' 2024-02-15 09:27:50 +01:00
VinciGit00
ce7949de1b refactoring of the folders 2024-02-15 09:27:39 +01:00
VinciGit00
4474d9523d changed link 2024-02-15 09:06:46 +01:00
VinciGit00
2a234f2e4d refactoring of the code changing the name 2024-02-14 20:35:30 +01:00
VinciGit00
ad6574e22d refactoring of token_calculator 2024-02-13 12:35:38 +01:00
VinciGit00
ba2af0b715 add function for saving in csv and json format 2024-02-13 12:30:35 +01:00
VinciGit00
1e7ca9f3fb refactoring of test folder 2024-02-10 19:20:21 +01:00
PeriniM
5312fcaf55 dev: changed library name 2024-02-03 21:42:06 +01:00
PeriniM
787fea0e78 add: readthedocs structure 2024-01-31 16:46:05 +01:00
PeriniM
a9beecde8f add: setup.py for deployment 2024-01-30 15:05:29 +01:00
PeriniM
f367c8919d dev: refactor project structure 2024-01-30 10:36:02 +01:00
VinciGit00
87616018b6 add private class and tests 2024-01-27 21:26:43 +01:00