Commit Graph

12 Commits

Author SHA1 Message Date
Marco Vinciguerra
b913b51cca Merge branch 'logger-integration' into pre/beta 2024-05-24 12:39:14 +02:00
Federico Minutoli
c251cc45d3 fix(node-logging): use centralized logger in each node for logging 2024-05-24 01:09:49 +02:00
Marco Perini
fc58e2d3a6 feat(smart-scraper-multi): add schema to graphs and created SmartScraperMultiGraph 2024-05-21 13:13:27 +02:00
VinciGit00
9e9f8f09d5 removed max depth 2024-05-16 12:39:08 +02:00
mayurdb
d60438cc89 Add a n-level deep search support 2024-05-15 23:32:15 +02:00
VinciGit00
05890835f5 refactoring of loggers 2024-05-15 10:54:53 +02:00
VinciGit00
e53766b16e feat: add logger integration 2024-05-14 15:20:39 +02:00
Marco Perini
a8d5e7db05 feat(batchsize): tested different batch sizes and systems 2024-05-13 23:49:48 +02:00
Marco Perini
dedc733047 fix(asyncio): replaced deepcopy with copy due to serialization problems 2024-05-13 18:46:34 +02:00
Federico Minutoli
627cbeeb20 feat(parallel-exeuction): add asyncio event loop dispatcher with semaphore for parallel graph instances
TODO: still untested
2024-05-11 00:13:27 +02:00
Marco Perini
930adb38f2 feat(node): multiple url search in SearchGraph + fixes
Implemented GraphIteratorNode and MergeAnswersNode to create multiple istances of a graph and merge the scraped content from multiple pages
2024-05-06 00:30:09 +02:00
Marco Perini
dbb614a8dd feat: multiple graph instances 2024-05-05 23:51:04 +02:00