Commit Graph

16 Commits

Author SHA1 Message Date
Marco Vinciguerra
88ba2310ac feat:add dynamic rendering 2024-10-09 10:45:47 +02:00
Marco Vinciguerra
4f816f3b04 feat: update chromium loader 2024-10-09 10:39:29 +02:00
Marco Vinciguerra
a447aeae2a Merge branch 'pre/beta' of https://github.com/ScrapeGraphAI/Scrapegraph-ai into pre/beta 2024-10-08 08:54:22 +02:00
Marco Vinciguerra
a200f595de refactoring of examples 2024-10-08 08:54:18 +02:00
ekinsenler
d94959c3a2 pass headless state to the browser 2024-10-06 23:10:56 +03:00
ekinsenler
80ece2179a feat: undected_chromedriver support 2024-10-06 22:50:52 +03:00
Marco Vinciguerra
d03eedccd7 Update chromium.py 2024-08-01 13:05:13 +02:00
Marco Perini
99dc8497d8
docs(gpt-4o-mini): added new gpt, fixed chromium lazy loading,
add documentation and metrics
2024-07-20 20:02:26 +02:00
Steven Thomas
8f405ff87a Add the ability to specify load state 2024-06-11 11:22:39 -04:00
Marco Vinciguerra
b913b51cca Merge branch 'logger-integration' into pre/beta 2024-05-24 12:39:14 +02:00
Federico Minutoli
0790ecd208 fix(web-loader): use sublogger 2024-05-24 01:08:28 +02:00
QIN2DIM
7b3ee4e71e feat(docloaders): undetected-playwright 2024-05-19 18:01:03 +08:00
VinciGit00
cc5adefd29 fix: come back to the old version 2024-05-15 15:54:00 +02:00
VinciGit00
7ced0d0564 remove asdt 2024-05-15 15:49:09 +02:00
Federico Minutoli
b54d984c13 fix(chromium-loader): ensure it subclasses langchain's base loader 2024-05-11 11:44:56 +02:00
Federico Minutoli
768719cce8 feat(safe-web-driver): enchanced the original AsyncChromiumLoader web driver with proxy protection and flexible kwargs and backend
the original class prevents passing kwargs down to the playwright backend, making some config unfeasible, including passing a proxy server to the web driver.

the new class has backward compatibility with the original, but 1) allows any kwarg to be passed down to the web driver, 2) allows specifying the web driver backend (only playwright is supported for now) in case more (e.g., selenium) will be supported in the future and 3) automatically fetches a suitable proxy if one is not passed already
2024-05-10 21:13:38 +02:00