Marco Vinciguerra
4cd5ef296e
add docstring files
CodeQL / Analyze (python) (push) Has been cancelled
/ build (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
2024-10-24 15:28:27 +02:00
Marco Vinciguerra
88ba2310ac
feat:add dynamic rendering
2024-10-09 10:45:47 +02:00
Marco Vinciguerra
4f816f3b04
feat: update chromium loader
2024-10-09 10:39:29 +02:00
Marco Vinciguerra
a447aeae2a
Merge branch 'pre/beta' of https://github.com/ScrapeGraphAI/Scrapegraph-ai into pre/beta
2024-10-08 08:54:22 +02:00
Marco Vinciguerra
a200f595de
refactoring of examples
2024-10-08 08:54:18 +02:00
ekinsenler
d94959c3a2
pass headless state to the browser
2024-10-06 23:10:56 +03:00
ekinsenler
80ece2179a
feat: undected_chromedriver support
2024-10-06 22:50:52 +03:00
Marco Vinciguerra
560f079d4c
refactoring of the code
2024-09-28 09:02:20 +02:00
Marco Vinciguerra
14c5e6baf9
Merge branch 'pre/beta' into temp
2024-09-08 13:11:37 +02:00
Tuhin Mallick
007ff084c6
fix(browser_base_fetch): correct function signature and async_mode handling
...
- Added missing `async_mode` parameter to the function signature.
2024-09-08 10:59:04 +02:00
Marco Vinciguerra
02eed1ac9d
Merge branch 'main' into main
2024-09-08 10:51:31 +02:00
Tuhin Mallick
d56253d183
feat(browser_base_fetch): add async_mode to support both synchronous and asynchronous execution
...
- Introduced an async_mode flag to allow users to choose between synchronous and asynchronous fetching using Browserbase.
- Refactored common logic (browserbase initialization and result list) to avoid redundancy.
- Added internal async handling with asyncio.to_thread() for non-blocking execution in async_mode.
- Maintained backward compatibility for existing synchronous functionality.
2024-09-08 08:49:08 +00:00
Tuhin Mallick
57fd01f9a7
feat(docloaders): Enhance browser_base_fetch function flexibility
...
- Update browser_base_fetch to accept single URL or list of URLs
- Add text_content parameter for choosing between text-only and HTML output
- Improve type hinting and function documentation
- Ensure compatibility with latest Browserbase SDK interface
2024-09-08 01:41:39 +02:00
Marco Vinciguerra
8883bced7d
asdd proxy integratrion
2024-09-06 17:17:27 +02:00
Marco Vinciguerra
94e69a0515
feat: add scrape_do_integration
2024-09-06 16:51:48 +02:00
Federico Aguzzi
5c16ee985b
fix(docloaders): BrowserBase dynamic import
2024-08-27 16:44:05 +02:00
Marco Vinciguerra
1d7f30b65b
fix: browser-base integration
2024-08-17 12:21:00 +02:00
Marco Vinciguerra
6d8e02cd62
Update browser_base.py
...
Co-Authored-By: Federico Minutoli <40361744+DiTo97@users.noreply.github.com>
2024-08-01 13:24:32 +02:00
Marco Vinciguerra
968c69e217
fix: fixed bug on fetch_node
...
Co-Authored-By: Federico Minutoli <40361744+DiTo97@users.noreply.github.com>
2024-08-01 13:23:54 +02:00
Marco Vinciguerra
e21d461710
push
2024-08-01 13:16:49 +02:00
Marco Vinciguerra
d03eedccd7
Update chromium.py
2024-08-01 13:05:13 +02:00
Marco Vinciguerra
65f9e3a24c
Delete browser_base.py
2024-08-01 12:58:35 +02:00
Marco Vinciguerra
4cd5986516
Merge branch 'pre/beta' into browserbase_integration
/ build (push) Waiting to run
2024-08-01 12:52:36 +02:00
Marco Vinciguerra
5ecdbe715f
feat: add integration in the abstract grapgh
2024-08-01 12:51:18 +02:00
Marco Vinciguerra
7076ab12d3
allignment
2024-08-01 11:31:27 +02:00
Marco Vinciguerra
4caed545e5
feat: intregration of firebase
2024-07-31 19:49:59 +02:00
Marco Perini
99dc8497d8
docs(gpt-4o-mini): added new gpt, fixed chromium lazy loading,
...
add documentation and metrics
2024-07-20 20:02:26 +02:00
Steven Thomas
8f405ff87a
Add the ability to specify load state
2024-06-11 11:22:39 -04:00
Marco Vinciguerra
b913b51cca
Merge branch 'logger-integration' into pre/beta
2024-05-24 12:39:14 +02:00
Federico Minutoli
0790ecd208
fix(web-loader): use sublogger
2024-05-24 01:08:28 +02:00
QIN2DIM
7b3ee4e71e
feat(docloaders): undetected-playwright
2024-05-19 18:01:03 +08:00
VinciGit00
cc5adefd29
fix: come back to the old version
2024-05-15 15:54:00 +02:00
VinciGit00
7ced0d0564
remove asdt
2024-05-15 15:49:09 +02:00
Federico Minutoli
b54d984c13
fix(chromium-loader): ensure it subclasses langchain's base loader
2024-05-11 11:44:56 +02:00
Federico Minutoli
768719cce8
feat(safe-web-driver): enchanced the original AsyncChromiumLoader web driver with proxy protection and flexible kwargs and backend
...
the original class prevents passing kwargs down to the playwright backend, making some config unfeasible, including passing a proxy server to the web driver.
the new class has backward compatibility with the original, but 1) allows any kwarg to be passed down to the web driver, 2) allows specifying the web driver backend (only playwright is supported for now) in case more (e.g., selenium) will be supported in the future and 3) automatically fetches a suitable proxy if one is not passed already
2024-05-10 21:13:38 +02:00
