CodeCow/Scrapegraph-ai
1
0
Fork 0
mirror of https://github.com/VinciGit00/Scrapegraph-ai.git synced 2026-07-12 21:01:56 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
2,293 Commits 2 Branches 448 Tags 17 MiB
5faac9fb46
Commit Graph

1007 Commits

Author SHA1 Message Date
Marco Vinciguerra
e724ae4492 feat: update search_link graph 2024-09-22 11:32:46 +02:00
Marco Vinciguerra
9b3695db53 Update search_link_node.py 2024-09-22 10:37:25 +02:00
Marco Vinciguerra
c5a3f893f1 refactoring of node names 2024-09-22 10:35:43 +02:00
Matteo Vedovati
2ff0f0113f Added logs 2024-09-21 18:46:16 +02:00
Matteo Vedovati
f38c5e1d8f removed test code 2024-09-21 18:01:07 +02:00
Matteo Vedovati
34590664f1 Code generator updated version 2024-09-21 16:36:22 +02:00
Matteo Vedovati
afa00d1594 Reasoning loop created 2024-09-21 13:02:16 +02:00
Matteo Vedovati
5b579b323f gode generator v0.1 2024-09-21 11:44:04 +02:00
Marco Vinciguerra
86f68770e9 fix: removed faiss 2024-09-21 08:25:22 +02:00
Marco Vinciguerra
3ea1f20c83
Update fetch_node.py 2024-09-20 21:48:24 +02:00
Matteo Vedovati
eb9c77c2d5 code generator graph fixed 2024-09-19 18:09:27 +02:00
Matteo Vedovati
0f4b011814 generate code node added 2024-09-19 18:05:28 +02:00
Matteo Vedovati
470e768372 Update code generator graph 2024-09-19 14:45:56 +02:00
Marco Vinciguerra
c234c23f5c
Merge pull request #683 from kashindra-mahato/patch-1 
Update abstract_graph.py
 2024-09-19 12:37:25 +02:00
Marco Vinciguerra
72873c1b38 refactoring of teh code 2024-09-19 12:34:25 +02:00
kashindra-mahato
8746958880
Update abstract_graph.py 
fix spelling error 'togetherai'
 2024-09-19 15:56:40 +05:45
Matteo Vedovati
a2490e370a html analyzer node added 2024-09-19 11:01:47 +02:00
Matteo Vedovati
330c22fd5e Update prompt_refiner_node.py 2024-09-19 10:40:18 +02:00
Marco Vinciguerra
0cdd47ee06
Merge branch 'main' into temp 2024-09-19 10:07:40 +02:00
Marco Vinciguerra
95a5ee2d35
Merge pull request #680 from LorenzoPaleari/exec-info-enhanced 
feat: added Bedrock and Mistral to exec info
 2024-09-18 10:05:45 +02:00
Lorenzo Paleari
8a37c6b793
feat: added Bedrock and Mistral to exec info 2024-09-18 02:02:38 +02:00
Lorenzo Paleari
eb89549248
feat: updated pydantic to v2 2024-09-17 23:08:56 +02:00
Lorenzo Paleari
28b85a3b16
refactor: Output parser code 2024-09-17 23:07:16 +02:00
Marco Vinciguerra
9e46b468c1 fix: fetch_node 2024-09-16 18:11:47 +02:00
Marco Vinciguerra
59aa2510e1 feat: add grok integration for ollama 2024-09-16 15:43:02 +02:00
Marco Vinciguerra
3f45c17022 fix: fetch_node condition
Some checks failed
/ build (push) Has been cancelled
Details
Release / Build (push) Has been cancelled
Details
Release / Release (push) Has been cancelled
Details
2024-09-16 09:11:59 +02:00
Marco Vinciguerra
c717bb6d8e Merge branch 'main' into pre/beta 2024-09-16 09:08:37 +02:00
Marco Vinciguerra
438b8127db refctoring of the code 2024-09-15 11:20:08 +02:00
Marco Vinciguerra
5d1fe68dea
Merge branch 'pre/beta' into temp 2024-09-14 10:53:43 +02:00
Marco Vinciguerra
dcef172e03 Update copy.py
Some checks failed
CodeQL / Analyze (python) (push) Has been cancelled
Details
/ build (push) Has been cancelled
Details
Release / Build (push) Has been cancelled
Details
Release / Release (push) Has been cancelled
Details
2024-09-14 10:43:47 +02:00
Marco Vinciguerra
3327312731
Merge pull request #671 from goasleep/fix/fix_boto3_client_copy 
fix:fix boto3 client copy
 2024-09-14 10:04:55 +02:00
smith peng
7e3f66e180 fix:fix boto3 client copy 2024-09-14 11:15:31 +08:00
Lorenzo Paleari
e657113ebc
fix: Refactor code to use CustomOpenAiCallbackManager for exclusive access to get_openai_callback 2024-09-14 02:06:52 +02:00
Matteo Vedovati
545970ce54 html_reduction script 2024-09-13 18:17:37 +02:00
Marco Vinciguerra
5c25da2fe6 feat: integration of o1 2024-09-13 14:20:23 +02:00
Marco Vinciguerra
9e3171b9fa feat: add copy for smart_scraper_multi_concat 2024-09-13 09:17:21 +02:00
Marco Vinciguerra
2ae26e96a0
Merge pull request #664 from LorenzoPaleari/598-fix-pydantic-validation-error 
598 - Fix pydantic validation error
 2024-09-13 09:00:17 +02:00
Lorenzo Paleari
a92dddb3e0
fix: update all nodes that were using MergeNode or IteratorNode 2024-09-13 04:19:40 +02:00
Lorenzo Paleari
66ea166438
fix: Added support for nested structure 2024-09-13 04:18:53 +02:00
Lorenzo Paleari
039ba2e95a
fix: Fixed pydantic error on SearchGraphs 
Changed instatiation location of iterated graph classes
 2024-09-13 01:56:58 +02:00
Lorenzo Paleari
c3d1b7c200
fix: OmniScraerGraph working. 
Added url scraping capability to ParseNode
 2024-09-13 01:47:39 +02:00
Matteo Vedovati
2a760a1c6f initial promptrefiner prompt 2024-09-12 21:17:46 +02:00
Marco Vinciguerra
ec6b164653 feat: refactoring of the tokenization function 2024-09-12 20:21:00 +02:00
Matteo Vedovati
42318a1441 Creation of PromptRefiner 2024-09-12 18:35:19 +02:00
Matteo Vedovati
9862425fb1 JsonDescriptorNode created 2024-09-12 18:04:37 +02:00
Matteo Vedovati
280dd53c88 Code generatot graph creation 2024-09-12 18:00:59 +02:00
Marco Vinciguerra
4a16f14b25
Merge pull request #660 from tm-robinson/651-add-tokenization-for-ollama-and-mistral 
651 add tokenization for ollama and mistral
 2024-09-12 10:22:20 +02:00
Marco Vinciguerra
c64ce88db8 refactoting of imports 2024-09-12 10:16:15 +02:00
Tom Robinson
dc4a76b9c5 use semchunk by default as the other code is causing tokenizers to be called for every individual word which is very slow especially with the mistral tokenizer 2024-09-12 08:46:52 +01:00
Tom Robinson
da9726f738 updates to tokenization for #651 to implement for mistral and ollama 2024-09-12 08:28:30 +01:00
Marco Vinciguerra
18277c1109
Merge branch 'pre/beta' into temp 2024-09-12 09:09:38 +02:00
roryhaung
57a58e162e docs: Updated the graph_config in the documentation. 2024-09-12 14:50:02 +08:00
Marco Vinciguerra
fe3aa28fe7 refactoring of the code
Some checks failed
/ build (push) Has been cancelled
Details
Release / Build (push) Has been cancelled
Details
Release / Release (push) Has been cancelled
Details
2024-09-11 16:04:43 +02:00
Marco Vinciguerra
039fe3c6d9 fix: models tokens 2024-09-11 11:45:44 +02:00
Marco Vinciguerra
4ee7753895
Merge pull request #654 from ScrapeGraphAI/main 
allignment
 2024-09-10 15:57:18 +02:00
Marco Vinciguerra
b2be6b739e fix: models tokens 2024-09-10 15:56:52 +02:00
Marco Vinciguerra
1a7f21fbf3 feat: removed semchunk and used tikton 2024-09-10 14:03:52 +02:00
Marco Vinciguerra
380174d490 add chunking functionn 2024-09-10 13:52:15 +02:00
Federico Aguzzi
4c14fd79b2
Merge pull request #650 from ScrapeGraphAI/637-it-can´t-scrape-urls-from-the-source 
fix: parse node
 2024-09-10 11:19:24 +02:00
Marco Vinciguerra
947ebd2895 fix: parse node
Some checks failed
/ build (push) Has been cancelled
Details
2024-09-10 08:41:08 +02:00
Federico Aguzzi
32a102af3c
Merge pull request #648 from ScrapeGraphAI/637-it-can´t-scrape-urls-from-the-source 
637 it can´t scrape urls from the source
 2024-09-09 12:04:46 +02:00
Federico Aguzzi
8a0d46b714
Merge pull request #641 from ScrapeGraphAI/urls_search_graph 
feat: return urls in searchgraph
 2024-09-09 12:03:36 +02:00
Marco Vinciguerra
f2bb22d8e9 fix: temporary fix for parse_node 2024-09-09 11:42:33 +02:00
Marco Vinciguerra
14c5e6baf9
Merge branch 'pre/beta' into temp 2024-09-08 13:11:37 +02:00
Marco Vinciguerra
fc738cacac Update parse_node.py 2024-09-08 11:54:11 +02:00
Tuhin Mallick
007ff084c6
fix(browser_base_fetch): correct function signature and async_mode handling 
- Added missing `async_mode` parameter to the function signature.
 2024-09-08 10:59:04 +02:00
Marco Vinciguerra
02eed1ac9d
Merge branch 'main' into main 2024-09-08 10:51:31 +02:00
Tuhin Mallick
d56253d183 feat(browser_base_fetch): add async_mode to support both synchronous and asynchronous execution 
- Introduced an async_mode flag to allow users to choose between synchronous and asynchronous fetching using Browserbase.
- Refactored common logic (browserbase initialization and result list) to avoid redundancy.
- Added internal async handling with asyncio.to_thread() for non-blocking execution in async_mode.
- Maintained backward compatibility for existing synchronous functionality.
 2024-09-08 08:49:08 +00:00
Tuhin Mallick
57fd01f9a7
feat(docloaders): Enhance browser_base_fetch function flexibility 
- Update browser_base_fetch to accept single URL or list of URLs
- Add text_content parameter for choosing between text-only and HTML output
- Improve type hinting and function documentation
- Ensure compatibility with latest Browserbase SDK interface
 2024-09-08 01:41:39 +02:00
Federico Aguzzi
9016bb53fb
Merge pull request #639 from ScrapeGraphAI/scrape_do_integration 
Scrape do integration
 2024-09-07 17:06:22 +02:00
Marco Vinciguerra
ef7a5891dc fix: screenshot_scraper 2024-09-07 14:55:12 +02:00
Marco Vinciguerra
afb6eb7e47 feat: return urls in searchgraph 2024-09-07 11:43:10 +02:00
ZuanZuan
cb05f824ce
Update abstract_graph.py 2024-09-07 17:35:03 +08:00
Marco Vinciguerra
167f97040f feat: fetch_node improved
Some checks failed
/ build (push) Has been cancelled
Details
2024-09-07 09:33:57 +02:00
Marco Vinciguerra
8883bced7d asdd proxy integratrion 2024-09-06 17:17:27 +02:00
Marco Vinciguerra
f5e7a8bfaf fix of the bug for fetching the code 2024-09-06 16:58:37 +02:00
Marco Vinciguerra
94e69a0515 feat: add scrape_do_integration 2024-09-06 16:51:48 +02:00
Marco Vinciguerra
8b02cb4460
Merge pull request #632 from ekinsenler/concat_node 
feat: Concat node implementation
 2024-09-06 15:52:35 +02:00
Marco Vinciguerra
c382b9d126
Merge pull request #630 from ScrapeGraphAI/595-rate-limit-error 
feat(AbstractGraph): add adjustable rate limit
 2024-09-06 15:03:10 +02:00
Federico Aguzzi
2859fb72d6 feat(AbstractGraph): add adjustable rate limit 2024-09-05 16:31:33 +02:00
Federico Aguzzi
63a5d18486 fix(AbstractGraph): Bedrock init issues 
Closes #633
 2024-09-05 10:20:20 +02:00
ekinsenler
bd4b26d7d7 feat: ConcatNode.py added for heavy merge operations 2024-09-04 17:53:32 +03:00
Federico Aguzzi
52fe441c5a fix(ScreenShotScraper): static import of optional dependencies 2024-09-04 15:00:30 +02:00
Lorenzo Paleari
8e74ac55a1
fix: correctly parsing output when using structured_output 2024-09-02 17:03:14 +02:00
Marco Vinciguerra
81af62d35f
Merge pull request #622 from LorenzoPaleari/pre/beta 
ScrapeGraphAI/580-OmniScraperGraph-fix
 2024-09-02 15:13:07 +02:00
Federico Aguzzi
5242166575 fix(SmartScraper): pass llm_model to ParseNode 2024-09-02 15:04:54 +02:00
Federico Aguzzi
b8ef93738e fix(ScreenshotScraper): impose dynamic imports 2024-09-02 15:03:54 +02:00
Lorenzo Paleari
57337a0a8c
fix: Removed link_urls and img_ulrs from FetchNode output 2024-09-02 12:53:40 +02:00
Lorenzo Paleari
66a3b6d6a3
fix: Parse Node scraping link and img urls allowing OmniScraper to work 2024-09-02 12:53:10 +02:00
Marco Vinciguerra
89b1f10477
Merge pull request #621 from ScrapeGraphAI/609-fix-deepseek-instancing 
Fix deepseek and ollama instancing
 2024-09-02 12:45:13 +02:00
Marco Vinciguerra
1e466cd2a8
Merge branch 'pre/beta' into screenshot-scraper-fix 2024-09-02 12:43:32 +02:00
Federico Aguzzi
74dfc693f6 fix(DeepSeek): proper model initialization 2024-09-02 12:28:22 +02:00
Marco Vinciguerra
e741602996
Merge branch 'pre/beta' into 543-ScriptCreatorGraph-only-use-first-chunk 2024-09-02 11:35:53 +02:00
Marco Vinciguerra
1bcc0bff0a
Merge pull request #620 from goasleep/feature/export_search_engine 
feat:expose the search engine params to user
 2024-09-02 11:27:59 +02:00
Tom Robinson
3d265a8631 change GenerateScraperNode to only use first chunk 2024-09-02 08:21:19 +01:00
Tom Robinson
a8b0e4a359 updated token calculation on parsenode 2024-09-02 08:01:21 +01:00
smith peng
8422463ca6 feat:expose the search engine params to user 2024-09-02 14:28:39 +08:00
Marco Vinciguerra
afdf5249c5
Merge pull request #613 from goasleep/feature/add_copy_tool 
fix: deepcopy fail for coping model_instance config
 2024-09-01 11:54:21 +02:00
Marco Vinciguerra
0e0b280bde
Merge branch 'pre/beta' into temp 2024-09-01 11:53:51 +02:00
Marco Vinciguerra
360ce1c0e4 fix: pyproject.toml 2024-09-01 11:51:46 +02:00
smith peng
553527a269 fix: fix pydantic object copy 2024-09-01 16:42:48 +08:00
Marco Vinciguerra
a73573d87a update version 2024-08-31 12:32:25 +02:00
smith peng
71b22d4880 feat: add deepcopy error 2024-08-31 17:55:14 +08:00
smith peng
36818b1fb3 feat:adjust uncopiable obj raise error and remove memo 2024-08-31 17:39:33 +08:00
smith peng
cd07418474 fix: deepcopy fail for coping model_instance config 2024-08-31 16:26:11 +08:00
smith peng
4f4d091b82 feat:add deepcopy tool 2024-08-31 11:30:20 +08:00
Marco Vinciguerra
388630c0ff fix: screenshot scraper 2024-08-30 13:02:13 +02:00
Marco Vinciguerra
a0d21137b7 refactoring of folders 2024-08-30 12:17:21 +02:00
Marco Vinciguerra
735120d0a3
Merge branch 'screenshot-scraper-fix' into pre/beta 2024-08-30 11:41:45 +02:00
Marco Vinciguerra
c348f674ad fix: update generate answernode 2024-08-30 11:37:44 +02:00
elijahbenizzy
25d8fd2e72 Fixes node expression validator error message to make it easier to debug missing keys 2024-08-29 13:24:47 -07:00
Federico Aguzzi
34942deca5 chore(examples): create Together AI examples 
Co-Authored-By: Marco Vinciguerra <88108002+VinciGit00@users.noreply.github.com>
 2024-08-28 22:39:05 +02:00
Marco Vinciguerra
8f615adef3 feat: add togheterai 2024-08-28 17:02:48 +02:00
Marco Vinciguerra
08fa257407
Merge pull request #602 from ScrapeGraphAI/593-abstract-graph-fix-round-4 
Abstract graph fix
 2024-08-28 16:10:36 +02:00
Federico Aguzzi
f7a85c266a fix(models): better DeepSeek and OneApi integration 2024-08-28 12:51:50 +02:00
Federico Aguzzi
4f120e29c5 fix(AbstractGraph): model selection bug 2024-08-28 12:36:03 +02:00
Santabot123
90d75498fc updated requirements.txt 2024-08-28 11:46:49 +03:00
Santabot123
aa9e85fdac remove some comments and image 2024-08-28 11:38:56 +03:00
ajenkins
bda30a9ecb swapped failing imports (local Gemini and non-imported Ernie) for langchain chat models in graph_builder.py 2024-08-28 16:48:00 +10:00
Marco Vinciguerra
df70b4f75d Update abstract_graph.py 2024-08-27 18:08:53 +02:00
Marco Vinciguerra
cf73883451 fix: bug for abstract graph 2024-08-27 18:05:34 +02:00
Marco Vinciguerra
d45064b09a
Merge pull request #597 from ScrapeGraphAI/593-abstract-graph-fix-round-4 
Abbstract graph fix, round 4
 2024-08-27 17:54:04 +02:00
Federico Aguzzi
7789663338 fix(BurrBrige): dynamic imports 2024-08-27 17:17:51 +02:00
Federico Aguzzi
83e71df2e2 fix: set up dynamic imports correctly 2024-08-27 16:54:57 +02:00
Federico Aguzzi
5c16ee985b fix(docloaders): BrowserBase dynamic import 2024-08-27 16:44:05 +02:00
Federico Aguzzi
f6df9b7512 chore(examples): update model names 2024-08-27 12:41:18 +02:00
Federico Aguzzi
f73343f193 fix(AbstractGraph): correct and simplify instancing logic 2024-08-27 12:22:53 +02:00
Marco Vinciguerra
04128e7e9f fix: abstract graph local model 2024-08-26 18:00:17 +02:00
Marco Vinciguerra
2a602a157e
Merge branch 'pre/beta' into jamie-beck-patch-1 2024-08-26 17:54:31 +02:00
Jamie Beck
35b994a8cd
fix model_tokens not being used for ollama 
I am passing in the explicit model_tokens from user config as the default_token so it will correctly fallback to the users setting if the model is not found
 2024-08-26 11:30:09 -04:00
Santabot123
0cf7c44409 correct the typo and updated select_area_with_ipywidget() 2024-08-26 14:51:28 +03:00
Santabot123
b4f8ea420b add __init__.py and docstrings 2024-08-26 13:53:19 +03:00
Marco Vinciguerra
e3fbf01c5b
Revert "Anthropic refactoring" 2024-08-25 10:54:19 +02:00
Marco Vinciguerra
9df4b14bc0 refacttoring of the anthropic example 2024-08-25 10:53:01 +02:00
Marco Vinciguerra
86fe5fcaf1 fix: update abstract graph 2024-08-24 21:57:04 +02:00
Marco Vinciguerra
ee8f8b31ec fix: add claude3.5 sonnet 2024-08-24 21:25:55 +02:00
Santabot123
e11f0cd28d Added text_detection.py and updated screenshot_preparation.py 2024-08-24 18:40:54 +03:00
Marco Vinciguerra
cf1fada36a fix: abstract graph 
Co-Authored-By: Federico Aguzzi <62149513+f-aguzzi@users.noreply.github.com>
 2024-08-23 18:43:49 +02:00
Santabot123
49ae56ceee Added screenshot preparation script for screenshot scraping 2024-08-23 19:00:14 +03:00
Marco Vinciguerra
26de5dd623
Merge branch 'pre/beta' into ligthweigthing_library 2024-08-23 12:22:31 +02:00
Marco Vinciguerra
f7ba1f30de refactoring of the code 2024-08-23 11:33:22 +02:00
Marco Vinciguerra
0d2b7b37e0 update dependenceis 2024-08-21 20:48:47 +02:00
aziz-ullah-khan
a92b9c6970 Fix: Azure OpenAI issue 2024-08-21 16:18:51 +05:00
Federico Aguzzi
b05ec16b25 fix(models_tokens): add llama2 and llama3 sizes explicitly 2024-08-21 09:32:59 +02:00
Federico Aguzzi
dd406dff0c style(models_tokens): enforce formatting 2024-08-21 09:29:38 +02:00
Marco Vinciguerra
860fde8a2c
Merge pull request #558 from ScrapeGraphAI/screenshot_scraper 
Screenshot scraper integration
 2024-08-20 11:33:51 +02:00
Federico Aguzzi
d2486469af Merge branch 'pre/beta' into screenshot_scraper 2024-08-20 09:58:34 +02:00
Federico Aguzzi
052f7d5e66 fix(SearchNode): prompt 
Co-Authored-By: Andrew Masek <8219702+portoaj@users.noreply.github.com>
 2024-08-20 09:53:35 +02:00
Marco Vinciguerra
fee77d1fe6 Update screenshot_scraper_graph.py
Some checks failed
/ build (push) Has been cancelled
Details
2024-08-19 14:35:13 +02:00
Marco Vinciguerra
f774fe40e5 add try catch and robust integration 2024-08-19 14:24:27 +02:00
Federico Aguzzi
d29338b7c2 feat(GenerateAnswerNode): built-in structured output through LangChain
Some checks failed
/ build (push) Has been cancelled
Details 
Co-Authored-By: Marco Vinciguerra <88108002+VinciGit00@users.noreply.github.com>
 2024-08-19 13:45:37 +02:00
Federico Aguzzi
b48ee825ee Merge branch 'pre/beta' into support_structured_output_shema_openai 2024-08-19 13:31:01 +02:00
Federico Aguzzi
683bf57d89 fix(ParseNode): leave room for LLM reply in context window 2024-08-19 11:33:09 +02:00
Marco Vinciguerra
f60aa3acde feat: add async call
Some checks are pending
/ build (push) Waiting to run
Details
2024-08-19 11:22:40 +02:00
ekinsenler
08e9d9d6a0 feat: Implemented a filter logic in search_link_node.py 
feat: Added dict entry for Llama3.1:8b
 2024-08-19 11:05:31 +03:00
Marco Vinciguerra
0bf79b5926 Update generate_answer_from_image_node.py
Some checks are pending
/ build (push) Waiting to run
Details
2024-08-19 02:21:45 +02:00
Marco Vinciguerra
79fa3f6bd6 add if and cool stuff 2024-08-19 02:01:41 +02:00
Marco Vinciguerra
c72c077eb6 refactoring of the nodes 2024-08-19 01:15:45 +02:00
Marco Vinciguerra
8d6c0b7288 Update generate_answer_node.py
Some checks failed
/ build (push) Has been cancelled
Details
Release / Build (push) Has been cancelled
Details
Release / Release (push) Has been cancelled
Details
2024-08-18 22:01:39 +02:00
Marco Vinciguerra
103c21c86e Update generate_answer_from_image_node.py 2024-08-18 20:54:35 +02:00
Marco Vinciguerra
5eb3cff64f feat: refactoring of the code 2024-08-18 20:53:35 +02:00
Marco Vinciguerra
8e3d5deaaa add screenshot scraper 2024-08-18 19:39:49 +02:00
Marco Vinciguerra
8b8d8f09b7 refactoring of the code according to pylint style
Some checks are pending
/ build (push) Waiting to run
Details
Release / Build (push) Waiting to run
Details
Release / Release (push) Blocked by required conditions
Details
2024-08-18 11:51:34 +02:00
Marco Vinciguerra
ebdb74967d add new model for gpt 2024-08-17 15:00:44 +02:00
Marco Vinciguerra
609316c8e7 Update abstract_graph.py
Some checks are pending
/ build (push) Waiting to run
Details
Release / Build (push) Waiting to run
Details
Release / Release (push) Blocked by required conditions
Details
2024-08-17 14:39:39 +02:00
Marco Vinciguerra
391d051a5e updated 2024-08-17 14:39:19 +02:00
Marco Vinciguerra
0aca28732b feat: update model tokens dict 2024-08-17 14:34:06 +02:00
Marco Vinciguerra
c2c2e6582f Update generate_answer_node.py 2024-08-17 13:30:44 +02:00
Marco Vinciguerra
f0587908e2 Merge branch 'pre/beta' of https://github.com/ScrapeGraphAI/Scrapegraph-ai into pre/beta 2024-08-17 12:21:03 +02:00
Marco Vinciguerra
1d7f30b65b fix: browser-base integration 2024-08-17 12:21:00 +02:00
Federico Aguzzi
5eed0a7654 fix(FetchNode) add OpenAI optimization to GPT models on Azure 
closes #547
 2024-08-17 10:33:54 +02:00
Marco Vinciguerra
faef3186f7 fix: model count 2024-08-16 17:38:55 +02:00
Marco Vinciguerra
5100368b5a Merge branch 'pre/beta' of https://github.com/ScrapeGraphAI/Scrapegraph-ai into pre/beta 2024-08-16 09:01:30 +02:00
Marco Vinciguerra
b115f9612f refactoring of code and documentation 2024-08-16 09:01:27 +02:00
Marco Vinciguerra
333f09a289
Merge pull request #552 from sandeepchittilla/550-add-support-gpt4o-variants 
Add new feature to support gpt-4o variant models with different pricing
 2024-08-16 09:00:31 +02:00
Federico Aguzzi
ea72d7609c
Merge pull request #536 from ScrapeGraphAI/refactoring-of-abstract-graph 
Refactoring of abstract graph
 2024-08-15 16:46:03 +02:00
sandeepchittilla
855144876d
feat: Add new feature to support gpt-4o variant models with different pricing 2024-08-15 14:59:48 +01:00
Marco Vinciguerra
203ee2c186 removed unused imports
Some checks failed
/ build (push) Has been cancelled
Details
Release / Build (push) Has been cancelled
Details
Release / Release (push) Has been cancelled
Details
2024-08-14 11:07:11 +02:00
Marco Vinciguerra
597f2acd07 fixed doc bugs and removed unused rag node 2024-08-14 10:59:53 +02:00
Marco Vinciguerra
c5aebd73d3
Merge pull request #541 from ScrapeGraphAI/496-not-match-gemini-embeddings-model 2024-08-13 20:54:57 +02:00
Marco Vinciguerra
9be44742d6 Update abstract_graph.py
Some checks failed
/ build (push) Has been cancelled
Details
2024-08-13 19:29:03 +02:00
Marco Vinciguerra
795c9325cc
Merge branch 'pre/beta' into refactoring-of-abstract-graph
Some checks are pending
/ build (push) Waiting to run
Details
2024-08-12 18:35:55 +02:00
Marco Vinciguerra
c105c26b2f Update abstract_graph.py 2024-08-12 18:32:41 +02:00
Federico Aguzzi
cb6b35397e fix(models_tokens): incorrect provider names 2024-08-12 10:52:13 +02:00
Federico Aguzzi
bae89e832e Merge branch 'pre/beta' into 530-probable-bug 2024-08-12 10:37:50 +02:00
Federico Aguzzi
e6bedb6701 fix(AbstractGraph): pass kwargs to Ernie and Nvidia models
Some checks failed
/ build (push) Has been cancelled
Details 
Co-Authored-By: Marco Vinciguerra <88108002+VinciGit00@users.noreply.github.com>
 2024-08-12 10:11:45 +02:00
Marco Vinciguerra
8cece1d31b
Merge branch 'pre/beta' into refactoring-of-abstract-graph 2024-08-11 19:20:26 +02:00
Marco Vinciguerra
cef2fdb420 Update abstract_graph.py 
Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>
 2024-08-11 19:19:17 +02:00
Marco Vinciguerra
c77231c983 feat: update abstract graph 
Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>
 2024-08-11 19:18:24 +02:00
Marco Vinciguerra
de1ec250ef refactoring pyproject.toml
Some checks are pending
/ build (push) Waiting to run
Details
Release / Build (push) Waiting to run
Details
Release / Release (push) Blocked by required conditions
Details 
Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>
 2024-08-11 18:04:31 +02:00
Marco Vinciguerra
cec5537f2a add new tests
Some checks are pending
/ build (push) Waiting to run
Details
Release / Build (push) Waiting to run
Details
Release / Release (push) Blocked by required conditions
Details 
Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>
 2024-08-11 17:10:55 +02:00
Matteo Vedovati
a3b7181f95 quick fix typo 2024-08-11 11:52:50 +02:00
Matteo Vedovati
734b740bf9 Template name refactoring 2024-08-11 11:46:01 +02:00
Matteo Vedovati
98779d193b search_link_node prompts moved 2024-08-11 11:43:22 +02:00
Matteo Vedovati
ef966525c3 search_link_node prompt moved 2024-08-11 11:34:49 +02:00
Matteo Vedovati
86a4903e99 search_internet_node prompt moved 2024-08-11 11:31:51 +02:00
Matteo Vedovati
f455fcbc5f robot_node prompt moved 2024-08-11 11:27:27 +02:00
Matteo Vedovati
9814b6dd85 fixed versioning errors 2024-08-11 10:04:15 +02:00
Matteo Vedovati
7c6210019e Merge branch 'pre/beta' of https://github.com/vedovati-matteo/Scrapegraph-ai into pre/beta 2024-08-11 09:42:38 +02:00
Matteo Vedovati
f17cef94bb fix: merge_anwser prompt import 2024-08-11 09:41:31 +02:00