Marco Vinciguerra
bcf02e5f19
add possiibility to save the code
2024-09-24 21:42:45 +02:00
Matteo Vedovati
cd55c92b4e
Merge branch 'pre/beta' into pre/beta
2024-09-24 12:47:38 +02:00
Marco Vinciguerra
5a3ece9a1a
Merge branch 'pre/beta' into temp
2024-09-24 12:41:55 +02:00
Marco Vinciguerra
657ef711f7
raise keyerror exception for the schema
2024-09-24 12:06:45 +02:00
Marco Vinciguerra
3876cb7be8
feat: update exception
...
Co-Authored-By: Federico Aguzzi <62149513+f-aguzzi@users.noreply.github.com>
2024-09-24 09:35:33 +02:00
Marco Vinciguerra
bc881b4aaa
refctoring of the code
CodeQL / Analyze (python) (push) Has been cancelled
/ build (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
2024-09-23 08:37:52 +02:00
Marco Vinciguerra
de10b281ba
feat: update search_link_graph
2024-09-23 08:26:36 +02:00
Marco Vinciguerra
8ce08baf01
fix: graph Iterator node
2024-09-22 22:25:01 +02:00
Marco Vinciguerra
65b8675586
Update smart_scraper_multi_concat_graph.py
2024-09-22 21:10:57 +02:00
Marco Vinciguerra
e724ae4492
feat: update search_link graph
2024-09-22 11:32:46 +02:00
Matteo Vedovati
2ff0f0113f
Added logs
2024-09-21 18:46:16 +02:00
Matteo Vedovati
34590664f1
Code generator updated version
2024-09-21 16:36:22 +02:00
Matteo Vedovati
5b579b323f
gode generator v0.1
2024-09-21 11:44:04 +02:00
Matteo Vedovati
eb9c77c2d5
code generator graph fixed
2024-09-19 18:09:27 +02:00
Matteo Vedovati
470e768372
Update code generator graph
2024-09-19 14:45:56 +02:00
kashindra-mahato
8746958880
Update abstract_graph.py
...
fix spelling error 'togetherai'
2024-09-19 15:56:40 +05:45
Lorenzo Paleari
8a37c6b793
feat: added Bedrock and Mistral to exec info
2024-09-18 02:02:38 +02:00
Lorenzo Paleari
e657113ebc
fix: Refactor code to use CustomOpenAiCallbackManager for exclusive access to get_openai_callback
2024-09-14 02:06:52 +02:00
Marco Vinciguerra
9e3171b9fa
feat: add copy for smart_scraper_multi_concat
2024-09-13 09:17:21 +02:00
Lorenzo Paleari
a92dddb3e0
fix: update all nodes that were using MergeNode or IteratorNode
2024-09-13 04:19:40 +02:00
Lorenzo Paleari
039ba2e95a
fix: Fixed pydantic error on SearchGraphs
...
Changed instatiation location of iterated graph classes
2024-09-13 01:56:58 +02:00
Matteo Vedovati
2a760a1c6f
initial promptrefiner prompt
2024-09-12 21:17:46 +02:00
Matteo Vedovati
42318a1441
Creation of PromptRefiner
2024-09-12 18:35:19 +02:00
Matteo Vedovati
280dd53c88
Code generatot graph creation
2024-09-12 18:00:59 +02:00
Tom Robinson
da9726f738
updates to tokenization for #651 to implement for mistral and ollama
2024-09-12 08:28:30 +01:00
roryhaung
57a58e162e
docs: Updated the graph_config in the documentation.
2024-09-12 14:50:02 +08:00
Marco Vinciguerra
fe3aa28fe7
refactoring of the code
/ build (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
2024-09-11 16:04:43 +02:00
Marco Vinciguerra
94e69a0515
feat: add scrape_do_integration
2024-09-06 16:51:48 +02:00
Marco Vinciguerra
8b02cb4460
Merge pull request #632 from ekinsenler/concat_node
...
feat: Concat node implementation
2024-09-06 15:52:35 +02:00
Marco Vinciguerra
c382b9d126
Merge pull request #630 from ScrapeGraphAI/595-rate-limit-error
...
feat(AbstractGraph): add adjustable rate limit
2024-09-06 15:03:10 +02:00
Federico Aguzzi
2859fb72d6
feat(AbstractGraph): add adjustable rate limit
2024-09-05 16:31:33 +02:00
Federico Aguzzi
63a5d18486
fix(AbstractGraph): Bedrock init issues
...
Closes #633
2024-09-05 10:20:20 +02:00
ekinsenler
bd4b26d7d7
feat: ConcatNode.py added for heavy merge operations
2024-09-04 17:53:32 +03:00
Marco Vinciguerra
81af62d35f
Merge pull request #622 from LorenzoPaleari/pre/beta
...
ScrapeGraphAI/580-OmniScraperGraph-fix
2024-09-02 15:13:07 +02:00
Federico Aguzzi
5242166575
fix(SmartScraper): pass llm_model to ParseNode
2024-09-02 15:04:54 +02:00
Lorenzo Paleari
57337a0a8c
fix: Removed link_urls and img_ulrs from FetchNode output
2024-09-02 12:53:40 +02:00
Lorenzo Paleari
66a3b6d6a3
fix: Parse Node scraping link and img urls allowing OmniScraper to work
2024-09-02 12:53:10 +02:00
Federico Aguzzi
74dfc693f6
fix(DeepSeek): proper model initialization
2024-09-02 12:28:22 +02:00
Marco Vinciguerra
e741602996
Merge branch 'pre/beta' into 543-ScriptCreatorGraph-only-use-first-chunk
2024-09-02 11:35:53 +02:00
Marco Vinciguerra
1bcc0bff0a
Merge pull request #620 from goasleep/feature/export_search_engine
...
feat:expose the search engine params to user
2024-09-02 11:27:59 +02:00
Tom Robinson
3d265a8631
change GenerateScraperNode to only use first chunk
2024-09-02 08:21:19 +01:00
Tom Robinson
a8b0e4a359
updated token calculation on parsenode
2024-09-02 08:01:21 +01:00
smith peng
8422463ca6
feat:expose the search engine params to user
2024-09-02 14:28:39 +08:00
Marco Vinciguerra
afdf5249c5
Merge pull request #613 from goasleep/feature/add_copy_tool
...
fix: deepcopy fail for coping model_instance config
2024-09-01 11:54:21 +02:00
Marco Vinciguerra
0e0b280bde
Merge branch 'pre/beta' into temp
2024-09-01 11:53:51 +02:00
Marco Vinciguerra
360ce1c0e4
fix: pyproject.toml
2024-09-01 11:51:46 +02:00
smith peng
cd07418474
fix: deepcopy fail for coping model_instance config
2024-08-31 16:26:11 +08:00
Federico Aguzzi
34942deca5
chore(examples): create Together AI examples
...
Co-Authored-By: Marco Vinciguerra <88108002+VinciGit00@users.noreply.github.com>
2024-08-28 22:39:05 +02:00
Marco Vinciguerra
8f615adef3
feat: add togheterai
2024-08-28 17:02:48 +02:00
Federico Aguzzi
4f120e29c5
fix(AbstractGraph): model selection bug
2024-08-28 12:36:03 +02:00
Marco Vinciguerra
df70b4f75d
Update abstract_graph.py
2024-08-27 18:08:53 +02:00
Marco Vinciguerra
cf73883451
fix: bug for abstract graph
2024-08-27 18:05:34 +02:00
Federico Aguzzi
f73343f193
fix(AbstractGraph): correct and simplify instancing logic
2024-08-27 12:22:53 +02:00
Marco Vinciguerra
04128e7e9f
fix: abstract graph local model
2024-08-26 18:00:17 +02:00
Marco Vinciguerra
2a602a157e
Merge branch 'pre/beta' into jamie-beck-patch-1
2024-08-26 17:54:31 +02:00
Jamie Beck
35b994a8cd
fix model_tokens not being used for ollama
...
I am passing in the explicit model_tokens from user config as the default_token so it will correctly fallback to the users setting if the model is not found
2024-08-26 11:30:09 -04:00
Marco Vinciguerra
e3fbf01c5b
Revert "Anthropic refactoring"
2024-08-25 10:54:19 +02:00
Marco Vinciguerra
9df4b14bc0
refacttoring of the anthropic example
2024-08-25 10:53:01 +02:00
Marco Vinciguerra
86fe5fcaf1
fix: update abstract graph
2024-08-24 21:57:04 +02:00
Marco Vinciguerra
cf1fada36a
fix: abstract graph
...
Co-Authored-By: Federico Aguzzi <62149513+f-aguzzi@users.noreply.github.com>
2024-08-23 18:43:49 +02:00
Marco Vinciguerra
26de5dd623
Merge branch 'pre/beta' into ligthweigthing_library
2024-08-23 12:22:31 +02:00
Marco Vinciguerra
f7ba1f30de
refactoring of the code
2024-08-23 11:33:22 +02:00
Marco Vinciguerra
0d2b7b37e0
update dependenceis
2024-08-21 20:48:47 +02:00
aziz-ullah-khan
a92b9c6970
Fix: Azure OpenAI issue
2024-08-21 16:18:51 +05:00
Federico Aguzzi
d2486469af
Merge branch 'pre/beta' into screenshot_scraper
2024-08-20 09:58:34 +02:00
Marco Vinciguerra
fee77d1fe6
Update screenshot_scraper_graph.py
/ build (push) Has been cancelled
2024-08-19 14:35:13 +02:00
Marco Vinciguerra
f774fe40e5
add try catch and robust integration
2024-08-19 14:24:27 +02:00
ekinsenler
08e9d9d6a0
feat: Implemented a filter logic in search_link_node.py
...
feat: Added dict entry for Llama3.1:8b
2024-08-19 11:05:31 +03:00
Marco Vinciguerra
79fa3f6bd6
add if and cool stuff
2024-08-19 02:01:41 +02:00
Marco Vinciguerra
c72c077eb6
refactoring of the nodes
2024-08-19 01:15:45 +02:00
Marco Vinciguerra
8e3d5deaaa
add screenshot scraper
2024-08-18 19:39:49 +02:00
Marco Vinciguerra
609316c8e7
Update abstract_graph.py
/ build (push) Waiting to run
Release / Build (push) Waiting to run
Release / Release (push) Blocked by required conditions
2024-08-17 14:39:39 +02:00
Marco Vinciguerra
1d7f30b65b
fix: browser-base integration
2024-08-17 12:21:00 +02:00
Marco Vinciguerra
faef3186f7
fix: model count
2024-08-16 17:38:55 +02:00
Marco Vinciguerra
5100368b5a
Merge branch 'pre/beta' of https://github.com/ScrapeGraphAI/Scrapegraph-ai into pre/beta
2024-08-16 09:01:30 +02:00
Marco Vinciguerra
b115f9612f
refactoring of code and documentation
2024-08-16 09:01:27 +02:00
Federico Aguzzi
ea72d7609c
Merge pull request #536 from ScrapeGraphAI/refactoring-of-abstract-graph
...
Refactoring of abstract graph
2024-08-15 16:46:03 +02:00
Marco Vinciguerra
203ee2c186
removed unused imports
/ build (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
2024-08-14 11:07:11 +02:00
Marco Vinciguerra
597f2acd07
fixed doc bugs and removed unused rag node
2024-08-14 10:59:53 +02:00
Marco Vinciguerra
9be44742d6
Update abstract_graph.py
/ build (push) Has been cancelled
2024-08-13 19:29:03 +02:00
Marco Vinciguerra
795c9325cc
Merge branch 'pre/beta' into refactoring-of-abstract-graph
/ build (push) Waiting to run
2024-08-12 18:35:55 +02:00
Marco Vinciguerra
c105c26b2f
Update abstract_graph.py
2024-08-12 18:32:41 +02:00
Federico Aguzzi
bae89e832e
Merge branch 'pre/beta' into 530-probable-bug
2024-08-12 10:37:50 +02:00
Federico Aguzzi
e6bedb6701
fix(AbstractGraph): pass kwargs to Ernie and Nvidia models
...
/ build (push) Has been cancelled
Co-Authored-By: Marco Vinciguerra <88108002+VinciGit00@users.noreply.github.com>
2024-08-12 10:11:45 +02:00
Marco Vinciguerra
8cece1d31b
Merge branch 'pre/beta' into refactoring-of-abstract-graph
2024-08-11 19:20:26 +02:00
Marco Vinciguerra
cef2fdb420
Update abstract_graph.py
...
Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>
2024-08-11 19:19:17 +02:00
Marco Vinciguerra
c77231c983
feat: update abstract graph
...
Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>
2024-08-11 19:18:24 +02:00
Marco Vinciguerra
de1ec250ef
refactoring pyproject.toml
...
/ build (push) Waiting to run
Release / Build (push) Waiting to run
Release / Release (push) Blocked by required conditions
Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>
2024-08-11 18:04:31 +02:00
Marco Vinciguerra
8b2c266aff
refactoring of the code
...
Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>
2024-08-10 17:44:35 +02:00
Marco Vinciguerra
c3f1520240
Update abstract_graph.py
2024-08-10 12:13:09 +02:00
Marco Vinciguerra
6c3b37ab00
feat: add refactoring of default temperature
2024-08-10 11:51:37 +02:00
Marco Vinciguerra
157d59d5c0
Merge branch 'pre/beta' into temp
2024-08-09 10:28:59 +02:00
Marco Vinciguerra
a7db47ecad
refatoring
CodeQL / Analyze (python) (push) Has been cancelled
/ build (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
2024-08-07 21:23:42 +02:00
Federico Aguzzi
786af992f8
fix(AbstractGraph): LangChain warnings handling, Mistral tokens
2024-08-07 15:16:10 +02:00
Federico Aguzzi
f8ad616e10
chore(mistral): create examples
2024-08-06 18:16:15 +02:00
Federico Aguzzi
17f2707313
feat: add mistral support
2024-08-06 17:51:50 +02:00
Marco Vinciguerra
6e4d04450f
Update base_graph.py
2024-08-06 16:29:59 +02:00
Marco Vinciguerra
0571b6da55
feat: update base_graph
2024-08-06 14:01:11 +02:00
Marco Vinciguerra
66a29bc5cc
refactoring of the openai examples
...
/ build (push) Waiting to run
Release / Build (push) Waiting to run
Release / Release (push) Blocked by required conditions
Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>
2024-08-05 20:54:53 +02:00
Marco Vinciguerra
1fb711ae51
Merge branch 'pre/beta' of https://github.com/ScrapeGraphAI/Scrapegraph-ai into pre/beta
/ build (push) Waiting to run
Release / Build (push) Waiting to run
Release / Release (push) Blocked by required conditions
2024-08-05 14:54:16 +02:00
