Marco Vinciguerra
df70b4f75d
Update abstract_graph.py
2024-08-27 18:08:53 +02:00
Marco Vinciguerra
cf73883451
fix: bug for abstract graph
2024-08-27 18:05:34 +02:00
Federico Aguzzi
f73343f193
fix(AbstractGraph): correct and simplify instancing logic
2024-08-27 12:22:53 +02:00
Marco Vinciguerra
04128e7e9f
fix: abstract graph local model
2024-08-26 18:00:17 +02:00
Marco Vinciguerra
2a602a157e
Merge branch 'pre/beta' into jamie-beck-patch-1
2024-08-26 17:54:31 +02:00
Jamie Beck
35b994a8cd
fix model_tokens not being used for ollama
...
I am passing in the explicit model_tokens from user config as the default_token so it will correctly fallback to the users setting if the model is not found
2024-08-26 11:30:09 -04:00
Marco Vinciguerra
e3fbf01c5b
Revert "Anthropic refactoring"
2024-08-25 10:54:19 +02:00
Marco Vinciguerra
9df4b14bc0
refacttoring of the anthropic example
2024-08-25 10:53:01 +02:00
Marco Vinciguerra
86fe5fcaf1
fix: update abstract graph
2024-08-24 21:57:04 +02:00
Marco Vinciguerra
cf1fada36a
fix: abstract graph
...
Co-Authored-By: Federico Aguzzi <62149513+f-aguzzi@users.noreply.github.com>
2024-08-23 18:43:49 +02:00
Marco Vinciguerra
26de5dd623
Merge branch 'pre/beta' into ligthweigthing_library
2024-08-23 12:22:31 +02:00
Marco Vinciguerra
f7ba1f30de
refactoring of the code
2024-08-23 11:33:22 +02:00
Marco Vinciguerra
0d2b7b37e0
update dependenceis
2024-08-21 20:48:47 +02:00
aziz-ullah-khan
a92b9c6970
Fix: Azure OpenAI issue
2024-08-21 16:18:51 +05:00
Federico Aguzzi
d2486469af
Merge branch 'pre/beta' into screenshot_scraper
2024-08-20 09:58:34 +02:00
Marco Vinciguerra
fee77d1fe6
Update screenshot_scraper_graph.py
/ build (push) Has been cancelled
2024-08-19 14:35:13 +02:00
Marco Vinciguerra
f774fe40e5
add try catch and robust integration
2024-08-19 14:24:27 +02:00
ekinsenler
08e9d9d6a0
feat: Implemented a filter logic in search_link_node.py
...
feat: Added dict entry for Llama3.1:8b
2024-08-19 11:05:31 +03:00
Marco Vinciguerra
79fa3f6bd6
add if and cool stuff
2024-08-19 02:01:41 +02:00
Marco Vinciguerra
c72c077eb6
refactoring of the nodes
2024-08-19 01:15:45 +02:00
Marco Vinciguerra
8e3d5deaaa
add screenshot scraper
2024-08-18 19:39:49 +02:00
Marco Vinciguerra
609316c8e7
Update abstract_graph.py
/ build (push) Waiting to run
Release / Build (push) Waiting to run
Release / Release (push) Blocked by required conditions
2024-08-17 14:39:39 +02:00
Marco Vinciguerra
1d7f30b65b
fix: browser-base integration
2024-08-17 12:21:00 +02:00
Marco Vinciguerra
faef3186f7
fix: model count
2024-08-16 17:38:55 +02:00
Marco Vinciguerra
5100368b5a
Merge branch 'pre/beta' of https://github.com/ScrapeGraphAI/Scrapegraph-ai into pre/beta
2024-08-16 09:01:30 +02:00
Marco Vinciguerra
b115f9612f
refactoring of code and documentation
2024-08-16 09:01:27 +02:00
Federico Aguzzi
ea72d7609c
Merge pull request #536 from ScrapeGraphAI/refactoring-of-abstract-graph
...
Refactoring of abstract graph
2024-08-15 16:46:03 +02:00
Marco Vinciguerra
203ee2c186
removed unused imports
/ build (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
2024-08-14 11:07:11 +02:00
Marco Vinciguerra
597f2acd07
fixed doc bugs and removed unused rag node
2024-08-14 10:59:53 +02:00
Marco Vinciguerra
9be44742d6
Update abstract_graph.py
/ build (push) Has been cancelled
2024-08-13 19:29:03 +02:00
Marco Vinciguerra
795c9325cc
Merge branch 'pre/beta' into refactoring-of-abstract-graph
/ build (push) Waiting to run
2024-08-12 18:35:55 +02:00
Marco Vinciguerra
c105c26b2f
Update abstract_graph.py
2024-08-12 18:32:41 +02:00
Federico Aguzzi
bae89e832e
Merge branch 'pre/beta' into 530-probable-bug
2024-08-12 10:37:50 +02:00
Federico Aguzzi
e6bedb6701
fix(AbstractGraph): pass kwargs to Ernie and Nvidia models
...
/ build (push) Has been cancelled
Co-Authored-By: Marco Vinciguerra <88108002+VinciGit00@users.noreply.github.com>
2024-08-12 10:11:45 +02:00
Marco Vinciguerra
8cece1d31b
Merge branch 'pre/beta' into refactoring-of-abstract-graph
2024-08-11 19:20:26 +02:00
Marco Vinciguerra
cef2fdb420
Update abstract_graph.py
...
Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>
2024-08-11 19:19:17 +02:00
Marco Vinciguerra
c77231c983
feat: update abstract graph
...
Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>
2024-08-11 19:18:24 +02:00
Marco Vinciguerra
de1ec250ef
refactoring pyproject.toml
...
/ build (push) Waiting to run
Release / Build (push) Waiting to run
Release / Release (push) Blocked by required conditions
Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>
2024-08-11 18:04:31 +02:00
Marco Vinciguerra
8b2c266aff
refactoring of the code
...
Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>
2024-08-10 17:44:35 +02:00
Marco Vinciguerra
c3f1520240
Update abstract_graph.py
2024-08-10 12:13:09 +02:00
Marco Vinciguerra
6c3b37ab00
feat: add refactoring of default temperature
2024-08-10 11:51:37 +02:00
Marco Vinciguerra
157d59d5c0
Merge branch 'pre/beta' into temp
2024-08-09 10:28:59 +02:00
Marco Vinciguerra
a7db47ecad
refatoring
CodeQL / Analyze (python) (push) Has been cancelled
/ build (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
2024-08-07 21:23:42 +02:00
Federico Aguzzi
786af992f8
fix(AbstractGraph): LangChain warnings handling, Mistral tokens
2024-08-07 15:16:10 +02:00
Federico Aguzzi
f8ad616e10
chore(mistral): create examples
2024-08-06 18:16:15 +02:00
Federico Aguzzi
17f2707313
feat: add mistral support
2024-08-06 17:51:50 +02:00
Marco Vinciguerra
6e4d04450f
Update base_graph.py
2024-08-06 16:29:59 +02:00
Marco Vinciguerra
0571b6da55
feat: update base_graph
2024-08-06 14:01:11 +02:00
Marco Vinciguerra
66a29bc5cc
refactoring of the openai examples
...
/ build (push) Waiting to run
Release / Build (push) Waiting to run
Release / Release (push) Blocked by required conditions
Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>
2024-08-05 20:54:53 +02:00
Marco Vinciguerra
1fb711ae51
Merge branch 'pre/beta' of https://github.com/ScrapeGraphAI/Scrapegraph-ai into pre/beta
/ build (push) Waiting to run
Release / Build (push) Waiting to run
Release / Release (push) Blocked by required conditions
2024-08-05 14:54:16 +02:00
Marco Vinciguerra
a3d7f1b71c
Update csv_scraper_graph.py
2024-08-05 14:54:14 +02:00
Federico Aguzzi
ade28fca2c
fix(AbstractGraph): instantiation of Azure GPT models
...
/ build (push) Has been cancelled
Closes #498
2024-08-02 12:15:43 +02:00
Marco Vinciguerra
fe099f9cbc
Merge branch 'pre/beta' into browserbase_integration
/ build (push) Has been cancelled
2024-08-01 15:14:49 +02:00
Marco Vinciguerra
53dc06a2cb
Update speech_graph.py
/ build (push) Waiting to run
2024-08-01 14:48:19 +02:00
Marco Vinciguerra
9ac74de622
Update speech_graph.py
2024-08-01 14:47:49 +02:00
Marco Vinciguerra
0b4cfd6522
fix: abstract_graph and removed unused embeddings
...
Co-Authored-By: Federico Aguzzi <62149513+f-aguzzi@users.noreply.github.com>
2024-08-01 14:38:50 +02:00
Marco Vinciguerra
5ecdbe715f
feat: add integration in the abstract grapgh
2024-08-01 12:51:18 +02:00
Federico Aguzzi
a94ebcde00
refactor: move embeddings code from AbstractGraph to RAGNode
/ build (push) Waiting to run
2024-08-01 11:53:17 +02:00
Federico Aguzzi
bb73d916a1
refactor: reuse code for common interface models
2024-07-31 13:41:09 +02:00
Federico Aguzzi
b17756d934
style: enforce pylint styling
2024-07-31 13:07:19 +02:00
Federico Aguzzi
bc2c9967d2
refactor: remove redundant wrappers for Ernie and Nvidia
2024-07-30 10:59:12 +02:00
Federico Aguzzi
9275486240
refactor: remove redundant LangChain wrappers
/ build (push) Waiting to run
2024-07-29 21:59:39 +02:00
Marco Vinciguerra
9e795f4e35
removed unused init files
...
Co-Authored-By: Federico Aguzzi <62149513+f-aguzzi@users.noreply.github.com>
2024-07-29 17:35:10 +02:00
Federico Aguzzi
5e3eb6e43d
refactor(OpenAI): integrate new LangChain chat init
/ build (push) Waiting to run
2024-07-29 11:26:20 +02:00
Federico Aguzzi
d177afb68b
refactor(Ollama): integrate new LangChain chat init
2024-07-29 11:24:34 +02:00
Marco Perini
49b6468fb1
Merge branch 'main' into pre/beta
2024-07-23 16:14:15 +02:00
Marco Perini
12b5eada6e
fix(md_conversion): add absolute links md, added missing dependency
2024-07-23 15:34:12 +02:00
Marco Vinciguerra
fc0dadb8f8
feat: add nvidia connection
2024-07-22 11:56:33 +02:00
Marco Vinciguerra
ce6be37fbc
fix: abstract_graph moel token bug
2024-07-21 18:37:15 +02:00
Marco Vinciguerra
6a9205920f
Merge branch 'pre/beta' into temp
2024-07-20 20:03:20 +02:00
Marco Perini
99dc8497d8
docs(gpt-4o-mini): added new gpt, fixed chromium lazy loading,
...
add documentation and metrics
2024-07-20 20:02:26 +02:00
Federico Aguzzi
dccb893fdf
Merge pull request #456 from ScrapeGraphAI/refactoring-of-search_link_node
...
fix: search link node
2024-07-15 23:06:03 +02:00
Marco Vinciguerra
57fdaf9e3a
create search_link_graph
/ build (push) Waiting to run
2024-07-15 12:36:11 +02:00
Federico Aguzzi
fd1b7cb24a
chore: remove unused import
/ build (push) Has been cancelled
2024-07-14 22:36:43 +02:00
Marco Vinciguerra
a7249685cb
removed rag node
2024-07-14 10:24:38 +02:00
Marco Vinciguerra
765b548c0e
Merge pull request #417 from ScrapeGraphAI/md_scraper_integration
...
feat: add integrations for markdown files
2024-07-04 19:42:53 +02:00
Marco Vinciguerra
8a52914871
Merge pull request #429 from ScrapeGraphAI/421-default-prompt-template-customization
...
421 default prompt template customization
2024-07-04 19:42:35 +02:00
Federico Aguzzi
d77a622b05
Merge branch '423-add-vertex-ai-integration' into support
2024-07-04 18:23:22 +02:00
Federico Aguzzi
720f18729b
Merge branch 'fireworks_integration' into support
2024-07-04 18:17:38 +02:00
Federico Aguzzi
2ab7ddc95a
Merge pull request #405 from ScrapeGraphAI/integration_markdown
...
Integration markdown
2024-07-04 18:13:12 +02:00
Marco Vinciguerra
3bf5f570a8
feat: add integration for infos
2024-07-01 21:19:16 +02:00
Marco Vinciguerra
119514bdfc
feat: add vertexai integration
2024-07-01 12:21:47 +02:00
Marco Vinciguerra
5fe694b6b4
feat: improve md prompt recognition
/ build (3.10) (push) Waiting to run
2024-06-30 18:10:00 +02:00
Marco Vinciguerra
30ca15ca28
Merge branch 'md_scraper_integration' into integration_markdown
/ build (3.10) (push) Has been cancelled
2024-06-30 16:58:37 +02:00
Marco Vinciguerra
2804434a9e
feat: add integrations for markdown files
/ build (3.10) (push) Waiting to run
2024-06-29 13:35:39 +02:00
Marco Vinciguerra
9b45ebcdcf
modify fetch node with no cut mode
2024-06-28 14:38:36 +02:00
Marco Vinciguerra
0dfa5bf07e
Merge branch 'pre/beta' into main
2024-06-25 10:47:15 +02:00
Maorsg
f75e0835fc
added a function to the search_graph class to allow user to return URLs considered in the search
2024-06-24 21:31:28 -04:00
Marco Vinciguerra
df0e310829
feat: add fireworks integration
2024-06-24 23:11:28 +02:00
Djamel Feddad
2b4f4f12be
doc: Fixed a small typo in the warning message
...
This PR fixes a small type in the warning message
2024-06-23 15:34:48 +08:00
Marco Vinciguerra
d1c3de777f
fixed a bug
2024-06-21 14:14:43 +02:00
Marco Vinciguerra
7af411aa99
add trigger
...
Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>
2024-06-21 13:36:27 +02:00
Marco Vinciguerra
40b4b2d939
add new models tokens
2024-06-19 10:42:00 +02:00
Marco Perini
c7870905e1
fix: total tokens and docs
2024-06-18 23:22:23 +02:00
Jason Vertrees
aedda44868
fix: updated for schema changes
...
docs: updated for schema changes
2024-06-18 13:31:10 -05:00
Marco Vinciguerra
48ff87f20a
Merge branch 'pre/beta' of https://github.com/VinciGit00/Scrapegraph-ai into pre/beta
2024-06-17 14:17:46 +02:00
Marco Vinciguerra
03ffebc52d
fix: add chinese embedding model
2024-06-17 14:17:44 +02:00
Marco Perini
080a318ff6
feat(telemetry): add telemetry module
2024-06-17 13:00:33 +02:00
Marco Vinciguerra
da93162b53
Merge branch 'pre/beta' into main
2024-06-17 11:02:56 +02:00
shubihu
d8d5cd267a
Update abstract_graph.py
...
fix: Incorrect API Key Error with OpenAI Proxy
2024-06-17 16:26:33 +08:00
Marco Perini
4c8becc721
overwrite common params to affect nodes config
/ build (3.10) (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
2024-06-16 15:19:40 +02:00
Marco Vinciguerra
3d34ea65df
Merge pull request #384 from liaoliaojun/fix/merge
...
fix: TypeError ‘Model provided by the configuration not supported’
2024-06-16 13:34:43 +02:00
liaoliaojun
62b372b675
fix: shallow copy config of create_embedder
2024-06-15 17:53:13 +08:00
Marco Perini
09cb6e964e
refactor: add missing schemas and renamed files
/ build (3.10) (push) Waiting to run
Release / Build (push) Waiting to run
Release / Release (push) Blocked by required conditions
2024-06-14 15:38:46 +02:00
Marco Perini
12f4386552
Merge branch 'pre/beta' into 349-problem-with-scrapegraphaigraphspdf_scraper_graphpy
2024-06-14 15:22:43 +02:00
Marco Perini
91c5b5af43
fix(multi): updated multi pdf scraper with schema
2024-06-14 14:59:12 +02:00
Marco Perini
283b61fafc
docs: better logging
2024-06-13 18:13:47 +02:00
Marco Vinciguerra
1705046cc7
Update pdf_scraper_graph.py
2024-06-12 18:00:12 +02:00
Marco Vinciguerra
e6c7940a57
feat: add Parse_Node
2024-06-12 12:29:14 +02:00
Marco Vinciguerra
5065aa00e1
Merge branch 'pre/beta' into supercoder-327
2024-06-12 12:12:15 +02:00
supercoder-dev
828bdeedce
Update smart_scraper_graph.py
2024-06-12 14:28:33 +05:30
Marco Perini
a10b060409
Merge pull request #361 from VinciGit00/multi_scraper_implementation
...
Multi scraper implementation
2024-06-12 00:49:18 +02:00
Marco Perini
5d692bff9e
feat(schema): merge scripts to follow pydantic schema
2024-06-12 00:48:08 +02:00
Marco Perini
589da1d695
Merge pull request #351 from VinciGit00/faiss_integration
...
Faiss integration
2024-06-11 23:15:23 +02:00
Marco Perini
c881f64209
fix(cache): correctly pass the node arguments and logging
2024-06-11 22:56:09 +02:00
Marco Vinciguerra
9326637cc3
Merge branch 'main' into pre/beta
2024-06-09 17:04:11 +02:00
Marco Vinciguerra
1981230e6f
add multi scraper integration
2024-06-08 12:13:18 +02:00
duke147
4e16c9a81d
support ernie
2024-06-05 17:37:35 +08:00
Marco Vinciguerra
74fd530914
Merge branch 'pre/beta' into 332-pydantic-schema-validation
2024-06-05 09:05:19 +02:00
Marco Perini
f8b08e0b33
feat(append_node): append node to existing graph
/ build (3.10) (push) Has been cancelled
2024-06-04 23:34:43 +02:00
Marco Perini
376f758a76
feat(pydantic): added pydantic output schema
2024-06-04 23:07:49 +02:00
Marco Vinciguerra
fff89f431f
feat: refactoring of abstract graph
2024-06-04 19:41:11 +02:00
Marco Vinciguerra
f81442b817
removed unused if
2024-06-04 18:41:44 +02:00
Marco Vinciguerra
b4086550cc
feat: add csv scraper and xml scraper multi
2024-06-02 22:57:33 +02:00
Marco Vinciguerra
fff1232b8a
add rag node
2024-06-01 13:06:20 +02:00
Marco Vinciguerra
5bda918a39
feat: add json multiscraper
2024-06-01 12:04:19 +02:00
Marco Vinciguerra
4d42d7bfc6
add example
2024-06-01 11:20:24 +02:00
Marco Vinciguerra
f5cbd80c97
feat: add pdf scraper multi graph
2024-06-01 09:52:21 +02:00
Marco Vinciguerra
930f673747
feat: removed rag node
2024-05-31 21:03:48 +02:00
Marco Vinciguerra
3c7dedf9c8
Merge pull request #305 from VinciGit00/pdf_fix
...
Pdf fix
2024-05-26 15:39:21 +02:00
Marco Vinciguerra
1d958be44d
Merge pull request #303 from VinciGit00/295-scrapegraph-ai接入oneapi模型qwen-turbo
...
add OneAPI integration
2024-05-26 12:17:34 +02:00
Marco Perini
8d76c4b3cb
fix(schema): added schema
2024-05-26 10:51:48 +02:00
Marco Perini
f9f6b08753
Merge branch 'pre/beta' into burr_integration
2024-05-25 14:51:07 +02:00
Marco Perini
19b27bbe85
feat(burr): first burr integration and docs
2024-05-25 01:34:53 +02:00
Marco Perini
5684578fab
fix(kg): removed unused nodes and utils
2024-05-25 00:44:14 +02:00
Marco Perini
a4ee757507
Merge branch 'pre/beta' into pdf_scraper_refactoring
2024-05-25 00:16:38 +02:00
Marco Perini
8d5eb0bb0d
fix(local_file): fixed textual input pdf, csv, json and xml graph
2024-05-25 00:13:47 +02:00
Marco Vinciguerra
b6f1766bd1
add OneAPI integration
...
Co-Authored-By: Federico Aguzzi <62149513+f-aguzzi@users.noreply.github.com>
Co-Authored-By: wangdongpeng1 <74647183+wangdongpeng1@users.noreply.github.com>
2024-05-24 13:46:40 +02:00
Marco Vinciguerra
b913b51cca
Merge branch 'logger-integration' into pre/beta
2024-05-24 12:39:14 +02:00
Federico Minutoli
c807695720
feat(verbose): centralized graph logging on debug or warning depending on verbose
2024-05-24 01:09:03 +02:00
Marco Vinciguerra
5fd7633c63
Update pdf_scraper_graph.py
2024-05-23 21:09:09 +02:00
Marco Vinciguerra
d00cde6030
fix(pdf_scraper): fix the pdf scraper gaph
2024-05-23 20:03:16 +02:00
Marco Vinciguerra
c93dbe0a94
Update smart_scraper_graph.py
2024-05-23 18:44:52 +02:00
Marco Vinciguerra
6d33a8a25e
rollback
2024-05-23 18:44:04 +02:00
Marco Vinciguerra
909af8d912
refactor gen answ node
2024-05-23 13:45:23 +02:00
Marco Vinciguerra
b377467b29
add info
2024-05-23 12:51:08 +02:00
Marco Vinciguerra
1774b18059
refactor of embeddings
2024-05-23 12:32:49 +02:00
Marco Vinciguerra
f00ed35f7b
Merge branch 'pre/beta' into patch-1
2024-05-23 11:47:51 +02:00
Joe Stone
ffd6015a50
Update abstract_graph.py
...
Adapt to some ollama modles with "nam/modelname" like ( 893379029/piccolo-large-zh-v2)
2024-05-23 15:58:47 +08:00
Marco Perini
ac10128ff3
feat(burr): added burr integration in graphs and optional burr installation
2024-05-22 18:30:49 +02:00
