Marco Vinciguerra
|
a3d7f1b71c
|
Update csv_scraper_graph.py
|
2024-08-05 14:54:14 +02:00 |
|
Federico Aguzzi
|
ade28fca2c
|
fix(AbstractGraph): instantiation of Azure GPT models
/ build (push) Has been cancelled
Closes #498
|
2024-08-02 12:15:43 +02:00 |
|
Marco Vinciguerra
|
fe099f9cbc
|
Merge branch 'pre/beta' into browserbase_integration
/ build (push) Has been cancelled
|
2024-08-01 15:14:49 +02:00 |
|
Marco Vinciguerra
|
53dc06a2cb
|
Update speech_graph.py
/ build (push) Waiting to run
|
2024-08-01 14:48:19 +02:00 |
|
Marco Vinciguerra
|
9ac74de622
|
Update speech_graph.py
|
2024-08-01 14:47:49 +02:00 |
|
Marco Vinciguerra
|
0b4cfd6522
|
fix: abstract_graph and removed unused embeddings
Co-Authored-By: Federico Aguzzi <62149513+f-aguzzi@users.noreply.github.com>
|
2024-08-01 14:38:50 +02:00 |
|
Marco Vinciguerra
|
5ecdbe715f
|
feat: add integration in the abstract grapgh
|
2024-08-01 12:51:18 +02:00 |
|
Federico Aguzzi
|
a94ebcde00
|
refactor: move embeddings code from AbstractGraph to RAGNode
/ build (push) Waiting to run
|
2024-08-01 11:53:17 +02:00 |
|
Federico Aguzzi
|
bb73d916a1
|
refactor: reuse code for common interface models
|
2024-07-31 13:41:09 +02:00 |
|
Federico Aguzzi
|
b17756d934
|
style: enforce pylint styling
|
2024-07-31 13:07:19 +02:00 |
|
Federico Aguzzi
|
bc2c9967d2
|
refactor: remove redundant wrappers for Ernie and Nvidia
|
2024-07-30 10:59:12 +02:00 |
|
Federico Aguzzi
|
9275486240
|
refactor: remove redundant LangChain wrappers
/ build (push) Waiting to run
|
2024-07-29 21:59:39 +02:00 |
|
Marco Vinciguerra
|
9e795f4e35
|
removed unused init files
Co-Authored-By: Federico Aguzzi <62149513+f-aguzzi@users.noreply.github.com>
|
2024-07-29 17:35:10 +02:00 |
|
Federico Aguzzi
|
5e3eb6e43d
|
refactor(OpenAI): integrate new LangChain chat init
/ build (push) Waiting to run
|
2024-07-29 11:26:20 +02:00 |
|
Federico Aguzzi
|
d177afb68b
|
refactor(Ollama): integrate new LangChain chat init
|
2024-07-29 11:24:34 +02:00 |
|
Marco Perini
|
49b6468fb1
|
Merge branch 'main' into pre/beta
|
2024-07-23 16:14:15 +02:00 |
|
Marco Perini
|
12b5eada6e
|
fix(md_conversion): add absolute links md, added missing dependency
|
2024-07-23 15:34:12 +02:00 |
|
Marco Vinciguerra
|
fc0dadb8f8
|
feat: add nvidia connection
|
2024-07-22 11:56:33 +02:00 |
|
Marco Vinciguerra
|
ce6be37fbc
|
fix: abstract_graph moel token bug
|
2024-07-21 18:37:15 +02:00 |
|
Marco Vinciguerra
|
6a9205920f
|
Merge branch 'pre/beta' into temp
|
2024-07-20 20:03:20 +02:00 |
|
Marco Perini
|
99dc8497d8
|
docs(gpt-4o-mini): added new gpt, fixed chromium lazy loading,
add documentation and metrics
|
2024-07-20 20:02:26 +02:00 |
|
Federico Aguzzi
|
dccb893fdf
|
Merge pull request #456 from ScrapeGraphAI/refactoring-of-search_link_node
fix: search link node
|
2024-07-15 23:06:03 +02:00 |
|
Marco Vinciguerra
|
57fdaf9e3a
|
create search_link_graph
/ build (push) Waiting to run
|
2024-07-15 12:36:11 +02:00 |
|
Federico Aguzzi
|
fd1b7cb24a
|
chore: remove unused import
/ build (push) Has been cancelled
|
2024-07-14 22:36:43 +02:00 |
|
Marco Vinciguerra
|
a7249685cb
|
removed rag node
|
2024-07-14 10:24:38 +02:00 |
|
Marco Vinciguerra
|
765b548c0e
|
Merge pull request #417 from ScrapeGraphAI/md_scraper_integration
feat: add integrations for markdown files
|
2024-07-04 19:42:53 +02:00 |
|
Marco Vinciguerra
|
8a52914871
|
Merge pull request #429 from ScrapeGraphAI/421-default-prompt-template-customization
421 default prompt template customization
|
2024-07-04 19:42:35 +02:00 |
|
Federico Aguzzi
|
d77a622b05
|
Merge branch '423-add-vertex-ai-integration' into support
|
2024-07-04 18:23:22 +02:00 |
|
Federico Aguzzi
|
720f18729b
|
Merge branch 'fireworks_integration' into support
|
2024-07-04 18:17:38 +02:00 |
|
Federico Aguzzi
|
2ab7ddc95a
|
Merge pull request #405 from ScrapeGraphAI/integration_markdown
Integration markdown
|
2024-07-04 18:13:12 +02:00 |
|
Marco Vinciguerra
|
3bf5f570a8
|
feat: add integration for infos
|
2024-07-01 21:19:16 +02:00 |
|
Marco Vinciguerra
|
119514bdfc
|
feat: add vertexai integration
|
2024-07-01 12:21:47 +02:00 |
|
Marco Vinciguerra
|
5fe694b6b4
|
feat: improve md prompt recognition
/ build (3.10) (push) Waiting to run
|
2024-06-30 18:10:00 +02:00 |
|
Marco Vinciguerra
|
30ca15ca28
|
Merge branch 'md_scraper_integration' into integration_markdown
/ build (3.10) (push) Has been cancelled
|
2024-06-30 16:58:37 +02:00 |
|
Marco Vinciguerra
|
2804434a9e
|
feat: add integrations for markdown files
/ build (3.10) (push) Waiting to run
|
2024-06-29 13:35:39 +02:00 |
|
Marco Vinciguerra
|
9b45ebcdcf
|
modify fetch node with no cut mode
|
2024-06-28 14:38:36 +02:00 |
|
Marco Vinciguerra
|
0dfa5bf07e
|
Merge branch 'pre/beta' into main
|
2024-06-25 10:47:15 +02:00 |
|
Maorsg
|
f75e0835fc
|
added a function to the search_graph class to allow user to return URLs considered in the search
|
2024-06-24 21:31:28 -04:00 |
|
Marco Vinciguerra
|
df0e310829
|
feat: add fireworks integration
|
2024-06-24 23:11:28 +02:00 |
|
Djamel Feddad
|
2b4f4f12be
|
doc: Fixed a small typo in the warning message
This PR fixes a small type in the warning message
|
2024-06-23 15:34:48 +08:00 |
|
Marco Vinciguerra
|
d1c3de777f
|
fixed a bug
|
2024-06-21 14:14:43 +02:00 |
|
Marco Vinciguerra
|
7af411aa99
|
add trigger
Co-Authored-By: Matteo Vedovati <68272450+vedovati-matteo@users.noreply.github.com>
|
2024-06-21 13:36:27 +02:00 |
|
Marco Vinciguerra
|
40b4b2d939
|
add new models tokens
|
2024-06-19 10:42:00 +02:00 |
|
Marco Perini
|
c7870905e1
|
fix: total tokens and docs
|
2024-06-18 23:22:23 +02:00 |
|
Jason Vertrees
|
aedda44868
|
fix: updated for schema changes
docs: updated for schema changes
|
2024-06-18 13:31:10 -05:00 |
|
Marco Vinciguerra
|
48ff87f20a
|
Merge branch 'pre/beta' of https://github.com/VinciGit00/Scrapegraph-ai into pre/beta
|
2024-06-17 14:17:46 +02:00 |
|
Marco Vinciguerra
|
03ffebc52d
|
fix: add chinese embedding model
|
2024-06-17 14:17:44 +02:00 |
|
Marco Perini
|
080a318ff6
|
feat(telemetry): add telemetry module
|
2024-06-17 13:00:33 +02:00 |
|
Marco Vinciguerra
|
da93162b53
|
Merge branch 'pre/beta' into main
|
2024-06-17 11:02:56 +02:00 |
|
shubihu
|
d8d5cd267a
|
Update abstract_graph.py
fix: Incorrect API Key Error with OpenAI Proxy
|
2024-06-17 16:26:33 +08:00 |
|
Marco Perini
|
4c8becc721
|
overwrite common params to affect nodes config
/ build (3.10) (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
|
2024-06-16 15:19:40 +02:00 |
|
Marco Vinciguerra
|
3d34ea65df
|
Merge pull request #384 from liaoliaojun/fix/merge
fix: TypeError ‘Model provided by the configuration not supported’
|
2024-06-16 13:34:43 +02:00 |
|
liaoliaojun
|
62b372b675
|
fix: shallow copy config of create_embedder
|
2024-06-15 17:53:13 +08:00 |
|
Marco Perini
|
09cb6e964e
|
refactor: add missing schemas and renamed files
/ build (3.10) (push) Waiting to run
Release / Build (push) Waiting to run
Release / Release (push) Blocked by required conditions
|
2024-06-14 15:38:46 +02:00 |
|
Marco Perini
|
12f4386552
|
Merge branch 'pre/beta' into 349-problem-with-scrapegraphaigraphspdf_scraper_graphpy
|
2024-06-14 15:22:43 +02:00 |
|
Marco Perini
|
91c5b5af43
|
fix(multi): updated multi pdf scraper with schema
|
2024-06-14 14:59:12 +02:00 |
|
Marco Perini
|
283b61fafc
|
docs: better logging
|
2024-06-13 18:13:47 +02:00 |
|
Marco Vinciguerra
|
1705046cc7
|
Update pdf_scraper_graph.py
|
2024-06-12 18:00:12 +02:00 |
|
Marco Vinciguerra
|
e6c7940a57
|
feat: add Parse_Node
|
2024-06-12 12:29:14 +02:00 |
|
Marco Vinciguerra
|
5065aa00e1
|
Merge branch 'pre/beta' into supercoder-327
|
2024-06-12 12:12:15 +02:00 |
|
supercoder-dev
|
828bdeedce
|
Update smart_scraper_graph.py
|
2024-06-12 14:28:33 +05:30 |
|
Marco Perini
|
a10b060409
|
Merge pull request #361 from VinciGit00/multi_scraper_implementation
Multi scraper implementation
|
2024-06-12 00:49:18 +02:00 |
|
Marco Perini
|
5d692bff9e
|
feat(schema): merge scripts to follow pydantic schema
|
2024-06-12 00:48:08 +02:00 |
|
Marco Perini
|
589da1d695
|
Merge pull request #351 from VinciGit00/faiss_integration
Faiss integration
|
2024-06-11 23:15:23 +02:00 |
|
Marco Perini
|
c881f64209
|
fix(cache): correctly pass the node arguments and logging
|
2024-06-11 22:56:09 +02:00 |
|
Marco Vinciguerra
|
9326637cc3
|
Merge branch 'main' into pre/beta
|
2024-06-09 17:04:11 +02:00 |
|
Marco Vinciguerra
|
1981230e6f
|
add multi scraper integration
|
2024-06-08 12:13:18 +02:00 |
|
duke147
|
4e16c9a81d
|
support ernie
|
2024-06-05 17:37:35 +08:00 |
|
Marco Vinciguerra
|
74fd530914
|
Merge branch 'pre/beta' into 332-pydantic-schema-validation
|
2024-06-05 09:05:19 +02:00 |
|
Marco Perini
|
f8b08e0b33
|
feat(append_node): append node to existing graph
/ build (3.10) (push) Has been cancelled
|
2024-06-04 23:34:43 +02:00 |
|
Marco Perini
|
376f758a76
|
feat(pydantic): added pydantic output schema
|
2024-06-04 23:07:49 +02:00 |
|
Marco Vinciguerra
|
fff89f431f
|
feat: refactoring of abstract graph
|
2024-06-04 19:41:11 +02:00 |
|
Marco Vinciguerra
|
f81442b817
|
removed unused if
|
2024-06-04 18:41:44 +02:00 |
|
Marco Vinciguerra
|
b4086550cc
|
feat: add csv scraper and xml scraper multi
|
2024-06-02 22:57:33 +02:00 |
|
Marco Vinciguerra
|
fff1232b8a
|
add rag node
|
2024-06-01 13:06:20 +02:00 |
|
Marco Vinciguerra
|
5bda918a39
|
feat: add json multiscraper
|
2024-06-01 12:04:19 +02:00 |
|
Marco Vinciguerra
|
4d42d7bfc6
|
add example
|
2024-06-01 11:20:24 +02:00 |
|
Marco Vinciguerra
|
f5cbd80c97
|
feat: add pdf scraper multi graph
|
2024-06-01 09:52:21 +02:00 |
|
Marco Vinciguerra
|
930f673747
|
feat: removed rag node
|
2024-05-31 21:03:48 +02:00 |
|
Marco Vinciguerra
|
3c7dedf9c8
|
Merge pull request #305 from VinciGit00/pdf_fix
Pdf fix
|
2024-05-26 15:39:21 +02:00 |
|
Marco Vinciguerra
|
1d958be44d
|
Merge pull request #303 from VinciGit00/295-scrapegraph-ai接入oneapi模型qwen-turbo
add OneAPI integration
|
2024-05-26 12:17:34 +02:00 |
|
Marco Perini
|
8d76c4b3cb
|
fix(schema): added schema
|
2024-05-26 10:51:48 +02:00 |
|
Marco Perini
|
f9f6b08753
|
Merge branch 'pre/beta' into burr_integration
|
2024-05-25 14:51:07 +02:00 |
|
Marco Perini
|
19b27bbe85
|
feat(burr): first burr integration and docs
|
2024-05-25 01:34:53 +02:00 |
|
Marco Perini
|
5684578fab
|
fix(kg): removed unused nodes and utils
|
2024-05-25 00:44:14 +02:00 |
|
Marco Perini
|
a4ee757507
|
Merge branch 'pre/beta' into pdf_scraper_refactoring
|
2024-05-25 00:16:38 +02:00 |
|
Marco Perini
|
8d5eb0bb0d
|
fix(local_file): fixed textual input pdf, csv, json and xml graph
|
2024-05-25 00:13:47 +02:00 |
|
Marco Vinciguerra
|
b6f1766bd1
|
add OneAPI integration
Co-Authored-By: Federico Aguzzi <62149513+f-aguzzi@users.noreply.github.com>
Co-Authored-By: wangdongpeng1 <74647183+wangdongpeng1@users.noreply.github.com>
|
2024-05-24 13:46:40 +02:00 |
|
Marco Vinciguerra
|
b913b51cca
|
Merge branch 'logger-integration' into pre/beta
|
2024-05-24 12:39:14 +02:00 |
|
Federico Minutoli
|
c807695720
|
feat(verbose): centralized graph logging on debug or warning depending on verbose
|
2024-05-24 01:09:03 +02:00 |
|
Marco Vinciguerra
|
5fd7633c63
|
Update pdf_scraper_graph.py
|
2024-05-23 21:09:09 +02:00 |
|
Marco Vinciguerra
|
d00cde6030
|
fix(pdf_scraper): fix the pdf scraper gaph
|
2024-05-23 20:03:16 +02:00 |
|
Marco Vinciguerra
|
c93dbe0a94
|
Update smart_scraper_graph.py
|
2024-05-23 18:44:52 +02:00 |
|
Marco Vinciguerra
|
6d33a8a25e
|
rollback
|
2024-05-23 18:44:04 +02:00 |
|
Marco Vinciguerra
|
909af8d912
|
refactor gen answ node
|
2024-05-23 13:45:23 +02:00 |
|
Marco Vinciguerra
|
b377467b29
|
add info
|
2024-05-23 12:51:08 +02:00 |
|
Marco Vinciguerra
|
1774b18059
|
refactor of embeddings
|
2024-05-23 12:32:49 +02:00 |
|
Marco Vinciguerra
|
f00ed35f7b
|
Merge branch 'pre/beta' into patch-1
|
2024-05-23 11:47:51 +02:00 |
|
Joe Stone
|
ffd6015a50
|
Update abstract_graph.py
Adapt to some ollama modles with "nam/modelname" like ( 893379029/piccolo-large-zh-v2)
|
2024-05-23 15:58:47 +08:00 |
|
Marco Perini
|
ac10128ff3
|
feat(burr): added burr integration in graphs and optional burr installation
|
2024-05-22 18:30:49 +02:00 |
|
PeriniM
|
654a042396
|
feat(burr-node): working burr bridge
|
2024-05-22 00:24:38 +02:00 |
|
Marco Perini
|
6cbd84f254
|
feat(burr-bridge): BurrBridge class to integrate inside BaseGraph
|
2024-05-21 19:57:10 +02:00 |
|
Marco Vinciguerra
|
be4237a04d
|
Merge branch 'pre/beta' into multi_scraper_graph
|
2024-05-21 13:44:06 +02:00 |
|
Marco Perini
|
fc58e2d3a6
|
feat(smart-scraper-multi): add schema to graphs and created SmartScraperMultiGraph
|
2024-05-21 13:13:27 +02:00 |
|
Marco Vinciguerra
|
1ef63217dd
|
add deepseek embeddings
|
2024-05-21 10:41:01 +02:00 |
|
Marco Vinciguerra
|
659fad770a
|
fix: add deepseek embeddings
|
2024-05-21 10:36:40 +02:00 |
|
JGalego
|
d0a301d3c3
|
Moved common params up (verbose, headless and loader_kwargs)
|
2024-05-20 17:25:13 +01:00 |
|
Marco Perini
|
bed3eed50c
|
feat(multiple_search): working multiple example
|
2024-05-18 01:51:12 +02:00 |
|
Marco Vinciguerra
|
05e511e36f
|
add new prompts
|
2024-05-18 00:22:52 +02:00 |
|
Marco Perini
|
0196423bde
|
feat(knowledgegraph): add knowledge graph node
|
2024-05-17 23:41:44 +02:00 |
|
Marco Perini
|
73fa31db0f
|
feat(base_graph): alligned with main
|
2024-05-17 18:54:27 +02:00 |
|
Marco Vinciguerra
|
3453f72397
|
add graph
|
2024-05-17 18:23:50 +02:00 |
|
Marco Vinciguerra
|
02745a4f63
|
Merge branch 'main' into pre/beta
|
2024-05-17 10:40:19 +02:00 |
|
Marco Perini
|
d4d913c8a3
|
fix(deepcopy): switch whether we have obj in the config
|
2024-05-17 10:36:39 +02:00 |
|
VinciGit00
|
9e9f8f09d5
|
removed max depth
|
2024-05-16 12:39:08 +02:00 |
|
VinciGit00
|
9483afddd3
|
revert
|
2024-05-16 12:34:02 +02:00 |
|
Mayur Bhosale
|
1e0b2f7e70
|
Merge branch 'pre/beta' into nDeep
|
2024-05-15 23:36:23 +02:00 |
|
mayurdb
|
d60438cc89
|
Add a n-level deep search support
|
2024-05-15 23:32:15 +02:00 |
|
VinciGit00
|
ba8a4f7122
|
removed duplicates
|
2024-05-15 21:47:39 +02:00 |
|
VinciGit00
|
4fe58d9ba4
|
fix logger
|
2024-05-15 16:12:13 +02:00 |
|
VinciGit00
|
40260d8d25
|
remove asdt
|
2024-05-15 16:00:47 +02:00 |
|
Marco Perini
|
999c930f42
|
fix(deepcopy): reaplced to shallow copy
|
2024-05-15 16:00:42 +02:00 |
|
VinciGit00
|
cc5adefd29
|
fix: come back to the old version
|
2024-05-15 15:54:00 +02:00 |
|
VinciGit00
|
5587a64d23
|
fix: removed unused
|
2024-05-15 15:51:27 +02:00 |
|
VinciGit00
|
29d284e497
|
Merge branch 'main' into logger-integration
|
2024-05-15 15:28:20 +02:00 |
|
Marco Vinciguerra
|
008f8d9eae
|
Merge pull request #248 from VinciGit00/main
reallignment
|
2024-05-15 15:20:53 +02:00 |
|
Marco Vinciguerra
|
0b5cdd48fd
|
Merge pull request #246 from VinciGit00/main
reallignment
|
2024-05-15 15:19:05 +02:00 |
|
Marco Vinciguerra
|
22cd9e3605
|
Merge branch 'search_link_context' into main
|
2024-05-15 15:16:57 +02:00 |
|
Marco Perini
|
096b665c01
|
fix(searchgraph): used shallow copy to serialize obj
|
2024-05-15 15:05:47 +02:00 |
|
mayurdb
|
0b71b9a1e8
|
Add a new graph traversal that allows more than one edges out of a graph
|
2024-05-15 13:46:19 +02:00 |
|
VinciGit00
|
05890835f5
|
refactoring of loggers
|
2024-05-15 10:54:53 +02:00 |
|
Marco Perini
|
a6e1813ddd
|
fix(fetch_node): bug in handling local files
|
2024-05-14 16:51:10 +02:00 |
|
Marco Perini
|
fcb3abb01d
|
feat(omni-search): added omni search graph and updated docs
|
2024-05-14 16:26:43 +02:00 |
|
Marco Perini
|
a296927624
|
feat(omni-scraper): working OmniScraperGraph with images
|
2024-05-14 13:46:49 +02:00 |
|
VinciGit00
|
d6f5ca874f
|
Merge branch 'main' into pre/beta
|
2024-05-14 10:24:29 +02:00 |
|
JGalego
|
859c5d5ba5
|
Refactored to include custom AWS client for bedrock; Added missing Anthropic class
|
2024-05-13 17:57:53 +01:00 |
|
Marco Vinciguerra
|
f3d44c09ae
|
Merge pull request #228 from JGalego/fix/bedrock-support
fix: Amazon Bedrock Support
|
2024-05-13 14:57:23 +02:00 |
|
VinciGit00
|
d0167dee71
|
fix: bug for claude
|
2024-05-13 13:43:42 +02:00 |
|
JGalego
|
39be38f292
|
Fixed anthropic/bedrock conflict; Removed duplicate class Claude; Updated BedrockEmbeddings class
|
2024-05-13 12:35:42 +01:00 |
|
Marco Perini
|
7e8acd8e6a
|
Merge branch 'pre/beta' into fix/fetch-node-proxybroker
|
2024-05-13 11:17:37 +02:00 |
|
Marco Perini
|
1e9a564616
|
fix(proxy-rotation): removed duplicated arg and passed the loader_kwarhs correctly to the node
|
2024-05-12 18:39:03 +02:00 |
|
Federico Aguzzi
|
156b67b91e
|
feat: add support for deepseek-chat
closes #222
|
2024-05-12 01:00:11 +02:00 |
|
mayurdb
|
8f1fbe7e10
|
minor changes
|
2024-05-11 16:52:36 +05:30 |
|
mayurdb
|
df271b6451
|
Add search link node that can find out relevant links in the webpage
|
2024-05-11 16:39:55 +05:30 |
|
Stefan Krawczyk
|
f2bb1cc4f8
|
Fixes LC document deserialization
Depends on https://github.com/DAGWorks-Inc/burr/pull/175.
|
2024-05-11 00:06:02 -07:00 |
|
Eric Page
|
0683e78e78
|
Merge branch 'pre/beta' into fix-GenerateScraperGraph
|
2024-05-11 01:59:28 +02:00 |
|
Eric Page
|
24c3b0580c
|
Removed nonfunctional RAG node from ScriptCreatorGraph
|
2024-05-11 01:38:40 +02:00 |
|
Stefan Krawczyk
|
82afa0ef3d
|
Working smart scraper graph
Bugs found in tracker persistence:
- serializing inputs properly for tracker
- deserializing state from a previous found
|
2024-05-10 10:49:53 -07:00 |
|
Stefan Krawczyk
|
d94195f823
|
WIP
|
2024-05-10 09:48:46 -07:00 |
|
Stefan Krawczyk
|
be16fecb55
|
WIP
|
2024-05-10 09:48:44 -07:00 |
|
VinciGit00
|
0ab31c3fdb
|
fix: add json integration
|
2024-05-09 21:07:07 +02:00 |
|
VinciGit00
|
324e977b85
|
fix: fixed bugs for csv and xml
|
2024-05-09 20:46:46 +02:00 |
|
Shubham Kamboj
|
f10f3b1438
|
feat: Add support for passing pdf path as source
|
2024-05-09 21:55:05 +05:30 |
|
VinciGit00
|
94156755d1
|
Update abstract_graph.py
|
2024-05-09 12:29:39 +02:00 |
|
VinciGit00
|
403979337c
|
Update abstract_graph.py
|
2024-05-09 10:46:31 +02:00 |
|
VinciGit00
|
0bb68d1500
|
Merge branch 'main' of https://github.com/VinciGit00/Scrapegraph-ai
|
2024-05-09 10:31:21 +02:00 |
|
VinciGit00
|
8272d736a6
|
add tokenizatio for mxbai-embed-large
|
2024-05-08 21:50:42 +02:00 |
|
VinciGit00
|
4ed0fb89c3
|
feat: update info
|
2024-05-08 21:25:03 +02:00 |
|
VinciGit00
|
e7d39a5daf
|
fixed gemini embeddings
|
2024-05-08 21:24:17 +02:00 |
|
Marco Perini
|
6b71ec1d2b
|
fix(examples): local, mixed models and fixed SearchGraph embeddings problem
|
2024-05-08 15:36:26 +02:00 |
|
VinciGit00
|
2258fe5ac0
|
add new search graph examples
|
2024-05-06 22:31:48 +02:00 |
|
VinciGit00
|
67d5fbf816
|
feat: new search_graph
|
2024-05-06 22:09:18 +02:00 |
|
VinciGit00
|
5a67bca0db
|
Merge branch 'pre/beta' into pr/161
|
2024-05-06 14:50:04 +02:00 |
|
Cem Uzunoglu
|
2ac9e16dd9
|
Fixed accidental reformatting.
|
2024-05-06 15:09:56 +03:00 |
|
Cem Uzunoglu
|
e264e92e72
|
Added support for Claude 3 models from Anthropic
|
2024-05-06 14:34:35 +03:00 |
|
Shubham Kamboj
|
726de28898
|
feat: Fix bug for gemini case when embeddings config not passed
|
2024-05-06 15:40:03 +05:30 |
|
VinciGit00
|
51aa109e42
|
feat: add turboscraper (alfa)
|
2024-05-06 11:59:14 +02:00 |
|
VinciGit00
|
80053a2358
|
Merge branch 'pre/beta' of https://github.com/VinciGit00/Scrapegraph-ai into pre/beta
|
2024-05-06 10:07:56 +02:00 |
|
VinciGit00
|
389b52aabb
|
removed examples
|
2024-05-06 10:07:31 +02:00 |
|
Marco Perini
|
930adb38f2
|
feat(node): multiple url search in SearchGraph + fixes
Implemented GraphIteratorNode and MergeAnswersNode to create multiple istances of a graph and merge the scraped content from multiple pages
|
2024-05-06 00:30:09 +02:00 |
|
Marco Perini
|
1c4ba91620
|
exposed abstract_graph allowing the user to create new graphs
|
2024-05-05 22:05:11 +02:00 |
|
Marco Perini
|
84fcb44aaa
|
feat: fixed custom_graphs example and robots_node
|
2024-05-05 22:02:24 +02:00 |
|
Marco Perini
|
36a1522bba
|
Merge pull request #153 from VinciGit00/google_embeddings
feat: add gemini embeddings
|
2024-05-05 17:54:07 +02:00 |
|
Eric Page
|
cc27b21c3f
|
Merge branch 'pre/beta' into pass-common-params-graph
|
2024-05-05 16:18:32 +02:00 |
|
Eric Page
|
3ae2ea1dbd
|
Miscellaneous "llm" -> "llm_model" refactors
|
2024-05-05 15:58:50 +02:00 |
|
Eric Page
|
a53e95cbf0
|
Corrected graphs to use common params
|
2024-05-05 14:36:16 +02:00 |
|
Eric Page
|
8d0e109a70
|
Added overwrite keyword to set_common_params`
|
2024-05-05 14:32:58 +02:00 |
|
VinciGit00
|
79daa4c112
|
feat: add gemini embeddings
|
2024-05-05 11:40:44 +02:00 |
|
Eric Page
|
4dc6049e76
|
Simplified create graph functions using common params
|
2024-05-05 10:40:04 +02:00 |
|
Eric Page
|
444a13a6a6
|
Created set_common_params function
|
2024-05-05 10:15:37 +02:00 |
|
Eric Page
|
2178485b3d
|
Adjusted graphs to reflect node_config change
|
2024-05-05 09:47:13 +02:00 |
|
Marco Perini
|
0ab7272fd7
|
Merge branch 'pre/beta' into 133-support-claude3-haiku-and-others-using-litellm
|
2024-05-05 02:15:15 +02:00 |
|
VinciGit00
|
2878695d5f
|
fix: trailing whitespace
|
2024-05-04 21:26:19 +02:00 |
|
Shubham Kamboj
|
fd59f282a8
|
Bug fixes
|
2024-05-04 22:18:54 +05:30 |
|
Shubham Kamboj
|
d830d1371b
|
Resolve merge conflicts
|
2024-05-04 22:01:40 +05:30 |
|
Shubham Kamboj
|
7599234ab9
|
feat: Enable end users to pass model instances of HuggingFaceHub
|
2024-05-04 21:42:57 +05:30 |
|
VinciGit00
|
10a94530e3
|
feat: add pdf scraper
|
2024-05-03 21:42:02 +02:00 |
|
VinciGit00
|
39f64e5d48
|
add claude model
|
2024-05-03 17:17:31 +02:00 |
|
S4mpl3r
|
819cbcd3be
|
refactor: Changed the way embedding model is created in AbstractGraph class and removed handling of embedding model creation from RAGNode. Now AbstractGraph will call a dedicated method for embedding models instead of _create_llm. This makes it easy to use any LLM with any supported embedding model.
|
2024-05-03 16:14:27 +03:30 |
|
Marco Vinciguerra
|
579a27faf9
|
Merge pull request #126 from VinciGit00/bedrock_support
feat: bedrock support
|
2024-05-02 17:57:20 +02:00 |
|
Marco Vinciguerra
|
a2d5c75f10
|
Merge branch 'pre/beta' into main
|
2024-05-02 17:55:21 +02:00 |
|
Shubham Kamboj
|
b86aac2188
|
feat: Allow end users to pass model instances for llm and embedding model
|
2024-05-02 20:09:23 +05:30 |
|
VinciGit00
|
16de49fa08
|
add integration for bedrock
Co-Authored-By: redrusty2 <15157208+redrusty2@users.noreply.github.com>
|
2024-05-02 13:47:17 +02:00 |
|
VinciGit00
|
4a3bc37f2f
|
fix: bug on script_creator_graph.py
|
2024-05-02 09:23:46 +02:00 |
|
VinciGit00
|
5cf4e4f92f
|
fix: examples and graphs
|
2024-05-02 09:20:46 +02:00 |
|
Marco Perini
|
29427c2334
|
docs: fixed basegraph docstring
|
2024-05-02 01:05:20 +02:00 |
|
Marco Perini
|
c11fc28896
|
docs: refactor examples
|
2024-05-02 00:44:19 +02:00 |
|
Marco Perini
|
0631985e61
|
docs: graphs and helpers docstrings
|
2024-05-02 00:23:38 +02:00 |
|
Marco Perini
|
02d1af006c
|
feat: modified node name
|
2024-05-01 21:33:25 +02:00 |
|
VinciGit00
|
276ac8b40c
|
changed name
|
2024-05-01 20:17:01 +02:00 |
|