Commit Graph

2293 Commits

Author SHA1 Message Date
Marco Perini
9b0e62742b changed source to text 2024-06-14 15:24:50 +02:00
semantic-release-bot
7da6cd2ab2 ci(release): 1.7.0-beta.7 [skip ci]
## [1.7.0-beta.7](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.7.0-beta.6...v1.7.0-beta.7) (2024-06-14)

### Features

* add Parse_Node ([e6c7940](e6c7940a57))

### Bug Fixes

* **pdf:** correctly read .pdf files ([203de83](203de83405))
* **multi:** updated multi pdf scraper with schema ([91c5b5a](91c5b5af43))

### Docs

* better logging ([283b61f](283b61fafc))
2024-06-14 13:24:14 +00:00
Marco Perini
1ae7c6a56a
Merge pull request #373 from VinciGit00/349-problem-with-scrapegraphaigraphspdf_scraper_graphpy
feat: add Parse_Node
2024-06-14 15:22:56 +02:00
Marco Perini
12f4386552
Merge branch 'pre/beta' into 349-problem-with-scrapegraphaigraphspdf_scraper_graphpy 2024-06-14 15:22:43 +02:00
Marco Perini
203de83405 fix(pdf): correctly read .pdf files 2024-06-14 15:20:30 +02:00
Marco Perini
91c5b5af43 fix(multi): updated multi pdf scraper with schema 2024-06-14 14:59:12 +02:00
Marco Perini
49f1795cae
Merge pull request #381 from VinciGit00/improve_generate_answer_nodes
refactoring of merging answers nodes
2024-06-14 14:35:07 +02:00
Marco Vinciguerra
7a34562d50 refactoring of merging answers nodes 2024-06-13 21:41:54 +02:00
Marco Perini
283b61fafc docs: better logging 2024-06-13 18:13:47 +02:00
Marco Vinciguerra
a6757aca57
Merge pull request #380 from Kshitij-Jande/main
Strip out the scheme from the proxy server address URI.
2024-06-13 13:23:26 +02:00
Marco Vinciguerra
c44b701d2d add new readmes
Some checks failed
CodeQL / Analyze (python) (push) Has been cancelled
/ build (3.10) (push) Has been cancelled
Release / Build (push) Has been cancelled
Release / Release (push) Has been cancelled
2024-06-13 11:39:57 +02:00
semantic-release-bot
dae3158519 ci(release): 1.7.0-beta.6 [skip ci]
## [1.7.0-beta.6](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.7.0-beta.5...v1.7.0-beta.6) (2024-06-13)

### Bug Fixes

* test for fetch node ([49c7e0e](49c7e0eaab))

### Docs

* fix label&logo for github action badges ([071f3d1](071f3d1906))

### Test

* fix tests for fetch node with proper mock&refactor ([17dd936](17dd936af7))
2024-06-13 09:06:15 +00:00
Marco Vinciguerra
49c7e0eaab fix: test for fetch node 2024-06-13 11:04:59 +02:00
Marco Vinciguerra
9dd2a63857
Merge pull request #379 from iamgodot/test
test: fix tests for fetch node with proper mock&refactor
2024-06-13 11:03:46 +02:00
Kshitij Jande
2a9ab69f4b Strip out the scheme from the server address URI 2024-06-13 12:18:41 +05:30
iamgodot
17dd936af7 test: fix tests for fetch node with proper mock&refactor 2024-06-12 22:45:43 -07:00
Marco Vinciguerra
cc9f5cc723
Merge pull request #375 from iamgodot/docs
Some checks are pending
/ build (3.10) (push) Waiting to run
Release / Build (push) Waiting to run
Release / Release (push) Blocked by required conditions
2024-06-12 20:35:57 +02:00
iamgodot
071f3d1906 docs: fix label&logo for github action badges 2024-06-12 11:25:49 -07:00
Marco Vinciguerra
1705046cc7 Update pdf_scraper_graph.py 2024-06-12 18:00:12 +02:00
Marco Vinciguerra
dc1340e302 Update generate_answer_pdf_node.py 2024-06-12 15:47:04 +02:00
Marco Vinciguerra
e45f159a31 enhanced performance and readibility 2024-06-12 14:59:10 +02:00
Marco Vinciguerra
58a257f05b update model tokens
Some checks are pending
/ build (3.10) (push) Waiting to run
Release / Build (push) Waiting to run
Release / Release (push) Blocked by required conditions
2024-06-12 12:41:58 +02:00
Marco Vinciguerra
e6c7940a57 feat: add Parse_Node 2024-06-12 12:29:14 +02:00
semantic-release-bot
79b8326b5b ci(release): 1.7.0-beta.5 [skip ci]
## [1.7.0-beta.5](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.7.0-beta.4...v1.7.0-beta.5) (2024-06-12)

### Features

* update fetch node ([1e7f334](1e7f3349f3))
2024-06-12 10:14:40 +00:00
Marco Vinciguerra
9952d98190 Merge branch 'pre/beta' of https://github.com/VinciGit00/Scrapegraph-ai into pre/beta 2024-06-12 12:13:22 +02:00
Marco Vinciguerra
1e7f3349f3 feat: update fetch node 2024-06-12 12:13:07 +02:00
Marco Vinciguerra
0145b8f0e8
Merge pull request #372 from supercoder-dev/supercoder-327
Issue 327 Resolved
2024-06-12 12:12:28 +02:00
Marco Vinciguerra
5065aa00e1
Merge branch 'pre/beta' into supercoder-327 2024-06-12 12:12:15 +02:00
supercoder-dev
d0e300af72
Update fetch_node.py 2024-06-12 14:32:01 +05:30
supercoder-dev
879c94a2b5
Update cleanup_html.py 2024-06-12 14:30:02 +05:30
supercoder-dev
828bdeedce
Update smart_scraper_graph.py 2024-06-12 14:28:33 +05:30
semantic-release-bot
b4d7532c6c ci(release): 1.7.0-beta.4 [skip ci]
## [1.7.0-beta.4](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.7.0-beta.3...v1.7.0-beta.4) (2024-06-12)

### Bug Fixes

* common params ([6b4cdf9](6b4cdf92b8))
2024-06-12 01:07:46 +00:00
Marco Perini
6b4cdf92b8 fix: common params 2024-06-12 03:06:21 +02:00
semantic-release-bot
85a75c893a ci(release): 1.7.0-beta.3 [skip ci]
## [1.7.0-beta.3](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.7.0-beta.2...v1.7.0-beta.3) (2024-06-11)

### Features

* add caching ([d790361](d79036149a))
* add dynamic caching ([7ed2fe8](7ed2fe8ef0))
* add new chunking function ([e1f045b](e1f045b280))
* **merge:** add scriptcreatormulti, rag cache and semchunk ([15421ef](15421eff70))
* **schema:** merge scripts to follow pydantic schema ([5d692bf](5d692bff9e))
* refactoring of rag node ([7a13a68](7a13a6819f))

### Bug Fixes

* **cache:** correctly pass the node arguments and logging ([c881f64](c881f64209))
* **node:** fixed generate answer node pydantic schema ([ab00f23](ab00f23d85))

### Docs

* **cache:** added cache_path param ([edddb68](edddb682d0))
* **scriptcreator:** enhance documentation ([650c3aa](650c3aaa60))
2024-06-11 23:55:32 +00:00
Marco Perini
6f994cef8c
Merge pull request #370 from VinciGit00/dev
Multiple Branches
2024-06-12 01:54:17 +02:00
Marco Perini
ab00f23d85 fix(node): fixed generate answer node pydantic schema 2024-06-12 01:40:49 +02:00
Marco Perini
15421eff70 feat(merge): add scriptcreatormulti, rag cache and semchunk 2024-06-12 01:23:01 +02:00
Marco Perini
650c3aaa60 docs(scriptcreator): enhance documentation 2024-06-12 01:16:50 +02:00
Marco Perini
a10b060409
Merge pull request #361 from VinciGit00/multi_scraper_implementation
Multi scraper implementation
2024-06-12 00:49:18 +02:00
Marco Perini
5d692bff9e feat(schema): merge scripts to follow pydantic schema 2024-06-12 00:48:08 +02:00
Marco Perini
893aaddc5c
Merge pull request #359 from VinciGit00/semchunk_integration
feat: add new chunking function
2024-06-11 23:16:00 +02:00
Marco Perini
589da1d695
Merge pull request #351 from VinciGit00/faiss_integration
Faiss integration
2024-06-11 23:15:23 +02:00
Marco Perini
edddb682d0 docs(cache): added cache_path param 2024-06-11 23:01:31 +02:00
Marco Perini
c881f64209 fix(cache): correctly pass the node arguments and logging 2024-06-11 22:56:09 +02:00
Marco Vinciguerra
fa951b4c8b
Merge pull request #368 from stevenmichaelthomas/wait-for-network-idle
Add the ability to specify load state
2024-06-11 19:59:23 +02:00
Steven Thomas
8f405ff87a Add the ability to specify load state 2024-06-11 11:22:39 -04:00
Marco Vinciguerra
81f89d88be
Update search_link_node.py 2024-06-10 16:14:24 +02:00
semantic-release-bot
e5bb5ae473 ci(release): 1.7.0-beta.2 [skip ci]
## [1.7.0-beta.2](https://github.com/VinciGit00/Scrapegraph-ai/compare/v1.7.0-beta.1...v1.7.0-beta.2) (2024-06-10)

### Features

* Add tests for RobotsNode and update test setup ([b0511ae](b0511aeaaa))
* Add tests for SmartScraperGraph using sample text and configuration fixtures ([@tejhande](https://github.com/tejhande)) ([c927145](c927145bd0))
* Add tests for SmartScraperGraph using sample text and configuration fixtures ([@tejhande](https://github.com/tejhande)) ([9e7038c](9e7038c596))
* Add tests for SmartScraperGraph using sample text and configuration fixtures ([@tejhande](https://github.com/tejhande)) ([c286b16](c286b1649e))
* Add tests for SmartScraperGraph using sample text and configuration fixtures ([@tejhande](https://github.com/tejhande)) ([08f1be6](08f1be682b))
2024-06-10 08:41:23 +00:00
Marco Vinciguerra
0748e10e3a
Merge pull request #365 from tejhande/main 2024-06-10 10:40:16 +02:00
Tejas Amol Hande
40747c3e01
Merge branch 'main' into main 2024-06-10 13:36:44 +05:30