CodeCow/Scrapegraph-ai
1
0
Fork 0
mirror of https://github.com/VinciGit00/Scrapegraph-ai.git synced 2026-07-09 21:19:20 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
2,352 Commits 2 Branches 448 Tags 17 MiB
7eeca1b91a
Commit Graph

2352 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Alin Cristian Preda
7eeca1b91a quickfix: removed unneccessary line 2024-12-03 21:17:47 +01:00
Alin Cristian Preda
1c8b910562 feat: added scrolling method to chromium docloader 2024-12-03 21:10:42 +01:00
Lorenzo Padoan
fde878fbe9
Update README.md
Some checks failed
CodeQL / Analyze (python) (push) Has been cancelled
Details
/ build (push) Has been cancelled
Details
Release / Build (push) Has been cancelled
Details
Release / Release (push) Has been cancelled
Details 
add website
 2024-12-02 15:16:30 +01:00
semantic-release-bot
7db5ce1038 ci(release): 1.32.0 [skip ci] 
## [1.32.0](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.31.1...v1.32.0) (2024-12-02)

### Features

* add API integration ([46373af](46373afe6d))
 2024-12-02 08:54:23 +00:00
Marco Vinciguerra
46373afe6d feat: add API integration 2024-12-02 09:53:07 +01:00
Marco Vinciguerra
aa7a7e2dae
Pre/beta (#835) 
* fix: error on fetching the code

* feat: revert search function

* feat: add api integration

* ci(release): 1.32.0-beta.1 [skip ci]

## [1.32.0-beta.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.31.1...v1.32.0-beta.1) (2024-11-24)

### Features

* revert search function ([faf0c01](faf0c0123b))

* fix: improved links extraction for parse_node, resolves #822

* ci(release): 1.32.0-beta.2 [skip ci]

## [1.32.0-beta.2](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.32.0-beta.1...v1.32.0-beta.2) (2024-11-25)

### Bug Fixes

* error on fetching the code ([7285ab0](7285ab065b))

* ci(release): 1.32.0-beta.3 [skip ci]

## [1.32.0-beta.3](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.32.0-beta.2...v1.32.0-beta.3) (2024-11-26)

### Bug Fixes

* improved links extraction for parse_node, resolves [#822](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/822) ([7da7bfe](7da7bfe338))

* chore: migrate from rye to uv

* feat: add sdk integration

* ci(release): 1.32.0-beta.4 [skip ci]

## [1.32.0-beta.4](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.32.0-beta.3...v1.32.0-beta.4) (2024-12-02)

### Features

* add api integration ([8aa9103](8aa9103f02))
* add sdk integration ([209b445](209b4456fd))

### chore

* migrate from rye to uv ([5fe528a](5fe528a7e7))

---------

Co-authored-by: semantic-release-bot <semantic-release-bot@martynus.net>
Co-authored-by: Michele_Zenoni <michelezenoni1@gmail.com>
Co-authored-by: Federico Aguzzi <62149513+f-aguzzi@users.noreply.github.com>
 2024-12-02 09:39:26 +01:00
Marco Vinciguerra
bbc7184e7b add examples for document_scraper
Some checks failed
CodeQL / Analyze (python) (push) Has been cancelled
Details
Release / Build (push) Has been cancelled
Details
Release / Release (push) Has been cancelled
Details
2024-11-24 10:27:24 +01:00
Marco Vinciguerra
7ed16db155
Merge pull request #823 from PeterDaveHelloKitchen/ImproveDockerfile 
Clean up cache files to reduce Docker image size
 2024-11-24 09:26:12 +01:00
semantic-release-bot
2aac7ffbc9 ci(release): 1.31.1 [skip ci] 
## [1.31.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.31.0...v1.31.1) (2024-11-22)

### Bug Fixes

* add new model istance ([2f3cafe](2f3cafeab0))
* fetch node regex ([e2af232](e2af2326f6))
* generate answer node timeout ([32ef554](32ef5547f1))
* timeout ([c243106](c243106552))

### CI

* **release:** 1.31.0-beta.1 [skip ci] ([1df7eb0](1df7eb0bcd)), closes [#805](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/805) [#805](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/805)
* **release:** 1.31.1-beta.1 [skip ci] ([86bf4f2](86bf4f2402)), closes [#805](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/805) [#805](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/805)
* **release:** 1.31.1-beta.2 [skip ci] ([f247844](f247844d81))
* **release:** 1.31.1-beta.3 [skip ci] ([30b0156](30b0156d17))
* **release:** 1.31.1-beta.4 [skip ci] ([b2720a4](b2720a452f))
 2024-11-22 07:41:58 +00:00
Marco Vinciguerra
3914a5f512
Merge pull request #819 from ScrapeGraphAI/pre/beta 2024-11-22 08:40:34 +01:00
semantic-release-bot
b2720a452f ci(release): 1.31.1-beta.4 [skip ci] 
## [1.31.1-beta.4](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.31.1-beta.3...v1.31.1-beta.4) (2024-11-21)

### Bug Fixes

* add new model istance ([2f3cafe](2f3cafeab0))
 2024-11-21 17:27:45 +00:00
Marco Vinciguerra
f8dd2e2ffa
Merge pull request #815 from ScrapeGraphAI/813-model-not-found-when-using-anthropic 
fix: add new model istance
 2024-11-21 18:26:03 +01:00
semantic-release-bot
30b0156d17 ci(release): 1.31.1-beta.3 [skip ci] 
## [1.31.1-beta.3](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.31.1-beta.2...v1.31.1-beta.3) (2024-11-21)

### Bug Fixes

* fetch node regex ([e2af232](e2af2326f6))
 2024-11-21 09:28:18 +00:00
Marco Vinciguerra
17f8f7282c
Merge pull request #817 from ScrapeGraphAI/refactoring_fetching 
fix: fetch node regex
 2024-11-21 10:26:53 +01:00
Marco Vinciguerra
e2af2326f6 fix: fetch node regex
Some checks failed
/ build (push) Has been cancelled
Details
2024-11-21 09:00:45 +01:00
semantic-release-bot
f247844d81 ci(release): 1.31.1-beta.2 [skip ci] 
## [1.31.1-beta.2](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.31.1-beta.1...v1.31.1-beta.2) (2024-11-20)

### Bug Fixes

* generate answer node timeout ([32ef554](32ef5547f1))
 2024-11-20 20:20:09 +00:00
Marco Vinciguerra
32ef5547f1 fix: generate answer node timeout 2024-11-20 21:18:38 +01:00
semantic-release-bot
86bf4f2402 ci(release): 1.31.1-beta.1 [skip ci] 
## [1.31.1-beta.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.31.0...v1.31.1-beta.1) (2024-11-20)

### Bug Fixes

* timeout ([c243106](c243106552))

### CI

* **release:** 1.31.0-beta.1 [skip ci] ([1df7eb0](1df7eb0bcd)), closes [#805](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/805) [#805](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/805)
 2024-11-20 07:11:07 +00:00
Marco Vinciguerra
1b1fef9f7e
Merge pull request #816 from ScrapeGraphAI/811-the-timeout-is-not-being-respected 2024-11-20 08:09:36 +01:00
Marco Vinciguerra
c243106552 fix: timeout 2024-11-19 21:01:05 +01:00
Marco Vinciguerra
1dee185346
Merge pull request #814 from ScrapeGraphAI/temp 
allignement
 2024-11-19 20:55:11 +01:00
Marco Vinciguerra
6b29827c09
Merge branch 'pre/beta' into temp 2024-11-19 20:49:09 +01:00
Marco Vinciguerra
2f3cafeab0 fix: add new model istance 2024-11-19 20:48:04 +01:00
Lorenzo Padoan
7c20fbe565
Update FUNDING.yml
Some checks failed
CodeQL / Analyze (python) (push) Has been cancelled
Details
/ build (push) Has been cancelled
Details
Release / Build (push) Has been cancelled
Details
Release / Release (push) Has been cancelled
Details
2024-11-19 17:53:54 +01:00
semantic-release-bot
1df7eb0bcd ci(release): 1.31.0-beta.1 [skip ci] 
## [1.31.0-beta.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.30.0...v1.31.0-beta.1) (2024-11-19)

### Features

* refactoring of generate answer node ([1f465e6](1f465e636d))
* Turkish language support has been added to README.md ([60f673d](60f673dc39))

### Bug Fixes

* fix generate answer node ([d332e21](d332e216db))
* generate answer node ([49897c4](49897c4d2e))
* try to infer possible provider from the model name, resolves [#805](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/805) ([d2d0312](d2d0312dc6))

### Docs

* Improved Turkish README ([f665138](f665138b3d))

### CI

* **release:** 1.30.0-beta.1 [skip ci] ([d996147](d996147f01))
* **release:** 1.30.0-beta.2 [skip ci] ([3e8c043](3e8c043473))
* **release:** 1.30.0-beta.3 [skip ci] ([0255007](02550077f1))
* **release:** 1.30.0-beta.4 [skip ci] ([777a685](777a68554e))
* **release:** 1.30.0-beta.5 [skip ci] ([af901a5](af901a54cf)), closes [#805](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/805)
 2024-11-19 07:01:45 +00:00
semantic-release-bot
2e4f25ca5f ci(release): 1.31.0 [skip ci] 
## [1.31.0](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.30.0...v1.31.0) (2024-11-19)

### Features

* refactoring of generate answer node ([1f465e6](1f465e636d))
* Turkish language support has been added to README.md ([60f673d](60f673dc39))

### Bug Fixes

* fix generate answer node ([d332e21](d332e216db))
* generate answer node ([49897c4](49897c4d2e))
* try to infer possible provider from the model name, resolves [#805](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/805) ([d2d0312](d2d0312dc6))

### Docs

* Improved Turkish README ([f665138](f665138b3d))

### CI

* **release:** 1.30.0-beta.1 [skip ci] ([d996147](d996147f01))
* **release:** 1.30.0-beta.2 [skip ci] ([3e8c043](3e8c043473))
* **release:** 1.30.0-beta.3 [skip ci] ([0255007](02550077f1))
* **release:** 1.30.0-beta.4 [skip ci] ([777a685](777a68554e))
* **release:** 1.30.0-beta.5 [skip ci] ([af901a5](af901a54cf)), closes [#805](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/805)
 2024-11-19 07:00:14 +00:00
Marco Vinciguerra
1c090cbc17
Merge pull request #808 from ScrapeGraphAI/main 
allignment
 2024-11-19 08:00:12 +01:00
Marco Vinciguerra
98cf5f1f83
Merge branch 'pre/beta' into main 2024-11-19 07:58:28 +01:00
Lorenzo Padoan
5dfda11cef
Update FUNDING.yml 2024-11-18 17:59:18 +01:00
Lorenzo Padoan
e99ddda6eb
Update FUNDING.yml 
Add open collective
 2024-11-18 17:56:54 +01:00
Marco Vinciguerra
a6269395a8 removed unused files
Some checks failed
CodeQL / Analyze (python) (push) Has been cancelled
Details
Release / Build (push) Has been cancelled
Details
Release / Release (push) Has been cancelled
Details
2024-11-18 14:28:32 +01:00
semantic-release-bot
af901a54cf ci(release): 1.30.0-beta.5 [skip ci] 
## [1.30.0-beta.5](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.30.0-beta.4...v1.30.0-beta.5) (2024-11-18)

### Bug Fixes

* try to infer possible provider from the model name, resolves [#805](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/805) ([d2d0312](d2d0312dc6))
 2024-11-18 10:47:46 +00:00
Marco Vinciguerra
8fd7b2422d
Merge pull request #806 from Levyathanus/pre/beta 
fix: try to infer possible provider from the model name, resolves #805
 2024-11-18 11:46:17 +01:00
Michele_Zenoni
d2d0312dc6 fix: try to infer possible provider from the model name, resolves #805 2024-11-17 20:04:30 +01:00
semantic-release-bot
777a68554e ci(release): 1.30.0-beta.4 [skip ci] 
## [1.30.0-beta.4](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.30.0-beta.3...v1.30.0-beta.4) (2024-11-16)

### Bug Fixes

* generate answer node ([49897c4](49897c4d2e))
 2024-11-16 15:33:48 +00:00
Marco Vinciguerra
bafc2b2cdc
Merge pull request #804 from ScrapeGraphAI/788-even-a-simplest-request-with-schema-doesnt-work 
fix: generate answer node
 2024-11-16 16:31:42 +01:00
Marco Vinciguerra
49897c4d2e fix: generate answer node 2024-11-16 16:30:57 +01:00
semantic-release-bot
02550077f1 ci(release): 1.30.0-beta.3 [skip ci] 
## [1.30.0-beta.3](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.30.0-beta.2...v1.30.0-beta.3) (2024-11-15)

### Features

* refactoring of generate answer node ([1f465e6](1f465e636d))
 2024-11-15 13:17:55 +00:00
Marco Vinciguerra
245b04d7e4
Merge pull request #802 from ScrapeGraphAI/798-timeout-in-llm-inference-hanging-state 
feat: refactoring of generate answer node
 2024-11-15 14:16:28 +01:00
Marco Vinciguerra
1f465e636d feat: refactoring of generate answer node 2024-11-15 14:15:08 +01:00
Peter Dave Hello
4a0872bec0 Clean up cache files to reduce Docker image size 
Remove unnecessary cache files and temporary data:
- Remove apt lists after package installation
- Use pip --no-cache-dir flag

Image size comparison:

```
REPOSITORY         TAG      IMAGE ID       CREATED          SIZE
scrapegraph-ai     after    609a2ecf4678   20 minutes ago   3.1GB
scrapegraph-ai     before   e3093b782ab0   24 minutes ago   3.39GB
```

This reduced about 0.29GB image size by preventing cache files from
being included in the final image layers.
 2024-11-15 03:19:48 +08:00
Marco Vinciguerra
5a100fb2e8
Merge pull request #796 from saied71/main
Some checks failed
CodeQL / Analyze (python) (push) Has been cancelled
Details
/ build (push) Has been cancelled
Details
Release / Build (push) Has been cancelled
Details
Release / Release (push) Has been cancelled
Details
2024-11-12 01:08:34 +01:00
saied71
5100fbb017 add html source support for source 2024-11-11 14:04:52 +03:30
Marco Vinciguerra
2159677295
Merge pull request #794 from bezineb5/patch-1
Some checks failed
CodeQL / Analyze (python) (push) Has been cancelled
Details
/ build (push) Has been cancelled
Details
Release / Build (push) Has been cancelled
Details
Release / Release (push) Has been cancelled
Details 
Fix output_parser for generate_answer_node
 2024-11-09 12:00:51 +01:00
semantic-release-bot
3e8c043473 ci(release): 1.30.0-beta.2 [skip ci] 
## [1.30.0-beta.2](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.30.0-beta.1...v1.30.0-beta.2) (2024-11-09)

### Bug Fixes

* fix generate answer node ([d332e21](d332e216db))

### Docs

* Improved Turkish README ([f665138](f665138b3d))
 2024-11-09 10:36:42 +00:00
Marco Vinciguerra
d332e216db fix: fix generate answer node 2024-11-09 11:35:04 +01:00
bezineb5
ebe0b0d56e
fix 2024-11-09 10:18:21 +01:00
Marco Vinciguerra
6f1a88f3e8
Merge pull request #792 from REDLANTERNDEV/turkish-language 2024-11-08 08:53:05 +01:00
REDLANTERNDEV
f665138b3d docs: Improved Turkish README 2024-11-07 19:27:36 +03:00
Lorenzo Padoan
b400cc5a66
Update README.md
Some checks failed
CodeQL / Analyze (python) (push) Has been cancelled
Details
/ build (push) Has been cancelled
Details
Release / Build (push) Has been cancelled
Details
Release / Release (push) Has been cancelled
Details
2024-11-07 16:02:19 +01:00