CodeCow/Scrapegraph-ai
1
0
Fork 0
mirror of https://github.com/VinciGit00/Scrapegraph-ai.git synced 2026-07-09 21:19:20 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
2,303 Commits 2 Branches 448 Tags 17 MiB
5a100fb2e8
Commit Graph

2303 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Marco Vinciguerra
5a100fb2e8
Merge pull request #796 from saied71/main
Some checks failed
CodeQL / Analyze (python) (push) Has been cancelled
Details
/ build (push) Has been cancelled
Details
Release / Build (push) Has been cancelled
Details
Release / Release (push) Has been cancelled
Details
2024-11-12 01:08:34 +01:00
saied71
5100fbb017 add html source support for source 2024-11-11 14:04:52 +03:30
Marco Vinciguerra
2159677295
Merge pull request #794 from bezineb5/patch-1
Some checks failed
CodeQL / Analyze (python) (push) Has been cancelled
Details
/ build (push) Has been cancelled
Details
Release / Build (push) Has been cancelled
Details
Release / Release (push) Has been cancelled
Details 
Fix output_parser for generate_answer_node
 2024-11-09 12:00:51 +01:00
bezineb5
ebe0b0d56e
fix 2024-11-09 10:18:21 +01:00
Lorenzo Padoan
b400cc5a66
Update README.md
Some checks failed
CodeQL / Analyze (python) (push) Has been cancelled
Details
/ build (push) Has been cancelled
Details
Release / Build (push) Has been cancelled
Details
Release / Release (push) Has been cancelled
Details
2024-11-07 16:02:19 +01:00
Lorenzo Padoan
774df5410c
Update README.md 2024-11-07 16:00:13 +01:00
semantic-release-bot
12fa3155b4 ci(release): 1.30.0 [skip ci] 
## [1.30.0](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.29.0...v1.30.0) (2024-11-06)

### Features

* update chromium ([38c6dd2](38c6dd2aa1))
 2024-11-06 08:23:03 +00:00
Marco Vinciguerra
a12c83f6f9
Merge pull request #787 from ScrapeGraphAI/786-csr-client-side-rendering-web-pages-dont-work 
feat: update chromium
 2024-11-06 09:21:33 +01:00
Marco Vinciguerra
38c6dd2aa1 feat: update chromium 2024-11-04 09:21:29 +01:00
semantic-release-bot
65add5f46c ci(release): 1.29.0 [skip ci] 
## [1.29.0](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.28.0...v1.29.0) (2024-11-04)

### Features

* Serper API integration for Google search ([c218546](c218546a3d))

### Bug Fixes

* resolved outparser issue ([e8cabfd](e8cabfd1ae))

### CI

* **release:** 1.28.0-beta.3 [skip ci] ([65d39bb](65d39bbaf0))
* **release:** 1.28.0-beta.4 [skip ci] ([b90bb00](b90bb00beb))
* **release:** 1.29.0-beta.1 [skip ci] ([950e859](950e859b1b))
 2024-11-04 08:14:43 +00:00
Marco Vinciguerra
5faac9fb46
Merge pull request #784 from ScrapeGraphAI/pre/beta 
fixed json on generate answer
 2024-11-04 09:13:19 +01:00
semantic-release-bot
950e859b1b ci(release): 1.29.0-beta.1 [skip ci] 
## [1.29.0-beta.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.28.0...v1.29.0-beta.1) (2024-11-04)

### Features

* Serper API integration for Google search ([c218546](c218546a3d))

### Bug Fixes

* resolved outparser issue ([e8cabfd](e8cabfd1ae))

### CI

* **release:** 1.28.0-beta.3 [skip ci] ([65d39bb](65d39bbaf0))
* **release:** 1.28.0-beta.4 [skip ci] ([b90bb00](b90bb00beb))
 2024-11-04 08:10:24 +00:00
Marco Vinciguerra
8d7fd08730
Merge branch 'main' into pre/beta 2024-11-04 09:08:37 +01:00
semantic-release-bot
b90bb00beb ci(release): 1.28.0-beta.4 [skip ci] 
## [1.28.0-beta.4](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.28.0-beta.3...v1.28.0-beta.4) (2024-11-03)

### Bug Fixes

* resolved outparser issue ([e8cabfd](e8cabfd1ae))
 2024-11-03 16:57:13 +00:00
Marco Vinciguerra
ec667d21a0
Merge pull request #783 from aziz-ullah-khan/pre/beta 
fix: resolved outparser issue
 2024-11-03 17:55:33 +01:00
aziz-ullah-khan
7666a91f4f cleaning 2024-11-03 20:28:50 +05:00
aziz-ullah-khan
e8cabfd1ae fix: resolved outparser issue 2024-11-03 20:23:29 +05:00
semantic-release-bot
65d39bbaf0 ci(release): 1.28.0-beta.3 [skip ci] 
## [1.28.0-beta.3](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.28.0-beta.2...v1.28.0-beta.3) (2024-11-02)

### Features

* Serper API integration for Google search ([c218546](c218546a3d))
 2024-11-02 17:36:10 +00:00
Marco Vinciguerra
902699c8d2
Merge pull request #781 from aziz-ullah-khan/pre/beta 2024-11-02 18:34:51 +01:00
aziz-ullah-khan
c218546a3d feat: Serper API integration for Google search 2024-11-02 15:02:08 +05:00
semantic-release-bot
7b5010f949 ci(release): 1.28.0 [skip ci] 
## [1.28.0](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.27.0...v1.28.0) (2024-11-01)

### Features

* add new mistral models ([6914170](6914170890))
* refactoring of the base_graph ([12a6c18](12a6c18f6a))
* update generate answer ([7172b32](7172b32a0f))

### Bug Fixes

* **AbstractGraph:** manually select model tokens ([f79f399](f79f399ee0)), closes [#768](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/768)

### CI

* **release:** 1.27.0-beta.11 [skip ci] ([3b2cadc](3b2cadce1a))
* **release:** 1.27.0-beta.12 [skip ci] ([62369e3](62369e3e28))
* **release:** 1.27.0-beta.13 [skip ci] ([deed355](deed355551)), closes [#768](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/768)
* **release:** 1.28.0-beta.1 [skip ci] ([8cbe582](8cbe582ea9)), closes [#768](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/768) [#768](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/768)
* **release:** 1.28.0-beta.2 [skip ci] ([7e3598d](7e3598ddfa))
 2024-11-01 09:44:12 +00:00
Marco Vinciguerra
9f0ba35be6
Merge pull request #780 from ScrapeGraphAI/pre/beta 
Pre/beta
 2024-11-01 10:42:44 +01:00
Lorenzo Padoan
ea2ff5099b
Update funding.json
Some checks failed
CodeQL / Analyze (python) (push) Has been cancelled
Details
Release / Build (push) Has been cancelled
Details
Release / Release (push) Has been cancelled
Details
2024-10-31 10:36:11 +01:00
Lorenzo Padoan
a04be3eec5
Update funding.json 2024-10-31 10:35:34 +01:00
Lorenzo Padoan
5970594f58
Update funding.json 2024-10-31 10:32:26 +01:00
Lorenzo Padoan
463ade403b
Update funding.json 2024-10-31 10:31:50 +01:00
Lorenzo Padoan
59ad0a231f
Update funding.json 2024-10-31 10:30:29 +01:00
Lorenzo Padoan
a01ec4867d
Update funding.json 2024-10-31 10:23:05 +01:00
semantic-release-bot
7e3598ddfa ci(release): 1.28.0-beta.2 [skip ci] 
## [1.28.0-beta.2](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.28.0-beta.1...v1.28.0-beta.2) (2024-10-31)

### Features

* update generate answer ([7172b32](7172b32a0f))
 2024-10-31 09:21:45 +00:00
Federico Aguzzi
76e2820ff1
Merge pull request #778 from ScrapeGraphAI/refactoring-generate-answer 
feat: update generate answer
 2024-10-31 10:20:17 +01:00
Marco Vinciguerra
7440f3735e
Merge pull request #779 from ScrapeGraphAI/main 
allignment
 2024-10-31 09:06:15 +01:00
Marco Vinciguerra
c2b68095c1 Update funding.json 2024-10-30 18:07:40 +01:00
Marco Vinciguerra
b75fbd26c5 add funding 2024-10-30 18:04:41 +01:00
Marco Vinciguerra
655ef28069 Update funding.json 2024-10-30 17:52:34 +01:00
Marco Vinciguerra
542751d35b Update funding.json 2024-10-30 14:23:11 +01:00
semantic-release-bot
8cbe582ea9 ci(release): 1.28.0-beta.1 [skip ci] 
## [1.28.0-beta.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.27.0...v1.28.0-beta.1) (2024-10-30)

### Features

* add new mistral models ([6914170](6914170890))
* refactoring of the base_graph ([12a6c18](12a6c18f6a))

### Bug Fixes

* **AbstractGraph:** manually select model tokens ([f79f399](f79f399ee0)), closes [#768](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/768)

### CI

* **release:** 1.27.0-beta.11 [skip ci] ([3b2cadc](3b2cadce1a))
* **release:** 1.27.0-beta.12 [skip ci] ([62369e3](62369e3e28))
* **release:** 1.27.0-beta.13 [skip ci] ([deed355](deed355551)), closes [#768](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/768)
 2024-10-30 08:02:00 +00:00
Marco Vinciguerra
bb2373d7a2
Merge pull request #775 from U-C4N/main 
This commit focuses on optimizing the utility modules in the codebase…
 2024-10-30 09:00:33 +01:00
Marco Vinciguerra
09c967822d
Merge branch 'pre/beta' into main 2024-10-30 09:00:20 +01:00
Marco Vinciguerra
7172b32a0f feat: update generate answer 2024-10-30 08:59:13 +01:00
semantic-release-bot
deed355551 ci(release): 1.27.0-beta.13 [skip ci] 
## [1.27.0-beta.13](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.27.0-beta.12...v1.27.0-beta.13) (2024-10-29)

### Bug Fixes

* **AbstractGraph:** manually select model tokens ([f79f399](f79f399ee0)), closes [#768](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/768)
 2024-10-29 08:02:25 +00:00
Marco Vinciguerra
8ab726e9c1
Merge pull request #773 from ScrapeGraphAI/768-fix-model-tokens 
fix(AbstractGraph): manually select model tokens
 2024-10-29 09:00:46 +01:00
Umut CAN
827f7260ad This commit focuses on optimizing the utility modules in the codebase for better performance and maintainability. Key improvements include: - More efficient HTML processing with combined regex operations and optimized tag handling - Enhanced deep copy functionality with better type handling and optimized recursion - Refactored web search with improved error handling and modular helper functions The changes maintain all existing functionality while improving code quality, performance, and maintainability. Documentation and type hints have been enhanced throughout. 
Optimize utils modules for better performance and maintainability

- Improve HTML cleanup and minification:
  - Combine regex operations for better performance
  - Add better error handling for HTML processing
  - Optimize tag removal and attribute filtering

- Enhance deep copy functionality:
  - Add special case handling for primitive types
  - Improve type checking and error handling
  - Optimize recursive copying for collections

- Refactor web search functionality:
  - Add input validation and error handling
  - Split search logic into separate helper functions
  - Improve proxy handling and configuration
  - Add better timeout and error management
  - Optimize URL filtering and processing

Technical improvements:
- Better type hints and documentation
- More efficient data structures
- Improved error handling and validation
- Reduced code duplication
- Better separation of concerns

No breaking changes - all existing functionality maintained
 2024-10-28 22:40:32 +03:00
Federico Aguzzi
f79f399ee0 fix(AbstractGraph): manually select model tokens 
closes #768
 2024-10-28 14:51:39 +01:00
Marco Vinciguerra
2d91848b76 a
Some checks failed
CodeQL / Analyze (python) (push) Has been cancelled
Details
Release / Build (push) Has been cancelled
Details
Release / Release (push) Has been cancelled
Details
2024-10-28 14:16:47 +01:00
Marco Vinciguerra
15415eebbc Update funding.json 2024-10-28 14:15:24 +01:00
Marco Vinciguerra
bc19e898ae Update funding.json 2024-10-28 14:07:28 +01:00
Marco Vinciguerra
5ed28976d2 Update funding.json 2024-10-28 14:05:47 +01:00
Marco Vinciguerra
6418479f49 Update funding.json 2024-10-28 13:59:46 +01:00
Marco Vinciguerra
e97add5daf Update funding.json 2024-10-28 13:58:01 +01:00
Marco Vinciguerra
8a69fb5ccc Update funding.json 2024-10-28 13:55:23 +01:00