mirror of
https://github.com/VinciGit00/Scrapegraph-ai.git
synced 2026-06-23 21:00:30 +08:00
d845a1ba7d
This commit enhances the test suite for the JSON scraping pipeline by introducing the following improvements: - Separate configuration from the test code by loading it from a JSON file (config.json) - Use a parametrized fixture to run the test with multiple configurations automatically - Read the sample JSON file from a separate inputs directory for better organization - Add explicit assertions to verify the expected output (list of titles) - Improve test organization and separation of concerns using fixtures - Promote better coding practices and make the test suite more extensible These changes aim to improve the testability, maintainability, and flexibility of the test suite. They make it easier to manage configurations, add or modify test cases, and ensure the robustness of the scraping pipeline. The test suite now follows best practices and is better prepared for future changes and requirements. |
||
|---|---|---|
| .. | ||
| inputs | ||
| scrape_json_ollama.py | ||
| scrape_plain_text_llama3_test.py | ||
| scrape_plain_text_mistral_test.py | ||
| scrape_xml_ollama_test.py | ||
| script_generator_test.py | ||
| smart_scraper_ernie_test.py | ||
| smart_scraper_ollama_test.py | ||