Scrapegraph-ai/scrapegraphai/utils
Marco Vinciguerra 95a5ee2d35
Merge pull request #680 from LorenzoPaleari/exec-info-enhanced
feat: added Bedrock and Mistral to exec info
2024-09-18 10:05:45 +02:00
..
screenshot_scraping fix(ScreenShotScraper): static import of optional dependencies 2024-09-04 15:00:30 +02:00
tokenizers feat: refactoring of the tokenization function 2024-09-12 20:21:00 +02:00
__init__.py feat: added Bedrock and Mistral to exec info 2024-09-18 02:02:38 +02:00
cleanup_html.py refactoring of the code 2024-08-23 11:33:22 +02:00
convert_to_csv.py refactoring of the code 2024-08-23 11:33:22 +02:00
convert_to_json.py refactoring of the code 2024-08-23 11:33:22 +02:00
convert_to_md.py refctoring of the code 2024-09-15 11:20:08 +02:00
copy.py refctoring of the code 2024-09-15 11:20:08 +02:00
custom_callback.py feat: added Bedrock and Mistral to exec info 2024-09-18 02:02:38 +02:00
llm_callback_manager.py feat: added Bedrock and Mistral to exec info 2024-09-18 02:02:38 +02:00
logging.py refactoring of the code 2024-08-23 11:33:22 +02:00
model_costs.py feat: added Bedrock and Mistral to exec info 2024-09-18 02:02:38 +02:00
output_parser.py refactor: Output parser code 2024-09-17 23:07:16 +02:00
parse_state_keys.py refctoring of the code 2024-09-15 11:20:08 +02:00
prettify_exec_info.py refactoring of the code 2024-09-11 16:04:43 +02:00
proxy_rotation.py refactoring of the code 2024-08-10 17:44:35 +02:00
research_web.py refactoring of the code 2024-09-11 16:04:43 +02:00
save_audio_from_bytes.py refctoring of the code 2024-09-15 11:20:08 +02:00
split_text_into_chunks.py use semchunk by default as the other code is causing tokenizers to be called for every individual word which is very slow especially with the mistral tokenizer 2024-09-12 08:46:52 +01:00
sys_dynamic_import.py refactoring of the code 2024-09-11 16:04:43 +02:00
tokenizer.py feat: refactoring of the tokenization function 2024-09-12 20:21:00 +02:00