CodeCow/Scrapegraph-ai
1
0
Fork 0
mirror of https://github.com/VinciGit00/Scrapegraph-ai.git synced 2026-06-28 21:01:55 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

fix: parse node
Some checks failed
/ build (push) Has been cancelled
Details

Browse Source
This commit is contained in:
Marco Vinciguerra 2024-09-10 08:41:08 +02:00
parent f2bb22d8e9
commit 947ebd2895
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
scrapegraphai/nodes/parse_node.py
View File

@ -65,7 +65,7 @@ class ParseNode(BaseNode):
docs_transformed = input_data[0] docs_transformed = input_data[0]
if self.parse_html: if self.parse_html:
docs_transformed = Html2TextTransformer().transform_documents(input_data[0]) docs_transformed = Html2TextTransformer(ignore_links=False).transform_documents(input_data[0])
docs_transformed = docs_transformed[0] docs_transformed = docs_transformed[0]
chunks = chunk(text=docs_transformed.page_content, chunks = chunk(text=docs_transformed.page_content,