Skip to content

fix(crawlers): Parse HTML responses starting with an XML declaration as HTML in ParselCrawler - #2262

Open
Mantisus wants to merge 1 commit into
apify:masterfrom
Mantisus:fix-parsel-112
Open

Mantisus wants to merge 1 commit into
apify:masterfrom
Mantisus:fix-parsel-112

Conversation

@Mantisus

Copy link
Copy Markdown
Collaborator

Description

  • ParselCrawler now parses text/html and application/xhtml+xml responses as HTML, even when the page starts with an XML declaration. Since parsel 1.12, such pages were parsed as XML, so CSS selectors and enqueue_links found nothing on XHTML pages.

@Mantisus Mantisus self-assigned this Sep 30, 2026
@Mantisus
Mantisus requested a review from Pijukatel September 30, 2026 15:34

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant