Implement text extraction from raw HTML + client-side rendering (CSR) detection in QA#992
Draft
emma-sg wants to merge 22 commits into
Draft
Implement text extraction from raw HTML + client-side rendering (CSR) detection in QA#992emma-sg wants to merge 22 commits into
emma-sg wants to merge 22 commits into
Conversation
emma-sg
force-pushed
the
qa-csr-clues-and-text-compare
branch
from
March 11, 2026 20:41
ba2edf1 to
e40d96f
Compare
|
Review the following changes in direct dependencies. Learn more about Socket for GitHub.
|
emma-sg
changed the title
emma-sg
force-pushed
the
qa-csr-clues-and-text-compare
branch
from
March 23, 2026 18:13
4d5e40d to
dd299af
Compare
emma-sg
force-pushed
the
qa-csr-clues-and-text-compare
branch
from
March 31, 2026 18:21
ecb9577 to
80fd48e
Compare
ikreymer
reviewed
Mar 31, 2026
emma-sg
force-pushed
the
qa-csr-clues-and-text-compare
branch
from
March 31, 2026 19:34
9d7e1e6 to
41775c9
Compare
adds option to analyze replayed html content to detect csr clues such as framework indicators, hydration data, web components, and dom manipulation patterns to identify client-side rendered pages will follow with text analysis using & not using additional page resources
text removes replay issues from the comparison also removes checking for previously extracted raw text, since the archived items we're looking at currently were crawled before this branch was developed
- add self-closing empty div variant for modern frameworks - update Nuxt hydration pattern to catch __NUXT_DATA__ variant - improve web components patterns with clearer descriptions - add new DOM manipulation patterns: output/template elements - add iframe/object/embed elements for frames detection
emma-sg
force-pushed
the
qa-csr-clues-and-text-compare
branch
from
April 1, 2026 21:03
7a77443 to
f8bd4e5
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds option (
--qaDetectClientSideRendering) to analyze replayed html content to detect CSR clues such as framework indicators, hydration data, web components, and DOM manipulation patterns to identify client-side rendered pages. Output is written to theinfowarcs along with the rest of the page info (pages, comparison info, etc).Will follow up with extracted text analysis using & not using additional page resources.