HTML tags should be removed when classifying a page for Brave ads otherwise the classifier will likely return "Technology & Computing-Software"
Actual result:
Page is classified as "technology & computing-software"
Expected result:
Page should be classified as "law-law"
Reproduces how often: [Easily reproduced, Intermittent Issue]
Easily reproduced
Brave Version:
Device details:
Website problems only:
Search for "Successfully classified page at" in the logs to see the page classification
Only stripping html tags is enough, or do we need to do more like extracting only <body> contents or removing css/script contents?
We're going to just use document.body.innerText as it provides the most accurate and quickest solution
I can confirm that tests @kylehickinson showed me using document.body.innerText are as good as the desktop page classification
Verification passed on iPhone XR with iOS 13.2 running 1.14(19.11.22.15)
Verification passed on iPhone 7+ with iOS 13.2 running 1.14(19.11.22.15)
Verification passed on iPhone 6 with iOS 12.4 running 1.14(19.11.22.15)
Verification passed on iPad Pro with iOS 13.2 running 1.14(19.11.22.15)
Verification passed on iPad Pro with iOS 12.4 running 1.14(19.11.22.15)
Most helpful comment
We're going to just use
document.body.innerTextas it provides the most accurate and quickest solution