Uassets: History.com - Embedded videos [Anti-Adblock]
Affected sites:
Any site that features embedded videos from History.com (via akamaihd.net).
Issue:
The rule @@||history.com^$generichide (found in 'EasyList') only works for videos shown natively, at history.com.
A script injection rule is needed, to cover the videos which are embedded at other sites too.
Example:
Embedded video, at TV2.no:
https://www.tv2.no/nyheter/10624595/
(Scroll down to the embedded video, with the headline "Se video: – Hva i h...... er det der?!")
History.com's embedded link (region locked to Norway):
https://www.history.com/embed/1521526339504/
(For testing purposes, the EasyList rule needs to be disabled first: @@||history.com^$generichide,badfilter)
History.com's native article, featuring the same video:
https://www.history.com/videos/uss-roosevelt-gofast-ufo-declassified-video/
(For testing purposes, the EasyList rule needs to be disabled first: @@||history.com^$generichide,badfilter)
Note:
Since History.com seems to enforce highly specific region restrictions, troubleshooting this problem has proven to be a bit difficult.
Even when accessing the native page above, users might be redirected to a site closer to their location, as experienced by lassekongo83 here:
https://github.com/DandelionSprout/adfilt/issues/7#issuecomment-495987239
Screenshots (from the TV2.no page):
Current situation:
After having added @@||tv2.no^$generichide:
Elaboration:
As you can see from the screenshots above, $generichide will work for embdedded videos too.
But of course, this solution isn't very practical, as it would have to be used for every site where the videos are shown!
A semi-fix has been posted by DandelionSprout here:
https://github.com/DandelionSprout/adfilt/issues/7#issuecomment-495911260
..but it has some rather serious limitations.
Most importantly, since it removes the Play button, it gives the false impression that the embedded videos are nothing more than plain images!
Reference (outdated fix):
https://github.com/uBlockOrigin/uAssets/issues/804/
--
- OS/version: Windows 8.1 Pro (x64)
- Browser/version: Pale Moon v28.5.0 (x64)
- Adblock Extension/version: uBlock Origin v1.16.4.10 (XUL)
THEtomaso
All 48 comments
a $generichide as a badfilter? so anyone not using an adblocker would also be part of this.
ryanbr
on 2 Jun 2019
For testing purposes, the EasyList rule needs to be disabled first: @@||history.com^$generichide,badfilter
mapx-
on 2 Jun 2019
Anyways, here is a fix;
@@||amazon-adsystem.com/aax2/apstag.js$script,domain=history.com
ryanbr
on 2 Jun 2019
That fix doesn't work at all from my end.
Not even for the videos hosted natively at history.com
(Tested in Pale Moon and in Chromium-ungoogled)
THEtomaso
on 2 Jun 2019
Okay; how about this?
@@||cloudfront.net^$domain=history.com
@@||amazon-adsystem.com/aax2/apstag.js$script,domain=history.com
Nope, that doesn't work either.
I've spent a fair amount of time troubleshooting this myself.
If the solution was as simple as whitelisting or blocking a few scripts, I think I would have figured it out by now.
Like I pointed out in the first post; some type of a script injection rule might be needed in this case.
THEtomaso
on 2 Jun 2019
I can't reproduce it anymore, essentially those 2 whitelists fix the "disable adblock". tl;dr works for me.
ryanbr
on 2 Jun 2019
Indeed they seem to have a lot of regional restrictions in place, making this whole thing very difficult to reproduce, depending on your location.
If seomeone want to have a go, testing this from my location, you'll find some free Norwegian proxies here:
http://spys.one/free-proxy-list/NO/
THEtomaso
on 2 Jun 2019
testing what ? which is the link / page / video to test ?
mapx-
on 2 Jun 2019
testing what ?
All of that which is listed in the first post, of course.
THEtomaso
on 2 Jun 2019
I tested https://www.history.com/embed/1521526339504 (us ip / norv ip) all fine here, no anti adb message.
(using default settings + norv list)
mapx-
on 2 Jun 2019
Tested under which circumstances?
As I've already pointed out; @@||history.com^$generichide (found in 'EasyList') effectively kills the adblock detection at history.com, but doesn't help for the same videos when they're embedded elsewhere.
THEtomaso
on 2 Jun 2019
this video (the same from the embedded one above) is working fine
https://www.tv2.no/nyheter/9562173/
so, you are searching for a general fix, otherwise the single videos can be easily fixed, right ?
I guess there is no general fix and it depends on how the embedded videos are managed by the various hosting pages
mapx-
on 2 Jun 2019
so, you are searching for a general fix, otherwise the single videos can be easily fixed, right ?
Yes, $generichide could be used for every single site, which features embedded videos from History.com.
My assumption though, is that a single script injection rule should be able to fix the issue for all sites.
..although, I don't know if such a fix is even possible.
THEtomaso
on 2 Jun 2019
mapx : this video (the same from the embedded one above) is working fine
https://www.tv2.no/nyheter/9562173/
Because you checked a wrong video.
kulfoon
on 2 Jun 2019
Yeah, he probably did.
It's not the big one (at the top of the page), but the smaller one (further down).
..like stated in my first post:
Scroll down to the embedded video, with the headline "Se video: – Hva i h...... er det der?!"
Nevertheless, I think it has been made quite clear now, what the problem is.
THEtomaso
on 2 Jun 2019
This is because $generichide is not applied to iframe. It works in ABP/AdBlock. I think this is not first issue about this. I remember something about streaming site(?), anyone recall? @gorhill is't this a bug? Maybe it should be changed?
gwarser
on 2 Jun 2019
@gorhill is't this a bug?
Seems like it, generichide should definitely be applied:
gorhill
on 3 Jun 2019
To be clear, what I reported above is with 1.19.7rc1 -- I had failed to notice the bug report was for 1.16.4.10.
So latest uBO is affected as well and I find this baffling that this bug was not spotted before. The generichide filter had been evaluated for the root context all this time, while it must be evaluated for the frame context.
gorhill
on 3 Jun 2019
I think it was not spotted before because the filter
@@||example.com^$generichide
get's applied to all 3rd-party iframes of example.com.
As a result the iframes of
example1.com, example2.com etc are all automatically fixed.
This case is slightly different and unusal, there is an existing filter
@@||example1.com^$generichide
but no filter
@@||example.com^$generichide.
Furthermore I could/can not reproduce the issue of the OP because I do not have a norwegian IP.
I tried with a EU and US IP.
okiehsch
on 3 Jun 2019
So I guess I won't consider it an emergency fix but it feels really bad to have this in there, and since at least 1.16.0 apparently. I have a fix for current uBO, not sure if the fix is trivial for legacy.
gorhill
on 3 Jun 2019
The issue that a 3rd-party iframe triggers an anti-adblock warning is quite common on warez/streaming sites but we have always fixed it with a generichide filter of the 1st-party domain because most of those sites use different streaming services and the 1st-party generichide filter fixes the issue for all of them.
TL;DR I don't think an emergency fix is necessary.
okiehsch
on 3 Jun 2019
Probably this is this streaming site issue: https://github.com/uBlockOrigin/uAssets/issues/2929#issuecomment-406688308
Don't know how much it differs now, but in uBlock 0.9.5.16 also does not work.
gwarser
on 3 Jun 2019
And this is also similar, but with popup option: https://github.com/uBlockOrigin/uAssets/issues/5116#issuecomment-471895337
gwarser
on 3 Jun 2019
popup is a completely different code path and semantic, so if there is an issue with it it needs to be filed as a separate issue.
gorhill
on 3 Jun 2019
https://github.com/gorhill/uBlock/commit/2eb9b726a59e4959f40e487d00c595660d41b3fe
https://github.com/gorhill/uBlock/commit/53f3e413f355e84893dc75230cd48d0385ff70e7
Yes, this fixed the problem!
Great job!
And special thanks, for taking your time to update the Legacy branch too!! :+1:
I'm closing this report then.
THEtomaso
on 3 Jun 2019
Top document generichide exception does not affect iframes now?
gwarser
on 3 Jun 2019
I was never supposed to affect iframes, it's a filter which is to apply in the local context, as per ABP filter syntax.
gorhill
on 3 Jun 2019
Anti-adblock is back, see https://old.reddit.com/r/uBlockOrigin/comments/davuwj/cant_get_around_the_adblock_blocker_on_historycom/
Test URL: https://www.history.com/shows/forged-in-fire/season-6/episode-30 NA geolock
@okiehsch Please add
||history.com/vendor/sourcepoint-bootstrap.js
||sourcepoint-mms.history.com^
llacb47
on 29 Sep 2019
Did you test these filters ?
https://github.com/uBlockOrigin/uAssets/commit/5986a37587f471c89df6549ad20d6d8b24616f13
I used for test this page
https://www.history.com/topics/us-government/before-the-supreme-court-sonia-sotomayor-saved-baseball-video?cmpid=HV_O_Site_H_HP_SOTOMAYOR
with your filters I still get the anti adb msg
mapx-
on 29 Sep 2019
That is a different type of video @mapx- and the whitelist added in https://github.com/uBlockOrigin/uAssets/commit/5986a37587f471c89df6549ad20d6d8b24616f13 lets through alot of ads and tracking.
I don't get any anti-adblock on that page with or without those filters.
And the filters added in https://github.com/uBlockOrigin/uAssets/commit/5986a37587f471c89df6549ad20d6d8b24616f13 break playback for https://www.history.com/shows/forged-in-fire/season-6/episode-30
@jspenguin2017 https://www.history.com/topics/us-government/before-the-supreme-court-sonia-sotomayor-saved-baseball-video?cmpid=HV_O_Site_H_HP_SOTOMAYOR will not play in Nano FYI.
llacb47
on 29 Sep 2019
How could break the playback 2 exceptions ?
mapx-
on 29 Sep 2019
@mapx- ok. I found better filters
Replace @@*$xhr,domain=history.com with @@||mavencoalition.io^$xmlhttprequest,domain=history.com
and add history.com##.m-header-ad:style(height:2px!important) for placeholder
llacb47
on 29 Sep 2019
the second does not work, I'll keep history.com#@#.m-in-content-ad-row
mapx-
on 29 Sep 2019
instead for your video are working these same filters ?
mapx-
on 29 Sep 2019
@llacb47 Can't reproduce with latest filters.
jspenguin2017
on 29 Sep 2019
https://www.history.com/topics/us-government/before-the-supreme-court-sonia-sotomayor-saved-baseball-video?cmpid=HV_O_Site_H_HP_SOTOMAYOR will not play in Nano.
Not in uBO either, at my end.
I only get a black screen, both in Chromium-ungoogled and in Pale Moon.
THEtomaso
on 29 Sep 2019
black screen using european ip, I needed us ip to test the issue
mapx-
on 29 Sep 2019
I have US IP but I can reproduce https://github.com/uBlockOrigin/uAssets/issues/5704#issuecomment-536333577 only in Nano, @thetomaso are your filter lists updated?
llacb47
on 29 Sep 2019
add history.com##phoenix-balloon-header
also add
||history.com/vendor/sourcepoint-bootstrap.js
||sourcepoint-mms.history.com^
From https://github.com/uBlockOrigin/uAssets/issues/5704#issuecomment-536322087, these are tracking and a backup way to stop the anti-adblock
llacb47
on 29 Sep 2019
are your filter lists updated?
Of course.
THEtomaso
on 29 Sep 2019
I am puzzled, even in Chrome Guest mode the video doesn't play. This must be a Chromium bug...
For example, on https://www.history.com/topics/immigration/ellis-island the main video at the top does not load in/show up. However, the video under the heading Ellis Island Timeline loads and plays. 😕
llacb47
on 29 Sep 2019
It plays fine for me. I can't support random browsers, I will only test on the official Google Chrome and the official Chromium build for Ubuntu (distributed by Canonical).
jspenguin2017
on 30 Sep 2019
I'm testing on the latest Google Chrome.
llacb47
on 30 Sep 2019
Could be GeoLock then.
jspenguin2017
on 30 Sep 2019
Nope, I'm in US and signed in with cable provider.
llacb47
on 30 Sep 2019
This works 100% of the time for me. Try a fresh profile, could be your settings.
jspenguin2017
on 1 Oct 2019
Fresh profile still does not work... What is going on
llacb47
on 1 Oct 2019
Related issues
BurungHantu1605
·
3Comments
Jose1971AB
·
3Comments
patrickdrd
·
3Comments
ghost
·
3Comments
patrickdrd
·
4Comments