That happens many times about a few search engines like The Pirate Bay.
+1
a dynamic blacklist (for a certain number of hours) of engines in error (for example google !)
+1
une blacklist dynamique (pour un certain nombre d'heures) des moteurs en erreur (pour exemple google !)
This is actually implemented but the duration of the ban is only 5s currently. Every engine has a ban counter which is increased by the ban duration on every error.
Perhaps, we should make the fail ban duration configurable.
I don't know if piratebay wikidata page is updated. If yes something similar to
https://gitlab.com/Flockademic/whereisscihub
Could be used.
Most helpful comment
This is actually implemented but the duration of the ban is only 5s currently. Every engine has a ban counter which is increased by the ban duration on every error.
Perhaps, we should make the fail ban duration configurable.