It maybe a good idea to implement mechanisms through which we can dynamically start sampling the data from a source and also completely throttle events. This gives us the flexibility to dynamically change configs of a prospector to start sampling/throttling data from a give source if downstream starts to complain of over whelming data rates.
vjsamuel
All 6 comments
Related to: https://github.com/elastic/beats/issues/1721 for Packetbeat.
monicasarbu
on 30 Mar 2017
@vjsamuel I was thinking along the same lines. I started a suggestion for the idea: Rate limit published event. Perhaps you can add a comment and provide some ideas about what the end implementation might look like.
lcaballero
on 25 Sep 2018
need this function
wu0407
on 11 Apr 2019
I created a new meta-issue to track this request. Closing this one for now.
mostlyjason
on 15 Apr 2020
@mostlyjason Could you link it with this one, please?
amomchilov
on 16 Apr 2020
@amomchilov posted here https://github.com/elastic/beats/issues/17775
mostlyjason
on 16 Apr 2020
Related issues
nicpenning
路
3Comments
exekias
路
3Comments
geekpete
路
3Comments
ppf2
路
3Comments
tsg
路
4Comments
Most helpful comment
@amomchilov posted here https://github.com/elastic/beats/issues/17775