Smokedetector: What does Body Summary do?
I was trying to understand Smokey's internal workings for something I was working on, and I came across an option named body_summary, present in the Rule class.
I first came across this findspam.py, where multiple rules set this option to true (example). I was able to trace it's origin back to bodyfetcher.py, but after a lot of searching, I haven't yet understood what exactly this option does, and when a post's body is a "Body Summary".
Could someone please explain what's happening here, and what exactly this is used for?
fortunate-man
All 3 comments
Body summary is what we get from the websocket. I don't have an example to hand, but the realtime websocket that we get the feed from sends site, ID, and body summary, among other things. It's the first 300 or so characters of the post. As stuff comes in from the socket, we scan title and body summary; if they look like spam, we queue a full check immediately, otherwise it gets put in the bodyfetcher queue to get fully checked later.
ArtOfCode-
on 26 Jan 2019
Yep. The check is a bit hidden, but it's there.
Undo1
on 27 Jan 2019
Ok, thanks @ArtOfCode- @Undo1. That helps me a lot!
fortunate-man
on 27 Jan 2019
Related issues
iBug
路
8Comments
tripleee
路
3Comments
user12986714
路
7Comments
gparyani
路
4Comments
GrumpyCrouton
路
6Comments
Most helpful comment
Body summary is what we get from the websocket. I don't have an example to hand, but the realtime websocket that we get the feed from sends site, ID, and body summary, among other things. It's the first 300 or so characters of the post. As stuff comes in from the socket, we scan title and body summary; if they look like spam, we queue a full check immediately, otherwise it gets put in the bodyfetcher queue to get fully checked later.