Sherlock: Should we add adult websites?
Hey guys!
Recently I found out that Sherlock has been used by TraceLabs CTF participators. This means that Sherlock is being used to find missing people, which is awesome!!
This got me thinking, should we add support for adult websites? Because thinking from an investigator's point of view, I would want to know if my subject who committed an offense, has accounts on adult websites. Why? So that I could know if they might have left some traces there.
My plan is to create another repo, similar to sherlock-data, but specifically for adult websites. The reason why I want to separate the adult websites from the main list of sites is because the last thing I want to happen to you is that you are at work and you use the --browse option and a bunch of adult websites open up on your work computer.
I do not want to maintain the adult website list because I do not feel comfortable in doing so. So after I create the repo, if any of you guys want to maintain it, feel free to shoot me an email and I will give your write access to the repo which is dedicated to the adult websites.
Let me know what you guys think, I am open to ideas! :)
sdushantha
All 11 comments
The idea is Good sir
Sir If you don't mind
What about idea of searching for a
person/account using email-id instead of name, So that it may be precise.
On Sun, Jun 21, 2020, 12:23 PM Siddharth Dushantha notifications@github.com
wrote:
Hey guys!
Recently I found out that Sherlock has been used by TraceLabs CTF
https://www.tracelabs.org/getinvolved/ctf/ participators. This means
that Sherlock is being used to find missing people, which is awesome!!This got me thinking, should we add support for adult websites? Because
thinking from an investigator's point of view, I would want to know if my
subject who committed an offense, has accounts on adult websites. Why? So
that I could know if they might have left some traces there.My plan is to create another repo, similar to sherlock-data
https://github.com/sherlock-project/sherlock-data, but specifically for
adult websites. The reason why I want to separate the adult websites from
the main list of sites is because the last thing I want to happen to you is
that you are at work and you use the --browse option and a bunch of adult
websites open up on your work computer.I do not want to maintain the adult website list because I do not feel
comfortable in doing so. So after I create the repo, if any of you guys
want to maintain it, feel free to shoot me an email and I will give your
write access to the repo which is dedicated to the adult websites.Let me know what you guys think, I am open to ideas! :)
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/sherlock-project/sherlock/issues/654, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AOGMGD77JIBS5633MQKJJ43RXWU6HANCNFSM4ODXDXQQ
.
Niroshan23
on 21 Jun 2020
Very good idea!
We can add more features later, but, if u agree with me... more info is better then less info....
Luidiblu
on 22 Jun 2020
Hey guys!
Recently I found out that Sherlock has been used by TraceLabs CTF participators. This means that Sherlock is being used to find missing people, which is awesome!!
This got me thinking, should we add support for adult websites? Because thinking from an investigator's point of view, I would want to know if my subject who committed an offense, has accounts on adult websites. Why? So that I could know if they might have left some traces there.
My plan is to create another repo, similar to sherlock-data, but specifically for adult websites. The reason why I want to separate the adult websites from the main list of sites is because the last thing I want to happen to you is that you are at work and you use the
--browseoption and a bunch of adult websites open up on your work computer.I do not want to maintain the adult website list because I do not feel comfortable in doing so. So after I create the repo, if any of you guys want to maintain it, feel free to shoot me an email and I will give your write access to the repo which is dedicated to the adult websites.
Let me know what you guys think, I am open to ideas! :)
Why not just a query param? --adult?
Luidiblu
on 22 Jun 2020
@Luidiblu That's a great idea!! In the data.json file we could have a value called "NSFW" and it can have a Boolean value. The command line flag could be --nsfw
sdushantha
on 22 Jun 2020
Sure!
If the key "nsfw" is in the data.json file, you only can see it if insert the flag --nsfw
Luidiblu
on 22 Jun 2020
@sdushantha Remember that we talked about the general technique of grouping sites of a similar theme in #522. I don't think that we can add a command line option for every grouping of website: the command line list would explode.
Implementing tags would provide just one command line option to filter the search. For example, if the user wanted to search for a certain name on video sites, then the command would be as follows:
% python3 sherlock --tag video user123
As far as adult sites in Sherlock, I did not think we were going to do that. Or at least, not as a default. Any user can use the --json option to pass a JSON file with adult sites in it. If they do that, then no special option or tag is required: the site list would already have nothing but adult sites.
It would probably be a good idea to make the --json option additive: when the user has one of these options, it adds to the list of sites (instead of replacing them). This would allow people to use the option multiple times to build up a super-list of sites.
hoadlck
on 22 Jun 2020
@hoadlck Do you agree with me that instead of passing a json file, the person can change the local json??
We are complicating something that should be simple, many parameters, make things confusing, I agree with you, we can review and make the parameters more comprehensive
Luidiblu
on 22 Jun 2020
Remember that we talked about the general technique of grouping sites of a similar theme in #522. I don't think that we can add a command line option for every grouping of website: the command line list would explode.
@hoadlck Very true, I agree with you.
It would probably be a good idea to make the --json option additive: when the user has one of these options, it adds to the list of sites (instead of replacing them). This would allow people to use the option multiple times to build up a super-list of sites.
This seems like a great idea
Should I go ahead and create the adult site repo? @Luidiblu, would like you maintain it?
sdushantha
on 22 Jun 2020
Sure @sdushantha !
Luidiblu
on 22 Jun 2020
@satznova can we close this issue now?
Luidiblu
on 22 Jun 2020
@Luidiblu I'm guessing you were trying to mention me, but yes, I'll lose this now
sdushantha
on 23 Jun 2020
Related issues
nareddyt
·
4Comments
dewjiguang
·
3Comments
plgrazon
·
6Comments
PythonB
·
7Comments
moran04
·
3Comments
Most helpful comment
@sdushantha Remember that we talked about the general technique of grouping sites of a similar theme in #522. I don't think that we can add a command line option for every grouping of website: the command line list would explode.
Implementing tags would provide just one command line option to filter the search. For example, if the user wanted to search for a certain name on video sites, then the command would be as follows:
As far as adult sites in Sherlock, I did not think we were going to do that. Or at least, not as a default. Any user can use the
--jsonoption to pass a JSON file with adult sites in it. If they do that, then no special option or tag is required: the site list would already have nothing but adult sites.It would probably be a good idea to make the
--jsonoption additive: when the user has one of these options, it adds to the list of sites (instead of replacing them). This would allow people to use the option multiple times to build up a super-list of sites.