Imgbrd-grabber: Add/update more local database options/documentations

Created on 9 May 2019  路  12Comments  路  Source: Bionus/imgbrd-grabber

Is your feature request related to a problem? Please describe

Right now the documentation refers to MyImouto's github which has since been deleted and hadn't been actively maintained anymore for a while, there are two forks of it both of which are abandoned as well.

As for Gelbooru... Well... 0.2 might never see publication and running 0.1 forever seems less than ideal...

Shimmie is... an eyesore to say the least and at best leaves us at a single technically viable option.

Describe the solution you'd like

Adding official Danbooru would be a good start, it's the mothership and keeps chugging along with active development.

Another booru that one may consider is szurubooru, I stumbled upon this one because there's a docker build in unRAID's Docker repo. (Community Apps)

Would be nice to see more options, preferable ones that have docker builds since that seems to be the hot new thing. (still have to warm up to it myself)

Describe alternatives you've considered

See above. :)

Additional context

I love this application!

documentation

All 12 comments

Indeed.

At the time I wrote this documentation, Danbooru's source code wasn't easily available, so I coudn't include it. And szurubooru didn't exist.

I'll have to see how easy they are to install, as Danbooru seems to rely on some annoying dependencies, while szurubooru uses Docker which is a pain to use and explain.

I love this application!

馃槃

So it's not just me who is a Docker dyslexic... And you are a dev and used to confusing documentation...

Frankly setting up szurubooru in Docker on unRAID was fairly easy in the end, however I still want to dabble in danbooru and see if the "Debian of boorus" might be worthier of my time, in the end I am after all entrusting thousands upon thousand of pictures and other stuff to it and I want to ride the path of active maintenance and support.

If you get to set it up I wouldn't mind taking help from you, because the deployment docs themselves claim to be iffy...

They SEEM alright to me at first glance, however I can already see the unexpected errors that'll take me hours to troubleshoot just because a dependency got updated in the time between documentation and my setup attempt.

Updated as in changing an environment variable or some other bullcrap. :D

Indeed.

At the time I wrote this documentation, Danbooru's source code wasn't easily available, so I coudn't include it. And szurubooru didn't exist.

I'll have to see how easy they are to install, as Danbooru seems to rely on some annoying dependencies, while szurubooru uses Docker which is a pain to use and explain.

I love this application!

馃槃

Feel free to follow this thread: https://github.com/r888888888/danbooru/issues/4085

I'll have a look. It seems to me that both heavily rely on docker though, which on one hand is a pain, but on the other means that explaining one also pretty much explains the other 馃

The other issue being that Docker on Windows sucks (hopefully the next update of Windows fixes that).

Danbooru is optimized for VM/bare metal as far as I understood it.

The Docker config file he talked about was just to explain steps how to set it up, because the file does the thijgs you would otherwise do... If I understood that correctly...

As for Docker in general... Ever thought of setting up a VM with Linux to tinker within? VirtualBox and Qemu have come a loooong way.

I'll have a look. It seems to me that both heavily rely on docker though, which on one hand is a pain, but on the other means that explaining one also pretty much explains the other 馃

The other issue being that Docker on Windows sucks (hopefully the next update of Windows fixes that).

Hey! Two things, firstly sorry for slacking on that German translation so far. I'll get around to work on that very soon, probably this weekend. I've been pretty busy and usually rather tired in my spare time when I had some and sitting at the desk translating is something I actually love to do, but when you're exhausted it's too daunting.

Second thing, good news! It's now EXTREMELY easy and very well documented to setup your own danbooru!

https://github.com/danbooru/danbooru/wiki/Ubuntu-Installation-Help-Guide

I used this guide and it worked perfectly. You don't even need the host-only network I think, at least my booru is setup to serve into my LAN and will happily serve pages to my other devices!

I'm running my VM on KVM (QEMU-based), but Virtualbox is even suggested. So either will work!

With how simple setting up a local danbooru has gotten I think we've just found the most ideal personal booru available.

I heard gelbooru 0.3 is in development and WILL be open-sourced. Well, as much as that's good to hear and that having options is ALWAYS good, I think for now I'm going to not wait around for much longer and finally properly store, tag and scrape my weeb content with the help of danbooru.

Thank you so much for considering this issue and not letting it get stale'd and closed. :)

Hey just an FYI szurubooru no longer depends on elasticsearch, it only needs postgres to run now. Additionally you don't need to know anything about that when using the docker-compose process -- which has also been simplified and is almost one-liner at this point.

Hey just an FYI szurubooru no longer depends on elasticsearch, it only needs postgres to run now. Additionally you don't need to know anything about that when using the docker-compose process -- which has also been simplified and is almost one-liner at this point.

I am using danbooru not for simplicity, but the feature richness, the vast community support and that I trust danbooru to exist for longer than szurubooru.

I have been running danbooru in a VM for several months now and am a VERY happy camper. I cannot recommend spending the time to deploy danbooru enough!

@FoxxMD Szurubooru took me less than 1h to have running and working with Grabber, so I added the docs here, it's indeed very straightforward:
https://github.com/Bionus/imgbrd-grabber/blob/develop/docs/_docs/commands/szurubooru.md

The only part that took me a while was writing the script to interface the API.


@GlassedSilver Honestly, while I can see why Danbooru is more powerful and why you wouldn't want to move away from it, I still think the setup remains too technical for most users (too many steps).

Using Docker like what Szurubooru does would be much more convenient, but given how much more complex the architecture is, I understand the reasons given by the developer as to why he doesn't.

Are you using it with Grabber?

Not sure if that was directed at Glassed or me. I am not using Grabber because I'm hosting my own szurubooru instance and it's really just for memes I personally find and want to archive.

BTW I think you could axe the whole Szurubooru download/installation/run/etc. sections and just include

  • note referencing install doc from szuru repo
  • the Configuration section (the tag categories seems important)

and then just get straight to the Grabber section. Users should be responsible for prereqs! It's shouldn't be your job to teach them.

Not sure if that was directed at Glassed or me. I am not using Grabber because I'm hosting my own szurubooru instance and it's really just for memes I personally find and want to archive.

Since you were posting here I thought you were also using Grabber, but oh well. 馃槄

BTW I think you could axe the whole Szurubooru download/installation/run/etc. sections and just include

  • note referencing install doc from szuru repo
  • the Configuration section (the tag categories seems important)

and then just get straight to the Grabber section. Users should be responsible for prereqs! It's shouldn't be your job to teach them.

I was actually considering this option, but then I remembered that many Grabber users are surprisingly not power users, so even just finding out you're supposed to configure a mounting point for the data storage in Docker might have been too much. Also, the setup mentions a bunch of stuff that could be confusing, such as editing configuration files, which is not necessary to a local installation.

Since in the end setting it up is so totally trivial anyway (big kudos to the devs for that, it's not always obvious), I just put the steps in there. The issue being if those steps change, it'll be out of date (I added a link to INSTALL.md at the top for that reason, but that's not really an optimal solution).

That makes sense. Kudos for understanding your audience and going the extra mile for them.

Was this page helpful?
0 / 5 - 0 ratings

Related issues

angaratosurion picture angaratosurion  路  8Comments

FirstDagger picture FirstDagger  路  3Comments

TheGho7t picture TheGho7t  路  4Comments

gabrielcesar16 picture gabrielcesar16  路  4Comments

satishbabariya picture satishbabariya  路  4Comments