Radarr: Increase TMDB Import List limit from 3 pages to no limit

[RandomNinjaAtk]

Is your feature request related to a problem? Please describe.
Yes, currently it seems the TMDB import list function is limited to a maximum of 3 pages. So I created a very large list of titles for auto import and 5 of the 8 pages are entirely skipped. This does not seem to be an issue with Trakt list importing because you can customize it.

Describe the solution you'd like
Add an option similar to the Trakt list integration to allow customization of import size limit

Describe alternatives you've considered
Not sure, kinda frustrated cause I just spent a very long time creating a list with over 1800 titles in it and can't use...

Additional context

[issue-label-bot[bot]]

Issue-Label Bot is automatically applying the label feature_request to this issue, with a confidence of 0.93. Please mark this comment with :thumbsup: or :thumbsdown: to give our bot feedback!

Links: app homepage, dashboard and code for this bot.

[RandomNinjaAtk]

After reviewing the code, this is a hard coded limit:

Source file: https://github.com/Radarr/Radarr/blob/develop/src/NzbDrone.Core/NetImport/TMDb/TMDbRequestGenerator.cs

Line 19 <-> 22

        public TMDbRequestGenerator()
        {
            MaxPages = 3;
        }

So if we can either make this a setting that can be changed via GUI or just up the default limit. I can easily write a pull request to set the number to larger limit, but that's about the extent of my skillset...

[fryfrog]

I thought the way this worked was that it would chug through them until they all got processed. So every time a movie gets added, the list goes down by one and more are shown. Is this not the case? How long did you let it go?

[RandomNinjaAtk]

@fryfrog I wish that was the case, does not appear to be that way in Aphrodite or older..

Edit:
After attempting to trace the issue further, looks like it could be a rate limit issue and not a page issue in Aphrodite

2020-2-12 11:42:18.7|Info|TMDbListImport|Importing TMDb movies from list: 118562
2020-2-12 11:42:18.7|Debug|TMDbListImport|Downloading List https://api.themoviedb.org/4/list/118562
2020-2-12 11:42:18.8|Trace|RateLimitService|Rate Limit triggered, delaying 'api.themoviedb.org' for 1.936 sec
2020-2-12 11:42:20.7|Trace|HttpClient|Req: [GET] https://api.themoviedb.org/4/list/118562
2020-2-12 11:42:20.7|Trace|ConfigService|Using default config value for 'proxyenabled' defaultValue:'False'
2020-2-12 11:42:20.8|Trace|HttpClient|Res: [GET] https://api.themoviedb.org/4/list/118562: 200.OK (130 ms)

There is 1896 items in the list and the library I have is still at less then 600 when combined with other lists, so its not importing all of the items from the list.

[Qstick]

API v4 should be returning all results now for TMDb lists.

[RandomNinjaAtk]

How do I test this? When I re-trigger net import sync, its still not picking up the list items. I don't get any errors anymore though...

The one list that is not an actor list, a custom list I created has 1896 items on it.

Now the debug log says this:

2020-2-12 16:14:22.7|Info|TMDbListImport|Importing TMDb movies from list: 118562
2020-2-12 16:14:22.7|Debug|TMDbListImport|Downloading List https://api.themoviedb.org/4/list/118562
2020-2-12 16:14:24.8|Debug|NetImportSearchService|Found 571 movies from list(s) Daniel Craig - 8784, Tom Cruise - 500, Bruce Willis - 62, Sigourney Weaver - 10205, Harrison Ford - 3, Matt Damon - 1892, Digital Collection
2020-2-12 16:14:24.8|Debug|MovieService|Updating 0 movie
2020-2-12 16:14:24.8|Debug|MovieService|0 movie updated

[Qstick]

Aphrodite was reverted back to v3 API for user lists thus it should be picking up everything on the list... the only thing that is page limited now is the popular lists.

[RandomNinjaAtk]

Thx for the update, I'll give it a try again. Last time I checked, I know it wasn't working but that was months ago at this point.

[RandomNinjaAtk]

We discussed this on chat, v3 api is limited to 500 results. So this is an issue, but not an easy fix. The only method to pull all is to use v4 api with paging, according to TMDB support forums...

[rcodehub]

Not sure if this is a related topic but when searching for new movies to add to Radarr if there are more than (X) number of similar titles you can never add all the movies if you don't specifically know what title to search for.

For example, if you wanted to add every Scooby Doo movie in existence by searching for them in the "Add Movies" search tab, it will bring up a bunch of movies, but will never show you every title because it always shows the same titles that have already been added.

[Qstick]

@rcodehub sounds like a completely separate issue, feel free to open another GitHub issue