Jackett: [req] add spanish tracker divxtotal

[fryfrog]

https://github.com/Jackett/Jackett/wiki/How-to-request-a-new-tracker

^ Might help you get it going, maybe even all by yourself. :)

[antoniogmartin]

But... What am i supossed to do? Create a file with categories from the webpage?
like this one:
AddMultiCategoryMapping(TorznabCatType.TVAnime,116, 140, 151, 117, 141, 152, 148);

[ghost]

@antoniogmartin
Have a look in here https://github.com/Jackett/Jackett/tree/master/src/Jackett/Definitions for examples of other trackers
and if you are familiar with html you will probably be able to create your own definition

[RmG152]

Main URL
http://www.newpct.com

Query
index.php?l=doSearch&q=FILMORSHOWTOSEARCH&category_=CATEGORY&idioma_=1&bus_de_=All

// Games
AddMultiCategoryMapping( TorznabCatType.PCGames, 47);
// Software
AddMultiCategoryMapping( TorznabCatType.PC, 125);
//Tv-HDTV, ERIE-ES-ES-HDTV, SERIE-VOSTES-ES-SD, SERIE-ES-ES-WEB, SERIE-ES-ES-WEB-RIP
AddMultiCategoryMapping(TorznabCatType.TVSD, 767,924);
//Tv-HDTV-720p, SERIE-ES-ES-HDTV-720p, SERIE-ES-ES-DVDrip, SERIE-ES-ES-BDrip, SERIE-ES-ES-MHD, SERIE-ES-ES-BluRay, SERIE-ES-ES-DVD, SERIE-VOSTES-ES-HD, SERIE-ES-ES-WEB-720p, SERIE-ES-ES-WEB-1080p, SERIE-ES-ES-WEB-RIP-720p, SERIE-ES-ES-WEB-RIP-1080p
AddMultiCategoryMapping(TorznabCatType.TVHD,1469);
//DVDRIP, DVDR-PAL, DVDR-NTSC, DVDR-FULL
AddMultiCategoryMapping(TorznabCatType.MoviesDVD,757,1921);
//BDRIP, HD-BLURAY
AddMultiCategoryMapping(TorznabCatType.MoviesBluRay, 1027);
//mHD-720p, mHD-1080p, HDRIP-720p, HDRIP-1080p
AddMultiCategoryMapping(TorznabCatType.MoviesHD, 1027);
//3d
AddMultiCategoryMapping(TorznabCatType.Movies3D, 1599);
//OtherFilms
AddMultiCategoryMapping(TorznabCatType.MoviesOther, 1921,3049,1527);
//DOCUMENTAIRES, DOCUMENTAIRES-HD
AddMultiCategoryMapping(TorznabCatType.TVDocumentary, 780);
//SERIE-VOSTES-ES-PACK, SERIE-ES-ES-PACK, VOSTES-ES, SUBPACK
AddMultiCategoryMapping(TorznabCatType.TV, 775);
//FILM-VOSTES-ES-PACK, FILM-ES-ES-PACK, FILM-ES, SUBPACK
AddMultiCategoryMapping(TorznabCatType.Movies, 778);
//TVSport
AddMultiCategoryMapping(TorznabCatType.TVSport, 822);
//Other
AddMultiCategoryMapping(TorznabCatType.OtherMisc, 827);

[imperativeoz]

Would love this to be added. How can I help? what is the next step?

[kaso17]

If you know a little about HTML/CSS selectors you might want to look at https://github.com/Jackett/Jackett/wiki/Definition-format

[josel2000]

I give a vote in favor I am interested also in that they work Spanish torrent

[kijart]

This can be used as a starting point for elitetorrent.eu and elitetorrent.biz. Could someone help on tests and improvements?

• elitetorrent-eu.yml.txt
• elitetorrent-biz.yml.txt

[xavisbd]

Hi @kijart if you tell me what I can help you to test.

[Aokromes]

newpct group (tumejortorrent, newpct, descargas2020, tvsinpager, torrentlocura): https://github.com/Jackett/Jackett/commit/ef22d43f463a94b7b1a9ec90f846fe64881ac05a

[rovik0]

This can be used as a starting point for elitetorrent.eu and elitetorrent.biz. Could someone help on tests and improvements?

* [elitetorrent-eu.yml.txt](https://github.com/Jackett/Jackett/files/1777440/elitetorrent-eu.yml.txt)

* [elitetorrent-biz.yml.txt](https://github.com/Jackett/Jackett/files/1777441/elitetorrent-biz.yml.txt)

I'm interested on having elitetorrent listed on jackett, we lack of spanish trackers over here and more and more are getting closed. Is this YML can be used directly with jackett as a working tracker or something? I've no clue how to use it.

[rovik0]

elitetorrent-biz.yml.txt looks like Jackett accepts and tests are ok but when I try to add it at Sonarr fails.

[garfield69]

yeah, elitetorrent-biz.yml is missing

      tv-search: [q, season, ep]
      movie-search: [q]

so Sonarr can't use it

[rovik0]

Tryed but no luck... This is the output , what I saw is that the API key is not filled so I was wondering that maybe there are some additional parameters to set up when adding an indexer.

TorznabRssParser An error occurred while processing feed item from http://x.x.x.x:xxxx/api/v2.0/indexers/elitetorrent-biz/results/torznab/api?t=tvsearch&cat=5030,5040&extended=1&apikey=(removed)&offset=0&limit=100: Value cannot be null. Parameter name: attribute

[garfield69]

I've improved it a bit so it returns valid fields, Sonarr needed the seeders.

---
  site: elitetorrent-biz
  name: EliteTorrent.biz
  description: "EliteTorrent.biz is a Public torrent site for TV, movies and documentaries"
  language: es-es
  type: public
  encoding: UTF-8
  links:
    - https://www.elitetorrent.biz/

  caps:
    categories:
      "series": TV
      "peliculas": Movies

    modes:
      search: [q]
      tv-search: [q, season, ep]
      movie-search: [q]

  settings: []

  download:
    selector: a[href^="magnet:?"]
    attribute: href 

  search:
    path: index.php
    inputs:
      s: "{{ .Keywords }}"
      $raw: "&x=0&y=0"
    rows:
      selector: "#principal .miniboxs-ficha li"
    fields:
      title:
        selector: .meta a
      details:
        selector: .meta a
        attribute: href
      download:
        selector: .meta a
        attribute: href
      category:
        selector: .meta a
        attribute: href
        filters:
          - name: split
            args: ["/", 3]
      size:
        selector: .voto1
        filters:
          - name: replace
            args: ["s", ""]
      date:
        text: now
      seeders:
        text: "1"
      leechers:
        text: "1"
      downloadvolumefactor:
        text: "0"
      uploadvolumefactor:
        text: "1"

but it still needs work, as the site does not use the SxxExx season/episode scheme, so Sonarr will not find any episodes for TV series.
Take a look at existing spanish and italian indexers for examples of the processing involved.

[kijart]

Thank you all for the improvements and comments, I'll try it next days to see if we are able to create a stable version of it.

[rovik0]

Wow this is awesome!! I would like to help but I need some guidance, what can I do?

[kijart]

I made some progress, the episodes format are normalized and now Sonarr is working well.

There is any way to retrieve seeders information from the torrent detail page, like for the download block?

Here is the yml file, if there is no way to get seeders information I can create a PR with it, even if is not fully perfect but functional.

  site: elitetorrent-biz
  name: EliteTorrent.biz
  description: "EliteTorrent.biz is a Public torrent site for TV, movies and documentaries"
  language: es-es
  type: public
  encoding: UTF-8
  links:
    - https://www.elitetorrent.biz/

  caps:
    categories:
      "series": TV
      "peliculas": Movies

    modes:
      search: [q]
      tv-search: [q, season, ep]
      movie-search: [q]

  settings: []

  download:
    selector: a[href^="magnet:?"]
    attribute: href

  search:
    path: index.php
    keywordsfilters:
      # most ES/ITA TV torrents are in XXxYY format, so we search without S/E prefixes and filter later
      - name: re_replace
        args: ["S0?(\\d{1,2})", " $1 "]
      - name: re_replace
        args: ["E(\\d{2,3})", " $1 "]
    inputs:
      s: "{{ .Keywords }}"
      $raw: "&x=0&y=0"
    rows:
      selector: "#principal .miniboxs-ficha li"
    fields:
      title:
        selector: .meta a
        # normalize to SXXEYY format
        filters:
          - name: re_replace
            args: ["(\\d{2})×(\\d{2})", "S$1E$2"]
          - name: re_replace
            args: ["(\\d{1})×(\\d{2})", "S0$1E$2"]
      details:
        selector: .meta a
        attribute: href
      download:
        selector: .meta a
        attribute: href
      category:
        selector: .meta a
        attribute: href
        filters:
          - name: split
            args: ["/", 3]
      size:
        selector: .voto1
        filters:
          - name: replace
            args: ["s", ""]
      date:
        text: now
      seeders:
        text: "1"
      leechers:
        text: "1"
      downloadvolumefactor:
        text: "0"
      uploadvolumefactor:
        text: "1"

[garfield69]

There is any way to retrieve seeders information from the torrent detail page, like for the download block?

the current implementation of the cardigann yaml processor requires that all the fields be on the primary results page to be processed.
the only exception is the download block which supports redirection to the details page to fetch the torrent/magnet link, which gets actioned when the user clicks on the download link.

reason for this is performance and politeness.
suppose the results page returned 100 torrents, jackett would need to then post 100 requests for the details of each torrent on the results page, causing a extended delay for the user (performance) , and excessive network traffic to the site (politeness) ;-)

[kijart]

Sure, it was only a doubt, thanks for the explanation.

What do you think, with my last updates is enough to make a PR and include it?

[garfield69]

go for it. don't forget to add an entry to the readme too. cheers.

[garfield69]

just one site left on the original list, divxtotal. its public so I'll build a cardigann indexer shortly. then we can close this ticket finally.

[garfield69]

Ahh. the tv series on divxtotal will require a native c# indexer, as the primary search result for vikings takes you to a secondary details page where all the individual episodes are listed. the candigann processor cannot currently handle this.

[garfield69]

Jackett 0.12.1486

[rovik0]

@garfield69 this means that Elitetorrent still is not a valid tracker and instead of that @ngosang majestically managed to add DivxTotal?

I mean, it returns correct results in Jackett but I can't add it into Sonarr, 'No results were returned from your indexer, please check your settings.'

[rovik0]

@ngosang On the other hand regarding DivxTotal (btw, nice job) it allows to add the tracker successfully and Jackett returns valid results with downloadable torrents (everything is ok apparently) but when performing a search it does not returns same results as Jackett.

Is there anything that needs to be considered along with this new tracker? Same happens with EliteTorrent?

[ngosang]

@rovik0 I did the basic implementation. I will improve it in the future => #6869
The thing is, none of the public Spanish trackers support the Sonarr / Scene format in the websites. We did the parser in Jackett for Mejortorrent and Newpct, but them still have flaws. I will work on all of them, but it will take time...

[rovik0]

I'll be happy to keep testing and give as much feedback as I can.

Thanks for the effort.

[ilike2burnthing]

Their skinned Cloudflare page _eventually_ fails to - ERR_TOO_MANY_REDIRECTS

[ilike2burnthing]

back up

[ilike2burnthing]

https://www.divxtotal.la/ - ERR_TOO_MANY_REDIRECTS again

[ilike2burnthing]

back up

[ilike2burnthing]

https://www.divxtotal.la/ - working

https://www.divxtotal.la/page/1/?s= - 503 Service Unavailable (previously Error 520 - Web server is returning an unknown error)

https://www.divxtotal.la/?s=2020 (or any search) - 503 Service Unavailable (previously Error 524 - A timeout occurred)

[ilike2burnthing]

https://www.divxtotal.la/ - Error 522 - Connection timed out

[ilike2burnthing]

https://www.divxtotal.la/ - working

https://www.divxtotal.la/page/1/?s= and https://www.divxtotal.la/?s=2020 (or any search):

• Error 503 - Backend fetch failed
• Error 524 - A timeout occurred
• Error al establecer una conexión con la base de datos
Failed to establish a connection to the database

[ilike2burnthing]

back up

[ilike2burnthing]

https://www.divxtotal.la/ - working

https://www.divxtotal.la/page/1/?s= and https://www.divxtotal.la/?s=2020 (or any search):

• Error 503 - Backend fetch failed
• Error 524 - A timeout occurred
• Error al establecer una conexión con la base de datos
Failed to establish a connection to the database

Last failure: 26.09.20 - 15:59 (GMT)

[garfield69]

online

[ilike2burnthing]

https://www.divxtotal.la/ - Error 503 - Backend fetch failed

[ilike2burnthing]

back up