News: Feed not automatically updated although it works when toggling the full text view switch

[j-ed]

IMPORTANT

Read and tick the following checkbox after you have created the issue or place an x inside the brackets ;)

• [x] I have read the CONTRIBUTING.md and followed the provided tips

Expected behavior

After successfully adding a new feed, it should be updated automatically.

Current behavior

A new feed, which can be added without a problem and also manually be updated by toggling the full text view switch, isn't automatically updated anymore. Log file entries which are related to an update problem cannot be found. All other subscribed feeds are updatedat the same time.

The feed url is https://www.presseportal.de/rss/dienststelle_65851.rss2

Steps to reproduce

1. Open the News app.
2. Add the mentioned feed.
3. Wait for any automatic update.
4. If no update happens, toggle the full text mode switch.

Environment

Server Configuration

OS: Linux 4.9.215
Web server: Apache2 2.4.41
Database: MariaDB 10.2.24
PHP version: 7.3.13
Nextcloud version: 18.0.3
News app version: 14.1.3

Client Configuration

Browser: Mozilla Firefox 75.0
Operating system: Windows 10

[theorangepotato]

I also see this issue. As another data point, I see it with the Matrix project RSS feed as well. For what it's worth, most of my feeds continue to update normally. Only a handful of them experience this issue.

I will also add my environment information as well:

Environment

Server Configuration

OS: Linux 5.0.15
Web server: Apache2 2.4.38
Database: MariaDB 10.3.20
PHP version: 7.2.24
Nextcloud version: 18.0.3 (Just upgraded to 18.0.4 today)
News app version: 14.1.3 (Just upgraded to 14.1.4 today)

Client Configuration

Browser: Mozilla Firefox 75.0
Operating system: Ubuntu 19.10

[Grotax]

Can you try the latest release 14.1.5 and report if its still the same.
14.1.4 and 14.1.5 both contained feed-io updates which is the underlying parsing library.

[TobiasDev]

Nextcloud version: 18.0.4
News version: 14.1.5

I'm seeing the same issue that my feeds are no longer updated (for me every feed I have has stopped updating). However, when I press the "Enable / Disable Full Text" it does re-load the feed and get's all new articles for most feeds. There is one or two that seems to not work at all.

If you let me know what to look for in the log-file and how to make sure there is no sensitive data in the log-file I could add it to this bug to see if there is anything helpful there?

Example of one feed that doesn't work: https://uxplanet.org/feed

[Grotax]

One thing I wanted to add we have had issues where the feed update would no longer work with previous versions. Various fixes were introduced in News and also feed-io. But if a feed got "stuck" it will not become available again unless you trigger full text or delete and re-add it because that forces a fresh fetch.

Some feeds might still be broken though for one the header we send at the moment seems to crash some servers, see #678

Regarding the log I don't know if there is a way to automatically remove sensitive data so I guess seach+replace is your friend

[TobiasDev]

Regarding the log I don't know if there is a way to automatically remove sensitive data so I guess seach+replace is your friend

Okay, I will look into this tomorrow then. I will try and clean the log so only logs from NEWS is there.

[TobiasDev]

I'm not seeing the issue today! Or at least not on the same feeds as yesterday! I'm going to give this a day or two and update the issue with more info if needed.

[theorangepotato]

Having updated to the News 14.1.5, I can give an update on my experiences: It seems that the feeds that I refreshed by enabling full text do continue to be updated properly. Those that were stuck have not automatically fixed themselves, but I seem to be able to enable full text to refresh them into working (n = 1, so this is anecdote moreso than evidence). I can also try to acquire logs if that would be helpful, as so far I do not know how to reproduce this issue on demand.

[j-ed]

I've now monitored the update behavior of the mentioned RSS feed (https://www.presseportal.de/rss/dienststelle_65851.rss2) and unfortunately it is still not being updated. I also removed the feed and re-added it again but without success.

First I checked that the feed itself has been updated:

Then I checked the Nextcloud log file for any related information:

{"reqId":"6E5TOuQqNo5K4A5K21XS","level":1,"time":"2020-05-05 08:35:12+02:00","remoteAddr":"","user":"--","app":"news","method":"","url":"/cron.php","message":"correct public id for node Presseportal.de - Kreispolizeibeh\u00f6rde Rhein-Kreis Neuss","userAgent":"--","version":"18.0.4.2"}
{"reqId":"6E5TOuQqNo5K4A5K21XS","level":0,"time":"2020-05-05 08:35:12+02:00","remoteAddr":"","user":"--","app":"news","method":"","url":"/cron.php","message":"Feed https://www.presseportal.de/rss/dienststelle_65851.rss2 was modified since last fetch. #0 items","userAgent":"--","version":"18.0.4.2"}
{"reqId":"6E5TOuQqNo5K4A5K21XS","level":0,"time":"2020-05-05 08:35:12+02:00","remoteAddr":"","user":"--","app":"cron","method":"","url":"/cron.php","message":"Finished OCA\\News\\Cron\\Updater job with ID 76 in 12 seconds","userAgent":"--","version":"18.0.4.2"}

I interpret the lines as if the change of the RSS feed is detected but no changed items were identified?! Is there anything else what I can do to narrow-down the problem?

[max-te]

I'm seeing the same behaviour with some of my feeds.
If there is anything I can do to help debug this, I'll be happy to help.

[stale[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

[theorangepotato]

I just checked and I believe I am still experiencing this problem (An article that came out 5 days ago did not show in my feed until just now when I refreshed it by clicking disable full text).

News Version: 14.1.11
Nextcloud Version: 18.0.4

[ballinger]

My feed list is a couple of years old, so I got many random subscriptions. Seems like most of them stopped working a while ago. Only way I know to refresh this is with toggling to full text or vice versa. News vers 14.1.11 nextc. Vers 18.0.4

[stale[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

[j-ed]

The problem still exists on NC 18.0.6 with the latest app release. Due to the fact that I can reproduce it on my server, I only need advice how to debug the issue.