Semanticmediawiki: Slow page load with a lot of functions, calculations and ask constructions

[askurashev]

Hello.
I love SMW and it is at the heart of my pet project.
In templates, I use a lot of parser functions, various calculations and, of course, a lot of ask constructions.
However, such templates lead to the fact that the pages on which it is inserted take a very long time, including loading sometimes with a 500 error.
My question is as follows. How can you facilitate / speed up such pages? Naturally, I use caching, try to optimize queries, but there are still a lot of them.
Is it possible to somehow do so that the races, if constructions are not executed when the page is loaded, but, say, on schedule, separately.
What I mean. For example, I have a catalog of scientific publications. For each publication, I form a snippet with the output data and use it on other pages (for example, in the list of publications of a specific author). How to make this snippet form independently, for example, every day a script / program, go through all the publications and form snippets for them.

[kghbln]

The 500 error most probably comes from memory exhaustion, so lifting the limit here may help short term.

Perhaps using subpages to the subject page which are individually edited but transcluded on the subject page may help here. I guess this is a matter of trying if it works out and provides the expected results.

[askurashev]

Thanks for your feedback, @kghbln.
Yes, as an option, I can split the page into subpages. But will I be able to request variables from page to subpage and vice versa? And the second thing. On my site, semantic properties include data that can change. On the page where this data is requested, it is not updated until the page is manually refreshed with a cache reset. Is there some mechanism for cascading data refresh in SMW?
That is, in the case of subpages, in order for the main page to be relevant, I will have to update all subpages.

[kghbln]

Yes, as an option, I can split the page into subpages. But will I be able to request variables from page to subpage and vice versa?

I guess you will have to test. I am not absolutely sure if page scope variables work on transclusion.

Is there some mechanism for cascading data refresh in SMW?

Have a look at embedded query updates. Moreover you can do a "shallow-update" on a regular basis via cron or even a full data rebuild, probably category specific to not overdo it. See "rebuildData.php" script

[kimcollin]

I bet I know what to do give me a hr

On Wed, Feb 10, 2021 at 6:07 AM Anton Kurashev [e-mail]
wrote:

Thanks for your feedback, @kghbln https://github.com/kghbln.
Yes, as an option, I can split the page into subpages. But will I be able
to request variables from page to subpage and vice versa? And the second
thing. On my site, semantic properties include data that can change. On the
page where this data is requested, it is not updated until the page is
manually refreshed with a cache reset. Is there some mechanism for
cascading data refresh in SMW?

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/SemanticMediaWiki/SemanticMediaWiki/issues/4928#issuecomment-776632365,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ACHE5IKD2AQ457MC2AO6A4LS6JSIHANCNFSM4XMQWEWA
.

>

Kimberly Ann Collins

[askurashev]

Thanks.