(Edited description to match the current scope of the issue)
Photon to not unnecessarily load additional resources. photon.js currently uses jQuery, but it doesn't look like there's much there that needs it. It can be re-written to vanilla js.
See above -- core's copy of jQuery is enqueued/loaded. To make matters worse, that version of jQuery has a known vulnerability (nothing to do with Jetpack, but that's what flagged this for me). https://snyk.io/vuln/npm:jquery?lh=1.12.4&utm_source=lighthouse&utm_medium=ref&utm_campaign=audit
Hm, that's interesting. I wasn't able to reproduce it with JN and local docker install. I do see jQuery requests (query.js?ver=1.12.4, jquery-migrate.min.js?ver=1.4.1) in network tab when only Photon module is enabled(https://github.com/Automattic/jetpack/blob/master/class.photon.php#L1019-L1033). I'm not sure if this is a correct way to do. How did you check that jQuery is loaded?
It's worth noting that even if you deactivate all modules, Jetpack still loads quite a few things, that are not linked to a specific module:
https://github.com/Automattic/jetpack/blob/ba02eabd81f42596fc1ba35afc46a342fd5a90f2/modules/module-extras.php#L8
Responsive Videos, for example, rely on jQuery and are loaded as soon as Jetpack is active, if your theme declares supports for it, and if it does not support Core Responsive embeds (which Twenty Nineteen does, so that would not be what caused the issue in your case).
Do you still have access to the site? If so, could you try to remove those extras, one at a time, and see if one of them seems to cause the issue?
I've just tried to reproduce this now, and I'm seeing the following; (TL;DR, can't reproduce).
With a completely empty JN site (fresh creation);
Sorry for the false alarm; I have no idea what was triggering it on the previous site.
I might open a separate issue though, to look at some of the other resources that definitely are loaded (Jetpack CSS, Devicepx) or are not minified (Twenty Nineteen compat CSS).
I did notice that enabling Site Accelerator definitely does enqueue jQuery (which I wouldn't expect):


I might open a separate issue though, to look at some of the other resources that definitely are loaded (Jetpack CSS, Devicepx) or are not minified (Twenty Nineteen compat CSS).
jetpack.css: I am afraid this is the way concatenation works today; the file is not aware of what modules and features are active or not, so it is always enqueued, just in case. That concatenated file includes CSS for the Responsive Videos theme tool for example, that may be in use on your site even if you don't have any module active. #1258 is a related issue.I did notice that enabling Site Accelerator definitely does enqueue jQuery (which I wouldn't expect):
Photon does indeed rely on jQuery:
https://github.com/Automattic/jetpack/blob/518984760e16cdcf24c52e5f8770adf7ee0f8ae4/class.photon.php#L1024
Photon looks like the culprit here, and that lines up with what I was testing, so I must have had it enabled when I saw jQuery previously.
I don't see anything in photon.js that _needs_ jQuery here. Looks like a somewhat easy refactor to vanilla js.
Most helpful comment
I don't see anything in photon.js that _needs_ jQuery here. Looks like a somewhat easy refactor to vanilla js.