Che: Che-Theia in Che deployed in an offline environment still need access to static.developers.redhat.com

Created on 2 Dec 2019 · 31Comments · Source: eclipse/che

Describe the bug

Che version

[x] latest
[ ] nightly
[ ] other: please specify

Steps to reproduce

Create Plugin and devfile registries for offline mode
Deploy Che with Helm ( or chectl) and configure it to use devfile and plugins registries created above
In administration tab create docker registry for the Docker proxy registry server
4. Create a workspace from a web browser that do not have internet access. The workspace starts, the green ball is displayed but Theia ide is not rendred.

Expected behavior

Runtime

[x] kubernetes (include output of kubectl version)
[ ] Openshift (include output of oc version)
[ ] minikube (include output of minikube version and kubectl version)
[ ] minishift (include output of minishift version and oc version)
[ ] docker-desktop + K8S (include output of docker version and kubectl version)
[ ] other: (please specify)

Screenshots

Installation method

[x] chectl
[ ] che-operator
[ ] minishift-addon
[ ] I don't know

Environment

[ ] my computer
- [x] Windows
- [ ] Linux
- [ ] macOS
[ ] Cloud
- [ ] Amazon
- [ ] Azure
- [ ] GCE
- [x] other (on premise )
[ ] other: please specify

Additional context

The needed resource to render Theia is a javascript hosted at :
https://static.developers.redhat.com/che/theia_artifacts/vendors.8db588d7bb55e4583128.js

areeditoche-theia kinbug severitP1 statuinfo-needed

Source

NM4

👍4

Most helpful comment

This issue disappeared in Che version 7.7.x but reappeared in version 7.8.0 !

NM4 on 7 Feb 2020

👍4

All 31 comments

cc @davidfestal wondering how we manage that for crw 2.0?

l0rd on 4 Dec 2019

@NM4 thanks for reporting this. Offline support is quite fresh and we need to investigate why we are still downloading this static resource.

l0rd on 4 Dec 2019

@l0rd We didn't change anything in che-theia for the offline case (we probably missed this point). However this should not be a problem since when Che-theia cannot access the files on the CDN (404 error for example), the default process is to fallback to the Che-theia server it self to retrieve files.

The only case that might bring difficulties is if the calls to URLs on static.developers.redhat.com lead to gateway timeouts for example, in whch case it migtht block ce-theia start during this time.

@NM4 Could you please share the content of the browser console, as well as the network tab, when you access to the workspace (enable the preseve log option in the network tab) ?

davidfestal on 4 Dec 2019

NM4 on 4 Dec 2019

Could you share the http responde code of the last requests to static.developers.redhat.com?

davidfestal on 4 Dec 2019

Also could you precise which browser you're using ?

davidfestal on 4 Dec 2019

Thank you for replying.

Firefox version : 52.1.2

There is no response for the last request.

NM4 on 4 Dec 2019

For information, When I use a web browser from another network that has Internet Access, I get Theia editor displayed.

NM4 on 4 Dec 2019

Could you try with chrome please ?

Firefox is not officially supported afaik.

davidfestal on 4 Dec 2019

Same behaviour with Chrome

NM4 on 4 Dec 2019

I get those logs :

Uncaught DOMException: Failed to execute 'send' on 'XMLHttpRequest': Failed to load 'https://static.developers.redhat.com/che/theia_artifacts/che.1e54ff4e91be7f851db7.js'.
at n.url (http://serverrxj1mqfs-theia-ide9m0-server-3100.dvodvoks018.devops.full-company-name.fr/cdn-support.79ef8e0583c625da2226.js:1:1020)
at http://serverrxj1mqfs-theia-ide9m0-server-3100.dvodvoks018.devops.full-company-name.fr/cdn-support.79ef8e0583c625da2226.js:1:620
at Array.map ()
at n.buildScripts (http://serverrxj1mqfs-theia-ide9m0-server-3100.dvodvoks018.devops.full-company-name.fr/cdn-support.79ef8e0583c625da2226.js:1:608)
at http://serverrxj1mqfs-theia-ide9m0-server-3100.dvodvoks018.devops.full-company-name.fr/?uid=581036:9:2150

NM4 on 4 Dec 2019

Could you see in the Network tab and try to grab the http response code of the failing requests ?

davidfestal on 4 Dec 2019

I don't get any response. Here what I have in the Headers section :


Request URL: https://static.developers.redhat.com/che/theia_artifacts/che.1e54ff4e91be7f851db7.js
Referrer Policy: no-referrer-when-downgrade
Provisional headers are shown
Referer: http://serverjuaar46y-theia-ideaqx-server-3100.dvodvoks018.full-company-name.fr/?uid=284284
Sec-Fetch-Mode: cors
User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3878.0 Safari/537.36

NM4 on 5 Dec 2019

The complete request from an exported .har file :


      {
        "startedDateTime": "2019-12-05T08:23:33.756Z",
        "time": 0.004405000014230609,
        "request": {
          "method": "HEAD",
          "url": "https://static.developers.redhat.com/che/theia_artifacts/che.1e54ff4e91be7f851db7.js",
          "httpVersion": "",
          "headers": [
            {
              "name": "Sec-Fetch-Mode",
              "value": "cors"
            },
            {
              "name": "Referer",
              "value": "http://serverjuaar46y-theia-ideaqx-server-3100.dvodvoks018.full-company-name.fr/?uid=3142"
            },
            {
              "name": "User-Agent",
              "value": "Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3878.0 Safari/537.36"
            }
          ],
          "queryString": [],
          "cookies": [],
          "headersSize": -1,
          "bodySize": 0
        },
        "response": {
          "status": 0,
          "statusText": "",
          "httpVersion": "",
          "headers": [],
          "cookies": [],
          "content": {
            "size": 0,
            "mimeType": "x-unknown"
          },
          "redirectURL": "",
          "headersSize": -1,
          "bodySize": -1,
          "_transferSize": 0,
          "_error": "net::ERR_NAME_NOT_RESOLVED"
        },
        "cache": {},
        "timings": {
          "blocked": 0.004405000014230609,
          "dns": -1,
          "ssl": -1,
          "connect": -1,
          "send": 0,
          "wait": 0,
          "receive": 0,
          "_blocked_queueing": -1
        },
        "serverIPAddress": "",
        "_initiator": {
          "type": "script",
          "stack": {
            "callFrames": [
              {
                "functionName": "url",
                "scriptId": "478",
                "url": "http://serverjuaar46y-theia-ideaqx-server-3100.dvodvoks018.full-company-name.fr/cdn-support.79ef8e0583c625da2226.js",
                "lineNumber": 0,
                "columnNumber": 1019
              },
              {
                "functionName": "",
                "scriptId": "478",
                "url": "http://serverjuaar46y-theia-ideaqx-server-3100.dvodvoks018.full-company-name.fr/cdn-support.79ef8e0583c625da2226.js",
                "lineNumber": 0,
                "columnNumber": 619
              },
              {
                "functionName": "buildScripts",
                "scriptId": "478",
                "url": "http://serverjuaar46y-theia-ideaqx-server-3100.dvodvoks018.full-company-name.fr/cdn-support.79ef8e0583c625da2226.js",
                "lineNumber": 0,
                "columnNumber": 607
              },
              {
                "functionName": "",
                "scriptId": "479",
                "url": "http://serverjuaar46y-theia-ideaqx-server-3100.dvodvoks018.full-company-name.fr/?uid=3142",
                "lineNumber": 8,
                "columnNumber": 2149
              }
            ]
          }
        },
        "_priority": "VeryHigh",
        "_resourceType": "xhr",
        "pageref": "page_1"
      }

NM4 on 5 Dec 2019

Thanks very much @NM4 for these last details. I think they would be very useful.
I'll answer as soon as I can analyzed them.

davidfestal on 5 Dec 2019

Hello @davidfestal

Any update about this issue.

Thank you.

NM4 on 7 Jan 2020

This issue disappeared in Che version 7.7.x but reappeared in version 7.8.0 !

NM4 on 7 Feb 2020

👍4

hello any update of this issue ?

TristanFAURE on 25 Mar 2020

Hello,
I installed Che version 7.9.2 in offline mode but I still have this same problem: the workspace starts correctly but the theia-ide is not displayed in my browser.
If I reconfigure my workspace to use the version 7.7.0 ( the only one that works) of theia editor then everything is ok.

NM4 on 25 Mar 2020

@NM4 In fact it happens that for some versions (including 7.7.0), the CDN support had been broken. I t has been restored in the meantime, which explains why you're getting your problem back.
However let me provide a bit more analysis here:
In the detail of the HEAD request that you shared above, I can see the following:

        "request": {
          "method": "HEAD",
          "url": "https://static.developers.redhat.com/che/theia_artifacts/che.1e54ff4e91be7f851db7.js",
          "httpVersion": "",
          "headers": [
            {
              "name": "Sec-Fetch-Mode",
              "value": "cors"
            },
            {
              "name": "Referer",
              "value": "http://serverjuaar46y-theia-ideaqx-server-3100.dvodvoks018.full-company-name.fr/?uid=3142"
            },
            {
              "name": "User-Agent",
              "value": "Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3878.0 Safari/537.36"
            }
          ],
          "queryString": [],
          "cookies": [],
          "headersSize": -1,
          "bodySize": 0
        },
        "response": {
          "status": 0,
          "statusText": "",
          "httpVersion": "",
          "headers": [],
          "cookies": [],
          "content": {
            "size": 0,
            "mimeType": "x-unknown"
          },
          "redirectURL": "",
          "headersSize": -1,
          "bodySize": -1,
          "_transferSize": 0,
          "_error": "net::ERR_NAME_NOT_RESOLVED"

That means that an exception occurred before even returning a response. In fact it seems to be a DNS error.
After looking into the code, we should catch such exceptions and simply ignore them, in order to bypass CDN and retrieve the artifacts from the Che-theia express server itself.

I'll provide a PR asap on this.

davidfestal on 26 Mar 2020

che-theia v7.11.0, has this issue.

yorkfly on 23 Apr 2020

How to disabe CDN support in offline mode ? THX

yorkfly on 24 Apr 2020

👍1

Hi, having the same issue with Che version 7.9.2
Is there a workaround?

thanks

dealboy on 29 May 2020

@dealboy that has been fixed in 7.9.3

l0rd on 3 Jun 2020

@davidfestal adding need-triage label for revision and fix confirmation

ibuziuk on 5 Jun 2020

In my environment, the only version of Theia ide that works offline is 7.7.0
I modified the Che plugins registry and set this version as default ( or set it as the only one)
I hope that will be fixed soon.

NM4 on 5 Jun 2020

@dealboy that has been fixed in 7.9.3

Thanks for the info, we decided to move our offline test installation to the latest version (currently 7.13.2) and the issue is fixed.

dealboy on 5 Jun 2020

Thanks, I'll test 7.13.2 version.

NM4 on 5 Jun 2020

Let me provide some more information here:

In the initial issue, the root cause of the failure was not the fact that CDN files were accessed from the static.developers.redhat.com, but the fact that the CDN mechanism didn't correctly catch the error that occurred when trying to access them.
You should not be required to manually disable CDN support in case of an offline environment. The PRs linked to this issue make the CDN support robust enough to detect when CDN artifacts are not reachable, and switch to non-CDN artifacts in such cases.
However if there is a mandatory reason to never use the CDN (which will obviously decrease Theia loading performances), then the NOCDN environment variable can be added in the Theia plugin section of the Devfile, in order to force disabling the CDN completely.

davidfestal on 5 Jun 2020

However if there is a mandatory reason to never use the CDN (which will obviously decrease Theia loading performances), then the NOCDN environment variable can be added in the Theia plugin section of the Devfile, in order to force disabling the CDN completely.

@davidfestal, would it be worth adding this piece of info to https://www.eclipse.org/che/docs/che-7/installing-che-in-restricted-environment/?

rkratky on 5 Jun 2020

👍1

However if there is a mandatory reason to never use the CDN (which will obviously decrease Theia loading performances), then the NOCDN environment variable can be added in the Theia plugin section of the Devfile, in order to force disabling the CDN completely.

@davidfestal
Is it possible to set this globally for all users and workspaces?