Kibana: [test-failed]: Chrome X-Pack UI Functional Tests1.x-pack/test/functional/apps/machine_learning/data_frame_analytics/cloning路ts - machine learning data frame analytics jobs cloning supported by UI form classification job supported by the form "before all" hook for "should open the flyout with a proper header"

Created on 8 Apr 2020  路  9Comments  路  Source: elastic/kibana

Version: 7.7.0
Class: Chrome X-Pack UI Functional Tests1.x-pack/test/functional/apps/machine_learning/data_frame_analytics/cloning路ts
Stack Trace:
Error: expected 200 "OK", got 400 "Bad Request"
at Test._assertStatus (/var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackGrp1/TASK/saas_run_kibana_tests/node/linux-immutable/ci/cloud/common/build/kibana/node_modules/supertest/lib/test.js:268:12)
at Test._assertFunction (/var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackGrp1/TASK/saas_run_kibana_tests/node/linux-immutable/ci/cloud/common/build/kibana/node_modules/supertest/lib/test.js:283:11)
at Test.assert (/var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackGrp1/TASK/saas_run_kibana_tests/node/linux-immutable/ci/cloud/common/build/kibana/node_modules/supertest/lib/test.js:173:18)
at assert (/var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackGrp1/TASK/saas_run_kibana_tests/node/linux-immutable/ci/cloud/common/build/kibana/node_modules/supertest/lib/test.js:131:12)
at /var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackGrp1/TASK/saas_run_kibana_tests/node/linux-immutable/ci/cloud/common/build/kibana/node_modules/supertest/lib/test.js:128:5
at Test.Request.callback (/var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackGrp1/TASK/saas_run_kibana_tests/node/linux-immutable/ci/cloud/common/build/kibana/node_modules/superagent/lib/node/index.js:718:3)
at parser (/var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackGrp1/TASK/saas_run_kibana_tests/node/linux-immutable/ci/cloud/common/build/kibana/node_modules/superagent/lib/node/index.js:906:18)
at Stream.res.on (/var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackGrp1/TASK/saas_run_kibana_tests/node/linux-immutable/ci/cloud/common/build/kibana/node_modules/superagent/lib/node/parsers/json.js:19:7)
at Unzip.unzip.on (/var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackGrp1/TASK/saas_run_kibana_tests/node/linux-immutable/ci/cloud/common/build/kibana/node_modules/superagent/lib/node/unzip.js:55:12)
at endReadableNT (_stream_readable.js:1145:12)
at process._tickCallback (internal/process/next_tick.js:63:19)
_Platform: cloud_
_Build Num: 79_

:ml failed-test test-cloud test-ece

All 9 comments

Pinging @elastic/kibana-test-triage (failed-test)

Pinging @elastic/ml-ui (:ml)

Version: 7.7.0
Class: Chrome X-Pack UI Functional Tests1.x-pack/test/functional/apps/machine_learning/data_frame_analytics/cloning路ts
Stack Trace:
Error: expected 200 "OK", got 400 "Bad Request"
at Test._assertStatus (/var/lib/jenkins/workspace/elastic+estf-ece-kibana-tests/JOB/xpackGrp1/TASK/ece_run_kibana_tests/node/ece-testing/ci/cloud/common/build/kibana/node_modules/supertest/lib/test.js:268:12)
at Test._assertFunction (/var/lib/jenkins/workspace/elastic+estf-ece-kibana-tests/JOB/xpackGrp1/TASK/ece_run_kibana_tests/node/ece-testing/ci/cloud/common/build/kibana/node_modules/supertest/lib/test.js:283:11)
at Test.assert (/var/lib/jenkins/workspace/elastic+estf-ece-kibana-tests/JOB/xpackGrp1/TASK/ece_run_kibana_tests/node/ece-testing/ci/cloud/common/build/kibana/node_modules/supertest/lib/test.js:173:18)
at assert (/var/lib/jenkins/workspace/elastic+estf-ece-kibana-tests/JOB/xpackGrp1/TASK/ece_run_kibana_tests/node/ece-testing/ci/cloud/common/build/kibana/node_modules/supertest/lib/test.js:131:12)
at /var/lib/jenkins/workspace/elastic+estf-ece-kibana-tests/JOB/xpackGrp1/TASK/ece_run_kibana_tests/node/ece-testing/ci/cloud/common/build/kibana/node_modules/supertest/lib/test.js:128:5
at Test.Request.callback (/var/lib/jenkins/workspace/elastic+estf-ece-kibana-tests/JOB/xpackGrp1/TASK/ece_run_kibana_tests/node/ece-testing/ci/cloud/common/build/kibana/node_modules/superagent/lib/node/index.js:718:3)
at parser (/var/lib/jenkins/workspace/elastic+estf-ece-kibana-tests/JOB/xpackGrp1/TASK/ece_run_kibana_tests/node/ece-testing/ci/cloud/common/build/kibana/node_modules/superagent/lib/node/index.js:906:18)
at Stream.res.on (/var/lib/jenkins/workspace/elastic+estf-ece-kibana-tests/JOB/xpackGrp1/TASK/ece_run_kibana_tests/node/ece-testing/ci/cloud/common/build/kibana/node_modules/superagent/lib/node/parsers/json.js:19:7)
at Unzip.unzip.on (/var/lib/jenkins/workspace/elastic+estf-ece-kibana-tests/JOB/xpackGrp1/TASK/ece_run_kibana_tests/node/ece-testing/ci/cloud/common/build/kibana/node_modules/superagent/lib/node/unzip.js:55:12)
at endReadableNT (_stream_readable.js:1145:12)
at process._tickCallback (internal/process/next_tick.js:63:19)
_Platform: ece_
_Build Num: 34_

Version: 7.8.0
Class: Chrome X-Pack UI Functional Tests1.x-pack/test/functional/apps/machine_learning/data_frame_analytics/cloning路ts
Stack Trace:
Error: expected 200 "OK", got 400 "Bad Request"
at Test._assertStatus (/var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackGrp1/TASK/saas_run_kibana_tests/node/linux-immutable/ci/cloud/common/build/kibana/node_modules/supertest/lib/test.js:268:12)
at Test._assertFunction (/var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackGrp1/TASK/saas_run_kibana_tests/node/linux-immutable/ci/cloud/common/build/kibana/node_modules/supertest/lib/test.js:283:11)
at Test.assert (/var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackGrp1/TASK/saas_run_kibana_tests/node/linux-immutable/ci/cloud/common/build/kibana/node_modules/supertest/lib/test.js:173:18)
at assert (/var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackGrp1/TASK/saas_run_kibana_tests/node/linux-immutable/ci/cloud/common/build/kibana/node_modules/supertest/lib/test.js:131:12)
at /var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackGrp1/TASK/saas_run_kibana_tests/node/linux-immutable/ci/cloud/common/build/kibana/node_modules/supertest/lib/test.js:128:5
at Test.Request.callback (/var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackGrp1/TASK/saas_run_kibana_tests/node/linux-immutable/ci/cloud/common/build/kibana/node_modules/superagent/lib/node/index.js:718:3)
at parser (/var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackGrp1/TASK/saas_run_kibana_tests/node/linux-immutable/ci/cloud/common/build/kibana/node_modules/superagent/lib/node/index.js:906:18)
at Stream.res.on (/var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackGrp1/TASK/saas_run_kibana_tests/node/linux-immutable/ci/cloud/common/build/kibana/node_modules/superagent/lib/node/parsers/json.js:19:7)
at Unzip.unzip.on (/var/lib/jenkins/workspace/elastic+estf-cloud-kibana-tests/JOB/xpackGrp1/TASK/saas_run_kibana_tests/node/linux-immutable/ci/cloud/common/build/kibana/node_modules/superagent/lib/node/unzip.js:55:12)
at endReadableNT (_stream_readable.js:1145:12)
at process._tickCallback (internal/process/next_tick.js:63:19)
_Platform: cloud_
_Build Num: 324_

This 400 Bad Request happens while we try to create a mock DFA job in the before of the test. Unfortunately, the log doesn't contain any more details. But it only seems to happen once in a while and only on cloud, so I suspect some flakiness based on the environment. I'll try to add some log output to our api service methods, so we have more details when this happens again.

I've debugged this and the reason why it fails on some cloud deployments and passes on others is that we use different node sizing (I usually run with 4GB ML nodeswhile the cloud test plan only uses a1GBML node). The classification job, we try to set up has a model memory limit of350MBdefined, which is less than a1GB` ML cloud node provides by default:

model_memory_limit [350mb] must be less than the value of the xpack.ml.max_model_memory_limit setting [315mb]

@liza-mae can we bump the ML node to 2GB to fix this issue?

It is best if this test can be rewritten to use 1GB, so we can minimize capacity issues on ESS.

Memory requirements will be reduced with #69295

I've double checked on a manual cloud deployment with 1GB ES, 1GB ML, 1GB Kibana that all ML and Transform tests (API and UI) are passing after the merge of #69295. Closing this issue.

@liza-mae From the ML point of view, we can return to 1GB ML nodes in the cloud cluster, although I'm not sure if there are any solutions tests with ML integration out there that still require more memory.

Was this page helpful?
0 / 5 - 0 ratings

Related issues

bhavyarm picture bhavyarm  路  3Comments

treussart picture treussart  路  3Comments

timroes picture timroes  路  3Comments

snide picture snide  路  3Comments

socialmineruser1 picture socialmineruser1  路  3Comments