Kibana: Logs tabs/panel stuck in error after adding column

[J-Siu]

Kibana version:
7.3.1
Elasticsearch version:
7.3.1
Server OS version:
Ubuntu 18.04
Browser version:
Firefox 68.0.2
Browser OS version:
macOS Mojave
Original install method (e.g. download page, yum, from source, etc.):
apt from "deb https://artifacts.elastic.co/packages/7.x/apt stable main"
Describe the bug:

The "Logs" panel is stuck in error even after re-login.

ba@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:224:315 x@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:224:584 Bf@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:224:50684 p@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:224:52380 v@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:224:53494 Cf/<@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:224:55493 S@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:224:62438 Tg@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:224:70460 bi@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:224:91928 ci@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:224:92307 Di@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:224:99414 Yh@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:224:98789 Xh@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:224:97822 qf@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:224:96639 enqueueSetState@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:224:48095 vendors</E.prototype.setState@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:192:1610 onStateChange@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:123:300066 notify@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:232:1361285 notifyNestedSubs@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:232:1362069 onStateChange@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:123:300097 dispatch@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:70:1109343 epicMiddleware/</<@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:541:282425 dispatch@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:70:1114592 vendors</SafeSubscriber</SafeSubscriber.prototype.__tryOrUnsub@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:21:168390 vendors</SafeSubscriber</SafeSubscriber.prototype.next@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:21:167037 vendors</Subscriber</Subscriber.prototype._next@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:21:165478 vendors</Subscriber</Subscriber.prototype.next@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:21:165077 vendors</MergeMapSubscriber</MergeMapSubscriber.prototype.notifyNext@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:54:55896 vendors</InnerSubscriber</InnerSubscriber.prototype._next@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:541:301286 vendors</Subscriber</Subscriber.prototype.next@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:21:165077 vendors</Notification</Notification.prototype.observe@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:70:3650 vendors</ObserveOnSubscriber</ObserveOnSubscriber.dispatch@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:150:105155 vendors</AsyncAction</AsyncAction.prototype._execute@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:54:49168 vendors</QueueAction</QueueAction.prototype.execute@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:541:284362 vendors</AsyncScheduler</AsyncScheduler.prototype.flush@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:54:51016 vendors</QueueAction</QueueAction.prototype.schedule@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:541:284204 vendors</Scheduler</Scheduler.prototype.schedule@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:150:103516 vendors</AsyncScheduler</AsyncScheduler.prototype.schedule@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:54:50824 vendors</ObserveOnSubscriber</ObserveOnSubscriber.prototype.scheduleMessage@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:150:105289 vendors</ObserveOnSubscriber</ObserveOnSubscriber.prototype._next@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:150:105450 vendors</Subscriber</Subscriber.prototype.next@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:21:165077 vendors</MergeMapSubscriber</MergeMapSubscriber.prototype.notifyNext@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:54:55896 vendors</InnerSubscriber</InnerSubscriber.prototype._next@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:541:301286 vendors</Subscriber</Subscriber.prototype.next@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:21:165077 vendors</MergeMapSubscriber</MergeMapSubscriber.prototype.notifyNext@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:54:55896 vendors</InnerSubscriber</InnerSubscriber.prototype._next@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:541:301286 vendors</Subscriber</Subscriber.prototype.next@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:21:165077 vendors</SwitchMapSubscriber</SwitchMapSubscriber.prototype.notifyNext@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:76:48752 vendors</InnerSubscriber</InnerSubscriber.prototype._next@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:541:301286 vendors</Subscriber</Subscriber.prototype.next@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:21:165077 vendors</MergeMapSubscriber</MergeMapSubscriber.prototype.notifyNext@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:54:55896 vendors</InnerSubscriber</InnerSubscriber.prototype._next@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:541:301286 vendors</Subscriber</Subscriber.prototype.next@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:21:165077 vendors</Subscriber</Subscriber.prototype._next@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:21:165478 vendors</Subscriber</Subscriber.prototype.next@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:21:165077 vendors</MapSubscriber</MapSubscriber.prototype._next@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:28:753422 vendors</Subscriber</Subscriber.prototype.next@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:21:165077 vendors</exports.subscribeToPromise/</<@https://ki.johnsiu.info/built_assets/dlls/vendors.bundle.dll.js:150:109163

Steps to reproduce:

1. Added 2 or 3 columns without issue. Then add 1 more and error pop-up. Can't remember which index field.

Expected behavior:

Some way to reset logs display settings.

Screenshots (if relevant):

See above.

Errors in browser console (if relevant):

Provide logs and/or server output (if relevant):

Any additional context:

[J-Siu]

I am more interested in how to clear it now. It is very annoying not able to use the log panel.

[elasticmachine]

Pinging @elastic/infra-logs-ui

[weltenwort]

To quickly clear it you could delete the saved object that contains the source configuration from the Kibana system index.

:warning: Deletion queries are risky, please double-check to make sure it doesn't delete more than intended. Substitute the Kibana system index name and the space name as appropriate.

To delete the source configuration for the default Kibana space assuming the Kibana system index is .kibana.

DELETE .kibana/_doc/infrastructure-ui-source:default

To delete the source configuration for a Kibana space called space-1 assuming the Kibana system index is .kibana:

DELETE .kibana/_doc/space-1:infrastructure-ui-source:default

[weltenwort]

@J-Siu Before you delete the source though, I would appreciate it if you could provide the source configuration so we can try to determine the cause of the problem. You can fetch the source configuration using the same queries as for the deletion, but as GET requests, e.g.:

GET .kibana/_doc/infrastructure-ui-source:default

[J-Siu]

GET .kibana/_doc/infrastructure-ui-source:default

Output:

{
  "_index" : ".kibana_2",
  "_type" : "_doc",
  "_id" : "infrastructure-ui-source:default",
  "_version" : 8,
  "_seq_no" : 705,
  "_primary_term" : 11,
  "found" : true,
  "_source" : {
    "infrastructure-ui-source" : {
      "name" : "Default",
      "description" : "",
      "metricAlias" : "metricbeat-*",
      "logAlias" : "filebeat-*",
      "fields" : {
        "container" : "container.id",
        "host" : "host.name",
        "pod" : "kubernetes.pod.uid",
        "tiebreaker" : "_doc",
        "timestamp" : "@timestamp"
      },
      "logColumns" : [
        {
          "timestampColumn" : {
            "id" : "5e7f964a-be8a-40d8-88d2-fbcfbdca0e2f"
          }
        },
        {
          "fieldColumn" : {
            "field" : "event.dataset",
            "id" : " eb9777a8-fcd3-420e-ba7d-172fff6da7a2"
          }
        },
        {
          "messageColumn" : {
            "id" : "b645d6da-824b-4723-9a2a-e8cece1645c0"
          }
        },
        {
          "fieldColumn" : {
            "field" : "log.file.path",
            "id" : "c49c1daa-c22e-4f0f-bd87-f3fff08924fe"
          }
        },
        {
          "fieldColumn" : {
            "field" : "user_agent.name",
            "id" : "af3ff7f1-6fce-40b0-84e5-cc941eca436b"
          }
        },
        {
          "fieldColumn" : {
            "field" : "http.request.referrer",
            "id" : "5b440d9f-30f9-42c3-9266-426cb2685bf8"
          }
        },
        {
          "fieldColumn" : {
            "field" : "source.geo.city_name",
            "id" : "2636a198-7ccf-4bda-bf7c-e48cab8e08b9"
          }
        },
        {
          "fieldColumn" : {
            "field" : "source.geo.location",
            "id" : "2b0b1432-e626-484a-a167-ed98c7ab058c"
          }
        }
      ]
    },
    "type" : "infrastructure-ui-source",
    "references" : [ ],
    "updated_at" : "2019-09-02T14:01:09.946Z"
  }
}

This bring back memory, "source.geo.location" should be the one I added last, and where the error start.

[weltenwort]

Thanks a lot, I'll try to reproduce it.

[J-Siu]

@weltenwort After clearing it. The log panel works. I added "source.geo.location" and the error pop-up right away.

Once I click "Update Source", error!!

[weltenwort]

I have a fix in #44906, which I'll try to get into 7.4 if possible.