Origin: Unable to deploy Gitlab on OpenShift: getting "error: update acceptor rejected gitlab-ce-postgresql-1: pods for rc "gitlab-ce-postgresql-1" took longer than 600 seconds to become ready"

Created on 25 Jan 2018  Â·  16Comments  Â·  Source: openshift/origin

I'm trying to deploy Gitlab on OpenShift.
While deploying, I'm getting following error.
I have tried this in two different openshift environments - openshift 3.5 and openshift 3.6, and getting the same error.
I have followed below two articles for the reference[1][2].
"--> Scaling gitlab-ce-postgresql-1 to 1
--> Waiting up to 10m0s for pods in rc gitlab-ce-postgresql-1 to become ready
error: update acceptor rejected gitlab-ce-postgresql-1: pods for rc "gitlab-ce-postgresql-1" took longer than 600 seconds to become ready"

[1] https://blog.openshift.com/deploy-gitlab-openshift/
[2] https://about.gitlab.com/2016/06/28/get-started-with-openshift-origin-3-and-gitlab/

Version

openshift v3.5.5.31.48
kubernetes v1.5.2+43a9be4
etcd 3.1.0
[and]
openshift v3.6.173.0.49
kubernetes v1.6.1+5115d708d7

Steps To Reproduce
  1. Follow this guide https://blog.openshift.com/deploy-gitlab-openshift/ or
    https://about.gitlab.com/2016/06/28/get-started-with-openshift-origin-3-and-gitlab/
Current Result

error: update acceptor rejected gitlab-ce-postgresql-1: pods for rc "gitlab-ce-postgresql-1" took longer than 600 seconds to become ready

componenstorage kinquestion lifecyclrotten prioritP2 sistorage

Most helpful comment

timeout1200
Before the build choose - Edit - set Timeout to 1200

All 16 comments

@sbuvaneshkumar Could you post the output of oc get events?

@akram Any ideas why it has happened?

@php-coder
In OpenShift 3.6 environment:

➜  ~ oc get events
LASTSEEN   FIRSTSEEN   COUNT     NAME                  KIND      SUBOBJECT                     TYPE      REASON        SOURCE                                 MESSAGE
13m        13m         1         postgresql-1-deploy   Pod                                     Normal    Scheduled     default-scheduler                      Successfully assigned postgresql-1-deploy to ip-172-16-7-53.ec2.internal
13m        13m         1         postgresql-1-deploy   Pod       spec.containers{deployment}   Normal    Pulled        kubelet, ip-172-16-7-53.ec2.internal   Container image "registry.reg-aws.openshift.com:443/openshift3/ose-deployer:v3.6.173.0.49" already present on machine
13m        13m         1         postgresql-1-deploy   Pod       spec.containers{deployment}   Normal    Created       kubelet, ip-172-16-7-53.ec2.internal   Created container
13m        13m         1         postgresql-1-deploy   Pod       spec.containers{deployment}   Normal    Started       kubelet, ip-172-16-7-53.ec2.internal   Started container
13m        13m         1         postgresql-1-ppwxs    Pod                                     Normal    Scheduled     default-scheduler                      Successfully assigned postgresql-1-ppwxs to ip-172-16-6-80.ec2.internal
13m        13m         1         postgresql-1-ppwxs    Pod                                     Warning   FailedMount   attachdetach                           Failed to attach volume "pvc-ed7d3934-01c2-11e8-ada1-126ee6b1d97f" on node "ip-172-16-6-80.ec2.internal" with: Error attaching EBS volume "vol-02ee51e019391e446" to instance "i-0b5996257f0cf1e0c": IncorrectState: vol-02ee51e019391e446 is not 'available'.
           status code: 400, request id: 84251a2a-ae09-4ada-b843-77f43a0420e7
12m        13m       4         postgresql-1-ppwxs   Pod                     spec.containers{postgresql}   Normal    Pulled                        kubelet, ip-172-16-6-80.ec2.internal   Container image "registry.access.redhat.com/rhscl/postgresql-95-rhel7@sha256:19aacf0c8331df76b67932415bd84abf74ec36fd9d4aef518ad9f6285c4a948a" already present on machine
12m        13m       4         postgresql-1-ppwxs   Pod                     spec.containers{postgresql}   Normal    Created                       kubelet, ip-172-16-6-80.ec2.internal   Created container
12m        13m       4         postgresql-1-ppwxs   Pod                     spec.containers{postgresql}   Normal    Started                       kubelet, ip-172-16-6-80.ec2.internal   Started container
12m        13m       6         postgresql-1-ppwxs   Pod                     spec.containers{postgresql}   Warning   BackOff                       kubelet, ip-172-16-6-80.ec2.internal   Back-off restarting failed container
8m         13m       27        postgresql-1-ppwxs   Pod                                                   Warning   FailedSync                    kubelet, ip-172-16-6-80.ec2.internal   Error syncing pod
13m        13m       1         postgresql-1         ReplicationController                                 Normal    SuccessfulCreate              replication-controller                 Created pod: postgresql-1-ppwxs
3m         3m        1         postgresql-1         ReplicationController                                 Normal    SuccessfulDelete              replication-controller                 Deleted pod: postgresql-1-ppwxs
13m        13m       1         postgresql           DeploymentConfig                                      Normal    DeploymentCreated             deploymentconfig-controller            Created new replication controller "postgresql-1" for version 1
13m        13m       1         postgresql           PersistentVolumeClaim                                 Normal    ProvisioningSucceeded         persistentvolume-controller            Successfully provisioned volume pvc-ed7d3934-01c2-11e8-ada1-126ee6b1d97f using kubernetes.io/aws-ebs
3m         3m        1         postgresql           DeploymentConfig                                      Normal    ReplicationControllerScaled   deploymentconfig-controller            Scaled replication controller "postgresql-1" from 842433591084 to 0

In OpenShift 3.5 environment:

[root@ocp-master ~]# oc get events
LASTSEEN   FIRSTSEEN   COUNT     NAME         KIND                    SUBOBJECT   TYPE      REASON          SOURCE                           MESSAGE
5s         18h         4329      postgresql   PersistentVolumeClaim               Normal    FailedBinding   {persistentvolume-controller }   no persistent volumes available for this claim and no storage class is set

I can see that, In openshift v3.5, I'm getting different error (persistent volume issue), but in the logs I see same error (error: update acceptor rejected postgresql-1: pods for rc "postgresql-1" took longer than 600 seconds to become ready) in both environments.

Looks like some issues with storage.

CC @openshift/sig-storage

no persistent volumes available for this claim and no storage class is set: It looks like there is no storage configure in your cluster. Where is it deployed? You need to set a default storage class. https://docs.openshift.com/container-platform/3.5/install_config/persistent_storage/dynamically_provisioning_pvs.html. You can copy the one that's working in your 3.6 deployment.

And I don't see any storage related issue in 3.6 logs - PV has been dynamically provisioned for your PVC there.

@jsafrane I see same log messages in both environments. But oc get events only showing the actual cause.
Thanks @jsafrane, I got the point that my 3.5 environment storage was not configured properly.
But you see, there is no storage issue in 3.6 environment, but still it is failing.

UPDATE: I have configured storage successfully in openshift 3.5 environment.
But still, it's failing.

[root@ocp-master ~]# oc get pv
NAME         CAPACITY   ACCESSMODES   RECLAIMPOLICY   STATUS    CLAIM               REASON    AGE
postgresql   5G         RWX           Retain          Bound     gitlab/postgresql             39m

```console
[root@ocp-master ~]# oc get pvc
NAME STATUS VOLUME CAPACITY ACCESSMODES AGE
postgresql Bound postgresql 5G RWX 42m

```console
[root@ocp-master ~]# oc get events
LASTSEEN   FIRSTSEEN   COUNT     NAME                 KIND      SUBOBJECT                     TYPE      REASON       SOURCE                               MESSAGE
1h         1h          1         postgresql-1-0cq6l   Pod                                     Normal    Scheduled    {default-scheduler }                 Successfully assigned postgresql-1-0cq6l to ocp-node1.blr.redhat.com
1h         1h          1         postgresql-1-0cq6l   Pod       spec.containers{postgresql}   Normal    Pulling      {kubelet ocp-node1.blr.redhat.com}   pulling image "registry.access.redhat.com/rhscl/postgresql-95-rhel7@sha256:33888776920331bc37ae17692bac043210305aa35ed444cf5eded89f8311d0d7"
1h         1h          1         postgresql-1-0cq6l   Pod       spec.containers{postgresql}   Normal    Pulled       {kubelet ocp-node1.blr.redhat.com}   Successfully pulled image "registry.access.redhat.com/rhscl/postgresql-95-rhel7@sha256:33888776920331bc37ae17692bac043210305aa35ed444cf5eded89f8311d0d7"
1h         1h          26        postgresql-1-0cq6l   Pod                                     Warning   FailedSync   {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with RunContainerError: "GenerateRunContainerOptions: secrets \"postgresql\" not found"

1h        1h        27        postgresql-1-0cq6l   Pod       spec.containers{postgresql}   Normal    Pulled       {kubelet ocp-node1.blr.redhat.com}   Container image "registry.access.redhat.com/rhscl/postgresql-95-rhel7@sha256:33888776920331bc37ae17692bac043210305aa35ed444cf5eded89f8311d0d7" already present on machine
1h        1h        1         postgresql-1-0cq6l   Pod       spec.containers{postgresql}   Normal    Created      {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 308d9b6fd6ad; Security:[seccomp=unconfined]
1h        1h        1         postgresql-1-0cq6l   Pod       spec.containers{postgresql}   Normal    Started      {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 308d9b6fd6ad
1h        1h        1         postgresql-1-0cq6l   Pod       spec.containers{postgresql}   Normal    Created      {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 6b3ae8a092d0; Security:[seccomp=unconfined]
1h        1h        1         postgresql-1-0cq6l   Pod       spec.containers{postgresql}   Normal    Started      {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 6b3ae8a092d0
1h        1h        2         postgresql-1-0cq6l   Pod       spec.containers{postgresql}   Warning   BackOff      {kubelet ocp-node1.blr.redhat.com}   Back-off restarting failed docker container
1h        1h        2         postgresql-1-0cq6l   Pod                                     Warning   FailedSync   {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 10s restarting failed container=postgresql pod=postgresql-1-0cq6l_gitlab(5508096e-0526-11e8-9f1c-00163e493c45)"

55m       55m       1         postgresql-1-3f7tk   Pod                                     Normal    Scheduled     {default-scheduler }                 Successfully assigned postgresql-1-3f7tk to ocp-node1.blr.redhat.com
47m       53m       4         postgresql-1-3f7tk   Pod                                     Warning   FailedMount   {kubelet ocp-node1.blr.redhat.com}   Unable to mount volumes for pod "postgresql-1-3f7tk_gitlab(386452f4-0528-11e8-9f1c-00163e493c45)": timeout expired waiting for volumes to attach/mount for pod "gitlab"/"postgresql-1-3f7tk". list of unattached/unmounted volumes=[postgresql-data]
47m       53m       4         postgresql-1-3f7tk   Pod                                     Warning   FailedSync    {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: timeout expired waiting for volumes to attach/mount for pod "gitlab"/"postgresql-1-3f7tk". list of unattached/unmounted volumes=[postgresql-data]
45m       45m       1         postgresql-1-3f7tk   Pod                                     Warning   FailedMount   {kubelet ocp-node1.blr.redhat.com}   Unable to mount volumes for pod "postgresql-1-3f7tk_gitlab(386452f4-0528-11e8-9f1c-00163e493c45)": timeout expired waiting for volumes to attach/mount for pod "gitlab"/"postgresql-1-3f7tk". list of unattached/unmounted volumes=[postgresql-data default-token-b5933]
45m       45m       1         postgresql-1-3f7tk   Pod                                     Warning   FailedSync    {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: timeout expired waiting for volumes to attach/mount for pod "gitlab"/"postgresql-1-3f7tk". list of unattached/unmounted volumes=[postgresql-data default-token-b5933]
43m       43m       1         postgresql-1-4802g   Pod                                     Normal    Scheduled     {default-scheduler }                 Successfully assigned postgresql-1-4802g to ocp-node1.blr.redhat.com
37m       43m       7         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Pulled        {kubelet ocp-node1.blr.redhat.com}   Container image "registry.access.redhat.com/rhscl/postgresql-95-rhel7@sha256:33888776920331bc37ae17692bac043210305aa35ed444cf5eded89f8311d0d7" already present on machine
43m       43m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Created       {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 5ca98e784209; Security:[seccomp=unconfined]
43m       43m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Started       {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 5ca98e784209
43m       43m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Created       {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 42802516855d; Security:[seccomp=unconfined]
43m       43m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Started       {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 42802516855d
33m       43m       52        postgresql-1-4802g   Pod       spec.containers{postgresql}   Warning   BackOff       {kubelet ocp-node1.blr.redhat.com}   Back-off restarting failed docker container
43m       43m       4         postgresql-1-4802g   Pod                                     Warning   FailedSync    {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 10s restarting failed container=postgresql pod=postgresql-1-4802g_gitlab(f7c48223-0529-11e8-9f1c-00163e493c45)"

42m       42m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Created      {kubelet ocp-node1.blr.redhat.com}   Created container with docker id da68131adc13; Security:[seccomp=unconfined]
42m       42m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Started      {kubelet ocp-node1.blr.redhat.com}   Started container with docker id da68131adc13
42m       42m       4         postgresql-1-4802g   Pod                                     Warning   FailedSync   {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 20s restarting failed container=postgresql pod=postgresql-1-4802g_gitlab(f7c48223-0529-11e8-9f1c-00163e493c45)"

42m       42m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Created      {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 32282cc2c83e; Security:[seccomp=unconfined]
42m       42m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Started      {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 32282cc2c83e
41m       42m       6         postgresql-1-4802g   Pod                                     Warning   FailedSync   {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 40s restarting failed container=postgresql pod=postgresql-1-4802g_gitlab(f7c48223-0529-11e8-9f1c-00163e493c45)"

41m       41m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Created      {kubelet ocp-node1.blr.redhat.com}   Created container with docker id f64c01330d92; Security:[seccomp=unconfined]
41m       41m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Started      {kubelet ocp-node1.blr.redhat.com}   Started container with docker id f64c01330d92
40m       41m       7         postgresql-1-4802g   Pod                                     Warning   FailedSync   {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 1m20s restarting failed container=postgresql pod=postgresql-1-4802g_gitlab(f7c48223-0529-11e8-9f1c-00163e493c45)"

39m       39m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Created      {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 8fea563eda55; Security:[seccomp=unconfined]
39m       39m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Started      {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 8fea563eda55
37m       39m       13        postgresql-1-4802g   Pod                                     Warning   FailedSync   {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=postgresql pod=postgresql-1-4802g_gitlab(f7c48223-0529-11e8-9f1c-00163e493c45)"

37m       37m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Created      {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 4a01a769526e; Security:[seccomp=unconfined]
37m       37m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Started      {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 4a01a769526e
33m       37m       18        postgresql-1-4802g   Pod                                     Warning   FailedSync   {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 5m0s restarting failed container=postgresql pod=postgresql-1-4802g_gitlab(f7c48223-0529-11e8-9f1c-00163e493c45)"

1h        1h        1         postgresql-1-deploy   Pod                                                   Normal    Scheduled          {default-scheduler }                 Successfully assigned postgresql-1-deploy to ocp-node1.blr.redhat.com
1h        1h        1         postgresql-1-deploy   Pod                     spec.containers{deployment}   Normal    Pulled             {kubelet ocp-node1.blr.redhat.com}   Container image "openshift3/ose-deployer:v3.5.5.31.48" already present on machine
1h        1h        1         postgresql-1-deploy   Pod                     spec.containers{deployment}   Normal    Created            {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 5ca59996c91f; Security:[seccomp=unconfined]
1h        1h        1         postgresql-1-deploy   Pod                     spec.containers{deployment}   Normal    Started            {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 5ca59996c91f
1h        1h        1         postgresql-1-deploy   Pod                     spec.containers{deployment}   Normal    Killing            {kubelet ocp-node1.blr.redhat.com}   Killing container with docker id 5ca59996c91f: Need to kill pod.
56m       56m       1         postgresql-1-deploy   Pod                                                   Normal    Scheduled          {default-scheduler }                 Successfully assigned postgresql-1-deploy to ocp-node1.blr.redhat.com
55m       55m       1         postgresql-1-deploy   Pod                     spec.containers{deployment}   Normal    Pulled             {kubelet ocp-node1.blr.redhat.com}   Container image "openshift3/ose-deployer:v3.5.5.31.48" already present on machine
55m       55m       1         postgresql-1-deploy   Pod                     spec.containers{deployment}   Normal    Created            {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 868ec8ca8e56; Security:[seccomp=unconfined]
55m       55m       1         postgresql-1-deploy   Pod                     spec.containers{deployment}   Normal    Started            {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 868ec8ca8e56
43m       43m       1         postgresql-1-deploy   Pod                                                   Normal    Scheduled          {default-scheduler }                 Successfully assigned postgresql-1-deploy to ocp-node1.blr.redhat.com
43m       43m       1         postgresql-1-deploy   Pod                     spec.containers{deployment}   Normal    Pulled             {kubelet ocp-node1.blr.redhat.com}   Container image "openshift3/ose-deployer:v3.5.5.31.48" already present on machine
43m       43m       1         postgresql-1-deploy   Pod                     spec.containers{deployment}   Normal    Created            {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 3c5f718dbc19; Security:[seccomp=unconfined]
43m       43m       1         postgresql-1-deploy   Pod                     spec.containers{deployment}   Normal    Started            {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 3c5f718dbc19
1h        1h        1         postgresql-1          ReplicationController                                 Normal    SuccessfulCreate   {replication-controller }            Created pod: postgresql-1-0cq6l
1h        1h        1         postgresql-1          ReplicationController                                 Normal    SuccessfulDelete   {replication-controller }            Deleted pod: postgresql-1-0cq6l
55m       55m       1         postgresql-1          ReplicationController                                 Normal    SuccessfulCreate   {replication-controller }            Created pod: postgresql-1-3f7tk
45m       45m       1         postgresql-1          ReplicationController                                 Normal    SuccessfulDelete   {replication-controller }            Deleted pod: postgresql-1-3f7tk
43m       43m       1         postgresql-1          ReplicationController                                 Normal    SuccessfulCreate   {replication-controller }            Created pod: postgresql-1-4802g
33m       33m       1         postgresql-1          ReplicationController                                 Normal    SuccessfulDelete   {replication-controller }            Deleted pod: postgresql-1-4802g
1h        1h        1         postgresql-2-deploy   Pod                                                   Normal    Scheduled          {default-scheduler }                 Successfully assigned postgresql-2-deploy to ocp-node1.blr.redhat.com
1h        1h        1         postgresql-2-deploy   Pod                     spec.containers{deployment}   Normal    Pulled             {kubelet ocp-node1.blr.redhat.com}   Container image "openshift3/ose-deployer:v3.5.5.31.48" already present on machine
1h        1h        1         postgresql-2-deploy   Pod                     spec.containers{deployment}   Normal    Created            {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 8b51444aa151; Security:[seccomp=unconfined]
1h        1h        1         postgresql-2-deploy   Pod                     spec.containers{deployment}   Normal    Started            {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 8b51444aa151
1h        1h        1         postgresql-2-sst0j    Pod                                                   Normal    Scheduled          {default-scheduler }                 Successfully assigned postgresql-2-sst0j to ocp-node1.blr.redhat.com
1h        1h        6         postgresql-2-sst0j    Pod                     spec.containers{postgresql}   Normal    Pulled             {kubelet ocp-node1.blr.redhat.com}   Container image "registry.access.redhat.com/rhscl/postgresql-95-rhel7@sha256:33888776920331bc37ae17692bac043210305aa35ed444cf5eded89f8311d0d7" already present on machine
1h        1h        1         postgresql-2-sst0j    Pod                     spec.containers{postgresql}   Normal    Created            {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 2e44a8db554f; Security:[seccomp=unconfined]
1h        1h        1         postgresql-2-sst0j    Pod                     spec.containers{postgresql}   Normal    Started            {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 2e44a8db554f
1h        1h        1         postgresql-2-sst0j    Pod                     spec.containers{postgresql}   Normal    Created            {kubelet ocp-node1.blr.redhat.com}   Created container with docker id d72e546296a3; Security:[seccomp=unconfined]
1h        1h        1         postgresql-2-sst0j    Pod                     spec.containers{postgresql}   Normal    Started            {kubelet ocp-node1.blr.redhat.com}   Started container with docker id d72e546296a3
58m       1h        31        postgresql-2-sst0j    Pod                     spec.containers{postgresql}   Warning   BackOff            {kubelet ocp-node1.blr.redhat.com}   Back-off restarting failed docker container
1h        1h        3         postgresql-2-sst0j    Pod                                                   Warning   FailedSync         {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 10s restarting failed container=postgresql pod=postgresql-2-sst0j_gitlab(2405951a-0527-11e8-9f1c-00163e493c45)"

1h        1h        1         postgresql-2-sst0j   Pod       spec.containers{postgresql}   Normal    Created      {kubelet ocp-node1.blr.redhat.com}   Created container with docker id f39a0c1b1297; Security:[seccomp=unconfined]
1h        1h        1         postgresql-2-sst0j   Pod       spec.containers{postgresql}   Normal    Started      {kubelet ocp-node1.blr.redhat.com}   Started container with docker id f39a0c1b1297
1h        1h        4         postgresql-2-sst0j   Pod                                     Warning   FailedSync   {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 20s restarting failed container=postgresql pod=postgresql-2-sst0j_gitlab(2405951a-0527-11e8-9f1c-00163e493c45)"

1h        1h        1         postgresql-2-sst0j   Pod       spec.containers{postgresql}   Normal    Created      {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 259baa91aa6a; Security:[seccomp=unconfined]
1h        1h        1         postgresql-2-sst0j   Pod       spec.containers{postgresql}   Normal    Started      {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 259baa91aa6a
1h        1h        4         postgresql-2-sst0j   Pod                                     Warning   FailedSync   {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 40s restarting failed container=postgresql pod=postgresql-2-sst0j_gitlab(2405951a-0527-11e8-9f1c-00163e493c45)"

1h        1h        1         postgresql-2-sst0j   Pod       spec.containers{postgresql}   Normal    Created      {kubelet ocp-node1.blr.redhat.com}   Created container with docker id d18c803380dc; Security:[seccomp=unconfined]
1h        1h        1         postgresql-2-sst0j   Pod       spec.containers{postgresql}   Normal    Started      {kubelet ocp-node1.blr.redhat.com}   Started container with docker id d18c803380dc
1h        1h        7         postgresql-2-sst0j   Pod                                     Warning   FailedSync   {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 1m20s restarting failed container=postgresql pod=postgresql-2-sst0j_gitlab(2405951a-0527-11e8-9f1c-00163e493c45)"

1h        1h        1         postgresql-2-sst0j   Pod       spec.containers{postgresql}   Normal    Created      {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 4625148f584e; Security:[seccomp=unconfined]
1h        1h        1         postgresql-2-sst0j   Pod       spec.containers{postgresql}   Normal    Started      {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 4625148f584e
58m       1h        13        postgresql-2-sst0j   Pod                                     Warning   FailedSync   {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=postgresql pod=postgresql-2-sst0j_gitlab(2405951a-0527-11e8-9f1c-00163e493c45)"

1h        1h        1         postgresql-2   ReplicationController             Normal    SuccessfulCreate                 {replication-controller }        Created pod: postgresql-2-sst0j
58m       58m       1         postgresql-2   ReplicationController             Normal    SuccessfulDelete                 {replication-controller }        Deleted pod: postgresql-2-sst0j
1h        1h        1         postgresql     DeploymentConfig                  Normal    DeploymentCreated                {deploymentconfig-controller }   Created new replication controller "postgresql-1" for version 1
1h        1h        1         postgresql     DeploymentConfig                  Normal    DeploymentCancelled              {deploymentconfig-controller }   Cancelled deployment "postgresql-1" superceded by version 2
1h        1h        10        postgresql     DeploymentConfig                  Normal    DeploymentAwaitingCancellation   {deploymentconfig-controller }   Deployment of version 2 awaiting cancellation of older running deployments
1h        1h        1         postgresql     DeploymentConfig                  Normal    DeploymentCancelled              {deployments-controller }        postgresql-1: Deployment "gitlab/postgresql-1" cancelled
1h        1h        1         postgresql     DeploymentConfig                  Normal    DeploymentCreated                {deploymentconfig-controller }   Created new replication controller "postgresql-2" for version 2
47m       56m       35        postgresql     PersistentVolumeClaim             Normal    FailedBinding                    {persistentvolume-controller }   no persistent volumes available for this claim and no storage class is set
56m       56m       1         postgresql     DeploymentConfig                  Normal    DeploymentCreated                {deploymentconfig-controller }   Created new replication controller "postgresql-1" for version 1
44m       47m       13        postgresql     PersistentVolumeClaim             Normal    FailedBinding                    {persistentvolume-controller }   no persistent volumes available for this claim and no storage class is set
45m       45m       1         postgresql     DeploymentConfig                  Normal    ReplicationControllerScaled      {deploymentconfig-controller }   Scaled replication controller "postgresql-1" from 1 to 0
43m       43m       1         postgresql     DeploymentConfig                  Normal    DeploymentCreated                {deploymentconfig-controller }   Created new replication controller "postgresql-1" for version 1
33m       33m       1         postgresql     DeploymentConfig                  Normal    ReplicationControllerScaled      {deploymentconfig-controller }   Scaled replication controller "postgresql-1" from 1 to 0
[root@ocp-master ~]# 
[root@ocp-master ~]# oc get events
LASTSEEN   FIRSTSEEN   COUNT     NAME                 KIND      SUBOBJECT                     TYPE      REASON       SOURCE                               MESSAGE
1h         1h          1         postgresql-1-0cq6l   Pod                                     Normal    Scheduled    {default-scheduler }                 Successfully assigned postgresql-1-0cq6l to ocp-node1.blr.redhat.com
1h         1h          1         postgresql-1-0cq6l   Pod       spec.containers{postgresql}   Normal    Pulling      {kubelet ocp-node1.blr.redhat.com}   pulling image "registry.access.redhat.com/rhscl/postgresql-95-rhel7@sha256:33888776920331bc37ae17692bac043210305aa35ed444cf5eded89f8311d0d7"
1h         1h          1         postgresql-1-0cq6l   Pod       spec.containers{postgresql}   Normal    Pulled       {kubelet ocp-node1.blr.redhat.com}   Successfully pulled image "registry.access.redhat.com/rhscl/postgresql-95-rhel7@sha256:33888776920331bc37ae17692bac043210305aa35ed444cf5eded89f8311d0d7"
1h         1h          26        postgresql-1-0cq6l   Pod                                     Warning   FailedSync   {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with RunContainerError: "GenerateRunContainerOptions: secrets \"postgresql\" not found"

1h        1h        27        postgresql-1-0cq6l   Pod       spec.containers{postgresql}   Normal    Pulled       {kubelet ocp-node1.blr.redhat.com}   Container image "registry.access.redhat.com/rhscl/postgresql-95-rhel7@sha256:33888776920331bc37ae17692bac043210305aa35ed444cf5eded89f8311d0d7" already present on machine
1h        1h        1         postgresql-1-0cq6l   Pod       spec.containers{postgresql}   Normal    Created      {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 308d9b6fd6ad; Security:[seccomp=unconfined]
1h        1h        1         postgresql-1-0cq6l   Pod       spec.containers{postgresql}   Normal    Started      {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 308d9b6fd6ad
1h        1h        1         postgresql-1-0cq6l   Pod       spec.containers{postgresql}   Normal    Created      {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 6b3ae8a092d0; Security:[seccomp=unconfined]
1h        1h        1         postgresql-1-0cq6l   Pod       spec.containers{postgresql}   Normal    Started      {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 6b3ae8a092d0
1h        1h        2         postgresql-1-0cq6l   Pod       spec.containers{postgresql}   Warning   BackOff      {kubelet ocp-node1.blr.redhat.com}   Back-off restarting failed docker container
1h        1h        2         postgresql-1-0cq6l   Pod                                     Warning   FailedSync   {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 10s restarting failed container=postgresql pod=postgresql-1-0cq6l_gitlab(5508096e-0526-11e8-9f1c-00163e493c45)"

56m       56m       1         postgresql-1-3f7tk   Pod                                     Normal    Scheduled     {default-scheduler }                 Successfully assigned postgresql-1-3f7tk to ocp-node1.blr.redhat.com
47m       54m       4         postgresql-1-3f7tk   Pod                                     Warning   FailedMount   {kubelet ocp-node1.blr.redhat.com}   Unable to mount volumes for pod "postgresql-1-3f7tk_gitlab(386452f4-0528-11e8-9f1c-00163e493c45)": timeout expired waiting for volumes to attach/mount for pod "gitlab"/"postgresql-1-3f7tk". list of unattached/unmounted volumes=[postgresql-data]
47m       54m       4         postgresql-1-3f7tk   Pod                                     Warning   FailedSync    {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: timeout expired waiting for volumes to attach/mount for pod "gitlab"/"postgresql-1-3f7tk". list of unattached/unmounted volumes=[postgresql-data]
45m       45m       1         postgresql-1-3f7tk   Pod                                     Warning   FailedMount   {kubelet ocp-node1.blr.redhat.com}   Unable to mount volumes for pod "postgresql-1-3f7tk_gitlab(386452f4-0528-11e8-9f1c-00163e493c45)": timeout expired waiting for volumes to attach/mount for pod "gitlab"/"postgresql-1-3f7tk". list of unattached/unmounted volumes=[postgresql-data default-token-b5933]
45m       45m       1         postgresql-1-3f7tk   Pod                                     Warning   FailedSync    {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: timeout expired waiting for volumes to attach/mount for pod "gitlab"/"postgresql-1-3f7tk". list of unattached/unmounted volumes=[postgresql-data default-token-b5933]
43m       43m       1         postgresql-1-4802g   Pod                                     Normal    Scheduled     {default-scheduler }                 Successfully assigned postgresql-1-4802g to ocp-node1.blr.redhat.com
37m       43m       7         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Pulled        {kubelet ocp-node1.blr.redhat.com}   Container image "registry.access.redhat.com/rhscl/postgresql-95-rhel7@sha256:33888776920331bc37ae17692bac043210305aa35ed444cf5eded89f8311d0d7" already present on machine
43m       43m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Created       {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 5ca98e784209; Security:[seccomp=unconfined]
43m       43m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Started       {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 5ca98e784209
43m       43m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Created       {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 42802516855d; Security:[seccomp=unconfined]
43m       43m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Started       {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 42802516855d
33m       43m       52        postgresql-1-4802g   Pod       spec.containers{postgresql}   Warning   BackOff       {kubelet ocp-node1.blr.redhat.com}   Back-off restarting failed docker container
43m       43m       4         postgresql-1-4802g   Pod                                     Warning   FailedSync    {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 10s restarting failed container=postgresql pod=postgresql-1-4802g_gitlab(f7c48223-0529-11e8-9f1c-00163e493c45)"

43m       43m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Created      {kubelet ocp-node1.blr.redhat.com}   Created container with docker id da68131adc13; Security:[seccomp=unconfined]
43m       43m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Started      {kubelet ocp-node1.blr.redhat.com}   Started container with docker id da68131adc13
42m       43m       4         postgresql-1-4802g   Pod                                     Warning   FailedSync   {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 20s restarting failed container=postgresql pod=postgresql-1-4802g_gitlab(f7c48223-0529-11e8-9f1c-00163e493c45)"

42m       42m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Created      {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 32282cc2c83e; Security:[seccomp=unconfined]
42m       42m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Started      {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 32282cc2c83e
42m       42m       6         postgresql-1-4802g   Pod                                     Warning   FailedSync   {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 40s restarting failed container=postgresql pod=postgresql-1-4802g_gitlab(f7c48223-0529-11e8-9f1c-00163e493c45)"

41m       41m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Created      {kubelet ocp-node1.blr.redhat.com}   Created container with docker id f64c01330d92; Security:[seccomp=unconfined]
41m       41m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Started      {kubelet ocp-node1.blr.redhat.com}   Started container with docker id f64c01330d92
40m       41m       7         postgresql-1-4802g   Pod                                     Warning   FailedSync   {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 1m20s restarting failed container=postgresql pod=postgresql-1-4802g_gitlab(f7c48223-0529-11e8-9f1c-00163e493c45)"

40m       40m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Created      {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 8fea563eda55; Security:[seccomp=unconfined]
40m       40m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Started      {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 8fea563eda55
37m       40m       13        postgresql-1-4802g   Pod                                     Warning   FailedSync   {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=postgresql pod=postgresql-1-4802g_gitlab(f7c48223-0529-11e8-9f1c-00163e493c45)"

37m       37m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Created      {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 4a01a769526e; Security:[seccomp=unconfined]
37m       37m       1         postgresql-1-4802g   Pod       spec.containers{postgresql}   Normal    Started      {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 4a01a769526e
33m       37m       18        postgresql-1-4802g   Pod                                     Warning   FailedSync   {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 5m0s restarting failed container=postgresql pod=postgresql-1-4802g_gitlab(f7c48223-0529-11e8-9f1c-00163e493c45)"

1h        1h        1         postgresql-1-deploy   Pod                                                   Normal    Scheduled          {default-scheduler }                 Successfully assigned postgresql-1-deploy to ocp-node1.blr.redhat.com
1h        1h        1         postgresql-1-deploy   Pod                     spec.containers{deployment}   Normal    Pulled             {kubelet ocp-node1.blr.redhat.com}   Container image "openshift3/ose-deployer:v3.5.5.31.48" already present on machine
1h        1h        1         postgresql-1-deploy   Pod                     spec.containers{deployment}   Normal    Created            {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 5ca59996c91f; Security:[seccomp=unconfined]
1h        1h        1         postgresql-1-deploy   Pod                     spec.containers{deployment}   Normal    Started            {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 5ca59996c91f
1h        1h        1         postgresql-1-deploy   Pod                     spec.containers{deployment}   Normal    Killing            {kubelet ocp-node1.blr.redhat.com}   Killing container with docker id 5ca59996c91f: Need to kill pod.
56m       56m       1         postgresql-1-deploy   Pod                                                   Normal    Scheduled          {default-scheduler }                 Successfully assigned postgresql-1-deploy to ocp-node1.blr.redhat.com
56m       56m       1         postgresql-1-deploy   Pod                     spec.containers{deployment}   Normal    Pulled             {kubelet ocp-node1.blr.redhat.com}   Container image "openshift3/ose-deployer:v3.5.5.31.48" already present on machine
56m       56m       1         postgresql-1-deploy   Pod                     spec.containers{deployment}   Normal    Created            {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 868ec8ca8e56; Security:[seccomp=unconfined]
56m       56m       1         postgresql-1-deploy   Pod                     spec.containers{deployment}   Normal    Started            {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 868ec8ca8e56
43m       43m       1         postgresql-1-deploy   Pod                                                   Normal    Scheduled          {default-scheduler }                 Successfully assigned postgresql-1-deploy to ocp-node1.blr.redhat.com
43m       43m       1         postgresql-1-deploy   Pod                     spec.containers{deployment}   Normal    Pulled             {kubelet ocp-node1.blr.redhat.com}   Container image "openshift3/ose-deployer:v3.5.5.31.48" already present on machine
43m       43m       1         postgresql-1-deploy   Pod                     spec.containers{deployment}   Normal    Created            {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 3c5f718dbc19; Security:[seccomp=unconfined]
43m       43m       1         postgresql-1-deploy   Pod                     spec.containers{deployment}   Normal    Started            {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 3c5f718dbc19
1h        1h        1         postgresql-1          ReplicationController                                 Normal    SuccessfulCreate   {replication-controller }            Created pod: postgresql-1-0cq6l
1h        1h        1         postgresql-1          ReplicationController                                 Normal    SuccessfulDelete   {replication-controller }            Deleted pod: postgresql-1-0cq6l
56m       56m       1         postgresql-1          ReplicationController                                 Normal    SuccessfulCreate   {replication-controller }            Created pod: postgresql-1-3f7tk
46m       46m       1         postgresql-1          ReplicationController                                 Normal    SuccessfulDelete   {replication-controller }            Deleted pod: postgresql-1-3f7tk
43m       43m       1         postgresql-1          ReplicationController                                 Normal    SuccessfulCreate   {replication-controller }            Created pod: postgresql-1-4802g
33m       33m       1         postgresql-1          ReplicationController                                 Normal    SuccessfulDelete   {replication-controller }            Deleted pod: postgresql-1-4802g
1h        1h        1         postgresql-2-deploy   Pod                                                   Normal    Scheduled          {default-scheduler }                 Successfully assigned postgresql-2-deploy to ocp-node1.blr.redhat.com
1h        1h        1         postgresql-2-deploy   Pod                     spec.containers{deployment}   Normal    Pulled             {kubelet ocp-node1.blr.redhat.com}   Container image "openshift3/ose-deployer:v3.5.5.31.48" already present on machine
1h        1h        1         postgresql-2-deploy   Pod                     spec.containers{deployment}   Normal    Created            {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 8b51444aa151; Security:[seccomp=unconfined]
1h        1h        1         postgresql-2-deploy   Pod                     spec.containers{deployment}   Normal    Started            {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 8b51444aa151
1h        1h        1         postgresql-2-sst0j    Pod                                                   Normal    Scheduled          {default-scheduler }                 Successfully assigned postgresql-2-sst0j to ocp-node1.blr.redhat.com
1h        1h        6         postgresql-2-sst0j    Pod                     spec.containers{postgresql}   Normal    Pulled             {kubelet ocp-node1.blr.redhat.com}   Container image "registry.access.redhat.com/rhscl/postgresql-95-rhel7@sha256:33888776920331bc37ae17692bac043210305aa35ed444cf5eded89f8311d0d7" already present on machine
1h        1h        1         postgresql-2-sst0j    Pod                     spec.containers{postgresql}   Normal    Created            {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 2e44a8db554f; Security:[seccomp=unconfined]
1h        1h        1         postgresql-2-sst0j    Pod                     spec.containers{postgresql}   Normal    Started            {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 2e44a8db554f
1h        1h        1         postgresql-2-sst0j    Pod                     spec.containers{postgresql}   Normal    Created            {kubelet ocp-node1.blr.redhat.com}   Created container with docker id d72e546296a3; Security:[seccomp=unconfined]
1h        1h        1         postgresql-2-sst0j    Pod                     spec.containers{postgresql}   Normal    Started            {kubelet ocp-node1.blr.redhat.com}   Started container with docker id d72e546296a3
58m       1h        31        postgresql-2-sst0j    Pod                     spec.containers{postgresql}   Warning   BackOff            {kubelet ocp-node1.blr.redhat.com}   Back-off restarting failed docker container
1h        1h        3         postgresql-2-sst0j    Pod                                                   Warning   FailedSync         {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 10s restarting failed container=postgresql pod=postgresql-2-sst0j_gitlab(2405951a-0527-11e8-9f1c-00163e493c45)"

1h        1h        1         postgresql-2-sst0j   Pod       spec.containers{postgresql}   Normal    Created      {kubelet ocp-node1.blr.redhat.com}   Created container with docker id f39a0c1b1297; Security:[seccomp=unconfined]
1h        1h        1         postgresql-2-sst0j   Pod       spec.containers{postgresql}   Normal    Started      {kubelet ocp-node1.blr.redhat.com}   Started container with docker id f39a0c1b1297
1h        1h        4         postgresql-2-sst0j   Pod                                     Warning   FailedSync   {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 20s restarting failed container=postgresql pod=postgresql-2-sst0j_gitlab(2405951a-0527-11e8-9f1c-00163e493c45)"

1h        1h        1         postgresql-2-sst0j   Pod       spec.containers{postgresql}   Normal    Created      {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 259baa91aa6a; Security:[seccomp=unconfined]
1h        1h        1         postgresql-2-sst0j   Pod       spec.containers{postgresql}   Normal    Started      {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 259baa91aa6a
1h        1h        4         postgresql-2-sst0j   Pod                                     Warning   FailedSync   {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 40s restarting failed container=postgresql pod=postgresql-2-sst0j_gitlab(2405951a-0527-11e8-9f1c-00163e493c45)"

1h        1h        1         postgresql-2-sst0j   Pod       spec.containers{postgresql}   Normal    Created      {kubelet ocp-node1.blr.redhat.com}   Created container with docker id d18c803380dc; Security:[seccomp=unconfined]
1h        1h        1         postgresql-2-sst0j   Pod       spec.containers{postgresql}   Normal    Started      {kubelet ocp-node1.blr.redhat.com}   Started container with docker id d18c803380dc
1h        1h        7         postgresql-2-sst0j   Pod                                     Warning   FailedSync   {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 1m20s restarting failed container=postgresql pod=postgresql-2-sst0j_gitlab(2405951a-0527-11e8-9f1c-00163e493c45)"

1h        1h        1         postgresql-2-sst0j   Pod       spec.containers{postgresql}   Normal    Created      {kubelet ocp-node1.blr.redhat.com}   Created container with docker id 4625148f584e; Security:[seccomp=unconfined]
1h        1h        1         postgresql-2-sst0j   Pod       spec.containers{postgresql}   Normal    Started      {kubelet ocp-node1.blr.redhat.com}   Started container with docker id 4625148f584e
58m       1h        13        postgresql-2-sst0j   Pod                                     Warning   FailedSync   {kubelet ocp-node1.blr.redhat.com}   Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=postgresql pod=postgresql-2-sst0j_gitlab(2405951a-0527-11e8-9f1c-00163e493c45)"

1h        1h        1         postgresql-2   ReplicationController             Normal    SuccessfulCreate                 {replication-controller }        Created pod: postgresql-2-sst0j
58m       58m       1         postgresql-2   ReplicationController             Normal    SuccessfulDelete                 {replication-controller }        Deleted pod: postgresql-2-sst0j
1h        1h        1         postgresql     DeploymentConfig                  Normal    DeploymentCreated                {deploymentconfig-controller }   Created new replication controller "postgresql-1" for version 1
1h        1h        1         postgresql     DeploymentConfig                  Normal    DeploymentCancelled              {deploymentconfig-controller }   Cancelled deployment "postgresql-1" superceded by version 2
1h        1h        10        postgresql     DeploymentConfig                  Normal    DeploymentAwaitingCancellation   {deploymentconfig-controller }   Deployment of version 2 awaiting cancellation of older running deployments
1h        1h        1         postgresql     DeploymentConfig                  Normal    DeploymentCancelled              {deployments-controller }        postgresql-1: Deployment "gitlab/postgresql-1" cancelled
1h        1h        1         postgresql     DeploymentConfig                  Normal    DeploymentCreated                {deploymentconfig-controller }   Created new replication controller "postgresql-2" for version 2
47m       56m       35        postgresql     PersistentVolumeClaim             Normal    FailedBinding                    {persistentvolume-controller }   no persistent volumes available for this claim and no storage class is set
56m       56m       1         postgresql     DeploymentConfig                  Normal    DeploymentCreated                {deploymentconfig-controller }   Created new replication controller "postgresql-1" for version 1
44m       47m       13        postgresql     PersistentVolumeClaim             Normal    FailedBinding                    {persistentvolume-controller }   no persistent volumes available for this claim and no storage class is set
46m       46m       1         postgresql     DeploymentConfig                  Normal    ReplicationControllerScaled      {deploymentconfig-controller }   Scaled replication controller "postgresql-1" from 1 to 0
43m       43m       1         postgresql     DeploymentConfig                  Normal    DeploymentCreated                {deploymentconfig-controller }   Created new replication controller "postgresql-1" for version 1
33m       33m       1         postgresql     DeploymentConfig                  Normal    ReplicationControllerScaled      {deploymentconfig-controller }   Scaled replication controller "postgresql-1" from 1 to 0

I had exactly the same problem.
Adding a security constraint to the project where the gitlab deployment was started did the trick.

There is a nice description from Chris Milsted which helped a lot,
see https://blog.openshift.com/getting-any-docker-image-running-in-your-own-openshift-cluster/

I am also facing below problem
--> Scaling gateway-postgresqldb-1 to 1
error: update acceptor rejected gateway-postgresqldb-1: pods for rc 'gateway/gateway-postgresqldb-1' took longer than 600 seconds to become available

these are my events

oc get events.txt

Issues go stale after 90d of inactivity.

Mark the issue as fresh by commenting /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.
Exclude this issue from closing by commenting /lifecycle frozen.

If this issue is safe to close now please do so with /close.

/lifecycle stale

Stale issues rot after 30d of inactivity.

Mark the issue as fresh by commenting /remove-lifecycle rotten.
Rotten issues close after an additional 30d of inactivity.
Exclude this issue from closing by commenting /lifecycle frozen.

If this issue is safe to close now please do so with /close.

/lifecycle rotten
/remove-lifecycle stale

/remove-lifecycle-rotten

Rotten issues close after 30d of inactivity.

Reopen the issue by commenting /reopen.
Mark the issue as fresh by commenting /remove-lifecycle rotten.
Exclude this issue from closing again by commenting /lifecycle frozen.

/close

@openshift-bot: Closing this issue.

In response to this:

Rotten issues close after 30d of inactivity.

Reopen the issue by commenting /reopen.
Mark the issue as fresh by commenting /remove-lifecycle rotten.
Exclude this issue from closing again by commenting /lifecycle frozen.

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

timeout1200
Before the build choose - Edit - set Timeout to 1200

Had the same error, because the probes where wrong

Was this page helpful?
0 / 5 - 0 ratings