I've created 30 builds via:
for i in $( seq 1 30 ); do oc new-project gogo$i && oc new-app --template="redmine"; done
And some of them failed with:
I0305 16:43:02.072052 1 recreate.go:131] Performing acceptance check of gogo28/redmine-app-1
4 I0305 16:43:02.072136 1 lifecycle.go:445] Waiting 600 seconds for pods owned by deployment "gogo28/redmine-app-1" to become ready (checking every 1 seconds; 0 pods previously accepted)
5 F0305 16:53:02.072349 1 deployer.go:69] update acceptor rejected gogo28/redmine-app-1: pods for deployment "gogo28/redmine-app-1" took longer than 600 seconds to become ready
I got five bare metal servers each with 16GB of RAM 4 cores and they are located in one rack.
Can this issue be caused by creating too many instances at once? Another problem is that there are no events in event log for this particular deployments (deployments which failed).
david-strejc
All 18 comments
Can you post the output of oc get all --all -o yaml from a project where the deployment failed?
kargakis
on 8 Mar 2016
Reopen if you can reproduce and provide more info about the failures.
kargakis
on 1 Jul 2016
It seems can be reproduced:
- Start a deployment, which works more than 10 minutes (default value). Deployment will be marked as failed.
- Delete all objects (deployment, deploy pod, target pod etc.).
- Try to create a deployment with the same name - got "update acceptor rejected". Repeat many times - the same behavior.
- Restart origin-master and you can create deployment with that name.
livelace
on 17 Mar 2017
Confirming the same problem...
akamalov
on 3 Apr 2017
Can you guys post the output of:
oc version
oc get dc,rc,pod --all -o yaml
oc get events
Also can you grab logs from the controller process?
kargakis
on 4 Apr 2017
Here it is. Attempting to deploy one of the 'example' deployments: "django-psql-persistent"
Below is the output of what requested:
#
Get 'oc' version:
[root@node237 scripts]# oc version
oc v3.4.1.10
kubernetes v1.4.0+776c994
features: Basic-Auth GSSAPI Kerberos SPNEGO
Server https://master.openshift-cluster.bnymellon.net:8443
openshift v3.4.1.10
kubernetes v1.4.0+776c994
[root@node237 scripts]#
#
Get information on project test2 (pods, rc, etc):
[root@node237 scripts]# oc get dc,rc,pod -n test2 -o yaml
apiVersion: v1
items:
- apiVersion: v1
kind: DeploymentConfig
metadata:
annotations:
description: Defines how to deploy the application server
creationTimestamp: 2017-04-05T13:11:14Z
generation: 2
labels:
app: django-psql-persistent
template: django-psql-persistent
name: django-psql-persistent
namespace: test2
resourceVersion: "609134"
selfLink: /oapi/v1/namespaces/test2/deploymentconfigs/django-psql-persistent
uid: 58c5b5de-1a01-11e7-8237-005056b6143a
spec:
replicas: 1
selector:
name: django-psql-persistent
strategy:
resources: {}
rollingParams:
intervalSeconds: 1
maxSurge: 25%
maxUnavailable: 25%
timeoutSeconds: 600
updatePeriodSeconds: 1
type: Rolling
template:
metadata:
creationTimestamp: null
labels:
name: django-psql-persistent
name: django-psql-persistent
spec:
containers:
- env:
- name: DATABASE_SERVICE_NAME
value: postgresql
- name: DATABASE_ENGINE
value: postgresql
- name: DATABASE_NAME
value: default
- name: DATABASE_USER
valueFrom:
secretKeyRef:
key: database-user
name: django-psql-persistent
- name: DATABASE_PASSWORD
valueFrom:
secretKeyRef:
key: database-password
name: django-psql-persistent
- name: APP_CONFIG
- name: DJANGO_SECRET_KEY
valueFrom:
secretKeyRef:
key: django-secret-key
name: django-psql-persistent
image: 172.30.214.181:5000/test2/django-psql-persistent@sha256:631e2875e8a797692a9073e596b7cbacc34285e3a7ba077e2f7814bfee9093e5
imagePullPolicy: IfNotPresent
livenessProbe:
failureThreshold: 3
httpGet:
path: /health
port: 8080
scheme: HTTP
initialDelaySeconds: 30
periodSeconds: 10
successThreshold: 1
timeoutSeconds: 3
name: django-psql-persistent
ports:
- containerPort: 8080
protocol: TCP
readinessProbe:
failureThreshold: 3
httpGet:
path: /health
port: 8080
scheme: HTTP
initialDelaySeconds: 3
periodSeconds: 10
successThreshold: 1
timeoutSeconds: 3
resources:
limits:
memory: 512Mi
terminationMessagePath: /dev/termination-log
dnsPolicy: ClusterFirst
restartPolicy: Always
securityContext: {}
terminationGracePeriodSeconds: 30
test: false
triggers:
- imageChangeParams:
automatic: true
containerNames:
- django-psql-persistent
from:
kind: ImageStreamTag
name: django-psql-persistent:latest
namespace: test2
lastTriggeredImage: 172.30.214.181:5000/test2/django-psql-persistent@sha256:631e2875e8a797692a9073e596b7cbacc34285e3a7ba077e2f7814bfee9093e5
type: ImageChange
- type: ConfigChange
status:
conditions:
- lastTransitionTime: 2017-04-05T13:11:14Z
message: Deployment config does not have minimum availability.
status: "False"
type: Available
- lastTransitionTime: 2017-04-05T13:24:37Z
message: Replication controller "django-psql-persistent-1" has failed progressing
reason: ProgressDeadlineExceeded
status: "False"
type: Progressing
details:
causes:
- imageTrigger:
from:
kind: ImageStreamTag
name: django-psql-persistent:latest
namespace: test2
type: ImageChange
message: image change
latestVersion: 1
observedGeneration: 2
- apiVersion: v1
kind: DeploymentConfig
metadata:
annotations:
description: Defines how to deploy the database
creationTimestamp: 2017-04-05T13:11:14Z
generation: 2
labels:
app: django-psql-persistent
template: django-psql-persistent
name: postgresql
namespace: test2
resourceVersion: "608866"
selfLink: /oapi/v1/namespaces/test2/deploymentconfigs/postgresql
uid: 58c05d68-1a01-11e7-8237-005056b6143a
spec:
replicas: 1
selector:
name: postgresql
strategy:
recreateParams:
timeoutSeconds: 600
resources: {}
type: Recreate
template:
metadata:
creationTimestamp: null
labels:
name: postgresql
name: postgresql
spec:
containers:
- env:
- name: POSTGRESQL_USER
valueFrom:
secretKeyRef:
key: database-user
name: django-psql-persistent
- name: POSTGRESQL_PASSWORD
valueFrom:
secretKeyRef:
key: database-password
name: django-psql-persistent
- name: POSTGRESQL_DATABASE
value: default
image: registry.access.redhat.com/rhscl/postgresql-95-rhel7@sha256:3de246be6b1f80e8bde6f5b4fc06580327be4318804ea6812cf2f11505e6546a
imagePullPolicy: IfNotPresent
livenessProbe:
failureThreshold: 3
initialDelaySeconds: 30
periodSeconds: 10
successThreshold: 1
tcpSocket:
port: 5432
timeoutSeconds: 1
name: postgresql
ports:
- containerPort: 5432
protocol: TCP
readinessProbe:
exec:
command:
- /bin/sh
- -i
- -c
- psql -h 127.0.0.1 -U ${POSTGRESQL_USER} -q -d ${POSTGRESQL_DATABASE}
-c 'SELECT 1'
failureThreshold: 3
initialDelaySeconds: 5
periodSeconds: 10
successThreshold: 1
timeoutSeconds: 1
resources:
limits:
memory: 512Mi
terminationMessagePath: /dev/termination-log
volumeMounts:
- mountPath: /var/lib/pgsql/data
name: postgresql-data
dnsPolicy: ClusterFirst
restartPolicy: Always
securityContext: {}
terminationGracePeriodSeconds: 30
volumes:
- name: postgresql-data
persistentVolumeClaim:
claimName: postgresql
test: false
triggers:
- imageChangeParams:
automatic: true
containerNames:
- postgresql
from:
kind: ImageStreamTag
name: postgresql:9.5
namespace: openshift
lastTriggeredImage: registry.access.redhat.com/rhscl/postgresql-95-rhel7@sha256:3de246be6b1f80e8bde6f5b4fc06580327be4318804ea6812cf2f11505e6546a
type: ImageChange
- type: ConfigChange
status:
conditions:
- lastTransitionTime: 2017-04-05T13:11:14Z
message: Deployment config does not have minimum availability.
status: "False"
type: Available
- lastTransitionTime: 2017-04-05T13:21:25Z
message: Replication controller "postgresql-1" has failed progressing
reason: ProgressDeadlineExceeded
status: "False"
type: Progressing
details:
causes:
- imageTrigger:
from:
kind: ImageStreamTag
name: postgresql:9.5
namespace: openshift
type: ImageChange
message: image change
latestVersion: 1
observedGeneration: 2
- apiVersion: v1
kind: ReplicationController
metadata:
annotations:
kubectl.kubernetes.io/desired-replicas: "1"
openshift.io/deployer-pod.name: django-psql-persistent-1-deploy
openshift.io/deployment-config.latest-version: "1"
openshift.io/deployment-config.name: django-psql-persistent
openshift.io/deployment.phase: Failed
openshift.io/deployment.replicas: "0"
openshift.io/deployment.status-reason: image change
openshift.io/encoded-deployment-config: |
{"kind":"DeploymentConfig","apiVersion":"v1","metadata":{"name":"django-psql-persistent","namespace":"test2","selfLink":"/oapi/v1/namespaces/test2/deploymentconfigs/django-psql-persistent","uid":"58c5b5de-1a01-11e7-8237-005056b6143a","resourceVersion":"608149","generation":2,"creationTimestamp":"2017-04-05T13:11:14Z","labels":{"app":"django-psql-persistent","template":"django-psql-persistent"},"annotations":{"description":"Defines how to deploy the application server"}},"spec":{"strategy":{"type":"Rolling","rollingParams":{"updatePeriodSeconds":1,"intervalSeconds":1,"timeoutSeconds":600,"maxUnavailable":"25%","maxSurge":"25%"},"resources":{}},"triggers":[{"type":"ImageChange","imageChangeParams":{"automatic":true,"containerNames":["django-psql-persistent"],"from":{"kind":"ImageStreamTag","namespace":"test2","name":"django-psql-persistent:latest"},"lastTriggeredImage":"172.30.214.181:5000/test2/django-psql-persistent@sha256:631e2875e8a797692a9073e596b7cbacc34285e3a7ba077e2f7814bfee9093e5"}},{"type":"ConfigChange"}],"replicas":1,"test":false,"selector":{"name":"django-psql-persistent"},"template":{"metadata":{"name":"django-psql-persistent","creationTimestamp":null,"labels":{"name":"django-psql-persistent"}},"spec":{"containers":[{"name":"django-psql-persistent","image":"172.30.214.181:5000/test2/django-psql-persistent@sha256:631e2875e8a797692a9073e596b7cbacc34285e3a7ba077e2f7814bfee9093e5","ports":[{"containerPort":8080,"protocol":"TCP"}],"env":[{"name":"DATABASE_SERVICE_NAME","value":"postgresql"},{"name":"DATABASE_ENGINE","value":"postgresql"},{"name":"DATABASE_NAME","value":"default"},{"name":"DATABASE_USER","valueFrom":{"secretKeyRef":{"name":"django-psql-persistent","key":"database-user"}}},{"name":"DATABASE_PASSWORD","valueFrom":{"secretKeyRef":{"name":"django-psql-persistent","key":"database-password"}}},{"name":"APP_CONFIG"},{"name":"DJANGO_SECRET_KEY","valueFrom":{"secretKeyRef":{"name":"django-psql-persistent","key":"django-secret-key"}}}],"resources":{"limits":{"memory":"512Mi"}},"livenessProbe":{"httpGet":{"path":"/health","port":8080,"scheme":"HTTP"},"initialDelaySeconds":30,"timeoutSeconds":3,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/health","port":8080,"scheme":"HTTP"},"initialDelaySeconds":3,"timeoutSeconds":3,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","securityContext":{}}}},"status":{"latestVersion":1,"observedGeneration":1,"details":{"message":"image change","causes":[{"type":"ImageChange","imageTrigger":{"from":{"kind":"ImageStreamTag","namespace":"test2","name":"django-psql-persistent:latest"}}}]},"conditions":[{"type":"Available","status":"False","lastTransitionTime":"2017-04-05T13:11:14Z","message":"Deployment config does not have minimum availability."}]}}
creationTimestamp: 2017-04-05T13:14:24Z
generation: 3
labels:
app: django-psql-persistent
openshift.io/deployment-config.name: django-psql-persistent
template: django-psql-persistent
name: django-psql-persistent-1
namespace: test2
resourceVersion: "609133"
selfLink: /api/v1/namespaces/test2/replicationcontrollers/django-psql-persistent-1
uid: ca0a8cfa-1a01-11e7-8237-005056b6143a
spec:
replicas: 0
selector:
deployment: django-psql-persistent-1
deploymentconfig: django-psql-persistent
name: django-psql-persistent
template:
metadata:
annotations:
openshift.io/deployment-config.latest-version: "1"
openshift.io/deployment-config.name: django-psql-persistent
openshift.io/deployment.name: django-psql-persistent-1
creationTimestamp: null
labels:
deployment: django-psql-persistent-1
deploymentconfig: django-psql-persistent
name: django-psql-persistent
spec:
containers:
- env:
- name: DATABASE_SERVICE_NAME
value: postgresql
- name: DATABASE_ENGINE
value: postgresql
- name: DATABASE_NAME
value: default
- name: DATABASE_USER
valueFrom:
secretKeyRef:
key: database-user
name: django-psql-persistent
- name: DATABASE_PASSWORD
valueFrom:
secretKeyRef:
key: database-password
name: django-psql-persistent
- name: APP_CONFIG
- name: DJANGO_SECRET_KEY
valueFrom:
secretKeyRef:
key: django-secret-key
name: django-psql-persistent
image: 172.30.214.181:5000/test2/django-psql-persistent@sha256:631e2875e8a797692a9073e596b7cbacc34285e3a7ba077e2f7814bfee9093e5
imagePullPolicy: IfNotPresent
livenessProbe:
failureThreshold: 3
httpGet:
path: /health
port: 8080
scheme: HTTP
initialDelaySeconds: 30
periodSeconds: 10
successThreshold: 1
timeoutSeconds: 3
name: django-psql-persistent
ports:
- containerPort: 8080
protocol: TCP
readinessProbe:
failureThreshold: 3
httpGet:
path: /health
port: 8080
scheme: HTTP
initialDelaySeconds: 3
periodSeconds: 10
successThreshold: 1
timeoutSeconds: 3
resources:
limits:
memory: 512Mi
terminationMessagePath: /dev/termination-log
dnsPolicy: ClusterFirst
restartPolicy: Always
securityContext: {}
terminationGracePeriodSeconds: 30
status:
observedGeneration: 3
replicas: 0
- apiVersion: v1
kind: ReplicationController
metadata:
annotations:
kubectl.kubernetes.io/desired-replicas: "1"
openshift.io/deployer-pod.name: postgresql-1-deploy
openshift.io/deployment-config.latest-version: "1"
openshift.io/deployment-config.name: postgresql
openshift.io/deployment.phase: Failed
openshift.io/deployment.replicas: "0"
openshift.io/deployment.status-reason: image change
openshift.io/encoded-deployment-config: |
{"kind":"DeploymentConfig","apiVersion":"v1","metadata":{"name":"postgresql","namespace":"test2","selfLink":"/oapi/v1/namespaces/test2/deploymentconfigs/postgresql","uid":"58c05d68-1a01-11e7-8237-005056b6143a","resourceVersion":"607815","generation":2,"creationTimestamp":"2017-04-05T13:11:14Z","labels":{"app":"django-psql-persistent","template":"django-psql-persistent"},"annotations":{"description":"Defines how to deploy the database"}},"spec":{"strategy":{"type":"Recreate","recreateParams":{"timeoutSeconds":600},"resources":{}},"triggers":[{"type":"ImageChange","imageChangeParams":{"automatic":true,"containerNames":["postgresql"],"from":{"kind":"ImageStreamTag","namespace":"openshift","name":"postgresql:9.5"},"lastTriggeredImage":"registry.access.redhat.com/rhscl/postgresql-95-rhel7@sha256:3de246be6b1f80e8bde6f5b4fc06580327be4318804ea6812cf2f11505e6546a"}},{"type":"ConfigChange"}],"replicas":1,"test":false,"selector":{"name":"postgresql"},"template":{"metadata":{"name":"postgresql","creationTimestamp":null,"labels":{"name":"postgresql"}},"spec":{"volumes":[{"name":"postgresql-data","persistentVolumeClaim":{"claimName":"postgresql"}}],"containers":[{"name":"postgresql","image":"registry.access.redhat.com/rhscl/postgresql-95-rhel7@sha256:3de246be6b1f80e8bde6f5b4fc06580327be4318804ea6812cf2f11505e6546a","ports":[{"containerPort":5432,"protocol":"TCP"}],"env":[{"name":"POSTGRESQL_USER","valueFrom":{"secretKeyRef":{"name":"django-psql-persistent","key":"database-user"}}},{"name":"POSTGRESQL_PASSWORD","valueFrom":{"secretKeyRef":{"name":"django-psql-persistent","key":"database-password"}}},{"name":"POSTGRESQL_DATABASE","value":"default"}],"resources":{"limits":{"memory":"512Mi"}},"volumeMounts":[{"name":"postgresql-data","mountPath":"/var/lib/pgsql/data"}],"livenessProbe":{"tcpSocket":{"port":5432},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/sh","-i","-c","psql -h 127.0.0.1 -U ${POSTGRESQL_USER} -q -d ${POSTGRESQL_DATABASE} -c 'SELECT 1'"]},"initialDelaySeconds":5,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","securityContext":{}}}},"status":{"latestVersion":1,"observedGeneration":1,"details":{"message":"image change","causes":[{"type":"ImageChange","imageTrigger":{"from":{"kind":"ImageStreamTag","namespace":"openshift","name":"postgresql:9.5"}}}]},"conditions":[{"type":"Available","status":"False","lastTransitionTime":"2017-04-05T13:11:14Z","message":"Deployment config does not have minimum availability."}]}}
creationTimestamp: 2017-04-05T13:11:14Z
generation: 3
labels:
app: django-psql-persistent
openshift.io/deployment-config.name: postgresql
template: django-psql-persistent
name: postgresql-1
namespace: test2
resourceVersion: "608865"
selfLink: /api/v1/namespaces/test2/replicationcontrollers/postgresql-1
uid: 58d58f7f-1a01-11e7-8237-005056b6143a
spec:
replicas: 0
selector:
deployment: postgresql-1
deploymentconfig: postgresql
name: postgresql
template:
metadata:
annotations:
openshift.io/deployment-config.latest-version: "1"
openshift.io/deployment-config.name: postgresql
openshift.io/deployment.name: postgresql-1
creationTimestamp: null
labels:
deployment: postgresql-1
deploymentconfig: postgresql
name: postgresql
spec:
containers:
- env:
- name: POSTGRESQL_USER
valueFrom:
secretKeyRef:
key: database-user
name: django-psql-persistent
- name: POSTGRESQL_PASSWORD
valueFrom:
secretKeyRef:
key: database-password
name: django-psql-persistent
- name: POSTGRESQL_DATABASE
value: default
image: registry.access.redhat.com/rhscl/postgresql-95-rhel7@sha256:3de246be6b1f80e8bde6f5b4fc06580327be4318804ea6812cf2f11505e6546a
imagePullPolicy: IfNotPresent
livenessProbe:
failureThreshold: 3
initialDelaySeconds: 30
periodSeconds: 10
successThreshold: 1
tcpSocket:
port: 5432
timeoutSeconds: 1
name: postgresql
ports:
- containerPort: 5432
protocol: TCP
readinessProbe:
exec:
command:
- /bin/sh
- -i
- -c
- psql -h 127.0.0.1 -U ${POSTGRESQL_USER} -q -d ${POSTGRESQL_DATABASE}
-c 'SELECT 1'
failureThreshold: 3
initialDelaySeconds: 5
periodSeconds: 10
successThreshold: 1
timeoutSeconds: 1
resources:
limits:
memory: 512Mi
terminationMessagePath: /dev/termination-log
volumeMounts:
- mountPath: /var/lib/pgsql/data
name: postgresql-data
dnsPolicy: ClusterFirst
restartPolicy: Always
securityContext: {}
terminationGracePeriodSeconds: 30
volumes:
- name: postgresql-data
persistentVolumeClaim:
claimName: postgresql
status:
observedGeneration: 3
replicas: 0
- apiVersion: v1
kind: Pod
metadata:
annotations:
openshift.io/build.name: django-psql-persistent-1
openshift.io/scc: privileged
creationTimestamp: 2017-04-05T13:11:14Z
labels:
openshift.io/build.name: django-psql-persistent-1
name: django-psql-persistent-1-build
namespace: test2
resourceVersion: "608160"
selfLink: /api/v1/namespaces/test2/pods/django-psql-persistent-1-build
uid: 590f6ea4-1a01-11e7-8237-005056b6143a
spec:
containers:
- args:
- --loglevel=0
env:
- name: BUILD
value: |
{"kind":"Build","apiVersion":"v1","metadata":{"name":"django-psql-persistent-1","namespace":"test2","selfLink":"/oapi/v1/namespaces/test2/builds/django-psql-persistent-1","uid":"58ee4acd-1a01-11e7-8237-005056b6143a","resourceVersion":"607826","creationTimestamp":"2017-04-05T13:11:14Z","labels":{"app":"django-psql-persistent","buildconfig":"django-psql-persistent","openshift.io/build-config.name":"django-psql-persistent","openshift.io/build.start-policy":"Serial","template":"django-psql-persistent"},"annotations":{"openshift.io/build-config.name":"django-psql-persistent","openshift.io/build.number":"1"}},"spec":{"serviceAccount":"builder","source":{"type":"Git","git":{"uri":"https://github.com/openshift/django-ex.git"}},"strategy":{"type":"Source","sourceStrategy":{"from":{"kind":"DockerImage","name":"registry.access.redhat.com/rhscl/python-35-rhel7@sha256:95317a94cc9a9bfef5ea0168fa64124778896c08fcab7f6408904d8f6a4a8c2d"},"env":[{"name":"PIP_INDEX_URL"}]}},"output":{"to":{"kind":"DockerImage","name":"172.30.214.181:5000/test2/django-psql-persistent:latest"},"pushSecret":{"name":"builder-dockercfg-8bef1"}},"resources":{},"postCommit":{"script":"./manage.py test"},"nodeSelector":null,"triggeredBy":[{"message":"Build configuration change"}]},"status":{"phase":"New","outputDockerImageReference":"172.30.214.181:5000/test2/django-psql-persistent:latest","config":{"kind":"BuildConfig","namespace":"test2","name":"django-psql-persistent"}}}
- name: SOURCE_REPOSITORY
value: https://github.com/openshift/django-ex.git
- name: SOURCE_URI
value: https://github.com/openshift/django-ex.git
- name: ORIGIN_VERSION
value: v3.4.1.10
- name: ALLOWED_UIDS
value: 1-
- name: DROP_CAPS
value: KILL,MKNOD,SETGID,SETUID,SYS_CHROOT
- name: PUSH_DOCKERCFG_PATH
value: /var/run/secrets/openshift.io/push
image: openshift3/ose-sti-builder:v3.4.1.10
imagePullPolicy: IfNotPresent
name: sti-build
resources: {}
securityContext:
privileged: true
terminationMessagePath: /dev/termination-log
volumeMounts:
- mountPath: /var/run/docker.sock
name: docker-socket
- mountPath: /var/run/secrets/openshift.io/push
name: builder-dockercfg-8bef1-push
readOnly: true
- mountPath: /var/run/secrets/kubernetes.io/serviceaccount
name: builder-token-lsoq9
readOnly: true
dnsPolicy: ClusterFirst
imagePullSecrets:
- name: builder-dockercfg-8bef1
nodeName: node239.localnet.net
restartPolicy: Never
securityContext: {}
serviceAccount: builder
serviceAccountName: builder
terminationGracePeriodSeconds: 30
volumes:
- hostPath:
path: /var/run/docker.sock
name: docker-socket
- name: builder-dockercfg-8bef1-push
secret:
defaultMode: 420
secretName: builder-dockercfg-8bef1
- name: builder-token-lsoq9
secret:
defaultMode: 420
secretName: builder-token-lsoq9
status:
conditions:
- lastProbeTime: null
lastTransitionTime: 2017-04-05T13:11:15Z
reason: PodCompleted
status: "True"
type: Initialized
- lastProbeTime: null
lastTransitionTime: 2017-04-05T13:14:25Z
reason: PodCompleted
status: "False"
type: Ready
- lastProbeTime: null
lastTransitionTime: 2017-04-05T13:11:14Z
status: "True"
type: PodScheduled
containerStatuses:
- containerID: docker://e6383048384b667c4b99a19a39d6a24be2b17e322d6cb2684438131091bbe15b
image: openshift3/ose-sti-builder:v3.4.1.10
imageID: docker-pullable://registry.access.redhat.com/openshift3/ose-sti-builder@sha256:f373b2751facc14a3bbf67a5c63a2c8d46084ed7732a37d6fb7c4949d276ce7d
lastState: {}
name: sti-build
ready: false
restartCount: 0
state:
terminated:
containerID: docker://e6383048384b667c4b99a19a39d6a24be2b17e322d6cb2684438131091bbe15b
exitCode: 0
finishedAt: 2017-04-05T13:14:24Z
reason: Completed
startedAt: 2017-04-05T13:11:23Z
hostIP: 192.168.158.239
phase: Succeeded
podIP: 10.130.0.5
startTime: 2017-04-05T13:11:15Z
- apiVersion: v1
kind: Pod
metadata:
annotations:
openshift.io/deployment.name: django-psql-persistent-1
openshift.io/scc: restricted
creationTimestamp: 2017-04-05T13:14:24Z
labels:
openshift.io/deployer-pod-for.name: django-psql-persistent-1
name: django-psql-persistent-1-deploy
namespace: test2
resourceVersion: "609122"
selfLink: /api/v1/namespaces/test2/pods/django-psql-persistent-1-deploy
uid: ca126d8f-1a01-11e7-8237-005056b6143a
spec:
activeDeadlineSeconds: 21600
containers:
- env:
- name: KUBERNETES_MASTER
value: https://node237.localnet.net:8443
- name: OPENSHIFT_MASTER
value: https://node237.localnet.net:8443
- name: BEARER_TOKEN_FILE
value: /var/run/secrets/kubernetes.io/serviceaccount/token
- name: OPENSHIFT_CA_DATA
value: REDACTED
- name: OPENSHIFT_DEPLOYMENT_NAME
value: django-psql-persistent-1
- name: OPENSHIFT_DEPLOYMENT_NAMESPACE
value: test2
image: openshift3/ose-deployer:v3.4.1.10
imagePullPolicy: IfNotPresent
name: deployment
resources: {}
securityContext:
capabilities:
drop:
- KILL
- MKNOD
- SETGID
- SETUID
- SYS_CHROOT
privileged: false
runAsUser: 1000110000
seLinuxOptions:
level: s0:c11,c0
terminationMessagePath: /dev/termination-log
volumeMounts:
- mountPath: /var/run/secrets/kubernetes.io/serviceaccount
name: deployer-token-twlxq
readOnly: true
dnsPolicy: ClusterFirst
imagePullSecrets:
- name: deployer-dockercfg-l08uk
nodeName: node264.localnet.net
restartPolicy: Never
securityContext:
fsGroup: 1000110000
seLinuxOptions:
level: s0:c11,c0
serviceAccount: deployer
serviceAccountName: deployer
terminationGracePeriodSeconds: 10
volumes:
- name: deployer-token-twlxq
secret:
defaultMode: 420
secretName: deployer-token-twlxq
status:
conditions:
- lastProbeTime: null
lastTransitionTime: 2017-04-05T13:14:24Z
status: "True"
type: Initialized
- lastProbeTime: null
lastTransitionTime: 2017-04-05T13:24:37Z
message: 'containers with unready status: [deployment]'
reason: ContainersNotReady
status: "False"
type: Ready
- lastProbeTime: null
lastTransitionTime: 2017-04-05T13:14:24Z
status: "True"
type: PodScheduled
containerStatuses:
- containerID: docker://cf5c380009d34d53ec99a85608a40e5adc4f7f370ca7ab57657bf5fae7cb6c4c
image: openshift3/ose-deployer:v3.4.1.10
imageID: docker-pullable://registry.access.redhat.com/openshift3/ose-deployer@sha256:5488cb52b4fa8cc8620c74c0b3e62ef6e5f07ce335e2cea3952d0837e21fd70f
lastState: {}
name: deployment
ready: false
restartCount: 0
state:
terminated:
containerID: docker://cf5c380009d34d53ec99a85608a40e5adc4f7f370ca7ab57657bf5fae7cb6c4c
exitCode: 1
finishedAt: 2017-04-05T13:24:36Z
reason: Error
startedAt: 2017-04-05T13:14:30Z
hostIP: 192.168.158.98
phase: Failed
podIP: 10.130.2.6
startTime: 2017-04-05T13:14:24Z
- apiVersion: v1
kind: Pod
metadata:
annotations:
openshift.io/deployment.name: postgresql-1
openshift.io/scc: restricted
creationTimestamp: 2017-04-05T13:11:14Z
labels:
openshift.io/deployer-pod-for.name: postgresql-1
name: postgresql-1-deploy
namespace: test2
resourceVersion: "608854"
selfLink: /api/v1/namespaces/test2/pods/postgresql-1-deploy
uid: 58eb3ecb-1a01-11e7-8237-005056b6143a
spec:
activeDeadlineSeconds: 21600
containers:
- env:
- name: KUBERNETES_MASTER
value: https://node237.localnet.net:8443
- name: OPENSHIFT_MASTER
value: https://node237.localnet.net:8443
- name: BEARER_TOKEN_FILE
value: /var/run/secrets/kubernetes.io/serviceaccount/token
- name: OPENSHIFT_CA_DATA
value: REDACTED
- name: OPENSHIFT_DEPLOYMENT_NAME
value: postgresql-1
- name: OPENSHIFT_DEPLOYMENT_NAMESPACE
value: test2
image: openshift3/ose-deployer:v3.4.1.10
imagePullPolicy: IfNotPresent
name: deployment
resources: {}
securityContext:
capabilities:
drop:
- KILL
- MKNOD
- SETGID
- SETUID
- SYS_CHROOT
privileged: false
runAsUser: 1000110000
seLinuxOptions:
level: s0:c11,c0
terminationMessagePath: /dev/termination-log
volumeMounts:
- mountPath: /var/run/secrets/kubernetes.io/serviceaccount
name: deployer-token-twlxq
readOnly: true
dnsPolicy: ClusterFirst
imagePullSecrets:
- name: deployer-dockercfg-l08uk
nodeName: node260.localnet.net
restartPolicy: Never
securityContext:
fsGroup: 1000110000
seLinuxOptions:
level: s0:c11,c0
serviceAccount: deployer
serviceAccountName: deployer
terminationGracePeriodSeconds: 10
volumes:
- name: deployer-token-twlxq
secret:
defaultMode: 420
secretName: deployer-token-twlxq
status:
conditions:
- lastProbeTime: null
lastTransitionTime: 2017-04-05T13:11:14Z
status: "True"
type: Initialized
- lastProbeTime: null
lastTransitionTime: 2017-04-05T13:21:25Z
message: 'containers with unready status: [deployment]'
reason: ContainersNotReady
status: "False"
type: Ready
- lastProbeTime: null
lastTransitionTime: 2017-04-05T13:11:14Z
status: "True"
type: PodScheduled
containerStatuses:
- containerID: docker://bd81f73c622c2178ccf08a72d7773420637aa5676132f53b1f9ea1b591eed11f
image: openshift3/ose-deployer:v3.4.1.10
imageID: docker-pullable://registry.access.redhat.com/openshift3/ose-deployer@sha256:5488cb52b4fa8cc8620c74c0b3e62ef6e5f07ce335e2cea3952d0837e21fd70f
lastState: {}
name: deployment
ready: false
restartCount: 0
state:
terminated:
containerID: docker://bd81f73c622c2178ccf08a72d7773420637aa5676132f53b1f9ea1b591eed11f
exitCode: 1
finishedAt: 2017-04-05T13:21:24Z
reason: Error
startedAt: 2017-04-05T13:11:20Z
hostIP: 192.168.158.94
phase: Failed
podIP: 10.128.2.5
startTime: 2017-04-05T13:11:14Z
kind: List
metadata: {}
#
Display events:
[root@node237 scripts]# oc get event -n test2
LASTSEEN FIRSTSEEN COUNT NAME KIND SUBOBJECT TYPE REASON SOURCE MESSAGE
20m 20m 1 django-psql-persistent-1-build Pod Normal Scheduled {default-scheduler } Successfully assigned django-psql-persistent-1-build to node239.localnet.net
20m 20m 1 django-psql-persistent-1-build Pod spec.containers{sti-build} Normal Pulled {kubelet node239.localnet.net} Container image "openshift3/ose-sti-builder:v3.4.1.10" already present on machine
20m 20m 1 django-psql-persistent-1-build Pod spec.containers{sti-build} Normal Created {kubelet node239.localnet.net} Created container with docker id e6383048384b; Security:[seccomp=unconfined]
20m 20m 1 django-psql-persistent-1-build Pod spec.containers{sti-build} Normal Started {kubelet node239.localnet.net} Started container with docker id e6383048384b
17m 17m 1 django-psql-persistent-1-csbgk Pod Normal Scheduled {default-scheduler } Successfully assigned django-psql-persistent-1-csbgk to node239.localnet.net
10m 17m 7 django-psql-persistent-1-csbgk Pod spec.containers{django-psql-persistent} Normal Pulled {kubelet node239.localnet.net} Container image "172.30.214.181:5000/test2/django-psql-persistent@sha256:631e2875e8a797692a9073e596b7cbacc34285e3a7ba077e2f7814bfee9093e5" already present on machine
17m 17m 1 django-psql-persistent-1-csbgk Pod spec.containers{django-psql-persistent} Normal Created {kubelet node239.localnet.net} Created container with docker id 59fe18f1db9b; Security:[seccomp=unconfined]
17m 17m 1 django-psql-persistent-1-csbgk Pod spec.containers{django-psql-persistent} Normal Started {kubelet node239.localnet.net} Started container with docker id 59fe18f1db9b
14m 17m 5 django-psql-persistent-1-csbgk Pod spec.containers{django-psql-persistent} Warning Unhealthy {kubelet node239.localnet.net} Readiness probe failed: Get http://10.130.0.6:8080/health: dial tcp 10.130.0.6:8080: getsockopt: connection refused
16m 16m 1 django-psql-persistent-1-csbgk Pod spec.containers{django-psql-persistent} Normal Created {kubelet node239.localnet.net} Created container with docker id 64a0e8be57b0; Security:[seccomp=unconfined]
16m 16m 1 django-psql-persistent-1-csbgk Pod spec.containers{django-psql-persistent} Normal Started {kubelet node239.localnet.net} Started container with docker id 64a0e8be57b0
7m 16m 44 django-psql-persistent-1-csbgk Pod spec.containers{django-psql-persistent} Warning BackOff {kubelet node239.localnet.net} Back-off restarting failed docker container
16m 16m 2 django-psql-persistent-1-csbgk Pod Warning FailedSync {kubelet node239.localnet.net} Error syncing pod, skipping: failed to "StartContainer" for "django-psql-persistent" with CrashLoopBackOff: "Back-off 10s restarting failed container=django-psql-persistent pod=django-psql-persistent-1-csbgk_test2(d0f32d23-1a01-11e7-8237-005056b6143a)"
16m 16m 1 django-psql-persistent-1-csbgk Pod spec.containers{django-psql-persistent} Normal Created {kubelet node239.localnet.net} Created container with docker id 3b6f7d23097b; Security:[seccomp=unconfined]
16m 16m 1 django-psql-persistent-1-csbgk Pod spec.containers{django-psql-persistent} Normal Started {kubelet node239.localnet.net} Started container with docker id 3b6f7d23097b
16m 16m 3 django-psql-persistent-1-csbgk Pod Warning FailedSync {kubelet node239.localnet.net} Error syncing pod, skipping: failed to "StartContainer" for "django-psql-persistent" with CrashLoopBackOff: "Back-off 20s restarting failed container=django-psql-persistent pod=django-psql-persistent-1-csbgk_test2(d0f32d23-1a01-11e7-8237-005056b6143a)"
15m 15m 1 django-psql-persistent-1-csbgk Pod spec.containers{django-psql-persistent} Normal Created {kubelet node239.localnet.net} Created container with docker id b27016951889; Security:[seccomp=unconfined]
15m 15m 1 django-psql-persistent-1-csbgk Pod spec.containers{django-psql-persistent} Normal Started {kubelet node239.localnet.net} Started container with docker id b27016951889
15m 15m 4 django-psql-persistent-1-csbgk Pod Warning FailedSync {kubelet node239.localnet.net} Error syncing pod, skipping: failed to "StartContainer" for "django-psql-persistent" with CrashLoopBackOff: "Back-off 40s restarting failed container=django-psql-persistent pod=django-psql-persistent-1-csbgk_test2(d0f32d23-1a01-11e7-8237-005056b6143a)"
14m 14m 1 django-psql-persistent-1-csbgk Pod spec.containers{django-psql-persistent} Normal Created {kubelet node239.localnet.net} Created container with docker id 57f9e8e10a5f; Security:[seccomp=unconfined]
14m 14m 1 django-psql-persistent-1-csbgk Pod spec.containers{django-psql-persistent} Normal Started {kubelet node239.localnet.net} Started container with docker id 57f9e8e10a5f
13m 14m 7 django-psql-persistent-1-csbgk Pod Warning FailedSync {kubelet node239.localnet.net} Error syncing pod, skipping: failed to "StartContainer" for "django-psql-persistent" with CrashLoopBackOff: "Back-off 1m20s restarting failed container=django-psql-persistent pod=django-psql-persistent-1-csbgk_test2(d0f32d23-1a01-11e7-8237-005056b6143a)"
13m 13m 1 django-psql-persistent-1-csbgk Pod spec.containers{django-psql-persistent} Normal Created {kubelet node239.localnet.net} Created container with docker id 20dcd0b2e0f8; Security:[seccomp=unconfined]
13m 13m 1 django-psql-persistent-1-csbgk Pod spec.containers{django-psql-persistent} Normal Started {kubelet node239.localnet.net} Started container with docker id 20dcd0b2e0f8
10m 13m 13 django-psql-persistent-1-csbgk Pod Warning FailedSync {kubelet node239.localnet.net} Error syncing pod, skipping: failed to "StartContainer" for "django-psql-persistent" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=django-psql-persistent pod=django-psql-persistent-1-csbgk_test2(d0f32d23-1a01-11e7-8237-005056b6143a)"
10m 10m 1 django-psql-persistent-1-csbgk Pod spec.containers{django-psql-persistent} Normal Created {kubelet node239.localnet.net} Created container with docker id 55d0b9c16b82; Security:[seccomp=unconfined]
10m 10m 1 django-psql-persistent-1-csbgk Pod spec.containers{django-psql-persistent} Normal Started {kubelet node239.localnet.net} Started container with docker id 55d0b9c16b82
7m 10m 15 django-psql-persistent-1-csbgk Pod Warning FailedSync {kubelet node239.localnet.net} Error syncing pod, skipping: failed to "StartContainer" for "django-psql-persistent" with CrashLoopBackOff: "Back-off 5m0s restarting failed container=django-psql-persistent pod=django-psql-persistent-1-csbgk_test2(d0f32d23-1a01-11e7-8237-005056b6143a)"
17m 17m 1 django-psql-persistent-1-deploy Pod Normal Scheduled {default-scheduler } Successfully assigned django-psql-persistent-1-deploy to node264.localnet.net
17m 17m 1 django-psql-persistent-1-deploy Pod spec.containers{deployment} Normal Pulled {kubelet node264.localnet.net} Container image "openshift3/ose-deployer:v3.4.1.10" already present on machine
17m 17m 1 django-psql-persistent-1-deploy Pod spec.containers{deployment} Normal Created {kubelet node264.localnet.net} Created container with docker id cf5c380009d3; Security:[seccomp=unconfined]
17m 17m 1 django-psql-persistent-1-deploy Pod spec.containers{deployment} Normal Started {kubelet node264.localnet.net} Started container with docker id cf5c380009d3
17m 17m 1 django-psql-persistent-1 ReplicationController Normal SuccessfulCreate {replication-controller } Created pod: django-psql-persistent-1-csbgk
7m 7m 1 django-psql-persistent-1 ReplicationController Normal SuccessfulDelete {replication-controller } Deleted pod: django-psql-persistent-1-csbgk
17m 17m 1 django-psql-persistent DeploymentConfig Normal DeploymentCreated {deploymentconfig-controller } Created new replication controller "django-psql-persistent-1" for version 1
7m 7m 1 django-psql-persistent DeploymentConfig Normal ReplicationControllerScaled {deploymentconfig-controller } Scaled replication controller "django-psql-persistent-1" from 1 to 0
20m 20m 1 postgresql-1-deploy Pod Normal Scheduled {default-scheduler } Successfully assigned postgresql-1-deploy to node260.localnet.net
20m 20m 1 postgresql-1-deploy Pod spec.containers{deployment} Normal Pulled {kubelet node260.localnet.net} Container image "openshift3/ose-deployer:v3.4.1.10" already present on machine
20m 20m 1 postgresql-1-deploy Pod spec.containers{deployment} Normal Created {kubelet node260.localnet.net} Created container with docker id bd81f73c622c; Security:[seccomp=unconfined]
20m 20m 1 postgresql-1-deploy Pod spec.containers{deployment} Normal Started {kubelet node260.localnet.net} Started container with docker id bd81f73c622c
20m 20m 1 postgresql-1-t199e Pod Normal Scheduled {default-scheduler } Successfully assigned postgresql-1-t199e to node238.localnet.net
20m 20m 1 postgresql-1-t199e Pod spec.containers{postgresql} Normal Pulling {kubelet node238.localnet.net} pulling image "registry.access.redhat.com/rhscl/postgresql-95-rhel7@sha256:3de246be6b1f80e8bde6f5b4fc06580327be4318804ea6812cf2f11505e6546a"
20m 20m 1 postgresql-1-t199e Pod spec.containers{postgresql} Normal Pulled {kubelet node238.localnet.net} Successfully pulled image "registry.access.redhat.com/rhscl/postgresql-95-rhel7@sha256:3de246be6b1f80e8bde6f5b4fc06580327be4318804ea6812cf2f11505e6546a"
20m 20m 1 postgresql-1-t199e Pod spec.containers{postgresql} Normal Created {kubelet node238.localnet.net} Created container with docker id daa7b685e961; Security:[seccomp=unconfined]
20m 20m 1 postgresql-1-t199e Pod spec.containers{postgresql} Normal Started {kubelet node238.localnet.net} Started container with docker id daa7b685e961
13m 19m 6 postgresql-1-t199e Pod spec.containers{postgresql} Normal Pulled {kubelet node238.localnet.net} Container image "registry.access.redhat.com/rhscl/postgresql-95-rhel7@sha256:3de246be6b1f80e8bde6f5b4fc06580327be4318804ea6812cf2f11505e6546a" already present on machine
19m 19m 1 postgresql-1-t199e Pod spec.containers{postgresql} Normal Created {kubelet node238.localnet.net} Created container with docker id bc5d39a3b6a8; Security:[seccomp=unconfined]
19m 19m 1 postgresql-1-t199e Pod spec.containers{postgresql} Normal Started {kubelet node238.localnet.net} Started container with docker id bc5d39a3b6a8
10m 19m 47 postgresql-1-t199e Pod spec.containers{postgresql} Warning BackOff {kubelet node238.localnet.net} Back-off restarting failed docker container
19m 19m 2 postgresql-1-t199e Pod Warning FailedSync {kubelet node238.localnet.net} Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 10s restarting failed container=postgresql pod=postgresql-1-t199e_test2(5e7b1fd3-1a01-11e7-8237-005056b6143a)"
19m 19m 1 postgresql-1-t199e Pod spec.containers{postgresql} Normal Created {kubelet node238.localnet.net} Created container with docker id 0677b9733249; Security:[seccomp=unconfined]
19m 19m 1 postgresql-1-t199e Pod spec.containers{postgresql} Normal Started {kubelet node238.localnet.net} Started container with docker id 0677b9733249
19m 19m 3 postgresql-1-t199e Pod Warning FailedSync {kubelet node238.localnet.net} Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 20s restarting failed container=postgresql pod=postgresql-1-t199e_test2(5e7b1fd3-1a01-11e7-8237-005056b6143a)"
19m 19m 1 postgresql-1-t199e Pod spec.containers{postgresql} Normal Created {kubelet node238.localnet.net} Created container with docker id 07d05461c0ad; Security:[seccomp=unconfined]
19m 19m 1 postgresql-1-t199e Pod spec.containers{postgresql} Normal Started {kubelet node238.localnet.net} Started container with docker id 07d05461c0ad
18m 19m 4 postgresql-1-t199e Pod Warning FailedSync {kubelet node238.localnet.net} Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 40s restarting failed container=postgresql pod=postgresql-1-t199e_test2(5e7b1fd3-1a01-11e7-8237-005056b6143a)"
18m 18m 1 postgresql-1-t199e Pod spec.containers{postgresql} Normal Created {kubelet node238.localnet.net} Created container with docker id a8acbe218e6b; Security:[seccomp=unconfined]
18m 18m 1 postgresql-1-t199e Pod spec.containers{postgresql} Normal Started {kubelet node238.localnet.net} Started container with docker id a8acbe218e6b
16m 18m 7 postgresql-1-t199e Pod Warning FailedSync {kubelet node238.localnet.net} Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 1m20s restarting failed container=postgresql pod=postgresql-1-t199e_test2(5e7b1fd3-1a01-11e7-8237-005056b6143a)"
16m 16m 1 postgresql-1-t199e Pod spec.containers{postgresql} Normal Created {kubelet node238.localnet.net} Created container with docker id fff011cfca83; Security:[seccomp=unconfined]
16m 16m 1 postgresql-1-t199e Pod spec.containers{postgresql} Normal Started {kubelet node238.localnet.net} Started container with docker id fff011cfca83
14m 16m 14 postgresql-1-t199e Pod Warning FailedSync {kubelet node238.localnet.net} Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 2m40s restarting failed container=postgresql pod=postgresql-1-t199e_test2(5e7b1fd3-1a01-11e7-8237-005056b6143a)"
13m 13m 1 postgresql-1-t199e Pod spec.containers{postgresql} Normal Created {kubelet node238.localnet.net} Created container with docker id e8e38c4080f8; Security:[seccomp=unconfined]
13m 13m 1 postgresql-1-t199e Pod spec.containers{postgresql} Normal Started {kubelet node238.localnet.net} Started container with docker id e8e38c4080f8
10m 13m 17 postgresql-1-t199e Pod Warning FailedSync {kubelet node238.localnet.net} Error syncing pod, skipping: failed to "StartContainer" for "postgresql" with CrashLoopBackOff: "Back-off 5m0s restarting failed container=postgresql pod=postgresql-1-t199e_test2(5e7b1fd3-1a01-11e7-8237-005056b6143a)"
20m 20m 1 postgresql-1 ReplicationController Normal SuccessfulCreate {replication-controller } Created pod: postgresql-1-t199e
10m 10m 1 postgresql-1 ReplicationController Normal SuccessfulDelete {replication-controller } Deleted pod: postgresql-1-t199e
20m 20m 1 postgresql DeploymentConfig Normal DeploymentCreated {deploymentconfig-controller } Created new replication controller "postgresql-1" for version 1
10m 10m 1 postgresql DeploymentConfig
Normal ReplicationControllerScaled {deploymentconfig-controller } Scaled
replication controller "postgresql-1" from 1 to 0
#
akamalov
on 5 Apr 2017
Display pods:
[root@node237 origin]# oc get pods -n test2
NAME READY STATUS RESTARTS AGE
django-psql-persistent-1-build 0/1 Completed 0 47m
django-psql-persistent-1-deploy 0/1 Error 0 44m
postgresql-1-deploy 0/1 Error 0 47m
Display pod details:
[root@node237 origin]# oc describe pod django-psql-persistent-1-deploy -n test2
Name: django-psql-persistent-1-deploy
Namespace: test2
Security Policy: restricted
Node: node264.localnet.net/192.168.158.98
Start Time: Wed, 05 Apr 2017 13:14:24 +0000
Labels: openshift.io/deployer-pod-for.name=django-psql-persistent-1
Status: Failed
IP: 10.130.2.6
Controllers: <none>
Containers:
deployment:
Container ID: docker://cf5c380009d34d53ec99a85608a40e5adc4f7f370ca7ab57657bf5fae7cb6c4c
Image: openshift3/ose-deployer:v3.4.1.10
Image ID: docker-pullable://registry.access.redhat.com/openshift3/ose-deployer@sha256:5488cb52b4fa8cc8620c74c0b3e62ef6e5f07ce335e2cea3952d0837e21fd70f
Port:
State: Terminated
Reason: Error
Exit Code: 1
Started: Wed, 05 Apr 2017 13:14:30 +0000
Finished: Wed, 05 Apr 2017 13:24:36 +0000
Ready: False
Restart Count: 0
Volume Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from deployer-token-twlxq (ro)
Environment Variables:
KUBERNETES_MASTER: https://node237.localnet.net:8443
OPENSHIFT_MASTER: https://node237.localnet.net:8443
BEARER_TOKEN_FILE: /var/run/secrets/kubernetes.io/serviceaccount/token
OPENSHIFT_CA_DATA: REDACTED
OPENSHIFT_DEPLOYMENT_NAME: django-psql-persistent-1
OPENSHIFT_DEPLOYMENT_NAMESPACE: test2
Conditions:
Type Status
Initialized True
Ready False
PodScheduled True
Volumes:
deployer-token-twlxq:
Type: Secret (a volume populated by a Secret)
SecretName: deployer-token-twlxq
QoS Class: BestEffort
Tolerations: <none>
Events:
FirstSeen LastSeen Count From SubobjectPath Type Reason Message
--------- -------- ----- ---- ------------- -------- ------ -------
45m 45m 1 {default-scheduler } Normal Scheduled Successfully assigned django-psql-persistent-1-deploy to node264.localnet.net
45m 45m 1 {kubelet node264.localnet.net} spec.containers{deployment} Normal Pulled Container image "openshift3/ose-deployer:v3.4.1.10" already present on machine
45m 45m 1 {kubelet node264.localnet.net} spec.containers{deployment} Normal Created Created container with docker id cf5c380009d3; Security:[seccomp=unconfined]
45m 45m 1 {kubelet node264.localnet.net} spec.containers{deployment} Normal Started Started container with docker id cf5c380009d3
[root@node237 origin]#
Comments above were edited to remove certificate data. Better safe than sorry :smile:
pweil-
on 5 Apr 2017
👍1
Hi, I face the same issue for jenkins. I could not find a solution here. Has anyone helped with the solution for this issues.
Thanks in Advance
Ram
ram4ibm
on 25 Apr 2017
@akamalov can you also post the logs from the deployer pod?
oc logs -n test2 django-psql-persistent-1-deploy
error: update acceptor rejected amqservice-amq-4: pods for deployment "amqservice-amq-4" took longer than 600 seconds to become ready
I m getting this error while deploying amq-tcp-ssl. what are all the possibilities are there to get this error. And please help me to get out from this.
Renukadevir
on 16 May 2017
anyone got a clue for this? I have seen only logs requested thats all...? could someone please suggest the reason for this issue?
KrishnaVaddadi
on 27 Jun 2017
Hello Friends,
i am also experiencing the same issue , i am using tomcat 8 S2I catalog to deploy helloworld java app war file . However i see the below error ?
Any advise or help ?
Scaling javahello-1 to 1
| --> Waiting up to 10m0s for pods in deployment javahello-1 to become ready
| error: update acceptor rejected javahello-1: pods for deployment "javahello-1" took longer than 600 seconds to become read
ghost
on 12 Jul 2017
This error means that the pods the deployer is trying to deploy have never become ready. That could be a variety of different things which is why @kargakis requested logs. The steps you can take to try and diagnose this further are:
- look for failed containers of the image you are trying to deploy and check out their logs in docker. Perhaps the containers are failing and preventing the deployment from completing.
- review probes you have defined for the container in your pod spec. Is the probe defined correctly or is there an issue that would prevent readiness?
- review the logs of the deployment and look for errors
This issue is becoming a bit confused with different postings. Each image running into this issue could be suffering from its own problems. Since the original requestor has not responded with logs I'm going to close this with the suggestion that folks open their own unique issue with the detailed logs and resource definitions.
pweil-
on 12 Jul 2017
👍1
Thanks @pweil- will try your suggestions.
ghost
on 12 Jul 2017
i haven't configured any probes for this container, same war file worked when i deployed manually.
ghost
on 12 Jul 2017
This is my work around for this problem but first this is how i replicate it.
Steps to Replicate.
Create new app
command:oc new-app openshift/templates/dev-django.json --name=django-project
This will going to create a successful deployment.Delete the created new app.
command:oc delete all -l app=<appname>
This will delete the created app BUT NOT THEsecretsRecreate the app again with the same name.
This time. It will start build but in the end the error will be
update acceptor rejected
Work around is delete the secret of the app before create new app.
junejie
on 29 Jul 2017
There are many reasons why your pod may not start up (missing secrets, images, PVCs, app misconfiguration, etc.). Redirect new issues/questions into new issues please.
kargakis
on 29 Jul 2017
Was this page helpful?
0 / 5 - 0 ratings
Related issues
alikhajeh1
路
3Comments
edseymour
路
3Comments
crobby
路
4Comments
slmzig
路
3Comments
thescouser89
路
3Comments