Kubespray: Vagrant install with error
Hi,
I'm trying to run the vagrant install but some etcd errors are showing up.
Could someone help?
Thank you.
Here's the complete log:
23:02:55-kargo (master) $ vagrant status
vagranCurrent machine states:
k8s-01 not created (virtualbox)
k8s-02 not created (virtualbox)
k8s-03 not created (virtualbox)
This environment represents multiple VMs. The VMs are all listed
above with their current state. For more information about a specific
VM, run `vagrant status NAME`.
23:03:10-kargo (master) $ vagrant -v
Vagrant 1.8.5
23:03:12-kargo (master) $ vagrant up
Bringing machine 'k8s-01' up with 'virtualbox' provider...
Bringing machine 'k8s-02' up with 'virtualbox' provider...
Bringing machine 'k8s-03' up with 'virtualbox' provider...
==> k8s-01: Importing base box 'bento/ubuntu-14.04'...
==> k8s-01: Matching MAC address for NAT networking...
==> k8s-01: Checking if box 'bento/ubuntu-14.04' is up to date...
==> k8s-01: Setting the name of the VM: kargo_k8s-01_1469585013417_14329
==> k8s-01: Clearing any previously set network interfaces...
==> k8s-01: Preparing network interfaces based on configuration...
k8s-01: Adapter 1: nat
k8s-01: Adapter 2: hostonly
==> k8s-01: Forwarding ports...
k8s-01: 22 (guest) => 2222 (host) (adapter 1)
==> k8s-01: Running 'pre-boot' VM customizations...
==> k8s-01: Booting VM...
==> k8s-01: Waiting for machine to boot. This may take a few minutes...
k8s-01: SSH address: 127.0.0.1:2222
k8s-01: SSH username: vagrant
k8s-01: SSH auth method: private key
==> k8s-01: Machine booted and ready!
==> k8s-01: Checking for guest additions in VM...
==> k8s-01: Setting hostname...
==> k8s-01: Configuring and enabling network interfaces...
==> k8s-01: Mounting shared folders...
k8s-01: /vagrant => /Users/user/vagrant_kubernetes_kargo/kargo
==> k8s-02: Importing base box 'bento/ubuntu-14.04'...
==> k8s-02: Matching MAC address for NAT networking...
==> k8s-02: Checking if box 'bento/ubuntu-14.04' is up to date...
==> k8s-02: Setting the name of the VM: kargo_k8s-02_1469585044589_10253
==> k8s-02: Fixed port collision for 22 => 2222. Now on port 2200.
==> k8s-02: Clearing any previously set network interfaces...
==> k8s-02: Preparing network interfaces based on configuration...
k8s-02: Adapter 1: nat
k8s-02: Adapter 2: hostonly
==> k8s-02: Forwarding ports...
k8s-02: 22 (guest) => 2200 (host) (adapter 1)
==> k8s-02: Running 'pre-boot' VM customizations...
==> k8s-02: Booting VM...
==> k8s-02: Waiting for machine to boot. This may take a few minutes...
k8s-02: SSH address: 127.0.0.1:2200
k8s-02: SSH username: vagrant
k8s-02: SSH auth method: private key
==> k8s-02: Machine booted and ready!
==> k8s-02: Checking for guest additions in VM...
==> k8s-02: Setting hostname...
==> k8s-02: Configuring and enabling network interfaces...
==> k8s-02: Mounting shared folders...
k8s-02: /vagrant => /Users/user/vagrant_kubernetes_kargo/kargo
==> k8s-03: Importing base box 'bento/ubuntu-14.04'...
==> k8s-03: Matching MAC address for NAT networking...
==> k8s-03: Checking if box 'bento/ubuntu-14.04' is up to date...
==> k8s-03: Setting the name of the VM: kargo_k8s-03_1469585076403_8601
==> k8s-03: Fixed port collision for 22 => 2222. Now on port 2201.
==> k8s-03: Clearing any previously set network interfaces...
==> k8s-03: Preparing network interfaces based on configuration...
k8s-03: Adapter 1: nat
k8s-03: Adapter 2: hostonly
==> k8s-03: Forwarding ports...
k8s-03: 22 (guest) => 2201 (host) (adapter 1)
==> k8s-03: Running 'pre-boot' VM customizations...
==> k8s-03: Booting VM...
==> k8s-03: Waiting for machine to boot. This may take a few minutes...
k8s-03: SSH address: 127.0.0.1:2201
k8s-03: SSH username: vagrant
k8s-03: SSH auth method: private key
==> k8s-03: Machine booted and ready!
==> k8s-03: Checking for guest additions in VM...
==> k8s-03: Setting hostname...
==> k8s-03: Configuring and enabling network interfaces...
==> k8s-03: Mounting shared folders...
k8s-03: /vagrant => /Users/user/vagrant_kubernetes_kargo/kargo
==> k8s-03: Running provisioner: ansible...
==> k8s-03: Vagrant has detected a host range pattern in the `groups` option.
==> k8s-03: Vagrant doesn't fully check the validity of these parameters!
==> k8s-03:
==> k8s-03: Please check https://docs.ansible.com/ansible/intro_inventory.html#hosts-and-groups
==> k8s-03: for more information.
k8s-03: Running ansible-playbook...
PLAY [etcd] ********************************************************************
TASK [setup] *******************************************************************
ok: [k8s-03]
ok: [k8s-01]
ok: [k8s-02]
TASK [adduser : User | Create User Group] **************************************
changed: [k8s-03]
changed: [k8s-01]
changed: [k8s-02]
TASK [adduser : User | Create User] ********************************************
changed: [k8s-02]
changed: [k8s-01]
changed: [k8s-03]
TASK [kubernetes/preinstall : include] *****************************************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [kubernetes/preinstall : include] *****************************************
included: /Users/user/vagrant_kubernetes_kargo/kargo/roles/kubernetes/preinstall/tasks/set_facts.yml for k8s-01, k8s-02, k8s-03
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-02]
ok: [k8s-01]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-02]
ok: [k8s-01]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : gather os specific variables] ********************
ok: [k8s-01] => (item=/Users/user/vagrant_kubernetes_kargo/kargo/roles/kubernetes/preinstall/templates/../vars/debian.yml)
ok: [k8s-02] => (item=/Users/user/vagrant_kubernetes_kargo/kargo/roles/kubernetes/preinstall/templates/../vars/debian.yml)
ok: [k8s-03] => (item=/Users/user/vagrant_kubernetes_kargo/kargo/roles/kubernetes/preinstall/templates/../vars/debian.yml)
TASK [kubernetes/preinstall : Force binaries directory for CoreOS] *************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [kubernetes/preinstall : Create kubernetes config directory] **************
changed: [k8s-02]
changed: [k8s-01]
changed: [k8s-03]
TASK [kubernetes/preinstall : Create kubernetes script directory] **************
changed: [k8s-01]
changed: [k8s-02]
changed: [k8s-03]
TASK [kubernetes/preinstall : Create kubernetes manifests directory] ***********
changed: [k8s-01]
changed: [k8s-03]
changed: [k8s-02]
TASK [kubernetes/preinstall : Create kubernetes logs directory] ****************
changed: [k8s-02]
changed: [k8s-03]
changed: [k8s-01]
TASK [kubernetes/preinstall : check cloud_provider value] **********************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [kubernetes/preinstall : include] *****************************************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [kubernetes/preinstall : Create cni directories] **************************
skipping: [k8s-01] => (item=/etc/cni/net.d)
skipping: [k8s-02] => (item=/etc/cni/net.d)
skipping: [k8s-03] => (item=/etc/cni/net.d)
skipping: [k8s-02] => (item=/opt/cni/bin)
skipping: [k8s-01] => (item=/opt/cni/bin)
skipping: [k8s-03] => (item=/opt/cni/bin)
TASK [kubernetes/preinstall : Update package management cache (YUM)] ***********
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [kubernetes/preinstall : Install latest version of python-apt for Debian distribs] ***
ok: [k8s-02]
ok: [k8s-01]
ok: [k8s-03]
TASK [kubernetes/preinstall : Install python-dnf for latest RedHat versions] ***
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [kubernetes/preinstall : Install epel-release on RedHat/CentOS] ***********
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [kubernetes/preinstall : Install packages requirements] *******************
changed: [k8s-03] => (item=[u'python-apt', u'aufs-tools', u'apt-transport-https', u'software-properties-common', u'python-httplib2', u'openssl', u'curl', u'rsync', u'bash-completion'])
changed: [k8s-01] => (item=[u'python-apt', u'aufs-tools', u'apt-transport-https', u'software-properties-common', u'python-httplib2', u'openssl', u'curl', u'rsync', u'bash-completion'])
changed: [k8s-02] => (item=[u'python-apt', u'aufs-tools', u'apt-transport-https', u'software-properties-common', u'python-httplib2', u'openssl', u'curl', u'rsync', u'bash-completion'])
TASK [kubernetes/preinstall : Set selinux policy to permissive] ****************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [kubernetes/preinstall : Write openstack cloud-config] ********************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [kubernetes/preinstall : include] *****************************************
included: /Users/user/vagrant_kubernetes_kargo/kargo/roles/kubernetes/preinstall/tasks/etchosts.yml for k8s-01, k8s-02, k8s-03
TASK [kubernetes/preinstall : Hosts | populate inventory into hosts file] ******
changed: [k8s-01] => (item=k8s-01)
changed: [k8s-02] => (item=k8s-01)
changed: [k8s-03] => (item=k8s-01)
changed: [k8s-03] => (item=k8s-02)
changed: [k8s-02] => (item=k8s-02)
changed: [k8s-01] => (item=k8s-02)
changed: [k8s-03] => (item=k8s-03)
changed: [k8s-02] => (item=k8s-03)
changed: [k8s-01] => (item=k8s-03)
TASK [kubernetes/preinstall : Hosts | populate kubernetes loadbalancer address into hosts file] ***
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [kubernetes/preinstall : Hosts | localhost ipv4 in hosts file] ************
changed: [k8s-02]
changed: [k8s-01]
changed: [k8s-03]
TASK [kubernetes/preinstall : Hosts | localhost ipv6 in hosts file] ************
changed: [k8s-01]
changed: [k8s-02]
changed: [k8s-03]
TASK [adduser : User | Create User Group] **************************************
changed: [k8s-01]
changed: [k8s-02]
changed: [k8s-03]
TASK [adduser : User | Create User] ********************************************
changed: [k8s-01]
changed: [k8s-02]
changed: [k8s-03]
TASK [download : include_vars] *************************************************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [download : downloading...] ***********************************************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [download : Create dest directories] **************************************
skipping: [k8s-01]
TASK [download : Download items] ***********************************************
skipping: [k8s-01]
TASK [download : Extract archives] *********************************************
skipping: [k8s-01]
TASK [download : Fix permissions] **********************************************
skipping: [k8s-01]
TASK [docker : gather os specific variables] ***********************************
ok: [k8s-01] => (item=/Users/user/vagrant_kubernetes_kargo/kargo/roles/docker/templates/../vars/ubuntu.yml)
ok: [k8s-02] => (item=/Users/user/vagrant_kubernetes_kargo/kargo/roles/docker/templates/../vars/ubuntu.yml)
ok: [k8s-03] => (item=/Users/user/vagrant_kubernetes_kargo/kargo/roles/docker/templates/../vars/ubuntu.yml)
TASK [docker : check for minimum kernel version] *******************************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [docker : ensure docker repository public key is installed] ***************
changed: [k8s-03] => (item=58118E89F3A912897C070ADBF76221572C52609D)
changed: [k8s-01] => (item=58118E89F3A912897C070ADBF76221572C52609D)
changed: [k8s-02] => (item=58118E89F3A912897C070ADBF76221572C52609D)
TASK [docker : ensure docker repository is enabled] ****************************
changed: [k8s-01] => (item=deb https://apt.dockerproject.org/repo ubuntu-trusty main
)
changed: [k8s-03] => (item=deb https://apt.dockerproject.org/repo ubuntu-trusty main
)
changed: [k8s-02] => (item=deb https://apt.dockerproject.org/repo ubuntu-trusty main
)
TASK [docker : Configure docker repository on RedHat/CentOS] *******************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [docker : ensure docker packages are installed] ***************************
changed: [k8s-03] => (item={u'force': True, u'name': u'docker-engine=1.10.3-0~trusty'})
changed: [k8s-01] => (item={u'force': True, u'name': u'docker-engine=1.10.3-0~trusty'})
changed: [k8s-02] => (item={u'force': True, u'name': u'docker-engine=1.10.3-0~trusty'})
TASK [docker : allow for proxies on systems using systemd] *********************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [docker : ensure docker service is started and enabled] *******************
ok: [k8s-01] => (item=docker)
ok: [k8s-02] => (item=docker)
ok: [k8s-03] => (item=docker)
TASK [kubernetes/preinstall : include] *****************************************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [kubernetes/preinstall : include] *****************************************
included: /Users/user/vagrant_kubernetes_kargo/kargo/roles/kubernetes/preinstall/tasks/set_facts.yml for k8s-01, k8s-02, k8s-03
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-02]
ok: [k8s-03]
ok: [k8s-01]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : set_fact] ****************************************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : gather os specific variables] ********************
ok: [k8s-01] => (item=/Users/user/vagrant_kubernetes_kargo/kargo/roles/kubernetes/preinstall/templates/../vars/debian.yml)
ok: [k8s-02] => (item=/Users/user/vagrant_kubernetes_kargo/kargo/roles/kubernetes/preinstall/templates/../vars/debian.yml)
ok: [k8s-03] => (item=/Users/user/vagrant_kubernetes_kargo/kargo/roles/kubernetes/preinstall/templates/../vars/debian.yml)
TASK [kubernetes/preinstall : Force binaries directory for CoreOS] *************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [kubernetes/preinstall : Create kubernetes config directory] **************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : Create kubernetes script directory] **************
ok: [k8s-02]
ok: [k8s-01]
ok: [k8s-03]
TASK [kubernetes/preinstall : Create kubernetes manifests directory] ***********
ok: [k8s-02]
ok: [k8s-01]
ok: [k8s-03]
TASK [kubernetes/preinstall : Create kubernetes logs directory] ****************
ok: [k8s-02]
ok: [k8s-03]
ok: [k8s-01]
TASK [kubernetes/preinstall : check cloud_provider value] **********************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [kubernetes/preinstall : include] *****************************************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [kubernetes/preinstall : Create cni directories] **************************
skipping: [k8s-01] => (item=/etc/cni/net.d)
skipping: [k8s-02] => (item=/etc/cni/net.d)
skipping: [k8s-03] => (item=/etc/cni/net.d)
skipping: [k8s-02] => (item=/opt/cni/bin)
skipping: [k8s-03] => (item=/opt/cni/bin)
skipping: [k8s-01] => (item=/opt/cni/bin)
TASK [kubernetes/preinstall : Update package management cache (YUM)] ***********
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [kubernetes/preinstall : Install latest version of python-apt for Debian distribs] ***
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : Install python-dnf for latest RedHat versions] ***
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [kubernetes/preinstall : Install epel-release on RedHat/CentOS] ***********
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [kubernetes/preinstall : Install packages requirements] *******************
ok: [k8s-02] => (item=[u'python-apt', u'aufs-tools', u'apt-transport-https', u'software-properties-common', u'python-httplib2', u'openssl', u'curl', u'rsync', u'bash-completion'])
ok: [k8s-01] => (item=[u'python-apt', u'aufs-tools', u'apt-transport-https', u'software-properties-common', u'python-httplib2', u'openssl', u'curl', u'rsync', u'bash-completion'])
ok: [k8s-03] => (item=[u'python-apt', u'aufs-tools', u'apt-transport-https', u'software-properties-common', u'python-httplib2', u'openssl', u'curl', u'rsync', u'bash-completion'])
TASK [kubernetes/preinstall : Set selinux policy to permissive] ****************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [kubernetes/preinstall : Write openstack cloud-config] ********************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [kubernetes/preinstall : include] *****************************************
included: /Users/user/vagrant_kubernetes_kargo/kargo/roles/kubernetes/preinstall/tasks/etchosts.yml for k8s-01, k8s-02, k8s-03
TASK [kubernetes/preinstall : Hosts | populate inventory into hosts file] ******
ok: [k8s-02] => (item=k8s-01)
ok: [k8s-01] => (item=k8s-01)
ok: [k8s-03] => (item=k8s-01)
ok: [k8s-01] => (item=k8s-02)
ok: [k8s-02] => (item=k8s-02)
ok: [k8s-03] => (item=k8s-02)
ok: [k8s-01] => (item=k8s-03)
ok: [k8s-02] => (item=k8s-03)
ok: [k8s-03] => (item=k8s-03)
TASK [kubernetes/preinstall : Hosts | populate kubernetes loadbalancer address into hosts file] ***
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [kubernetes/preinstall : Hosts | localhost ipv4 in hosts file] ************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [kubernetes/preinstall : Hosts | localhost ipv6 in hosts file] ************
ok: [k8s-02]
ok: [k8s-01]
ok: [k8s-03]
TASK [etcd : include] **********************************************************
included: /Users/user/vagrant_kubernetes_kargo/kargo/roles/etcd/tasks/install.yml for k8s-01, k8s-02, k8s-03
TASK [etcd : Install | Copy etcd binary from downloaddir] **********************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [etcd : Install | Copy etcdctl binary from downloaddir] *******************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [etcd : Install | Copy etcdctl binary from container] *********************
ok: [k8s-01]
ok: [k8s-02]
ok: [k8s-03]
TASK [etcd : include] **********************************************************
included: /Users/user/vagrant_kubernetes_kargo/kargo/roles/etcd/tasks/set_cluster_health.yml for k8s-01, k8s-02, k8s-03
TASK [etcd : Configure | Check if cluster is healthy] **************************
fatal: [k8s-02]: FAILED! => {"changed": false, "cmd": "etcdctl --peers=http://172.17.8.101:2379,http://172.17.8.102:2379,http://172.17.8.103:2379 cluster-health | grep -q 'cluster is healthy'", "delta": "0:00:00.021017", "end": "2016-07-27 02:07:12.195190", "failed": true, "rc": 1, "start": "2016-07-27 02:07:12.174173", "stderr": "Error: client: etcd cluster is unavailable or misconfigured\nerror #0: dial tcp 172.17.8.101:2379: getsockopt: connection refused\nerror #1: dial tcp 172.17.8.102:2379: getsockopt: connection refused\nerror #2: dial tcp 172.17.8.103:2379: getsockopt: connection refused", "stdout": "", "stdout_lines": [], "warnings": []}
...ignoring
fatal: [k8s-03]: FAILED! => {"changed": false, "cmd": "etcdctl --peers=http://172.17.8.101:2379,http://172.17.8.102:2379,http://172.17.8.103:2379 cluster-health | grep -q 'cluster is healthy'", "delta": "0:00:00.024093", "end": "2016-07-27 02:07:12.278190", "failed": true, "rc": 1, "start": "2016-07-27 02:07:12.254097", "stderr": "Error: client: etcd cluster is unavailable or misconfigured\nerror #0: dial tcp 172.17.8.102:2379: getsockopt: connection refused\nerror #1: dial tcp 172.17.8.101:2379: getsockopt: connection refused\nerror #2: dial tcp 172.17.8.103:2379: getsockopt: connection refused", "stdout": "", "stdout_lines": [], "warnings": []}
...ignoring
fatal: [k8s-01]: FAILED! => {"changed": false, "cmd": "etcdctl --peers=http://172.17.8.101:2379,http://172.17.8.102:2379,http://172.17.8.103:2379 cluster-health | grep -q 'cluster is healthy'", "delta": "0:00:00.011538", "end": "2016-07-27 02:07:12.589968", "failed": true, "rc": 1, "start": "2016-07-27 02:07:12.578430", "stderr": "Error: client: etcd cluster is unavailable or misconfigured\nerror #0: dial tcp 172.17.8.101:2379: getsockopt: connection refused\nerror #1: dial tcp 172.17.8.103:2379: getsockopt: connection refused\nerror #2: dial tcp 172.17.8.102:2379: getsockopt: connection refused", "stdout": "", "stdout_lines": [], "warnings": []}
...ignoring
TASK [etcd : include] **********************************************************
included: /Users/user/vagrant_kubernetes_kargo/kargo/roles/etcd/tasks/configure.yml for k8s-01, k8s-02, k8s-03
TASK [etcd : Configure | Check if member is in cluster] ************************
fatal: [k8s-01]: FAILED! => {"changed": false, "cmd": "etcdctl --peers=http://172.17.8.101:2379,http://172.17.8.102:2379,http://172.17.8.103:2379 member list | grep -q 172.17.8.101", "delta": "0:00:00.022523", "end": "2016-07-27 02:07:13.062224", "failed": true, "rc": 1, "start": "2016-07-27 02:07:13.039701", "stderr": "Error: client: etcd cluster is unavailable or misconfigured\nerror #0: dial tcp 172.17.8.102:2379: getsockopt: connection refused\nerror #1: dial tcp 172.17.8.101:2379: getsockopt: connection refused\nerror #2: dial tcp 172.17.8.103:2379: getsockopt: connection refused", "stdout": "", "stdout_lines": [], "warnings": []}
...ignoring
fatal: [k8s-02]: FAILED! => {"changed": false, "cmd": "etcdctl --peers=http://172.17.8.101:2379,http://172.17.8.102:2379,http://172.17.8.103:2379 member list | grep -q 172.17.8.102", "delta": "0:00:00.025146", "end": "2016-07-27 02:07:13.071553", "failed": true, "rc": 1, "start": "2016-07-27 02:07:13.046407", "stderr": "Error: client: etcd cluster is unavailable or misconfigured\nerror #0: dial tcp 172.17.8.102:2379: getsockopt: connection refused\nerror #1: dial tcp 172.17.8.103:2379: getsockopt: connection refused\nerror #2: dial tcp 172.17.8.101:2379: getsockopt: connection refused", "stdout": "", "stdout_lines": [], "warnings": []}
...ignoring
fatal: [k8s-03]: FAILED! => {"changed": false, "cmd": "etcdctl --peers=http://172.17.8.101:2379,http://172.17.8.102:2379,http://172.17.8.103:2379 member list | grep -q 172.17.8.103", "delta": "0:00:00.032131", "end": "2016-07-27 02:07:13.115984", "failed": true, "rc": 1, "start": "2016-07-27 02:07:13.083853", "stderr": "Error: client: etcd cluster is unavailable or misconfigured\nerror #0: dial tcp 172.17.8.102:2379: getsockopt: connection refused\nerror #1: dial tcp 172.17.8.101:2379: getsockopt: connection refused\nerror #2: dial tcp 172.17.8.103:2379: getsockopt: connection refused", "stdout": "", "stdout_lines": [], "warnings": []}
...ignoring
TASK [etcd : Configure | Add member to the cluster if it is not there] *********
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [etcd : Configure | Copy etcd.service systemd file] ***********************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [etcd : Configure | Write etcd initd script] ******************************
changed: [k8s-03]
changed: [k8s-01]
changed: [k8s-02]
TASK [etcd : Configure | Copy etcd-proxy.service systemd file] *****************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [etcd : Configure | Write etcd-proxy initd script] ************************
changed: [k8s-01]
changed: [k8s-02]
changed: [k8s-03]
TASK [etcd : include] **********************************************************
included: /Users/user/vagrant_kubernetes_kargo/kargo/roles/etcd/tasks/refresh_config.yml for k8s-01, k8s-02, k8s-03
TASK [etcd : Refresh config | Create etcd config file] *************************
changed: [k8s-01]
changed: [k8s-02]
changed: [k8s-03]
TASK [etcd : Refresh config | Create etcd-proxy config file] *******************
changed: [k8s-02]
changed: [k8s-03]
changed: [k8s-01]
TASK [etcd : Ensure etcd is running] *******************************************
changed: [k8s-01]
changed: [k8s-02]
changed: [k8s-03]
TASK [etcd : Ensure etcd-proxy is running] *************************************
fatal: [k8s-01]: FAILED! => {"changed": false, "failed": true, "msg": "start-stop-daemon: user 'etcd-proxy' not found\n"}
fatal: [k8s-02]: FAILED! => {"changed": false, "failed": true, "msg": "start-stop-daemon: user 'etcd-proxy' not found\n"}
fatal: [k8s-03]: FAILED! => {"changed": false, "failed": true, "msg": "start-stop-daemon: user 'etcd-proxy' not found\n"}
NO MORE HOSTS LEFT *************************************************************
RUNNING HANDLER [etcd : restart etcd] ******************************************
RUNNING HANDLER [etcd : restart etcd-proxy] ************************************
to retry, use: --limit @cluster.retry
PLAY RECAP *********************************************************************
k8s-01 : ok=88 changed=20 unreachable=0 failed=1
k8s-02 : ok=88 changed=20 unreachable=0 failed=1
k8s-03 : ok=88 changed=20 unreachable=0 failed=1
Ansible failed to complete successfully. Any error output should be
visible above. Please fix these errors and try again.
$ vagrant ssh k8s-01
Welcome to Ubuntu 14.04.4 LTS (GNU/Linux 3.13.0-92-generic x86_64)
* Documentation: https://help.ubuntu.com/
Last login: Wed Jul 27 02:12:27 2016 from 10.0.2.2
vagrant@k8s-01:~$ kubectl get nodes
WARNING:root:could not open file '/etc/apt/sources.list.d/apt_dockerproject_org_repo.list'
kubectl: command not found
raivil
All 9 comments
I believe the issue is related to this line: https://github.com/kubespray/kargo/blob/master/roles/etcd/templates/deb-etcd-proxy-docker.initd.j2#L31
I didn't do any Ubuntu 14.04 testing, but I see there's an etcd-proxy user configured here, but we don't create it anywhere. Let's just change it back to etcd user.
mattymo
on 27 Jul 2016
Still no luck with the fix.
TASK [etcd : Install | Copy etcdctl binary from container] *********************
ok: [k8s-02]
ok: [k8s-01]
ok: [k8s-03]
TASK [etcd : include] **********************************************************
included: /Users/user/vagrant_kubernetes_kargo/kargo/roles/etcd/tasks/set_cluster_health.yml for k8s-01, k8s-02, k8s-03
TASK [etcd : Configure | Check if cluster is healthy] **************************
fatal: [k8s-01]: FAILED! => {"changed": false, "cmd": "etcdctl --peers=http://172.17.8.101:2379,http://172.17.8.102:2379,http://172.17.8.103:2379 cluster-health | grep -q 'cluster is healthy'", "delta": "0:00:00.033279", "end": "2016-07-27 13:39:00.044187", "failed": true, "rc": 1, "start": "2016-07-27 13:39:00.010908", "stderr": "Error: client: etcd cluster is unavailable or misconfigured\nerror #0: dial tcp 172.17.8.102:2379: getsockopt: connection refused\nerror #1: dial tcp 172.17.8.103:2379: getsockopt: connection refused\nerror #2: dial tcp 172.17.8.101:2379: getsockopt: connection refused", "stdout": "", "stdout_lines": [], "warnings": []}
...ignoring
fatal: [k8s-02]: FAILED! => {"changed": false, "cmd": "etcdctl --peers=http://172.17.8.101:2379,http://172.17.8.102:2379,http://172.17.8.103:2379 cluster-health | grep -q 'cluster is healthy'", "delta": "0:00:00.031031", "end": "2016-07-27 13:39:00.049810", "failed": true, "rc": 1, "start": "2016-07-27 13:39:00.018779", "stderr": "Error: client: etcd cluster is unavailable or misconfigured\nerror #0: dial tcp 172.17.8.101:2379: getsockopt: connection refused\nerror #1: dial tcp 172.17.8.103:2379: getsockopt: connection refused\nerror #2: dial tcp 172.17.8.102:2379: getsockopt: connection refused", "stdout": "", "stdout_lines": [], "warnings": []}
...ignoring
fatal: [k8s-03]: FAILED! => {"changed": false, "cmd": "etcdctl --peers=http://172.17.8.101:2379,http://172.17.8.102:2379,http://172.17.8.103:2379 cluster-health | grep -q 'cluster is healthy'", "delta": "0:00:00.030793", "end": "2016-07-27 13:39:00.064149", "failed": true, "rc": 1, "start": "2016-07-27 13:39:00.033356", "stderr": "Error: client: etcd cluster is unavailable or misconfigured\nerror #0: dial tcp 172.17.8.101:2379: getsockopt: connection refused\nerror #1: dial tcp 172.17.8.102:2379: getsockopt: connection refused\nerror #2: dial tcp 172.17.8.103:2379: getsockopt: connection refused", "stdout": "", "stdout_lines": [], "warnings": []}
...ignoring
TASK [etcd : include] **********************************************************
included: /Users/user/vagrant_kubernetes_kargo/kargo/roles/etcd/tasks/configure.yml for k8s-01, k8s-02, k8s-03
TASK [etcd : Configure | Check if member is in cluster] ************************
fatal: [k8s-01]: FAILED! => {"changed": false, "cmd": "etcdctl --peers=http://172.17.8.101:2379,http://172.17.8.102:2379,http://172.17.8.103:2379 member list | grep -q 172.17.8.101", "delta": "0:00:00.019940", "end": "2016-07-27 13:39:00.845887", "failed": true, "rc": 1, "start": "2016-07-27 13:39:00.825947", "stderr": "Error: client: etcd cluster is unavailable or misconfigured\nerror #0: dial tcp 172.17.8.101:2379: getsockopt: connection refused\nerror #1: dial tcp 172.17.8.103:2379: getsockopt: connection refused\nerror #2: dial tcp 172.17.8.102:2379: getsockopt: connection refused", "stdout": "", "stdout_lines": [], "warnings": []}
...ignoring
fatal: [k8s-02]: FAILED! => {"changed": false, "cmd": "etcdctl --peers=http://172.17.8.101:2379,http://172.17.8.102:2379,http://172.17.8.103:2379 member list | grep -q 172.17.8.102", "delta": "0:00:00.023323", "end": "2016-07-27 13:39:00.866450", "failed": true, "rc": 1, "start": "2016-07-27 13:39:00.843127", "stderr": "Error: client: etcd cluster is unavailable or misconfigured\nerror #0: dial tcp 172.17.8.103:2379: getsockopt: connection refused\nerror #1: dial tcp 172.17.8.102:2379: getsockopt: connection refused\nerror #2: dial tcp 172.17.8.101:2379: getsockopt: connection refused", "stdout": "", "stdout_lines": [], "warnings": []}
...ignoring
fatal: [k8s-03]: FAILED! => {"changed": false, "cmd": "etcdctl --peers=http://172.17.8.101:2379,http://172.17.8.102:2379,http://172.17.8.103:2379 member list | grep -q 172.17.8.103", "delta": "0:00:00.019793", "end": "2016-07-27 13:39:00.878633", "failed": true, "rc": 1, "start": "2016-07-27 13:39:00.858840", "stderr": "Error: client: etcd cluster is unavailable or misconfigured\nerror #0: dial tcp 172.17.8.102:2379: getsockopt: connection refused\nerror #1: dial tcp 172.17.8.101:2379: getsockopt: connection refused\nerror #2: dial tcp 172.17.8.103:2379: getsockopt: connection refused", "stdout": "", "stdout_lines": [], "warnings": []}
...ignoring
TASK [etcd : Configure | Add member to the cluster if it is not there] *********
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [etcd : Configure | Copy etcd.service systemd file] ***********************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [etcd : Configure | Write etcd initd script] ******************************
changed: [k8s-03]
changed: [k8s-02]
changed: [k8s-01]
TASK [etcd : Configure | Copy etcd-proxy.service systemd file] *****************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [etcd : Configure | Write etcd-proxy initd script] ************************
changed: [k8s-01]
changed: [k8s-02]
changed: [k8s-03]
TASK [etcd : include] **********************************************************
included: /Users/user/vagrant_kubernetes_kargo/kargo/roles/etcd/tasks/refresh_config.yml for k8s-01, k8s-02, k8s-03
TASK [etcd : Refresh config | Create etcd config file] *************************
changed: [k8s-02]
changed: [k8s-03]
changed: [k8s-01]
TASK [etcd : Refresh config | Create etcd-proxy config file] *******************
changed: [k8s-01]
changed: [k8s-03]
changed: [k8s-02]
TASK [etcd : Ensure etcd is running] *******************************************
changed: [k8s-02]
changed: [k8s-01]
changed: [k8s-03]
TASK [etcd : Ensure etcd-proxy is running] *************************************
changed: [k8s-02]
changed: [k8s-03]
changed: [k8s-01]
TASK [etcd : Restart etcd if binary changed] ***********************************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [etcd : Restart etcd-proxy if binary changed] *****************************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
RUNNING HANDLER [etcd : restart etcd] ******************************************
changed: [k8s-03]
changed: [k8s-01]
changed: [k8s-02]
RUNNING HANDLER [etcd : restart etcd-proxy] ************************************
changed: [k8s-02]
changed: [k8s-01]
changed: [k8s-03]
RUNNING HANDLER [etcd : reload systemd] ****************************************
skipping: [k8s-03]
skipping: [k8s-01]
skipping: [k8s-02]
RUNNING HANDLER [etcd : wait for etcd up] **************************************
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (9 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (9 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (9 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (8 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (8 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (8 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (7 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (7 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (7 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (6 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (6 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (6 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (5 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (5 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (5 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (4 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (4 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (4 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (3 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (3 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (3 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (2 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (2 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (2 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (1 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (1 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (1 retries left).
fatal: [k8s-01]: FAILED! => {"changed": false, "content": "", "failed": true, "msg": "Status code was not [200]: Request failed: <urlopen error [Errno 111] Connection refused>", "redirected": false, "status": -1, "url": "http://172.17.8.101:2379/health"}
fatal: [k8s-02]: FAILED! => {"changed": false, "content": "", "failed": true, "msg": "Status code was not [200]: Request failed: <urlopen error [Errno 111] Connection refused>", "redirected": false, "status": -1, "url": "http://172.17.8.102:2379/health"}
fatal: [k8s-03]: FAILED! => {"changed": false, "content": "", "failed": true, "msg": "Status code was not [200]: Request failed: <urlopen error [Errno 111] Connection refused>", "redirected": false, "status": -1, "url": "http://172.17.8.103:2379/health"}
RUNNING HANDLER [etcd : reload etcd] *******************************************
RUNNING HANDLER [etcd : reload etcd-proxy] *************************************
NO MORE HOSTS LEFT *************************************************************
to retry, use: --limit @cluster.retry
PLAY RECAP *********************************************************************
k8s-01 : ok=91 changed=23 unreachable=0 failed=1
k8s-02 : ok=91 changed=23 unreachable=0 failed=1
k8s-03 : ok=91 changed=23 unreachable=0 failed=1
Ansible failed to complete successfully. Any error output should be
visible above. Please fix these errors and try again.
I'm able to replicate, similar issue still.
# vagrant -v
Vagrant 1.8.4
TASK [etcd : Configure | Check if cluster is healthy] **************************
fatal: [k8s-01]: FAILED! => {"changed": false, "cmd": "etcdctl --peers=http://172.17.8.101:2379,http://172.17.8.102:2379,http://172.17.8.103:2379 cluster-health | grep -q 'cluster is healthy'", "delta": "0:00:00.013517", "end": "2016-08-08 04:52:04.941547", "failed": true, "rc": 1, "start": "2016-08-08 04:52:04.928030", "stderr": "Error: client: etcd cluster is unavailable or misconfigured\nerror #0: dial tcp 172.17.8.101:2379: getsockopt: connection refused\nerror #1: dial tcp 172.17.8.102:2379: getsockopt: connection refused\nerror #2: dial tcp 172.17.8.103:2379: getsockopt: connection refused", "stdout": "", "stdout_lines": [], "warnings": []}
...ignoring
fatal: [k8s-02]: FAILED! => {"changed": false, "cmd": "etcdctl --peers=http://172.17.8.101:2379,http://172.17.8.102:2379,http://172.17.8.103:2379 cluster-health | grep -q 'cluster is healthy'", "delta": "0:00:00.013329", "end": "2016-08-08 04:52:04.955985", "failed": true, "rc": 1, "start": "2016-08-08 04:52:04.942656", "stderr": "Error: client: etcd cluster is unavailable or misconfigured\nerror #0: dial tcp 172.17.8.102:2379: getsockopt: connection refused\nerror #1: dial tcp 172.17.8.103:2379: getsockopt: connection refused\nerror #2: dial tcp 172.17.8.101:2379: getsockopt: connection refused", "stdout": "", "stdout_lines": [], "warnings": []}
...ignoring
fatal: [k8s-03]: FAILED! => {"changed": false, "cmd": "etcdctl --peers=http://172.17.8.101:2379,http://172.17.8.102:2379,http://172.17.8.103:2379 cluster-health | grep -q 'cluster is healthy'", "delta": "0:00:00.013813", "end": "2016-08-08 04:52:04.952856", "failed": true, "rc": 1, "start": "2016-08-08 04:52:04.939043", "stderr": "Error: client: etcd cluster is unavailable or misconfigured\nerror #0: dial tcp 172.17.8.101:2379: getsockopt: connection refused\nerror #1: dial tcp 172.17.8.103:2379: getsockopt: connection refused\nerror #2: dial tcp 172.17.8.102:2379: getsockopt: connection refused", "stdout": "", "stdout_lines": [], "warnings": []}
...ignoring
TASK [etcd : Configure | Check if member is in cluster] ************************
fatal: [k8s-01]: FAILED! => {"changed": false, "cmd": "etcdctl --peers=http://172.17.8.101:2379,http://172.17.8.102:2379,http://172.17.8.103:2379 member list | grep -q 172.17.8.101", "delta": "0:00:00.012516", "end": "2016-08-08 04:52:05.299045", "failed": true, "rc": 1, "start": "2016-08-08 04:52:05.286529", "stderr": "Error: client: etcd cluster is unavailable or misconfigured\nerror #0: dial tcp 172.17.8.101:2379: getsockopt: connection refused\nerror #1: dial tcp 172.17.8.103:2379: getsockopt: connection refused\nerror #2: dial tcp 172.17.8.102:2379: getsockopt: connection refused", "stdout": "", "stdout_lines": [], "warnings": []}
...ignoring
fatal: [k8s-02]: FAILED! => {"changed": false, "cmd": "etcdctl --peers=http://172.17.8.101:2379,http://172.17.8.102:2379,http://172.17.8.103:2379 member list | grep -q 172.17.8.102", "delta": "0:00:00.013166", "end": "2016-08-08 04:52:05.306980", "failed": true, "rc": 1, "start": "2016-08-08 04:52:05.293814", "stderr": "Error: client: etcd cluster is unavailable or misconfigured\nerror #0: dial tcp 172.17.8.103:2379: getsockopt: connection refused\nerror #1: dial tcp 172.17.8.101:2379: getsockopt: connection refused\nerror #2: dial tcp 172.17.8.102:2379: getsockopt: connection refused", "stdout": "", "stdout_lines": [], "warnings": []}
...ignoring
fatal: [k8s-03]: FAILED! => {"changed": false, "cmd": "etcdctl --peers=http://172.17.8.101:2379,http://172.17.8.102:2379,http://172.17.8.103:2379 member list | grep -q 172.17.8.103", "delta": "0:00:00.013048", "end": "2016-08-08 04:52:05.311676", "failed": true, "rc": 1, "start": "2016-08-08 04:52:05.298628", "stderr": "Error: client: etcd cluster is unavailable or misconfigured\nerror #0: dial tcp 172.17.8.103:2379: getsockopt: connection refused\nerror #1: dial tcp 172.17.8.102:2379: getsockopt: connection refused\nerror #2: dial tcp 172.17.8.101:2379: getsockopt: connection refused", "stdout": "", "stdout_lines": [], "warnings": []}
...ignoring
TASK [etcd : Configure | Add member to the cluster if it is not there] *********
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [etcd : Configure | Copy etcd.service systemd file] ***********************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [etcd : Configure | Write etcd initd script] ******************************
changed: [k8s-02]
changed: [k8s-03]
changed: [k8s-01]
TASK [etcd : Configure | Copy etcd-proxy.service systemd file] *****************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [etcd : Configure | Write etcd-proxy initd script] ************************
changed: [k8s-01]
changed: [k8s-02]
changed: [k8s-03]
TASK [etcd : Refresh config | Create etcd config file] *************************
changed: [k8s-01]
changed: [k8s-03]
changed: [k8s-02]
TASK [etcd : Refresh config | Create etcd-proxy config file] *******************
changed: [k8s-03]
changed: [k8s-02]
changed: [k8s-01]
TASK [etcd : Ensure etcd is running] *******************************************
changed: [k8s-02]
changed: [k8s-01]
changed: [k8s-03]
TASK [etcd : Ensure etcd-proxy is running] *************************************
changed: [k8s-01]
changed: [k8s-02]
changed: [k8s-03]
TASK [etcd : Restart etcd if binary changed] ***********************************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
TASK [etcd : Restart etcd-proxy if binary changed] *****************************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
RUNNING HANDLER [etcd : restart etcd] ******************************************
changed: [k8s-01]
changed: [k8s-02]
changed: [k8s-03]
RUNNING HANDLER [etcd : restart etcd-proxy] ************************************
changed: [k8s-01]
changed: [k8s-02]
changed: [k8s-03]
RUNNING HANDLER [etcd : etcd | reload systemd] *********************************
skipping: [k8s-01]
skipping: [k8s-02]
skipping: [k8s-03]
RUNNING HANDLER [etcd : wait for etcd up] **************************************
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (10 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (10 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (10 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (9 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (9 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (9 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (8 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (8 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (8 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (7 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (7 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (7 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (6 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (6 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (6 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (5 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (5 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (5 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (4 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (4 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (4 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (3 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (3 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (3 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (2 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (2 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (2 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (1 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (1 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (1 retries left).
fatal: [k8s-01]: FAILED! => {"changed": false, "content": "", "failed": true, "msg": "Status code was not [200]: Request failed: <urlopen error [Errno 111] Connection refused>", "redirected": false, "status": -1, "url": "http://172.17.8.101:2379/health"}
fatal: [k8s-03]: FAILED! => {"changed": false, "content": "", "failed": true, "msg": "Status code was not [200]: Request failed: <urlopen error [Errno 111] Connection refused>", "redirected": false, "status": -1, "url": "http://172.17.8.103:2379/health"}
fatal: [k8s-02]: FAILED! => {"changed": false, "content": "", "failed": true, "msg": "Status code was not [200]: Request failed: <urlopen error [Errno 111] Connection refused>", "redirected": false, "status": -1, "url": "http://172.17.8.102:2379/health"}
RUNNING HANDLER [etcd : reload etcd] *******************************************
RUNNING HANDLER [etcd : reload etcd-proxy] *************************************
NO MORE HOSTS LEFT *************************************************************
[WARNING]: Could not create retry file 'cluster.retry'. [Errno 2] No
such file or directory: ''
PLAY RECAP *********************************************************************
k8s-01 : ok=83 changed=23 unreachable=0 failed=1
k8s-02 : ok=83 changed=23 unreachable=0 failed=1
k8s-03 : ok=83 changed=23 unreachable=0 failed=1
Ansible failed to complete successfully. Any error output should be
visible above. Please fix these errors and try again.
mpetason
on 8 Aug 2016
The only real log information I could find was in the docker log in upstart on the nodes:
./upstart/docker.log:ERRO[0015] Handler for DELETE /v1.22/containers/etcdctl-binarycopy returned error: No such container: etcdctl-binarycopy
./upstart/docker.log:ERRO[0015] Handler for POST /v1.22/containers/create returned error: No such image: quay.io/coreos/etcd:v3.0.1
Still have this problem
Using this commit: 07c144d8a6871c3dd72f550beab9e74fe608ddaa
dshulyak
on 14 Aug 2016
I have this image in docker:
quay.io/coreos/etcd v3.0.1 4f4b2b766a37 6 weeks ago 43.37 MB
But there is no history in docker ps -a at all. Also i cannot find docker logs on any node
dshulyak
on 14 Aug 2016
I have a fix prepared for the init scripts which were preventing containers from starting. The other issue looks like if ip and access_ip are both set and equal, then etcd and etcd-proxy both try to start. It seems to conflict and then etcd can't stop because etcd-proxy is bound to that IP. I'm trying to work around in vagrant by unsetting access_ip, but it looks like we need to simply drop etcd-proxy if these two values are the same.
mattymo
on 15 Aug 2016
Hi,
I am using latest version on master branch, and same errors happened when using vagrant up
TASK [etcd : Restart etcd-proxy if binary changed] *****************************
skipping: [k8s-01]
RUNNING HANDLER [etcd : restart etcd] ******************************************
changed: [k8s-01]
RUNNING HANDLER [etcd : restart etcd-proxy] ************************************
changed: [k8s-01]
RUNNING HANDLER [etcd : etcd | reload systemd] *********************************
skipping: [k8s-01]
RUNNING HANDLER [etcd : wait for etcd up] **************************************
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (9 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (8 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (7 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (6 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (5 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (4 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (3 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (2 retries left).
FAILED - RETRYING: HANDLER: etcd : wait for etcd up (1 retries left).
fatal: [k8s-01]: FAILED! => {"changed": false, "content": "", "failed": true, "msg": "Status code was not [200]: Connection failure: timed out", "redirected": false, "status": -1, "url": "http://172.17.8.101:2379/health"}
RUNNING HANDLER [etcd : reload etcd] *******************************************
RUNNING HANDLER [etcd : reload etcd-proxy] *************************************
NO MORE HOSTS LEFT *************************************************************
to retry, use: --limit @cluster.retry
PLAY RECAP *********************************************************************
k8s-01 : ok=67 changed=27 unreachable=0 failed=1
k8s-02 : ok=46 changed=16 unreachable=0 failed=1
k8s-03 : ok=49 changed=16 unreachable=0 failed=1
Ansible failed to complete successfully. Any error output should be
visible above. Please fix these errors and try again.
iptables is disabled.
Here is the generated /etc/etcd.env in Node 1
TCD_DATA_DIR=/var/lib/etcd
ETCD_ADVERTISE_CLIENT_URLS=http://172.17.8.101:2379
ETCD_INITIAL_ADVERTISE_PEER_URLS=http://172.17.8.101:2380
ETCD_INITIAL_CLUSTER_STATE=new
ETCD_LISTEN_CLIENT_URLS=http://172.17.8.101:2379
ETCD_ELECTION_TIMEOUT=10000
ETCD_INITIAL_CLUSTER_TOKEN=k8s_etcd
ETCD_LISTEN_PEER_URLS=http://172.17.8.101:2380
ETCD_NAME=etcd1
ETCD_PROXY=off
ETCD_INITIAL_CLUSTER=etcd1=http://172.17.8.101:2380,etcd2=http://172.17.8.102:2380,etcd3=http://172.17.8.103:2380
fuyufjh
on 1 Nov 2016
👍3
The same as me
Poseiden
on 28 Jun 2018
👍1
Was this page helpful?
0 / 5 - 0 ratings
Related issues
hellwen
路
4Comments
VP2405
路
4Comments
IvanBiv
路
3Comments
lacebal
路
3Comments
servo1x
路
4Comments
Most helpful comment
Hi,
I am using latest version on master branch, and same errors happened when using
vagrant upiptablesis disabled.Here is the generated
/etc/etcd.envin Node 1