Kubernetes-ingress: Couldn't create a temp file for the file /etc/nginx/secrets/default: open /etc/nginx/secrets/default002976294: permission denied

[sharathmankala]

Hi Team,

When i am try to install nginx-ingress i am getting below error, please help.

ENV: AWS EKS
CNI: Wave-net
i tried runAs users 101

I0608 16:39:10.729410 1 main.go:169] Starting NGINX Ingress controller Version=1.6.0 GitCommit=75ecdbc2
2020/06/08 16:39:10 [emerg] 12#12: bind() to 0.0.0.0:80 failed (13: Permission denied)
nginx: [emerg] bind() to 0.0.0.0:80 failed (13: Permission denied)
F0608 16:39:14.792255 1 manager.go:195] Could not get newest config version: could not get expected version: 0

when i tried with runAs user 33 getting below error

$ kubectl.exe logs -f nginx-ingress-8lxd4 -n nginx-ingress
I0608 16:41:25.759625 1 main.go:169] Starting NGINX Ingress controller Version=1.6.0 GitCommit=75ecdbc2
F0608 16:41:25.772566 1 utils.go:56] Couldn't create a temp file for the file /etc/nginx/secrets/default: open /etc/nginx/secrets/default002976294: permission denied

[Dean-Coakley]

Hi @sharathmankala

I see you are running 1.6.0.
In 1.7.0 we made backwards incompatible changes to manifests to allow the Ingress Controller run as non-root.

Manifests are versioned per KIC release.

For 1.6 use manifests in:
https://github.com/nginxinc/kubernetes-ingress/tree/v1.6.0/deployments

For 1.7 use manifests in:
https://github.com/nginxinc/kubernetes-ingress/tree/v1.7.0/deployments

For edge use manifests on master.
https://github.com/nginxinc/kubernetes-ingress/tree/master/deployments

Hope that helps!

[sharathmankala]

Hi @Dean-Coakley ,
AS you suggested i used 1.7.0 but still i am getting same error.

$ kubectl.exe logs -f nginx-ingress-8srqf -n nginx-ingress
I0608 17:51:44.834353 1 main.go:186] Starting NGINX Ingress controller Version=1.7.0 GitCommit=d2ad33c4
2020/06/08 17:51:44 [emerg] 10#10: bind() to 0.0.0.0:80 failed (13: Permission denied)
nginx: [emerg] bind() to 0.0.0.0:80 failed (13: Permission denied)
F0608 17:51:48.910278 1 manager.go:230] Could not get newest config version: could not get expected version: 0

[sharathmankala]

HI @Dean-Coakley ,
I enabled debugging mode, but still i don't have what exact error.

$ kubectl.exe logs -f nginx-ingress-4fwpb -n nginx-ingress
I0609 10:51:33.095073 1 main.go:190] Starting NGINX Ingress controller Version=edge GitCommit=7d341058
I0609 10:51:33.114420 1 manager.go:178] Writing secret to /etc/nginx/secrets/default
I0609 10:51:33.120015 1 manager.go:109] Writing main config to /etc/nginx/nginx.conf
I0609 10:51:33.120035 1 manager.go:110]
worker_processes auto;
daemon off;

error_log /var/log/nginx/error.log notice;
pid /var/lib/nginx/nginx.pid;

events {
worker_connections 1024;
}

http {
include /etc/nginx/mime.types;
default_type application/octet-stream;

log_format  main  '$remote_addr - $remote_user [$time_local] "$request" '
                  '$status $body_bytes_sent "$http_referer" '
                  '"$http_user_agent" "$http_x_forwarded_for"';


access_log  /var/log/nginx/access.log  main;


sendfile        on;
#tcp_nopush     on;

keepalive_timeout 65s;
keepalive_requests 100;

#gzip  on;

server_names_hash_max_size 1024;
server_names_hash_bucket_size 256;

variables_hash_bucket_size 256;
variables_hash_max_size 1024;

map $http_upgrade $connection_upgrade {
    default upgrade;
    ''      close;
}
map $http_upgrade $vs_connection_header {
    default upgrade;
    ''      $default_connection_header;
}








server {
    # required to support the Websocket protocol in VirtualServer/VirtualServerRoutes
    set $default_connection_header "";

    listen 80 default_server;


    listen 443 ssl default_server;


    ssl_certificate /etc/nginx/secrets/default;
    ssl_certificate_key /etc/nginx/secrets/default;

    server_name _;
    server_tokens "on";






    location / {
       return 404;
    }
}
# stub_status
server {
    listen 8080;

    allow 127.0.0.1;
    deny all;

    location /stub_status {
        stub_status;
    }
}

include /etc/nginx/config-version.conf;
include /etc/nginx/conf.d/*.conf;

server {
    listen unix:/var/lib/nginx/nginx-502-server.sock;
    access_log off;



    location / {
        return 502;
    }
}

}

stream {
log_format stream-main '$remote_addr [$time_local] '
'$protocol $status $bytes_sent $bytes_received '
'$session_time "$ssl_preread_server_name"';

access_log  /var/log/nginx/stream-access.log  stream-main;





include /etc/nginx/stream-conf.d/*.conf;

}
I0609 10:51:33.120417 1 manager.go:277] Writing config version to /etc/nginx/config-version.conf
I0609 10:51:33.120430 1 manager.go:278] server {
listen unix:/var/lib/nginx/nginx-config-version.sock;
access_log off;

location /configVersion {
    return 200 0;
}

}
map $http_x_expected_config_version $config_version_mismatch {
"0" "";
default "mismatch";
}
I0609 10:51:33.120576 1 manager.go:215] Starting nginx
2020/06/09 10:51:33 [emerg] 12#12: bind() to 0.0.0.0:80 failed (13: Permission denied)
nginx: [emerg] bind() to 0.0.0.0:80 failed (13: Permission denied)
I0609 10:51:33.146572 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.171855 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.197120 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.222396 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.247732 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.273098 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.298370 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.323622 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.348904 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.374222 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.399515 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.424823 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.450165 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.475555 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.500817 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.526081 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.551348 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.576608 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.601894 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.627191 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.652484 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.677801 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.703087 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.728367 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.753634 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.778929 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.804194 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.829502 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.854859 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.880141 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.905417 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.930712 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.955997 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:33.981276 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.006618 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.031897 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.057155 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.082436 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.107719 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.132967 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.158254 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.183542 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.208873 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.234153 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.259495 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.284774 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.310048 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.335379 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.360660 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.385980 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.411348 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.436708 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.462073 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.487474 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.512820 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.538172 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.563439 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.588792 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.614045 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.639369 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.664633 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.689919 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.715168 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.740451 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.765699 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.790957 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.816178 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.841459 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.866718 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.891968 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.917219 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.942469 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.967768 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:34.993071 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.018439 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.043745 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.069010 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.094261 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.119525 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.144779 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.170041 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.195289 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.220602 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.245911 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.271184 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.296434 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.321716 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.346986 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.372269 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.397518 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.422822 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.448100 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.473377 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.498628 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.523875 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.549134 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.574411 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.599668 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.624977 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.650267 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.675524 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.700776 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.726050 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.751354 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.776603 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.801866 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.827112 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.852385 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.877651 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.902857 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.928117 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.953393 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:35.978682 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.003956 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.029237 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.054487 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.079807 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.105071 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.130331 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.155591 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.180858 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.206142 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.231414 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.256668 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.281978 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.307251 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.332505 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.357783 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.383036 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.408287 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.433577 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.458858 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.484105 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.509372 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.534625 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.559985 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.585255 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.610521 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.635786 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.661059 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.686378 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.711661 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.737012 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.762322 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.787693 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.812957 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.838213 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.863638 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.888906 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.914161 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.939410 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.964666 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:36.989894 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:37.015149 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:37.040405 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:37.065658 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:37.090910 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:37.116155 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:37.141402 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
I0609 10:51:37.166666 1 verify.go:70] Unable to fetch version: error getting client: Get "http://config-version/configVersion": dial unix /var/lib/nginx/nginx-config-version.sock: connect: no such file or directory
F0609 10:51:37.166686 1 manager.go:230] Could not get newest config version: could not get expected version: 0

[Dean-Coakley]

@sharathmankala Could you share your deployment manifest? (kubectl get deploy -o yaml -n nginx-ingress nginx-ingress)

Could you also check for a pod security policy that could be limiting setcap usage? (kubectl get psp, etc) - More info

[sharathmankala]

```
apiVersion: extensions/v1beta1
kind: Deployment
metadata:
annotations:
deployment.kubernetes.io/revision: "1"
kubectl.kubernetes.io/last-applied-configuration: |
{"apiVersion":"apps/v1","kind":"Deployment","metadata":{"annotations":{},"name":"nginx-ingress","namespace":"nginx-ingress"},"spec":{"replicas":1,"selector":{"matchLabels":{"app":"nginx-ingress"}},"template":{"metadata":{"labels":{"app":"nginx-ingress"}},"spec":{"containers":[{"args":["-nginx-configmaps=$(POD_NAMESPACE)/nginx-config","-default-server-tls-secret=$(POD_NAMESPACE)/default-server-secret"],"env":[{"name":"POD_NAMESPACE","valueFrom":{"fieldRef":{"fieldPath":"metadata.namespace"}}},{"name":"POD_NAME","valueFrom":{"fieldRef":{"fieldPath":"metadata.name"}}}],"image":"nginx/nginx-ingress:edge","imagePullPolicy":"Always","name":"nginx-ingress","ports":[{"containerPort":80,"name":"http"},{"containerPort":443,"name":"https"}],"securityContext":{"allowPrivilegeEscalation":true,"capabilities":{"add":["NET_BIND_SERVICE"],"drop":["ALL"]},"runAsUser":101}}],"serviceAccountName":"nginx-ingress"}}}}
creationTimestamp: "2020-06-09T04:54:29Z"
generation: 1
name: nginx-ingress
namespace: nginx-ingress
resourceVersion: "615771"
selfLink: /apis/extensions/v1beta1/namespaces/nginx-ingress/deployments/nginx-ingress
uid: 4ca0c0b7-6d59-4708-8617-8e65d6fdcc9e
spec:
progressDeadlineSeconds: 600
replicas: 1
revisionHistoryLimit: 10
selector:
matchLabels:
app: nginx-ingress
strategy:
rollingUpdate:
maxSurge: 25%
maxUnavailable: 25%
type: RollingUpdate
template:
metadata:
creationTimestamp: null
labels:
app: nginx-ingress
spec:
containers:
- args:
- -nginx-configmaps=$(POD_NAMESPACE)/nginx-config
- -default-server-tls-secret=$(POD_NAMESPACE)/default-server-secret
env:
- name: POD_NAMESPACE
valueFrom:
fieldRef:
apiVersion: v1
fieldPath: metadata.namespace
- name: POD_NAME
valueFrom:
fieldRef:
apiVersion: v1
fieldPath: metadata.name
image: nginx/nginx-ingress:edge
imagePullPolicy: Always
name: nginx-ingress
ports:
- containerPort: 80
name: http
protocol: TCP
- containerPort: 443
name: https
protocol: TCP
resources: {}
securityContext:
allowPrivilegeEscalation: true
capabilities:
add:
- NET_BIND_SERVICE
drop:
- ALL
runAsUser: 101
terminationMessagePath: /dev/termination-log
terminationMessagePolicy: File
dnsPolicy: ClusterFirst
restartPolicy: Always
schedulerName: default-scheduler
securityContext: {}
serviceAccount: nginx-ingress
serviceAccountName: nginx-ingress
terminationGracePeriodSeconds: 30
status:
conditions:
- lastTransitionTime: "2020-06-09T04:54:29Z"
lastUpdateTime: "2020-06-09T04:54:31Z"
message: ReplicaSet "nginx-ingress-676f78547c" has successfully progressed.
reason: NewReplicaSetAvailable
status: "True"
type: Progressing
- lastTransitionTime: "2020-06-09T16:11:54Z"
lastUpdateTime: "2020-06-09T16:11:54Z"
message: Deployment does not have minimum availability.
reason: MinimumReplicasUnavailable
status: "False"
type: Available
observedGeneration: 1
replicas: 1
unavailableReplicas: 1
updatedReplicas: 1

`######################################################
apiVersion: extensions/v1beta1
kind: DaemonSet
metadata:
creationTimestamp: "2020-06-09T04:54:50Z"
generation: 5
labels:
app: nginx-ingress
name: nginx-ingress
namespace: nginx-ingress
resourceVersion: "616100"
selfLink: /apis/extensions/v1beta1/namespaces/nginx-ingress/daemonsets/nginx-ingress
uid: 5247b3c3-7a84-490a-9649-342d943849bb
spec:
revisionHistoryLimit: 10
selector:
matchLabels:
app: nginx-ingress
template:
metadata:
creationTimestamp: null
labels:
app: nginx-ingress
spec:
containers:
- args:
- -nginx-configmaps=$(POD_NAMESPACE)/nginx-config
- -default-server-tls-secret=$(POD_NAMESPACE)/default-server-secret
- --v=5
env:
- name: POD_NAMESPACE
valueFrom:
fieldRef:
apiVersion: v1
fieldPath: metadata.namespace
- name: POD_NAME
valueFrom:
fieldRef:
apiVersion: v1
fieldPath: metadata.name
image: nginx/nginx-ingress:edge
imagePullPolicy: Always
name: nginx-ingress
ports:
- containerPort: 80
hostPort: 80
name: http
protocol: TCP
- containerPort: 443
hostPort: 443
name: https
protocol: TCP
resources: {}
securityContext:
allowPrivilegeEscalation: true
capabilities:
add:
- NET_BIND_SERVICE
drop:
- ALL
runAsUser: 101
terminationMessagePath: /dev/termination-log
terminationMessagePolicy: File
dnsPolicy: ClusterFirst
restartPolicy: Always
schedulerName: default-scheduler
securityContext: {}
serviceAccount: nginx-ingress
serviceAccountName: nginx-ingress
terminationGracePeriodSeconds: 30
templateGeneration: 5
updateStrategy:
rollingUpdate:
maxUnavailable: 1
type: RollingUpdate
status:
currentNumberScheduled: 2
desiredNumberScheduled: 2
numberMisscheduled: 0
numberReady: 0
numberUnavailable: 2
observedGeneration: 5
updatedNumberScheduled: 2

#

kubectl.exe get psp
NAME PRIV CAPS SELINUX RUNASUSER FSGROUP SUPGROUP READONLYROOTFS VOLUMES
eks.privileged true * RunAsAny RunAsAny RunAsAny RunAsAny false *

#

[Dean-Coakley]

@sharathmankala We will try reproduce your issue shortly.

I notice you have apiVersion: extensions/v1beta1 in your deployment manifests. I assume you experienced issues when trying to use apiVersion: apps/v1. What version of kubernetes are you running?

Perhaps it possible for you to try using a different CNI?

[sharathmankala]

we are using EKS k8s 1.15 version.

I have tried wave-net , vpc-cni and calico getting same error.

[sharathmankala]

@Dean-Coakley
I tried with runAs user : 0 also am getting same error.

[Dean-Coakley]

@sharathmankala When you ran as user: 0 did you also remove all capabilities?

For example, replacing:

        securityContext:
          allowPrivilegeEscalation: true
          capabilities:
            add:
            - NET_BIND_SERVICE
            drop:
            - ALL

With:

        securityContext:
          runAsUser: 0

In all manifests?

[sharathmankala]

I tried 2 methodes.
when i tried below

• containerPort: 80
  name: http
  protocol: TCP
  - containerPort: 443
  name: https
  protocol: TCP
  resources: {}
  securityContext:
  runAsUser: 0

pods are running but getting below error
I0611 17:31:46.020415 1 main.go:186] Starting NGINX Ingress controller Version=1.7.0 GitCommit=bbce726f
2020/06/11 17:31:46 [notice] 10#10: using the "epoll" event method
2020/06/11 17:31:46 [notice] 10#10: nginx/1.19.0
2020/06/11 17:31:46 [notice] 10#10: built by gcc 8.3.0 (Debian 8.3.0-6)
2020/06/11 17:31:46 [notice] 10#10: OS: Linux 4.14.173-137.228.amzn2.x86_64
2020/06/11 17:31:46 [notice] 10#10: getrlimit(RLIMIT_NOFILE): 10000:100000
2020/06/11 17:31:46 [notice] 10#10: start worker processes
2020/06/11 17:31:46 [notice] 10#10: start worker process 11
2020/06/11 17:31:46 [notice] 10#10: start worker process 12
E0611 17:31:46.076420 1 reflector.go:178] /home/ec2-user/workspace/C_kubernetes-ingress_release-1.7/internal/k8s/controller.go:390: Failed to list *v1alpha1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
E0611 17:31:46.078159 1 reflector.go:178] /home/ec2-user/workspace/C_kubernetes-ingress_release-1.7/internal/k8s/controller.go:388: Failed to list *v1.VirtualServer: the server could not find the requested resource (get virtualservers.k8s.nginx.org)
E0611 17:31:46.078478 1 reflector.go:178] /home/ec2-user/workspace/C_kubernetes-ingress_release-1.7/internal/k8s/controller.go:389: Failed to list *v1.VirtualServerRoute: the server could not find the requested resource (get virtualserverroutes.k8s.nginx.org)
E0611 17:31:46.079551 1 reflector.go:178] /home/ec2-user/workspace/C_kubernetes-ingress_release-1.7/internal/k8s/controller.go:390: Failed to list *v1alpha1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
2020/06/11 17:31:46 [notice] 16#16: signal process started
2020/06/11 17:31:46 [notice] 10#10: signal 1 (SIGHUP) received from 16, reconfiguring
2020/06/11 17:31:46 [notice] 10#10: reconfiguring
2020/06/11 17:31:46 [notice] 10#10: using the "epoll" event method
2020/06/11 17:31:46 [notice] 10#10: start worker processes
2020/06/11 17:31:46 [notice] 10#10: start worker process 18
2020/06/11 17:31:46 [notice] 10#10: start worker process 19
E0611 17:31:46.104965 1 reflector.go:178] /home/ec2-user/workspace/C_kubernetes-ingress_release-1.7/internal/k8s/controller.go:389: Failed to list *v1.VirtualServerRoute: the server could not find the requested resource (get virtualserverroutes.k8s.nginx.org)
E0611 17:31:46.105067 1 reflector.go:178] /home/ec2-user/workspace/C_kubernetes-ingress_release-1.7/internal/k8s/controller.go:388: Failed to list *v1.VirtualServer: the server could not find the requested resource (get virtualservers.k8s.nginx.org)
2020/06/11 17:31:46 [notice] 11#11: gracefully shutting down
2020/06/11 17:31:46 [notice] 11#11: exiting
2020/06/11 17:31:46 [notice] 12#12: gracefully shutting down
2020/06/11 17:31:46 [notice] 12#12: exiting
2020/06/11 17:31:46 [notice] 12#12: exit
2020/06/11 17:31:46 [notice] 11#11: exit
I0611 17:31:46.206889 1 event.go:278] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"nginx-ingress", Name:"nginx-config", UID:"cb147991-56c5-427b-904b-05a242042df5", APIVersion:"v1", ResourceVersion:"715527", FieldPath:""}): type: 'Normal' reason: 'Updated' Configuration from nginx-ingress/nginx-config was updated
2020/06/11 17:31:46 [notice] 21#21: signal process started
2020/06/11 17:31:46 [notice] 10#10: signal 1 (SIGHUP) received from 21, reconfiguring
2020/06/11 17:31:46 [notice] 10#10: reconfiguring
2020/06/11 17:31:46 [notice] 10#10: using the "epoll" event method
2020/06/11 17:31:46 [notice] 10#10: start worker processes
2020/06/11 17:31:46 [notice] 10#10: start worker process 22
2020/06/11 17:31:46 [notice] 10#10: start worker process 23
2020/06/11 17:31:46 [notice] 18#18: gracefully shutting down
2020/06/11 17:31:46 [notice] 10#10: signal 17 (SIGCHLD) received from 12
2020/06/11 17:31:46 [notice] 19#19: gracefully shutting down
2020/06/11 17:31:46 [notice] 19#19: exiting
2020/06/11 17:31:46 [notice] 10#10: worker process 11 exited with code 0
2020/06/11 17:31:46 [notice] 18#18: exiting
2020/06/11 17:31:46 [notice] 10#10: worker process 12 exited with code 0
2020/06/11 17:31:46 [notice] 10#10: signal 29 (SIGIO) received
2020/06/11 17:31:46 [notice] 19#19: exit
2020/06/11 17:31:46 [notice] 18#18: exit
I0611 17:31:46.342702 1 event.go:278] Event(v1.ObjectReference{Kind:"Secret", Namespace:"nginx-ingress", Name:"default-server-secret", UID:"3c5a7eb1-8edc-4f6f-a34f-82d16e535f6c", APIVersion:"v1", ResourceVersion:"715503", FieldPath:""}): type: 'Normal' reason: 'Updated' the special Secret nginx-ingress/default-server-secret was updated
2020/06/11 17:31:46 [notice] 10#10: signal 17 (SIGCHLD) received from 19
2020/06/11 17:31:46 [notice] 10#10: worker process 19 exited with code 0
2020/06/11 17:31:46 [notice] 10#10: signal 29 (SIGIO) received
2020/06/11 17:31:46 [notice] 10#10: signal 17 (SIGCHLD) received from 18
2020/06/11 17:31:46 [notice] 10#10: worker process 18 exited with code 0
2020/06/11 17:31:46 [notice] 10#10: signal 29 (SIGIO) received
E0611 17:31:48.188567 1 reflector.go:178] /home/ec2-user/workspace/C_kubernetes-ingress_release-1.7/internal/k8s/controller.go:389: Failed to list *v1.VirtualServerRoute: the server could not find the requested resource (get virtualserverroutes.k8s.nginx.org)
E0611 17:31:48.362176 1 reflector.go:178] /home/ec2-user/workspace/C_kubernetes-ingress_release-1.7/internal/k8s/controller.go:390: Failed to list *v1alpha1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)

[sharathmankala]

securityContext:
allowPrivilegeEscalation: true
capabilities:
add:
- NET_BIND_SERVICE
drop:
- ALL
runAsUser: 0

getting below error
$ kubectl.exe logs -f nginx-ingress-848dd98c49-btnrh -n nginx-ingress
I0611 17:37:52.134012 1 main.go:186] Starting NGINX Ingress controller Version=1.7.0 GitCommit=bbce726f
F0611 17:37:52.149996 1 utils.go:56] Couldn't create a temp file for the file /etc/nginx/secrets/default: open /etc/nginx/secrets/default467872827: permission denied

[Dean-Coakley]

With the first method you described, you are likely just missing the required CRDs.

From: https://docs.nginx.com/nginx-ingress-controller/installation/installation-with-manifests/#create-common-resources

$ kubectl apply -f common/vs-definition.yaml
$ kubectl apply -f common/vsr-definition.yaml
$ kubectl apply -f common/ts-definition.yaml

[sharathmankala]

@Dean-Coakley
After applying also same issue.

[sharathmankala]

@Dean-Coakley
can you please help us.

[Dean-Coakley]

@sharathmankala I attempted to reproduce your issues under the following environment:

• AWS EKS - Amazon Linux 2 AMI
• Kubernetes 1.15
• aws-cni
• KIC 1.7.0

Installed following: https://docs.nginx.com/nginx-ingress-controller/installation/installation-with-manifests/

No issues were experienced.

I recommend trying a clean install with no modifications to manifests. - Ensuring that you are using 1.7.0 manifests with 1.7.0 image.(for example)

Note:
If you are not using CRDs(VirtualServer and VirtualServerRoute resources) that the follow errors are not relevant:

Failed to list *:

You can avoid them by setting enable-custom-resources=false and you can use ingress resources without issues.

[sharathmankala]

Hi @Dean-Coakley ,
Issue resolve.
After modifying /etc/docker/daemon.json file its worked fine.
Thank you so munch for your help.

[Rulox]

@sharathmankala Glad to hear you fixed it, could you share the solution with us so we're aware in the future.

We'll appreciate it thanks

[sharathmankala]

Hi @Rulox,
Very Good morning.

We are using below parameters in docker daemon.json file,

issue with "userland-proxy": false, "no-new-privileges": true parameters.

after removing below 2 parameters its working fine in daemon.json file.
1.userland-proxy:false
2.no-new-privileges": true

Thanks in Advance! Have a great day!
Regads,
Sharath Mankala,