Aws-parallelcluster: Compute nodes suddenly failing to start

Created on 27 Sep 2019  Â·  21Comments  Â·  Source: aws/aws-parallelcluster

Environment:

  • aws-parallelcluster-2.4.1
  • OS: alinux
  • Scheduler: Slurm
  • Master instance type: t2.medium
  • Compute instance type: t2.2xlarge

Bug description and how to reproduce:
Compute nodes are suddenly failing to spawn. Initial cluster creation worked fine but new nodes keep dying due to a failure in the initialization.

Additional context:

Sep 27 14:27:23 cloud-init[3245]: helpers.py[DEBUG]: config-scripts-per-once already ran (freq=once)
Sep 27 14:27:23 cloud-init[3245]: stages.py[DEBUG]: Running module scripts-per-boot (<module 'cloudinit.config.cc_scripts_per_boot' from '/usr/lib/python2.7/dist-packages/cloudinit/config/cc_scripts_per_boot.pyc'>) with frequency always
Sep 27 14:27:23 cloud-init[3245]: helpers.py[DEBUG]: Running config-scripts-per-boot using lock (<cloudinit.helpers.DummyLock object at 0x7f020280d810>)
Sep 27 14:27:23 cloud-init[3245]: stages.py[DEBUG]: Running module scripts-per-instance (<module 'cloudinit.config.cc_scripts_per_instance' from '/usr/lib/python2.7/dist-packages/cloudinit/config/cc_scripts_per_instance.pyc'>) with frequency once-per-instance
Sep 27 14:27:23 cloud-init[3245]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-08f7d7aabbf4d517c/sem/config_scripts_per_instance - wb: [644] 20 bytes
Sep 27 14:27:23 cloud-init[3245]: helpers.py[DEBUG]: Running config-scripts-per-instance using lock (<FileLock using file '/var/lib/cloud/instances/i-08f7d7aabbf4d517c/sem/config_scripts_per_instance'>)
Sep 27 14:27:23 cloud-init[3245]: stages.py[DEBUG]: Running module scripts-user (<module 'cloudinit.config.cc_scripts_user' from '/usr/lib/python2.7/dist-packages/cloudinit/config/cc_scripts_user.pyc'>) with frequency once-per-instance
Sep 27 14:27:23 cloud-init[3245]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-08f7d7aabbf4d517c/sem/config_scripts_user - wb: [644] 20 bytes
Sep 27 14:27:23 cloud-init[3245]: helpers.py[DEBUG]: Running config-scripts-user using lock (<FileLock using file '/var/lib/cloud/instances/i-08f7d7aabbf4d517c/sem/config_scripts_user'>)
Sep 27 14:27:23 cloud-init[3245]: util.py[DEBUG]: Running command ['/var/lib/cloud/instance/scripts/part-002'] with allowed return codes [0] (shell=True, capture=False)
Sep 27 14:34:38 cloud-init[3245]: util.py[WARNING]: Failed running /var/lib/cloud/instance/scripts/part-002 [1]
Sep 27 14:34:38 cloud-init[3245]: util.py[DEBUG]: Failed running /var/lib/cloud/instance/scripts/part-002 [1]
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/cloudinit/util.py", line 645, in runparts
    subp(prefix + [exe_path], capture=False, shell=True)
  File "/usr/lib/python2.7/dist-packages/cloudinit/util.py", line 1626, in subp
    cmd=args)
ProcessExecutionError: Unexpected error while running command.
Command: ['/var/lib/cloud/instance/scripts/part-002']
Exit code: 1
Reason: -
Stdout: ''
Stderr: ''
Sep 27 14:34:38 cloud-init[3245]: util.py[DEBUG]: Running command ['/var/lib/cloud/instance/scripts/runcmd'] with allowed return codes [0] (shell=True, capture=False)
Sep 27 14:34:38 cloud-init[3245]: cc_scripts_user.py[WARNING]: Failed to run module scripts-user (scripts in /var/lib/cloud/instance/scripts)
Sep 27 14:34:38 cloud-init[3245]: util.py[WARNING]: Running module scripts-user (<module 'cloudinit.config.cc_scripts_user' from '/usr/lib/python2.7/dist-packages/cloudinit/config/cc_scripts_user.pyc'>) failed
Sep 27 14:34:38 cloud-init[3245]: util.py[DEBUG]: Running module scripts-user (<module 'cloudinit.config.cc_scripts_user' from '/usr/lib/python2.7/dist-packages/cloudinit/config/cc_scripts_user.pyc'>) failed
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/cloudinit/stages.py", line 660, in _run_modules
    cc.run(run_name, mod.handle, func_args, freq=freq)
  File "/usr/lib/python2.7/dist-packages/cloudinit/cloud.py", line 63, in run
    return self._runners.run(name, functor, args, freq, clear_on_fail)
  File "/usr/lib/python2.7/dist-packages/cloudinit/helpers.py", line 197, in run
    results = functor(*args)
  File "/usr/lib/python2.7/dist-packages/cloudinit/config/cc_scripts_user.py", line 38, in handle
    util.runparts(runparts_path)
  File "/usr/lib/python2.7/dist-packages/cloudinit/util.py", line 652, in runparts
    % (len(failed), len(attempted)))
RuntimeError: Runparts: 1 failures in 2 attempted commands
Sep 27 14:34:38 cloud-init[3245]: stages.py[DEBUG]: Running module ssh-authkey-fingerprints (<module 'cloudinit.config.cc_ssh_authkey_fingerprints' from '/usr/lib/python2.7/dist-packages/cloudinit/config/cc_ssh_authkey_fingerprints.pyc'>) with frequency once-per-instance
Sep 27 14:34:38 cloud-init[3245]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-08f7d7aabbf4d517c/sem/config_ssh_authkey_fingerprints - wb: [644] 20 bytes
Sep 27 14:34:38 cloud-init[3245]: helpers.py[DEBUG]: Running config-ssh-authkey-fingerprints using lock (<FileLock using file '/var/lib/cloud/instances/i-08f7d7aabbf4d517c/sem/config_ssh_authkey_fingerprints'>)
Sep 27 14:34:38 cloud-init[3245]: util.py[DEBUG]: Reading from /etc/ssh/sshd_config (quiet=False)
Sep 27 14:34:38 cloud-init[3245]: util.py[DEBUG]: Read 512 bytes from /etc/ssh/sshd_config
Sep 27 14:34:38 cloud-init[3245]: util.py[DEBUG]: Reading from /home/ec2-user/.ssh/authorized_keys (quiet=False)
Sep 27 14:34:38 cloud-init[3245]: util.py[DEBUG]: Read 404 bytes from /home/ec2-user/.ssh/authorized_keys
Sep 27 14:34:38 cloud-init[3245]: stages.py[DEBUG]: Running module keys-to-console (<module 'cloudinit.config.cc_keys_to_console' from '/usr/lib/python2.7/dist-packages/cloudinit/config/cc_keys_to_console.pyc'>) with frequency once-per-instance
Sep 27 14:34:38 cloud-init[3245]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-08f7d7aabbf4d517c/sem/config_keys_to_console - wb: [644] 20 bytes
Sep 27 14:34:38 cloud-init[3245]: helpers.py[DEBUG]: Running config-keys-to-console using lock (<FileLock using file '/var/lib/cloud/instances/i-08f7d7aabbf4d517c/sem/config_keys_to_console'>)
Sep 27 14:34:38 cloud-init[3245]: util.py[DEBUG]: Running command ['/usr/libexec/cloud-init/write-ssh-key-fingerprints', '', 'ssh-dss'] with allowed return codes [0] (shell=False, capture=True)
Sep 27 14:34:38 cloud-init[3245]: stages.py[DEBUG]: Running module phone-home (<module 'cloudinit.config.cc_phone_home' from '/usr/lib/python2.7/dist-packages/cloudinit/config/cc_phone_home.pyc'>) with frequency once-per-instance
Sep 27 14:34:38 cloud-init[3245]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-08f7d7aabbf4d517c/sem/config_phone_home - wb: [644] 20 bytes
Sep 27 14:34:38 cloud-init[3245]: helpers.py[DEBUG]: Running config-phone-home using lock (<FileLock using file '/var/lib/cloud/instances/i-08f7d7aabbf4d517c/sem/config_phone_home'>)
Sep 27 14:34:38 cloud-init[3245]: cc_phone_home.py[DEBUG]: Skipping module named phone-home, no 'phone_home' configuration found
Sep 27 14:34:38 cloud-init[3245]: stages.py[DEBUG]: Running module final-message (<module 'cloudinit.config.cc_final_message' from '/usr/lib/python2.7/dist-packages/cloudinit/config/cc_final_message.pyc'>) with frequency always
Sep 27 14:34:38 cloud-init[3245]: helpers.py[DEBUG]: Running config-final-message using lock (<cloudinit.helpers.DummyLock object at 0x7f02024694d0>)
Sep 27 14:34:38 cloud-init[3245]: util.py[DEBUG]: Reading from /proc/uptime (quiet=False)
Sep 27 14:34:38 cloud-init[3245]: util.py[DEBUG]: Read 15 bytes from /proc/uptime
Sep 27 14:34:38 cloud-init[3245]: util.py[DEBUG]: Cloud-init v. 0.7.6 finished at Fri, 27 Sep 2019 14:34:38 +0000. Datasource DataSourceEc2.  Up 460.71 seconds
Sep 27 14:34:38 cloud-init[3245]: util.py[DEBUG]: Writing to /var/lib/cloud/instance/boot-finished - wb: [644] 52 bytes
Sep 27 14:34:38 cloud-init[3245]: stages.py[DEBUG]: Running module power-state-change (<module 'cloudinit.config.cc_power_state_change' from '/usr/lib/python2.7/dist-packages/cloudinit/config/cc_power_state_change.pyc'>) with frequency once-per-instance
Sep 27 14:34:38 cloud-init[3245]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-08f7d7aabbf4d517c/sem/config_power_state_change - wb: [644] 20 bytes
Sep 27 14:34:38 cloud-init[3245]: helpers.py[DEBUG]: Running config-power-state-change using lock (<FileLock using file '/var/lib/cloud/instances/i-08f7d7aabbf4d517c/sem/config_power_state_change'>)
Sep 27 14:34:38 cloud-init[3245]: cc_power_state_change.py[DEBUG]: no power_state provided. doing nothing
Sep 27 14:34:38 cloud-init[3245]: cloud-init[DEBUG]: Ran 9 modules with 1 failures
Sep 27 14:34:38 cloud-init[3245]: util.py[DEBUG]: Creating symbolic link from '/run/cloud-init/result.json' => '../../var/lib/cloud/data/result.json'
Sep 27 14:34:38 cloud-init[3245]: util.py[DEBUG]: Reading from /proc/uptime (quiet=False)
Sep 27 14:34:38 cloud-init[3245]: util.py[DEBUG]: Read 15 bytes from /proc/uptime
Sep 27 14:34:38 cloud-init[3245]: util.py[DEBUG]: cloud-init mode 'modules' took 435.260 seconds (435.05)
closing-soon-if-no-response waiting customer

Most helpful comment

Yes, I tested without a custom ami using amazon Linux , I spun up a machine
added the necessary tools and then generated an image. The image isn’t
public at the moment. It seems to be an issue with the intel mpi repo as
well. The imported key wasn’t checking properly.

On Mon, Sep 30, 2019 at 4:12 AM Enrico Usai notifications@github.com
wrote:

Hi @medcelerate https://github.com/medcelerate thank you for your
analysis and your logs.

I see you are using a custom_ami.
It could be a problem related to your custom ami.

  1. Did you test without the custom_ami parameter?
  2. Which
    https://docs.aws.amazon.com/parallelcluster/latest/ug/tutorials_02_ami_customization.html
    process did you follow to build your custom AMI?
  3. Which is the source AMI Id of your AMI (if is it public)?

Thank you

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/aws/aws-parallelcluster/issues/1334?email_source=notifications&email_token=AHYKRGNA235FYN7RYPPWBSDQMGYG7A5CNFSM4I3HHWCKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD742BBI#issuecomment-536453253,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AHYKRGOHJFIFPLUBVJKEIV3QMGYG7ANCNFSM4I3HHWCA
.

All 21 comments

Hi @medcelerate

are you using a custom post install script?
If yes, could you attach it to the issue or just try by removing it?

I am not running any custom install script. I just tried it again using a blank amazon linux image and the same problem.

Hi @medcelerate
to understand the cause of your issue we need more information:

  • configuration file without any credentials or personal data.
  • /var/log/cfn-init.log, /var/log/cloud-init.log and /var/log/cloud-init-output.log files from the Master node
  • if a compute node was terminated due to failure, there will be a directory /home/logs/compute. Attach one of the instance-id.tar.gz from that directory
  • /var/log/nodewatcher from the Compute node and /var/log/jobwatcher and /var/log/sqswatcher from the Master node

The new deployment didn't even get the master node to work, ti failed with same error.

Cloud init:

Sep 27 16:39:46 cloud-init[3965]: stages.py[DEBUG]: Running module growpart (<module 'cloudinit.config.cc_growpart' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_growpart.pyc'>) with frequency always
Sep 27 16:39:46 cloud-init[3965]: handlers.py[DEBUG]: start: init-network/config-growpart: running config-growpart with frequency always
Sep 27 16:39:46 cloud-init[3965]: helpers.py[DEBUG]: Running config-growpart using lock (<cloudinit.helpers.DummyLock object at 0x7f31d2201b50>)
Sep 27 16:39:46 cloud-init[3965]: cc_growpart.py[DEBUG]: No 'growpart' entry in cfg.  Using default: {'ignore_growroot_disabled': False, 'mode': 'auto', 'devices': ['/']}
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Running command ['growpart', '--help'] with allowed return codes [0] (shell=False, capture=True)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Reading from /proc/3965/mountinfo (quiet=False)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Read 2533 bytes from /proc/3965/mountinfo
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Running command ['systemd-detect-virt', '--quiet', '--container'] with allowed return codes [0] (shell=False, capture=True)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Running command ['running-in-container'] with allowed return codes [0] (shell=False, capture=True)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Running command ['lxc-is-container'] with allowed return codes [0] (shell=False, capture=True)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Reading from /proc/1/environ (quiet=False)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Read 0 bytes from /proc/1/environ
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Reading from /proc/self/status (quiet=False)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Read 1300 bytes from /proc/self/status
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Reading from /etc/os-release (quiet=False)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Read 212 bytes from /etc/os-release
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Reading from /sys/class/block/xvda1/partition (quiet=False)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Read 2 bytes from /sys/class/block/xvda1/partition
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Reading from /sys/devices/vbd-51712/block/xvda/dev (quiet=False)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Read 6 bytes from /sys/devices/vbd-51712/block/xvda/dev
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Running command ['growpart', '--dry-run', '/dev/xvda', '1'] with allowed return codes [0] (shell=False, capture=True)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Running command ['growpart', '/dev/xvda', '1'] with allowed return codes [0] (shell=False, capture=True)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: resize_devices took 0.157 seconds
Sep 27 16:39:46 cloud-init[3965]: cc_growpart.py[INFO]: '/' resized: changed (/dev/xvda, 1) from 8587820544 to 18251496960
Sep 27 16:39:46 cloud-init[3965]: handlers.py[DEBUG]: finish: init-network/config-growpart: SUCCESS: config-growpart ran successfully
Sep 27 16:39:46 cloud-init[3965]: stages.py[DEBUG]: Running module resizefs (<module 'cloudinit.config.cc_resizefs' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_resizefs.pyc'>) with frequency always
Sep 27 16:39:46 cloud-init[3965]: handlers.py[DEBUG]: start: init-network/config-resizefs: running config-resizefs with frequency always
Sep 27 16:39:46 cloud-init[3965]: helpers.py[DEBUG]: Running config-resizefs using lock (<cloudinit.helpers.DummyLock object at 0x7f31d2191150>)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Reading from /proc/3965/mountinfo (quiet=False)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Read 2533 bytes from /proc/3965/mountinfo
Sep 27 16:39:46 cloud-init[3965]: cc_resizefs.py[DEBUG]: resize_info: dev=/dev/xvda1 mnt_point=/ path=/
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Running command ['systemd-detect-virt', '--quiet', '--container'] with allowed return codes [0] (shell=False, capture=True)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Running command ['running-in-container'] with allowed return codes [0] (shell=False, capture=True)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Running command ['lxc-is-container'] with allowed return codes [0] (shell=False, capture=True)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Reading from /proc/1/environ (quiet=False)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Read 0 bytes from /proc/1/environ
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Reading from /proc/self/status (quiet=False)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Read 1300 bytes from /proc/self/status
Sep 27 16:39:46 cloud-init[3965]: cc_resizefs.py[DEBUG]: Resizing / (xfs) using xfs_growfs /
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Forked child 4198 who will run callback log_time
Sep 27 16:39:46 cloud-init[3965]: cc_resizefs.py[DEBUG]: Resizing (via forking) root filesystem (type=xfs, val=noblock)
Sep 27 16:39:46 cloud-init[4198]: util.py[DEBUG]: Running command ('xfs_growfs', '/') with allowed return codes [0] (shell=False, capture=True)
Sep 27 16:39:46 cloud-init[3965]: handlers.py[DEBUG]: finish: init-network/config-resizefs: SUCCESS: config-resizefs ran successfully
Sep 27 16:39:46 cloud-init[3965]: stages.py[DEBUG]: Running module set-hostname (<module 'cloudinit.config.cc_set_hostname' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_set_hostname.pyc'>) with frequency once-per-instance
Sep 27 16:39:46 cloud-init[3965]: handlers.py[DEBUG]: start: init-network/config-set-hostname: running config-set-hostname with frequency once-per-instance
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_set_hostname - wb: [644] 20 bytes
Sep 27 16:39:46 cloud-init[3965]: helpers.py[DEBUG]: Running config-set-hostname using lock (<FileLock using file '/var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_set_hostname'>)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Reading from /var/lib/cloud/data/set-hostname (quiet=False)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Read 79 bytes from /var/lib/cloud/data/set-hostname
Sep 27 16:39:46 cloud-init[3965]: cc_set_hostname.py[DEBUG]: No hostname changes. Skipping set-hostname
Sep 27 16:39:46 cloud-init[3965]: handlers.py[DEBUG]: finish: init-network/config-set-hostname: SUCCESS: config-set-hostname ran successfully
Sep 27 16:39:46 cloud-init[3965]: stages.py[DEBUG]: Running module update-hostname (<module 'cloudinit.config.cc_update_hostname' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_update_hostname.pyc'>) with frequency always
Sep 27 16:39:46 cloud-init[3965]: handlers.py[DEBUG]: start: init-network/config-update-hostname: running config-update-hostname with frequency always
Sep 27 16:39:46 cloud-init[3965]: helpers.py[DEBUG]: Running config-update-hostname using lock (<cloudinit.helpers.DummyLock object at 0x7f31d21b7e10>)
Sep 27 16:39:46 cloud-init[3965]: cc_update_hostname.py[DEBUG]: Updating hostname to ip-10-80-252-214.ec2.internal (ip-10-80-252-214)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Reading from /var/lib/cloud/data/previous-hostname (quiet=False)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Read 28 bytes from /var/lib/cloud/data/previous-hostname
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Running command ['hostname'] with allowed return codes [0] (shell=False, capture=True)
Sep 27 16:39:46 cloud-init[3965]: __init__.py[INFO]: /var/lib/cloud/data/previous-hostname differs from /etc/hostname, assuming user maintained hostname.
Sep 27 16:39:46 cloud-init[3965]: handlers.py[DEBUG]: finish: init-network/config-update-hostname: SUCCESS: config-update-hostname ran successfully
Sep 27 16:39:46 cloud-init[3965]: stages.py[DEBUG]: Running module update-etc-hosts (<module 'cloudinit.config.cc_update_etc_hosts' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_update_etc_hosts.pyc'>) with frequency always
Sep 27 16:39:46 cloud-init[3965]: handlers.py[DEBUG]: start: init-network/config-update-etc-hosts: running config-update-etc-hosts with frequency always
Sep 27 16:39:46 cloud-init[3965]: helpers.py[DEBUG]: Running config-update-etc-hosts using lock (<cloudinit.helpers.DummyLock object at 0x7f31d21b7ed0>)
Sep 27 16:39:46 cloud-init[3965]: cc_update_etc_hosts.py[DEBUG]: Configuration option 'manage_etc_hosts' is not set, not managing /etc/hosts in module update-etc-hosts
Sep 27 16:39:46 cloud-init[3965]: handlers.py[DEBUG]: finish: init-network/config-update-etc-hosts: SUCCESS: config-update-etc-hosts ran successfully
Sep 27 16:39:46 cloud-init[3965]: stages.py[DEBUG]: Running module rsyslog (<module 'cloudinit.config.cc_rsyslog' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_rsyslog.pyc'>) with frequency once-per-instance
Sep 27 16:39:46 cloud-init[3965]: handlers.py[DEBUG]: start: init-network/config-rsyslog: running config-rsyslog with frequency once-per-instance
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_rsyslog - wb: [644] 20 bytes
Sep 27 16:39:46 cloud-init[3965]: helpers.py[DEBUG]: Running config-rsyslog using lock (<FileLock using file '/var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_rsyslog'>)
Sep 27 16:39:46 cloud-init[3965]: cc_rsyslog.py[DEBUG]: Skipping module named rsyslog, no 'rsyslog' key in configuration
Sep 27 16:39:46 cloud-init[3965]: handlers.py[DEBUG]: finish: init-network/config-rsyslog: SUCCESS: config-rsyslog ran successfully
Sep 27 16:39:46 cloud-init[3965]: stages.py[DEBUG]: Running module users-groups (<module 'cloudinit.config.cc_users_groups' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_users_groups.pyc'>) with frequency once-per-instance
Sep 27 16:39:46 cloud-init[3965]: handlers.py[DEBUG]: start: init-network/config-users-groups: running config-users-groups with frequency once-per-instance
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_users_groups - wb: [644] 20 bytes
Sep 27 16:39:46 cloud-init[3965]: helpers.py[DEBUG]: Running config-users-groups using lock (<FileLock using file '/var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_users_groups'>)
Sep 27 16:39:46 cloud-init[3965]: __init__.py[INFO]: User ec2-user already exists, skipping.
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Running command ['passwd', '-l', 'ec2-user'] with allowed return codes [0] (shell=False, capture=True)
Sep 27 16:39:46 cloud-init[4198]: util.py[DEBUG]: backgrounded Resizing took 0.058 seconds
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Reading from /etc/sudoers (quiet=False)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Read 3938 bytes from /etc/sudoers
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Writing to /etc/sudoers.d/90-cloud-init-users - ab: [None] 59 bytes
Sep 27 16:39:46 cloud-init[3965]: handlers.py[DEBUG]: finish: init-network/config-users-groups: SUCCESS: config-users-groups ran successfully
Sep 27 16:39:46 cloud-init[3965]: stages.py[DEBUG]: Running module ssh (<module 'cloudinit.config.cc_ssh' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_ssh.pyc'>) with frequency once-per-instance
Sep 27 16:39:46 cloud-init[3965]: handlers.py[DEBUG]: start: init-network/config-ssh: running config-ssh with frequency once-per-instance
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_ssh - wb: [644] 20 bytes
Sep 27 16:39:46 cloud-init[3965]: helpers.py[DEBUG]: Running config-ssh using lock (<FileLock using file '/var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_ssh'>)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Reading from /etc/ssh/sshd_config (quiet=False)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Read 3957 bytes from /etc/ssh/sshd_config
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Reading from /home/ec2-user/.ssh/authorized_keys (quiet=False)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Read 404 bytes from /home/ec2-user/.ssh/authorized_keys
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Writing to /home/ec2-user/.ssh/authorized_keys - wb: [600] 404 bytes
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Changing the ownership of /home/ec2-user/.ssh/authorized_keys to 1000:1000
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Reading from /etc/ssh/sshd_config (quiet=False)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Read 3957 bytes from /etc/ssh/sshd_config
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Reading from /root/.ssh/authorized_keys (quiet=False)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Read 561 bytes from /root/.ssh/authorized_keys
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Writing to /root/.ssh/authorized_keys - wb: [600] 561 bytes
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Changing the ownership of /root/.ssh/authorized_keys to 0:0
Sep 27 16:39:46 cloud-init[3965]: handlers.py[DEBUG]: finish: init-network/config-ssh: SUCCESS: config-ssh ran successfully
Sep 27 16:39:46 cloud-init[3965]: stages.py[DEBUG]: Running module resolv-conf (<module 'cloudinit.config.cc_resolv_conf' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_resolv_conf.pyc'>) with frequency once-per-instance
Sep 27 16:39:46 cloud-init[3965]: handlers.py[DEBUG]: start: init-network/config-resolv-conf: running config-resolv-conf with frequency once-per-instance
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_resolv_conf - wb: [644] 20 bytes
Sep 27 16:39:46 cloud-init[3965]: helpers.py[DEBUG]: Running config-resolv-conf using lock (<FileLock using file '/var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_resolv_conf'>)
Sep 27 16:39:46 cloud-init[3965]: cc_resolv_conf.py[DEBUG]: Skipping module named resolv-conf, no 'manage_resolv_conf' key in configuration
Sep 27 16:39:46 cloud-init[3965]: handlers.py[DEBUG]: finish: init-network/config-resolv-conf: SUCCESS: config-resolv-conf ran successfully
Sep 27 16:39:46 cloud-init[3965]: main.py[DEBUG]: Ran 13 modules with 0 failures
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Reading from /proc/uptime (quiet=False)
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: Read 12 bytes from /proc/uptime
Sep 27 16:39:46 cloud-init[3965]: util.py[DEBUG]: cloud-init mode 'init' took 1.010 seconds (1.01)
Sep 27 16:39:46 cloud-init[3965]: handlers.py[DEBUG]: finish: init-network: SUCCESS: searching for network datasources
Sep 27 16:39:46 cloud-init[4328]: util.py[DEBUG]: Cloud-init v. 18.2-72.amzn2.0.7 running 'modules:config' at Fri, 27 Sep 2019 16:39:46 +0000. Up 12.08 seconds.
Sep 27 16:39:46 cloud-init[4328]: stages.py[DEBUG]: Using distro class <class 'cloudinit.distros.amazon.Distro'>
Sep 27 16:39:46 cloud-init[4328]: stages.py[DEBUG]: Running module disk_setup (<module 'cloudinit.config.cc_disk_setup' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_disk_setup.pyc'>) with frequency once-per-instance
Sep 27 16:39:46 cloud-init[4328]: handlers.py[DEBUG]: start: modules-config/config-disk_setup: running config-disk_setup with frequency once-per-instance
Sep 27 16:39:46 cloud-init[4328]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_disk_setup - wb: [644] 20 bytes
Sep 27 16:39:46 cloud-init[4328]: helpers.py[DEBUG]: Running config-disk_setup using lock (<FileLock using file '/var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_disk_setup'>)
Sep 27 16:39:46 cloud-init[4328]: handlers.py[DEBUG]: finish: modules-config/config-disk_setup: SUCCESS: config-disk_setup ran successfully
Sep 27 16:39:46 cloud-init[4328]: stages.py[DEBUG]: Running module mounts (<module 'cloudinit.config.cc_mounts' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_mounts.pyc'>) with frequency once-per-instance
Sep 27 16:39:46 cloud-init[4328]: handlers.py[DEBUG]: start: modules-config/config-mounts: running config-mounts with frequency once-per-instance
Sep 27 16:39:46 cloud-init[4328]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_mounts - wb: [644] 20 bytes
Sep 27 16:39:46 cloud-init[4328]: helpers.py[DEBUG]: Running config-mounts using lock (<FileLock using file '/var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_mounts'>)
Sep 27 16:39:46 cloud-init[4328]: cc_mounts.py[DEBUG]: mounts configuration is [['ephemeral0', '/media/ephemeral0'], ['swap', 'none', 'swap', 'sw', '0', '0']]
Sep 27 16:39:46 cloud-init[4328]: util.py[DEBUG]: Reading from /etc/fstab (quiet=False)
Sep 27 16:39:46 cloud-init[4328]: util.py[DEBUG]: Read 156 bytes from /etc/fstab
Sep 27 16:39:46 cloud-init[4328]: cc_mounts.py[DEBUG]: Attempting to determine the real name of ephemeral0
Sep 27 16:39:46 cloud-init[4328]: cc_mounts.py[DEBUG]: changed ephemeral0 => None
Sep 27 16:39:46 cloud-init[4328]: cc_mounts.py[DEBUG]: Ignoring nonexistent named mount ephemeral0
Sep 27 16:39:46 cloud-init[4328]: cc_mounts.py[DEBUG]: Attempting to determine the real name of swap
Sep 27 16:39:46 cloud-init[4328]: DataSourceEc2.py[DEBUG]: Unable to convert swap to a device
Sep 27 16:39:46 cloud-init[4328]: cc_mounts.py[DEBUG]: changed swap => None
Sep 27 16:39:46 cloud-init[4328]: cc_mounts.py[DEBUG]: Ignoring nonexistent named mount swap
Sep 27 16:39:46 cloud-init[4328]: cc_mounts.py[DEBUG]: Attempting to determine the real name of ephemeral0
Sep 27 16:39:46 cloud-init[4328]: cc_mounts.py[DEBUG]: changed default device ephemeral0 => None
Sep 27 16:39:46 cloud-init[4328]: cc_mounts.py[DEBUG]: Ignoring nonexistent default named mount ephemeral0
Sep 27 16:39:46 cloud-init[4328]: cc_mounts.py[DEBUG]: Attempting to determine the real name of swap
Sep 27 16:39:46 cloud-init[4328]: DataSourceEc2.py[DEBUG]: Unable to convert swap to a device
Sep 27 16:39:46 cloud-init[4328]: cc_mounts.py[DEBUG]: changed default device swap => None
Sep 27 16:39:46 cloud-init[4328]: cc_mounts.py[DEBUG]: Ignoring nonexistent default named mount swap
Sep 27 16:39:46 cloud-init[4328]: cc_mounts.py[DEBUG]: Skipping nonexistent device named None
Sep 27 16:39:46 cloud-init[4328]: cc_mounts.py[DEBUG]: Skipping nonexistent device named None
Sep 27 16:39:46 cloud-init[4328]: cc_mounts.py[DEBUG]: no need to setup swap
Sep 27 16:39:46 cloud-init[4328]: cc_mounts.py[DEBUG]: No modifications to fstab needed
Sep 27 16:39:46 cloud-init[4328]: handlers.py[DEBUG]: finish: modules-config/config-mounts: SUCCESS: config-mounts ran successfully
Sep 27 16:39:46 cloud-init[4328]: stages.py[DEBUG]: Running module locale (<module 'cloudinit.config.cc_locale' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_locale.pyc'>) with frequency once-per-instance
Sep 27 16:39:46 cloud-init[4328]: handlers.py[DEBUG]: start: modules-config/config-locale: running config-locale with frequency once-per-instance
Sep 27 16:39:46 cloud-init[4328]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_locale - wb: [644] 19 bytes
Sep 27 16:39:46 cloud-init[4328]: helpers.py[DEBUG]: Running config-locale using lock (<FileLock using file '/var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_locale'>)
Sep 27 16:39:46 cloud-init[4328]: cc_locale.py[DEBUG]: Setting locale to en_US.UTF-8
Sep 27 16:39:46 cloud-init[4328]: util.py[DEBUG]: Reading from /etc/locale.conf (quiet=False)
Sep 27 16:39:46 cloud-init[4328]: util.py[DEBUG]: Read 97 bytes from /etc/locale.conf
Sep 27 16:39:46 cloud-init[4328]: util.py[DEBUG]: Writing to /etc/locale.conf - wb: [644] 97 bytes
Sep 27 16:39:46 cloud-init[4328]: handlers.py[DEBUG]: finish: modules-config/config-locale: SUCCESS: config-locale ran successfully
Sep 27 16:39:46 cloud-init[4328]: stages.py[DEBUG]: Running module set-passwords (<module 'cloudinit.config.cc_set_passwords' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_set_passwords.pyc'>) with frequency once-per-instance
Sep 27 16:39:46 cloud-init[4328]: handlers.py[DEBUG]: start: modules-config/config-set-passwords: running config-set-passwords with frequency once-per-instance
Sep 27 16:39:46 cloud-init[4328]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_set_passwords - wb: [644] 19 bytes
Sep 27 16:39:46 cloud-init[4328]: helpers.py[DEBUG]: Running config-set-passwords using lock (<FileLock using file '/var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_set_passwords'>)
Sep 27 16:39:46 cloud-init[4328]: util.py[DEBUG]: Reading from /etc/ssh/sshd_config (quiet=False)
Sep 27 16:39:46 cloud-init[4328]: util.py[DEBUG]: Read 3957 bytes from /etc/ssh/sshd_config
Sep 27 16:39:46 cloud-init[4328]: ssh_util.py[DEBUG]: line 63: option PasswordAuthentication already set to no
Sep 27 16:39:46 cloud-init[4328]: cc_set_passwords.py[DEBUG]: No need to restart ssh service, PasswordAuthentication not updated.
Sep 27 16:39:46 cloud-init[4328]: handlers.py[DEBUG]: finish: modules-config/config-set-passwords: SUCCESS: config-set-passwords ran successfully
Sep 27 16:39:46 cloud-init[4328]: stages.py[DEBUG]: Running module yum-configure (<module 'cloudinit.config.cc_yum_configure' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_yum_configure.pyc'>) with frequency once-per-instance
Sep 27 16:39:46 cloud-init[4328]: handlers.py[DEBUG]: start: modules-config/config-yum-configure: running config-yum-configure with frequency once-per-instance
Sep 27 16:39:46 cloud-init[4328]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_yum_configure - wb: [644] 19 bytes
Sep 27 16:39:46 cloud-init[4328]: helpers.py[DEBUG]: Running config-yum-configure using lock (<FileLock using file '/var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_yum_configure'>)
Sep 27 16:39:46 cloud-init[4328]: cc_yum_configure.py[DEBUG]: Generating default repo files
Sep 27 16:39:46 cloud-init[4328]: __init__.py[DEBUG]: filtered distro mirror info: {}
Sep 27 16:39:46 cloud-init[4328]: cc_yum_configure.py[DEBUG]: mirror_info: {}
Sep 27 16:39:46 cloud-init[4328]: cc_yum_configure.py[DEBUG]: No mirror info found; ignoring.
Sep 27 16:39:46 cloud-init[4328]: cc_yum_configure.py[INFO]: No releasever provided, leaving yum.conf unchanged.
Sep 27 16:39:47 cloud-init[4328]: cc_yum_configure.py[INFO]: No repo target provided, leaving target unchanged.
Sep 27 16:39:47 cloud-init[4328]: handlers.py[DEBUG]: finish: modules-config/config-yum-configure: SUCCESS: config-yum-configure ran successfully
Sep 27 16:39:47 cloud-init[4328]: stages.py[DEBUG]: Running module yum-add-repo (<module 'cloudinit.config.cc_yum_add_repo' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_yum_add_repo.pyc'>) with frequency once-per-instance
Sep 27 16:39:47 cloud-init[4328]: handlers.py[DEBUG]: start: modules-config/config-yum-add-repo: running config-yum-add-repo with frequency once-per-instance
Sep 27 16:39:47 cloud-init[4328]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_yum_add_repo - wb: [644] 19 bytes
Sep 27 16:39:47 cloud-init[4328]: helpers.py[DEBUG]: Running config-yum-add-repo using lock (<FileLock using file '/var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_yum_add_repo'>)
Sep 27 16:39:47 cloud-init[4328]: cc_yum_add_repo.py[DEBUG]: Skipping module named yum-add-repo, no 'yum_repos' configuration found
Sep 27 16:39:47 cloud-init[4328]: handlers.py[DEBUG]: finish: modules-config/config-yum-add-repo: SUCCESS: config-yum-add-repo ran successfully
Sep 27 16:39:47 cloud-init[4328]: stages.py[DEBUG]: Running module package-update-upgrade-install (<module 'cloudinit.config.cc_package_update_upgrade_install' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_package_update_upgrade_install.pyc'>) with frequency once-per-instance
Sep 27 16:39:47 cloud-init[4328]: handlers.py[DEBUG]: start: modules-config/config-package-update-upgrade-install: running config-package-update-upgrade-install with frequency once-per-instance
Sep 27 16:39:47 cloud-init[4328]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_package_update_upgrade_install - wb: [644] 19 bytes
Sep 27 16:39:47 cloud-init[4328]: helpers.py[DEBUG]: Running config-package-update-upgrade-install using lock (<FileLock using file '/var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_package_update_upgrade_install'>)
Sep 27 16:39:47 cloud-init[4328]: amazon.py[DEBUG]: Upgrade level: security
Sep 27 16:39:47 cloud-init[4328]: rhel.py[DEBUG]: Using YUM for package management
Sep 27 16:39:47 cloud-init[4328]: util.py[DEBUG]: Running command ['yum', '-t', '-y', '--exclude=kernel', '--exclude=nvidia*', '--exclude=cuda*', '--security', '--sec-severity=critical', '--sec-severity=important', 'upgrade'] with allowed return codes [0] (shell=False, capture=False)
Sep 27 16:39:55 cloud-init[4328]: handlers.py[DEBUG]: finish: modules-config/config-package-update-upgrade-install: SUCCESS: config-package-update-upgrade-install ran successfully
Sep 27 16:39:55 cloud-init[4328]: stages.py[DEBUG]: Running module timezone (<module 'cloudinit.config.cc_timezone' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_timezone.pyc'>) with frequency once-per-instance
Sep 27 16:39:55 cloud-init[4328]: handlers.py[DEBUG]: start: modules-config/config-timezone: running config-timezone with frequency once-per-instance
Sep 27 16:39:55 cloud-init[4328]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_timezone - wb: [644] 20 bytes
Sep 27 16:39:55 cloud-init[4328]: helpers.py[DEBUG]: Running config-timezone using lock (<FileLock using file '/var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_timezone'>)
Sep 27 16:39:55 cloud-init[4328]: cc_timezone.py[DEBUG]: Skipping module named timezone, no 'timezone' specified
Sep 27 16:39:55 cloud-init[4328]: handlers.py[DEBUG]: finish: modules-config/config-timezone: SUCCESS: config-timezone ran successfully
Sep 27 16:39:55 cloud-init[4328]: stages.py[DEBUG]: Running module disable-ec2-metadata (<module 'cloudinit.config.cc_disable_ec2_metadata' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_disable_ec2_metadata.pyc'>) with frequency always
Sep 27 16:39:55 cloud-init[4328]: handlers.py[DEBUG]: start: modules-config/config-disable-ec2-metadata: running config-disable-ec2-metadata with frequency always
Sep 27 16:39:55 cloud-init[4328]: helpers.py[DEBUG]: Running config-disable-ec2-metadata using lock (<cloudinit.helpers.DummyLock object at 0x7f8124721550>)
Sep 27 16:39:55 cloud-init[4328]: cc_disable_ec2_metadata.py[DEBUG]: Skipping module named disable-ec2-metadata, disabling the ec2 route not enabled
Sep 27 16:39:55 cloud-init[4328]: handlers.py[DEBUG]: finish: modules-config/config-disable-ec2-metadata: SUCCESS: config-disable-ec2-metadata ran successfully
Sep 27 16:39:55 cloud-init[4328]: stages.py[DEBUG]: Running module runcmd (<module 'cloudinit.config.cc_runcmd' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_runcmd.pyc'>) with frequency once-per-instance
Sep 27 16:39:55 cloud-init[4328]: handlers.py[DEBUG]: start: modules-config/config-runcmd: running config-runcmd with frequency once-per-instance
Sep 27 16:39:55 cloud-init[4328]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_runcmd - wb: [644] 20 bytes
Sep 27 16:39:55 cloud-init[4328]: helpers.py[DEBUG]: Running config-runcmd using lock (<FileLock using file '/var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_runcmd'>)
Sep 27 16:39:55 cloud-init[4328]: util.py[DEBUG]: Shellified 2 commands.
Sep 27 16:39:55 cloud-init[4328]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-02e5635df2cfa1023/scripts/runcmd - wb: [700] 211 bytes
Sep 27 16:39:55 cloud-init[4328]: handlers.py[DEBUG]: finish: modules-config/config-runcmd: SUCCESS: config-runcmd ran successfully
Sep 27 16:39:55 cloud-init[4328]: main.py[DEBUG]: Ran 10 modules with 0 failures
Sep 27 16:39:55 cloud-init[4328]: util.py[DEBUG]: Reading from /proc/uptime (quiet=False)
Sep 27 16:39:55 cloud-init[4328]: util.py[DEBUG]: Read 12 bytes from /proc/uptime
Sep 27 16:39:55 cloud-init[4328]: util.py[DEBUG]: cloud-init mode 'modules' took 8.962 seconds (8.96)
Sep 27 16:39:55 cloud-init[4328]: handlers.py[DEBUG]: finish: modules-config: SUCCESS: running modules for config
Sep 27 16:39:56 cloud-init[4883]: util.py[DEBUG]: Cloud-init v. 18.2-72.amzn2.0.7 running 'modules:final' at Fri, 27 Sep 2019 16:39:56 +0000. Up 21.40 seconds.
Sep 27 16:39:56 cloud-init[4883]: stages.py[DEBUG]: Using distro class <class 'cloudinit.distros.amazon.Distro'>
Sep 27 16:39:56 cloud-init[4883]: stages.py[DEBUG]: Running module scripts-per-once (<module 'cloudinit.config.cc_scripts_per_once' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_scripts_per_once.pyc'>) with frequency once
Sep 27 16:39:56 cloud-init[4883]: handlers.py[DEBUG]: start: modules-final/config-scripts-per-once: running config-scripts-per-once with frequency once
Sep 27 16:39:56 cloud-init[4883]: helpers.py[DEBUG]: config-scripts-per-once already ran (freq=once)
Sep 27 16:39:56 cloud-init[4883]: handlers.py[DEBUG]: finish: modules-final/config-scripts-per-once: SUCCESS: config-scripts-per-once previously ran
Sep 27 16:39:56 cloud-init[4883]: stages.py[DEBUG]: Running module scripts-per-boot (<module 'cloudinit.config.cc_scripts_per_boot' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_scripts_per_boot.pyc'>) with frequency always
Sep 27 16:39:56 cloud-init[4883]: handlers.py[DEBUG]: start: modules-final/config-scripts-per-boot: running config-scripts-per-boot with frequency always
Sep 27 16:39:56 cloud-init[4883]: helpers.py[DEBUG]: Running config-scripts-per-boot using lock (<cloudinit.helpers.DummyLock object at 0x7f10e36167d0>)
Sep 27 16:39:56 cloud-init[4883]: handlers.py[DEBUG]: finish: modules-final/config-scripts-per-boot: SUCCESS: config-scripts-per-boot ran successfully
Sep 27 16:39:56 cloud-init[4883]: stages.py[DEBUG]: Running module scripts-per-instance (<module 'cloudinit.config.cc_scripts_per_instance' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_scripts_per_instance.pyc'>) with frequency once-per-instance
Sep 27 16:39:56 cloud-init[4883]: handlers.py[DEBUG]: start: modules-final/config-scripts-per-instance: running config-scripts-per-instance with frequency once-per-instance
Sep 27 16:39:56 cloud-init[4883]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_scripts_per_instance - wb: [644] 19 bytes
Sep 27 16:39:56 cloud-init[4883]: helpers.py[DEBUG]: Running config-scripts-per-instance using lock (<FileLock using file '/var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_scripts_per_instance'>)
Sep 27 16:39:56 cloud-init[4883]: handlers.py[DEBUG]: finish: modules-final/config-scripts-per-instance: SUCCESS: config-scripts-per-instance ran successfully
Sep 27 16:39:56 cloud-init[4883]: stages.py[DEBUG]: Running module scripts-user (<module 'cloudinit.config.cc_scripts_user' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_scripts_user.pyc'>) with frequency once-per-instance
Sep 27 16:39:56 cloud-init[4883]: handlers.py[DEBUG]: start: modules-final/config-scripts-user: running config-scripts-user with frequency once-per-instance
Sep 27 16:39:56 cloud-init[4883]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_scripts_user - wb: [644] 19 bytes
Sep 27 16:39:56 cloud-init[4883]: helpers.py[DEBUG]: Running config-scripts-user using lock (<FileLock using file '/var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_scripts_user'>)
Sep 27 16:39:56 cloud-init[4883]: util.py[DEBUG]: Running command ['/var/lib/cloud/instance/scripts/part-002'] with allowed return codes [0] (shell=True, capture=False)
Sep 27 16:41:12 cloud-init[4883]: util.py[WARNING]: Failed running /var/lib/cloud/instance/scripts/part-002 [1]
Sep 27 16:41:12 cloud-init[4883]: util.py[DEBUG]: Failed running /var/lib/cloud/instance/scripts/part-002 [1]
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/cloudinit/util.py", line 860, in runparts
    subp(prefix + [exe_path], capture=False, shell=True)
  File "/usr/lib/python2.7/site-packages/cloudinit/util.py", line 2053, in subp
    cmd=args)
ProcessExecutionError: Unexpected error while running command.
Command: ['/var/lib/cloud/instance/scripts/part-002']
Exit code: 1
Reason: -
Stdout: -
Stderr: -
Sep 27 16:41:12 cloud-init[4883]: util.py[DEBUG]: Running command ['/var/lib/cloud/instance/scripts/runcmd'] with allowed return codes [0] (shell=True, capture=False)
Sep 27 16:41:12 cloud-init[4883]: cc_scripts_user.py[WARNING]: Failed to run module scripts-user (scripts in /var/lib/cloud/instance/scripts)
Sep 27 16:41:12 cloud-init[4883]: handlers.py[DEBUG]: finish: modules-final/config-scripts-user: FAIL: running config-scripts-user with frequency once-per-instance
Sep 27 16:41:12 cloud-init[4883]: util.py[WARNING]: Running module scripts-user (<module 'cloudinit.config.cc_scripts_user' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_scripts_user.pyc'>) failed
Sep 27 16:41:12 cloud-init[4883]: util.py[DEBUG]: Running module scripts-user (<module 'cloudinit.config.cc_scripts_user' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_scripts_user.pyc'>) failed
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/cloudinit/stages.py", line 798, in _run_modules
    freq=freq)
  File "/usr/lib/python2.7/site-packages/cloudinit/cloud.py", line 54, in run
    return self._runners.run(name, functor, args, freq, clear_on_fail)
  File "/usr/lib/python2.7/site-packages/cloudinit/helpers.py", line 187, in run
    results = functor(*args)
  File "/usr/lib/python2.7/site-packages/cloudinit/config/cc_scripts_user.py", line 45, in handle
    util.runparts(runparts_path)
  File "/usr/lib/python2.7/site-packages/cloudinit/util.py", line 867, in runparts
    % (len(failed), len(attempted)))
RuntimeError: Runparts: 1 failures in 2 attempted commands
Sep 27 16:41:12 cloud-init[4883]: stages.py[DEBUG]: Running module ssh-authkey-fingerprints (<module 'cloudinit.config.cc_ssh_authkey_fingerprints' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_ssh_authkey_fingerprints.pyc'>) with frequency once-per-instance
Sep 27 16:41:12 cloud-init[4883]: handlers.py[DEBUG]: start: modules-final/config-ssh-authkey-fingerprints: running config-ssh-authkey-fingerprints with frequency once-per-instance
Sep 27 16:41:12 cloud-init[4883]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_ssh_authkey_fingerprints - wb: [644] 20 bytes
Sep 27 16:41:12 cloud-init[4883]: helpers.py[DEBUG]: Running config-ssh-authkey-fingerprints using lock (<FileLock using file '/var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_ssh_authkey_fingerprints'>)
Sep 27 16:41:12 cloud-init[4883]: util.py[DEBUG]: Reading from /etc/ssh/sshd_config (quiet=False)
Sep 27 16:41:12 cloud-init[4883]: util.py[DEBUG]: Read 3957 bytes from /etc/ssh/sshd_config
Sep 27 16:41:12 cloud-init[4883]: util.py[DEBUG]: Reading from /home/ec2-user/.ssh/authorized_keys (quiet=False)
Sep 27 16:41:12 cloud-init[4883]: util.py[DEBUG]: Read 404 bytes from /home/ec2-user/.ssh/authorized_keys
Sep 27 16:41:12 cloud-init[4883]: handlers.py[DEBUG]: finish: modules-final/config-ssh-authkey-fingerprints: SUCCESS: config-ssh-authkey-fingerprints ran successfully
Sep 27 16:41:12 cloud-init[4883]: stages.py[DEBUG]: Running module keys-to-console (<module 'cloudinit.config.cc_keys_to_console' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_keys_to_console.pyc'>) with frequency once-per-instance
Sep 27 16:41:12 cloud-init[4883]: handlers.py[DEBUG]: start: modules-final/config-keys-to-console: running config-keys-to-console with frequency once-per-instance
Sep 27 16:41:12 cloud-init[4883]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_keys_to_console - wb: [644] 20 bytes
Sep 27 16:41:12 cloud-init[4883]: helpers.py[DEBUG]: Running config-keys-to-console using lock (<FileLock using file '/var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_keys_to_console'>)
Sep 27 16:41:12 cloud-init[4883]: util.py[DEBUG]: Running command ['/usr/libexec/cloud-init/write-ssh-key-fingerprints', '', 'ssh-dss'] with allowed return codes [0] (shell=False, capture=True)
Sep 27 16:41:12 cloud-init[4883]: handlers.py[DEBUG]: finish: modules-final/config-keys-to-console: SUCCESS: config-keys-to-console ran successfully
Sep 27 16:41:12 cloud-init[4883]: stages.py[DEBUG]: Running module phone-home (<module 'cloudinit.config.cc_phone_home' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_phone_home.pyc'>) with frequency once-per-instance
Sep 27 16:41:12 cloud-init[4883]: handlers.py[DEBUG]: start: modules-final/config-phone-home: running config-phone-home with frequency once-per-instance
Sep 27 16:41:12 cloud-init[4883]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_phone_home - wb: [644] 20 bytes
Sep 27 16:41:12 cloud-init[4883]: helpers.py[DEBUG]: Running config-phone-home using lock (<FileLock using file '/var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_phone_home'>)
Sep 27 16:41:12 cloud-init[4883]: cc_phone_home.py[DEBUG]: Skipping module named phone-home, no 'phone_home' configuration found
Sep 27 16:41:12 cloud-init[4883]: handlers.py[DEBUG]: finish: modules-final/config-phone-home: SUCCESS: config-phone-home ran successfully
Sep 27 16:41:12 cloud-init[4883]: stages.py[DEBUG]: Running module final-message (<module 'cloudinit.config.cc_final_message' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_final_message.pyc'>) with frequency always
Sep 27 16:41:12 cloud-init[4883]: handlers.py[DEBUG]: start: modules-final/config-final-message: running config-final-message with frequency always
Sep 27 16:41:12 cloud-init[4883]: helpers.py[DEBUG]: Running config-final-message using lock (<cloudinit.helpers.DummyLock object at 0x7f10e35e4f10>)
Sep 27 16:41:12 cloud-init[4883]: util.py[DEBUG]: Reading from /proc/uptime (quiet=False)
Sep 27 16:41:12 cloud-init[4883]: util.py[DEBUG]: Read 12 bytes from /proc/uptime
Sep 27 16:41:12 cloud-init[4883]: util.py[DEBUG]: Cloud-init v. 18.2-72.amzn2.0.7 finished at Fri, 27 Sep 2019 16:41:12 +0000. Datasource DataSourceEc2.  Up 98.14 seconds
Sep 27 16:41:12 cloud-init[4883]: util.py[DEBUG]: Writing to /var/lib/cloud/instance/boot-finished - wb: [644] 63 bytes
Sep 27 16:41:12 cloud-init[4883]: handlers.py[DEBUG]: finish: modules-final/config-final-message: SUCCESS: config-final-message ran successfully
Sep 27 16:41:12 cloud-init[4883]: stages.py[DEBUG]: Running module power-state-change (<module 'cloudinit.config.cc_power_state_change' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_power_state_change.pyc'>) with frequency once-per-instance
Sep 27 16:41:12 cloud-init[4883]: handlers.py[DEBUG]: start: modules-final/config-power-state-change: running config-power-state-change with frequency once-per-instance
Sep 27 16:41:12 cloud-init[4883]: util.py[DEBUG]: Writing to /var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_power_state_change - wb: [644] 20 bytes
Sep 27 16:41:12 cloud-init[4883]: helpers.py[DEBUG]: Running config-power-state-change using lock (<FileLock using file '/var/lib/cloud/instances/i-02e5635df2cfa1023/sem/config_power_state_change'>)
Sep 27 16:41:12 cloud-init[4883]: cc_power_state_change.py[DEBUG]: no power_state provided. doing nothing
Sep 27 16:41:12 cloud-init[4883]: handlers.py[DEBUG]: finish: modules-final/config-power-state-change: SUCCESS: config-power-state-change ran successfully
Sep 27 16:41:12 cloud-init[4883]: main.py[DEBUG]: Ran 9 modules with 1 failures
Sep 27 16:41:12 cloud-init[4883]: util.py[DEBUG]: Creating symbolic link from '/run/cloud-init/result.json' => '../../var/lib/cloud/data/result.json'
Sep 27 16:41:12 cloud-init[4883]: util.py[DEBUG]: Reading from /proc/uptime (quiet=False)
Sep 27 16:41:12 cloud-init[4883]: util.py[DEBUG]: Read 12 bytes from /proc/uptime
Sep 27 16:41:12 cloud-init[4883]: util.py[DEBUG]: cloud-init mode 'modules' took 76.751 seconds (76.75)
Sep 27 16:41:12 cloud-init[4883]: handlers.py[DEBUG]: finish: modules-final: FAIL: running modules for final

cloud-init-log

Cloud-init v. 18.2-72.amzn2.0.7 running 'init-local' at Fri, 27 Sep 2019 16:04:22 +0000. Up 6.01 seconds.
Cloud-init v. 18.2-72.amzn2.0.7 running 'init' at Fri, 27 Sep 2019 16:04:24 +0000. Up 8.23 seconds.
ci-info: ++++++++++++++++++++++++++++++++++++++Net device info+++++++++++++++++++++++++++++++++++++++
ci-info: +--------+------+-----------------------------+---------------+--------+-------------------+
ci-info: | Device |  Up  |           Address           |      Mask     | Scope  |     Hw-Address    |
ci-info: +--------+------+-----------------------------+---------------+--------+-------------------+
ci-info: |  eth0  | True |         172.31.32.47        | 255.255.240.0 | global | 0e:51:34:08:85:7c |
ci-info: |  eth0  | True | fe80::c51:34ff:fe08:857c/64 |       .       |  link  | 0e:51:34:08:85:7c |
ci-info: |   lo   | True |          127.0.0.1          |   255.0.0.0   |  host  |         .         |
ci-info: |   lo   | True |           ::1/128           |       .       |  host  |         .         |
ci-info: +--------+------+-----------------------------+---------------+--------+-------------------+
ci-info: ++++++++++++++++++++++++++++++++Route IPv4 info++++++++++++++++++++++++++++++++
ci-info: +-------+-----------------+-------------+-----------------+-----------+-------+
ci-info: | Route |   Destination   |   Gateway   |     Genmask     | Interface | Flags |
ci-info: +-------+-----------------+-------------+-----------------+-----------+-------+
ci-info: |   0   |     0.0.0.0     | 172.31.32.1 |     0.0.0.0     |    eth0   |   UG  |
ci-info: |   1   | 169.254.169.254 |   0.0.0.0   | 255.255.255.255 |    eth0   |   UH  |
ci-info: |   2   |   172.31.32.0   |   0.0.0.0   |  255.255.240.0  |    eth0   |   U   |
ci-info: +-------+-----------------+-------------+-----------------+-----------+-------+
ci-info: +++++++++++++++++++Route IPv6 info+++++++++++++++++++
ci-info: +-------+-------------+---------+-----------+-------+
ci-info: | Route | Destination | Gateway | Interface | Flags |
ci-info: +-------+-------------+---------+-----------+-------+
ci-info: |   9   |  fe80::/64  |    ::   |    eth0   |   U   |
ci-info: |   11  |    local    |    ::   |    eth0   |   U   |
ci-info: |   12  |   ff00::/8  |    ::   |    eth0   |   U   |
ci-info: +-------+-------------+---------+-----------+-------+
Cloud-init v. 18.2-72.amzn2.0.7 running 'modules:config' at Fri, 27 Sep 2019 16:04:26 +0000. Up 9.96 seconds.
Loaded plugins: extras_suggestions, langpacks, priorities, update-motd
Existing lock /var/run/yum.pid: another copy is running as pid 3336.
Another app is currently holding the yum lock; waiting for it to exit...
  The other application is: yum
    Memory :  31 M RSS (321 MB VSZ)
    Started: Fri Sep 27 16:04:25 2019 - 00:02 ago
    State  : Running, pid: 3336
Another app is currently holding the yum lock; waiting for it to exit...
  The other application is: yum
    Memory :  59 M RSS (350 MB VSZ)
    Started: Fri Sep 27 16:04:25 2019 - 00:04 ago
    State  : Running, pid: 3336
Another app is currently holding the yum lock; waiting for it to exit...
  The other application is: yum
    Memory : 102 M RSS (393 MB VSZ)
    Started: Fri Sep 27 16:04:25 2019 - 00:06 ago
    State  : Running, pid: 3336
 --> python-devel-2.7.16-3.amzn2.0.1.x86_64 from amzn2-core removed (updateinfo)
 --> glib2-2.56.1-4.amzn2.x86_64 from amzn2-core removed (updateinfo)
 --> cloud-utils-growpart-0.29-2.amzn2.noarch from installed removed (updateinfo)
 --> 1:mariadb-libs-5.5.64-1.amzn2.x86_64 from amzn2-core removed (updateinfo)
 --> dracut-033-535.amzn2.1.3.x86_64 from amzn2-core removed (updateinfo)
 --> python-devel-2.7.16-2.amzn2.0.1.x86_64 from installed removed (updateinfo)
 --> python-2.7.16-3.amzn2.0.1.x86_64 from amzn2-core removed (updateinfo)
 --> dracut-config-generic-033-535.amzn2.1.3.x86_64 from amzn2-core removed (updateinfo)
 --> 1:mariadb-libs-5.5.62-1.amzn2.0.1.x86_64 from installed removed (updateinfo)
 --> python-2.7.16-2.amzn2.0.1.x86_64 from installed removed (updateinfo)
 --> glib2-2.54.2-2.amzn2.x86_64 from installed removed (updateinfo)
 --> python-libs-2.7.16-2.amzn2.0.1.x86_64 from installed removed (updateinfo)
 --> dracut-config-generic-033-535.amzn2.1.2.x86_64 from installed removed (updateinfo)
 --> python-libs-2.7.16-3.amzn2.0.1.x86_64 from amzn2-core removed (updateinfo)
 --> cloud-utils-growpart-0.31-1.amzn2.noarch from amzn2-core removed (updateinfo)
 --> dracut-033-535.amzn2.1.2.x86_64 from installed removed (updateinfo)
1 package(s) needed (+0 related) for security, out of 9 available
Resolving Dependencies
--> Running transaction check
---> Package kernel-tools.x86_64 0:4.14.138-114.102.amzn2 will be updated
---> Package kernel-tools.x86_64 0:4.14.146-119.123.amzn2 will be an update
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================
 Package          Arch       Version                       Repository      Size
================================================================================
Updating:
 kernel-tools     x86_64     4.14.146-119.123.amzn2        amzn2-core     116 k

Transaction Summary
================================================================================
Upgrade  1 Package

Total download size: 116 k
Downloading packages:
Delta RPMs disabled because /usr/bin/applydeltarpm not installed.
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Updating   : kernel-tools-4.14.146-119.123.amzn2.x86_64                   1/2
  Cleanup    : kernel-tools-4.14.138-114.102.amzn2.x86_64                   2/2
  Verifying  : kernel-tools-4.14.146-119.123.amzn2.x86_64                   1/2
  Verifying  : kernel-tools-4.14.138-114.102.amzn2.x86_64                   2/2

Updated:
  kernel-tools.x86_64 0:4.14.146-119.123.amzn2

Complete!
Cloud-init v. 18.2-72.amzn2.0.7 running 'modules:final' at Fri, 27 Sep 2019 16:04:36 +0000. Up 19.97 seconds.
Cloud-init v. 18.2-72.amzn2.0.7 finished at Fri, 27 Sep 2019 16:04:36 +0000. Datasource DataSourceEc2.  Up 20.40 seconds
Cloud-init v. 18.2-72.amzn2.0.7 running 'init-local' at Fri, 27 Sep 2019 16:39:42 +0000. Up 7.91 seconds.
Cloud-init v. 18.2-72.amzn2.0.7 running 'init' at Fri, 27 Sep 2019 16:39:45 +0000. Up 10.51 seconds.
ci-info: +++++++++++++++++++++++++++++++++++++++Net device info++++++++++++++++++++++++++++++++++++++++
ci-info: +--------+------+-----------------------------+-----------------+--------+-------------------+
ci-info: | Device |  Up  |           Address           |       Mask      | Scope  |     Hw-Address    |
ci-info: +--------+------+-----------------------------+-----------------+--------+-------------------+
ci-info: |  eth0  | True |        10.80.252.214        | 255.255.255.224 | global | 0e:d5:c4:93:41:94 |
ci-info: |  eth0  | True | fe80::cd5:c4ff:fe93:4194/64 |        .        |  link  | 0e:d5:c4:93:41:94 |
ci-info: |   lo   | True |          127.0.0.1          |    255.0.0.0    |  host  |         .         |
ci-info: |   lo   | True |           ::1/128           |        .        |  host  |         .         |
ci-info: +--------+------+-----------------------------+-----------------+--------+-------------------+
ci-info: +++++++++++++++++++++++++++++++++Route IPv4 info+++++++++++++++++++++++++++++++++
ci-info: +-------+-----------------+---------------+-----------------+-----------+-------+
ci-info: | Route |   Destination   |    Gateway    |     Genmask     | Interface | Flags |
ci-info: +-------+-----------------+---------------+-----------------+-----------+-------+
ci-info: |   0   |     0.0.0.0     | 10.80.252.193 |     0.0.0.0     |    eth0   |   UG  |
ci-info: |   1   |  10.80.252.192  |    0.0.0.0    | 255.255.255.224 |    eth0   |   U   |
ci-info: |   2   | 169.254.169.254 |    0.0.0.0    | 255.255.255.255 |    eth0   |   UH  |
ci-info: +-------+-----------------+---------------+-----------------+-----------+-------+
ci-info: +++++++++++++++++++Route IPv6 info+++++++++++++++++++
ci-info: +-------+-------------+---------+-----------+-------+
ci-info: | Route | Destination | Gateway | Interface | Flags |
ci-info: +-------+-------------+---------+-----------+-------+
ci-info: |   9   |  fe80::/64  |    ::   |    eth0   |   U   |
ci-info: |   11  |    local    |    ::   |    eth0   |   U   |
ci-info: |   12  |   ff00::/8  |    ::   |    eth0   |   U   |
ci-info: +-------+-------------+---------+-----------+-------+
Cloud-init v. 18.2-72.amzn2.0.7 running 'modules:config' at Fri, 27 Sep 2019 16:39:46 +0000. Up 12.08 seconds.
Loaded plugins: extras_suggestions, langpacks, priorities, update-motd
191 packages excluded due to repository priority protections
 --> python-devel-2.7.16-3.amzn2.0.1.x86_64 from amzn2-core removed (updateinfo)
 --> python-2.7.16-2.amzn2.0.1.x86_64 from installed removed (updateinfo)
 --> python2-simplejson-3.10.0-2.el7.x86_64 from epel removed (updateinfo)
 --> cloud-utils-growpart-0.29-2.amzn2.noarch from installed removed (updateinfo)
 --> 1:mariadb-libs-5.5.64-1.amzn2.x86_64 from amzn2-core removed (updateinfo)
 --> dracut-033-535.amzn2.1.3.x86_64 from amzn2-core removed (updateinfo)
 --> python-devel-2.7.16-2.amzn2.0.1.x86_64 from installed removed (updateinfo)
 --> python-2.7.16-3.amzn2.0.1.x86_64 from amzn2-core removed (updateinfo)
 --> dracut-config-generic-033-535.amzn2.1.3.x86_64 from amzn2-core removed (updateinfo)
 --> 1:mariadb-libs-5.5.62-1.amzn2.0.1.x86_64 from installed removed (updateinfo)
 --> glib2-2.56.1-4.amzn2.x86_64 from amzn2-core removed (updateinfo)
 --> glib2-2.54.2-2.amzn2.x86_64 from installed removed (updateinfo)
 --> python-simplejson-3.2.0-1.amzn2.0.2.x86_64 from installed removed (updateinfo)
 --> python-libs-2.7.16-2.amzn2.0.1.x86_64 from installed removed (updateinfo)
 --> dracut-config-generic-033-535.amzn2.1.2.x86_64 from installed removed (updateinfo)
 --> python-libs-2.7.16-3.amzn2.0.1.x86_64 from amzn2-core removed (updateinfo)
 --> cloud-utils-growpart-0.31-1.amzn2.noarch from amzn2-core removed (updateinfo)
 --> dracut-033-535.amzn2.1.2.x86_64 from installed removed (updateinfo)
No packages needed for security; 9 packages available
Resolving Dependencies
Cloud-init v. 18.2-72.amzn2.0.7 running 'modules:final' at Fri, 27 Sep 2019 16:39:56 +0000. Up 21.40 seconds.
+ proxy=NONE
+ custom_cookbook=NONE
+ '[' NONE '!=' NONE ']'
+ proxy_args=
+ touch /tmp/proxy.sh
+ export _region=us-east-1
+ _region=us-east-1
+ s3_url=amazonaws.com
+ '[' NONE '!=' NONE ']'
+ cookbook_url=https://s3.us-east-1.amazonaws.com/us-east-1-aws-parallelcluster/cookbooks/aws-parallelcluster-cookbook-2.4.1.tgz
+ export PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/opt/aws/bin
+ PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/opt/aws/bin
+ export parallelcluster_version=aws-parallelcluster-2.4.1
+ parallelcluster_version=aws-parallelcluster-2.4.1
+ export cookbook_version=aws-parallelcluster-cookbook-2.4.1
+ cookbook_version=aws-parallelcluster-cookbook-2.4.1
+ export chef_version=14.2.0
+ chef_version=14.2.0
+ export ridley_version=5.1.1
+ ridley_version=5.1.1
+ export berkshelf_version=7.0.4
+ berkshelf_version=7.0.4
+ '[' -f /opt/parallelcluster/.bootstrapped ']'
+ bootstrap_instance
+ which yum
/bin/yum
+ yum=0
+ which apt-get
+ apt=1
+ '[' 0 == 0 ']'
+ yum -y groupinstall development
Loaded plugins: extras_suggestions, langpacks, priorities, update-motd
191 packages excluded due to repository priority protections
Resolving Dependencies
--> Running transaction check
---> Package autoconf.noarch 0:2.69-11.amzn2 will be installed
--> Processing Dependency: m4 >= 1.4.14 for package: autoconf-2.69-11.amzn2.noarch
--> Processing Dependency: perl(Data::Dumper) for package: autoconf-2.69-11.amzn2.noarch
---> Package automake.noarch 0:1.13.4-3.1.amzn2 will be installed
--> Processing Dependency: perl(Thread::Queue) for package: automake-1.13.4-3.1.amzn2.noarch
--> Processing Dependency: perl(TAP::Parser) for package: automake-1.13.4-3.1.amzn2.noarch
---> Package bison.x86_64 0:3.0.4-6.amzn2.0.2 will be installed
---> Package byacc.x86_64 0:1.9.20130304-3.amzn2.0.2 will be installed
---> Package cscope.x86_64 0:15.8-10.amzn2.0.2 will be installed
--> Processing Dependency: emacs-filesystem for package: cscope-15.8-10.amzn2.0.2.x86_64
---> Package ctags.x86_64 0:5.8-13.amzn2.0.2 will be installed
---> Package diffstat.x86_64 0:1.57-4.amzn2.0.2 will be installed
---> Package doxygen.x86_64 1:1.8.5-3.amzn2.0.2 will be installed
---> Package elfutils.x86_64 0:0.170-4.amzn2 will be installed
---> Package flex.x86_64 0:2.5.37-3.amzn2.0.3 will be installed
---> Package gcc.x86_64 0:7.3.1-5.amzn2.0.2 will be installed
--> Processing Dependency: cpp = 7.3.1-5.amzn2.0.2 for package: gcc-7.3.1-5.amzn2.0.2.x86_64
--> Processing Dependency: glibc-devel >= 2.2.90-12 for package: gcc-7.3.1-5.amzn2.0.2.x86_64
--> Processing Dependency: libubsan.so.0()(64bit) for package: gcc-7.3.1-5.amzn2.0.2.x86_64
--> Processing Dependency: libtsan.so.0()(64bit) for package: gcc-7.3.1-5.amzn2.0.2.x86_64
--> Processing Dependency: libquadmath.so.0()(64bit) for package: gcc-7.3.1-5.amzn2.0.2.x86_64
--> Processing Dependency: libmpxwrappers.so.2()(64bit) for package: gcc-7.3.1-5.amzn2.0.2.x86_64
--> Processing Dependency: libmpx.so.2()(64bit) for package: gcc-7.3.1-5.amzn2.0.2.x86_64
--> Processing Dependency: libmpfr.so.4()(64bit) for package: gcc-7.3.1-5.amzn2.0.2.x86_64
--> Processing Dependency: libmpc.so.3()(64bit) for package: gcc-7.3.1-5.amzn2.0.2.x86_64
--> Processing Dependency: liblsan.so.0()(64bit) for package: gcc-7.3.1-5.amzn2.0.2.x86_64
--> Processing Dependency: libitm.so.1()(64bit) for package: gcc-7.3.1-5.amzn2.0.2.x86_64
--> Processing Dependency: libcilkrts.so.5()(64bit) for package: gcc-7.3.1-5.amzn2.0.2.x86_64
--> Processing Dependency: libatomic.so.1()(64bit) for package: gcc-7.3.1-5.amzn2.0.2.x86_64
--> Processing Dependency: libasan.so.4()(64bit) for package: gcc-7.3.1-5.amzn2.0.2.x86_64
---> Package gcc-c++.x86_64 0:7.3.1-5.amzn2.0.2 will be installed
---> Package gcc-gfortran.x86_64 0:7.3.1-5.amzn2.0.2 will be installed
--> Processing Dependency: libgfortran.so.4()(64bit) for package: gcc-gfortran-7.3.1-5.amzn2.0.2.x86_64
---> Package git.x86_64 0:2.17.2-2.amzn2 will be installed
--> Processing Dependency: perl-Git = 2.17.2-2.amzn2 for package: git-2.17.2-2.amzn2.x86_64
--> Processing Dependency: git-core-doc = 2.17.2-2.amzn2 for package: git-2.17.2-2.amzn2.x86_64
--> Processing Dependency: git-core = 2.17.2-2.amzn2 for package: git-2.17.2-2.amzn2.x86_64
--> Processing Dependency: perl(Term::ReadKey) for package: git-2.17.2-2.amzn2.x86_64
--> Processing Dependency: perl(Git::I18N) for package: git-2.17.2-2.amzn2.x86_64
--> Processing Dependency: perl(Git) for package: git-2.17.2-2.amzn2.x86_64
--> Processing Dependency: libsecret-1.so.0()(64bit) for package: git-2.17.2-2.amzn2.x86_64
---> Package indent.x86_64 0:2.2.11-13.amzn2.0.2 will be installed
---> Package intltool.noarch 0:0.50.2-7.amzn2 will be installed
--> Processing Dependency: perl(XML::Parser) for package: intltool-0.50.2-7.amzn2.noarch
--> Processing Dependency: gettext-devel for package: intltool-0.50.2-7.amzn2.noarch
---> Package libtool.x86_64 0:2.4.2-22.2.amzn2.0.2 will be installed
---> Package patch.x86_64 0:2.7.1-10.amzn2.0.2 will be installed
---> Package patchutils.x86_64 0:0.3.3-4.amzn2.0.1 will be installed
---> Package rcs.x86_64 0:5.9.0-5.amzn2.0.2 will be installed
---> Package rpm-build.x86_64 0:4.11.3-25.amzn2.0.3 will be installed
--> Processing Dependency: system-rpm-config for package: rpm-build-4.11.3-25.amzn2.0.3.x86_64
--> Processing Dependency: /usr/bin/gdb-add-index for package: rpm-build-4.11.3-25.amzn2.0.3.x86_64
---> Package rpm-sign.x86_64 0:4.11.3-25.amzn2.0.3 will be installed
---> Package subversion.x86_64 0:1.7.14-11.amzn2.0.2 will be installed
--> Processing Dependency: subversion-libs(x86-64) = 1.7.14-11.amzn2.0.2 for package: subversion-1.7.14-11.amzn2.0.2.x86_64
--> Processing Dependency: libsvn_wc-1.so.0()(64bit) for package: subversion-1.7.14-11.amzn2.0.2.x86_64
--> Processing Dependency: libsvn_subr-1.so.0()(64bit) for package: subversion-1.7.14-11.amzn2.0.2.x86_64
--> Processing Dependency: libsvn_repos-1.so.0()(64bit) for package: subversion-1.7.14-11.amzn2.0.2.x86_64
--> Processing Dependency: libsvn_ra_svn-1.so.0()(64bit) for package: subversion-1.7.14-11.amzn2.0.2.x86_64
--> Processing Dependency: libsvn_ra_neon-1.so.0()(64bit) for package: subversion-1.7.14-11.amzn2.0.2.x86_64
--> Processing Dependency: libsvn_ra_local-1.so.0()(64bit) for package: subversion-1.7.14-11.amzn2.0.2.x86_64
--> Processing Dependency: libsvn_ra-1.so.0()(64bit) for package: subversion-1.7.14-11.amzn2.0.2.x86_64
--> Processing Dependency: libsvn_fs_util-1.so.0()(64bit) for package: subversion-1.7.14-11.amzn2.0.2.x86_64
--> Processing Dependency: libsvn_fs_fs-1.so.0()(64bit) for package: subversion-1.7.14-11.amzn2.0.2.x86_64
--> Processing Dependency: libsvn_fs_base-1.so.0()(64bit) for package: subversion-1.7.14-11.amzn2.0.2.x86_64
--> Processing Dependency: libsvn_fs-1.so.0()(64bit) for package: subversion-1.7.14-11.amzn2.0.2.x86_64
--> Processing Dependency: libsvn_diff-1.so.0()(64bit) for package: subversion-1.7.14-11.amzn2.0.2.x86_64
--> Processing Dependency: libsvn_delta-1.so.0()(64bit) for package: subversion-1.7.14-11.amzn2.0.2.x86_64
--> Processing Dependency: libsvn_client-1.so.0()(64bit) for package: subversion-1.7.14-11.amzn2.0.2.x86_64
--> Processing Dependency: libneon.so.27()(64bit) for package: subversion-1.7.14-11.amzn2.0.2.x86_64
--> Processing Dependency: libaprutil-1.so.0()(64bit) for package: subversion-1.7.14-11.amzn2.0.2.x86_64
--> Processing Dependency: libapr-1.so.0()(64bit) for package: subversion-1.7.14-11.amzn2.0.2.x86_64
---> Package swig.x86_64 0:3.0.12-11.amzn2.0.3 will be installed
---> Package systemtap.x86_64 0:4.1-0.20190208git4e76869512d2.amzn2.0.2 will be installed
--> Processing Dependency: systemtap-devel = 4.1-0.20190208git4e76869512d2.amzn2.0.2 for package: systemtap-4.1-0.20190208git4e76869512d2.amzn2.0.2.x86_64
--> Processing Dependency: systemtap-client = 4.1-0.20190208git4e76869512d2.amzn2.0.2 for package: systemtap-4.1-0.20190208git4e76869512d2.amzn2.0.2.x86_64
--> Running transaction check
---> Package apr.x86_64 0:1.6.3-5.amzn2.0.2 will be installed
---> Package apr-util.x86_64 0:1.6.1-5.amzn2.0.2 will be installed
--> Processing Dependency: apr-util-bdb(x86-64) = 1.6.1-5.amzn2.0.2 for package: apr-util-1.6.1-5.amzn2.0.2.x86_64
---> Package cpp.x86_64 0:7.3.1-5.amzn2.0.2 will be installed
---> Package emacs-filesystem.noarch 1:25.3-3.amzn2.0.1 will be installed
---> Package gdb.x86_64 0:8.0.1-30.amzn2.0.3 will be installed
---> Package gettext-devel.x86_64 0:0.19.8.1-2.amzn2.0.2 will be installed
--> Processing Dependency: gettext-common-devel = 0.19.8.1-2.amzn2.0.2 for package: gettext-devel-0.19.8.1-2.amzn2.0.2.x86_64
---> Package git-core.x86_64 0:2.17.2-2.amzn2 will be installed
---> Package git-core-doc.noarch 0:2.17.2-2.amzn2 will be installed
---> Package glibc-devel.x86_64 0:2.26-32.amzn2.0.1 will be installed
--> Processing Dependency: glibc-headers = 2.26-32.amzn2.0.1 for package: glibc-devel-2.26-32.amzn2.0.1.x86_64
--> Processing Dependency: glibc-headers for package: glibc-devel-2.26-32.amzn2.0.1.x86_64
---> Package libatomic.x86_64 0:7.3.1-5.amzn2.0.2 will be installed
---> Package libcilkrts.x86_64 0:7.3.1-5.amzn2.0.2 will be installed
---> Package libgfortran.x86_64 0:7.3.1-5.amzn2.0.2 will be installed
---> Package libitm.x86_64 0:7.3.1-5.amzn2.0.2 will be installed
---> Package libmpc.x86_64 0:1.0.1-3.amzn2.0.2 will be installed
---> Package libmpx.x86_64 0:7.3.1-5.amzn2.0.2 will be installed
---> Package libquadmath.x86_64 0:7.3.1-5.amzn2.0.2 will be installed
---> Package libsanitizer.x86_64 0:7.3.1-5.amzn2.0.2 will be installed
---> Package libsecret.x86_64 0:0.18.5-2.amzn2.0.2 will be installed
---> Package m4.x86_64 0:1.4.16-10.amzn2.0.2 will be installed
---> Package mpfr.x86_64 0:3.1.1-4.amzn2.0.2 will be installed
---> Package neon.x86_64 0:0.30.0-3.amzn2.0.2 will be installed
--> Processing Dependency: libgnutls.so.28(GNUTLS_2_12)(64bit) for package: neon-0.30.0-3.amzn2.0.2.x86_64
--> Processing Dependency: libgnutls.so.28(GNUTLS_1_4)(64bit) for package: neon-0.30.0-3.amzn2.0.2.x86_64
--> Processing Dependency: libproxy.so.1()(64bit) for package: neon-0.30.0-3.amzn2.0.2.x86_64
--> Processing Dependency: libpakchois.so.0()(64bit) for package: neon-0.30.0-3.amzn2.0.2.x86_64
--> Processing Dependency: libgnutls.so.28()(64bit) for package: neon-0.30.0-3.amzn2.0.2.x86_64
---> Package perl-Data-Dumper.x86_64 0:2.145-3.amzn2.0.2 will be installed
---> Package perl-Git.noarch 0:2.17.2-2.amzn2 will be installed
--> Processing Dependency: perl(Error) for package: perl-Git-2.17.2-2.amzn2.noarch
---> Package perl-TermReadKey.x86_64 0:2.30-20.amzn2.0.2 will be installed
---> Package perl-Test-Harness.noarch 0:3.28-3.amzn2 will be installed
---> Package perl-Thread-Queue.noarch 0:3.02-2.amzn2 will be installed
---> Package perl-XML-Parser.x86_64 0:2.41-10.amzn2.0.2 will be installed
---> Package subversion-libs.x86_64 0:1.7.14-11.amzn2.0.2 will be installed
---> Package system-rpm-config.noarch 0:9.1.0-76.amzn2.0.8 will be installed
--> Processing Dependency: dwz >= 0.4 for package: system-rpm-config-9.1.0-76.amzn2.0.8.noarch
--> Processing Dependency: perl-srpm-macros for package: system-rpm-config-9.1.0-76.amzn2.0.8.noarch
---> Package systemtap-client.x86_64 0:4.1-0.20190208git4e76869512d2.amzn2.0.2 will be installed
--> Processing Dependency: mokutil for package: systemtap-client-4.1-0.20190208git4e76869512d2.amzn2.0.2.x86_64
--> Processing Dependency: libavahi-common.so.3()(64bit) for package: systemtap-client-4.1-0.20190208git4e76869512d2.amzn2.0.2.x86_64
--> Processing Dependency: libavahi-client.so.3()(64bit) for package: systemtap-client-4.1-0.20190208git4e76869512d2.amzn2.0.2.x86_64
---> Package systemtap-devel.x86_64 0:4.1-0.20190208git4e76869512d2.amzn2.0.2 will be installed
--> Processing Dependency: kernel-devel-uname-r for package: systemtap-devel-4.1-0.20190208git4e76869512d2.amzn2.0.2.x86_64
--> Running transaction check
---> Package apr-util-bdb.x86_64 0:1.6.1-5.amzn2.0.2 will be installed
---> Package avahi-libs.x86_64 0:0.6.31-19.amzn2 will be installed
---> Package dwz.x86_64 0:0.11-3.amzn2.0.2 will be installed
---> Package gettext-common-devel.noarch 0:0.19.8.1-2.amzn2.0.2 will be installed
---> Package glibc-headers.x86_64 0:2.26-32.amzn2.0.1 will be installed
--> Processing Dependency: kernel-headers >= 2.2.1 for package: glibc-headers-2.26-32.amzn2.0.1.x86_64
--> Processing Dependency: kernel-headers for package: glibc-headers-2.26-32.amzn2.0.1.x86_64
---> Package gnutls.x86_64 0:3.3.29-9.amzn2 will be installed
--> Processing Dependency: trousers >= 0.3.11.2 for package: gnutls-3.3.29-9.amzn2.x86_64
--> Processing Dependency: libnettle.so.4()(64bit) for package: gnutls-3.3.29-9.amzn2.x86_64
--> Processing Dependency: libhogweed.so.2()(64bit) for package: gnutls-3.3.29-9.amzn2.x86_64
---> Package kernel-devel.x86_64 0:4.14.146-119.123.amzn2 will be installed
--> Processing Dependency: elfutils-libelf-devel for package: kernel-devel-4.14.146-119.123.amzn2.x86_64
---> Package libproxy.x86_64 0:0.4.11-10.amzn2.0.3 will be installed
--> Processing Dependency: libmodman.so.1()(64bit) for package: libproxy-0.4.11-10.amzn2.0.3.x86_64
---> Package mokutil.x86_64 1:0.3.0-10.amzn2.0.1 will be installed
--> Processing Dependency: libefivar.so.1(libefivar.so.0)(64bit) for package: 1:mokutil-0.3.0-10.amzn2.0.1.x86_64
--> Processing Dependency: libefivar.so.1(LIBEFIVAR_0.24)(64bit) for package: 1:mokutil-0.3.0-10.amzn2.0.1.x86_64
--> Processing Dependency: libefivar.so.1()(64bit) for package: 1:mokutil-0.3.0-10.amzn2.0.1.x86_64
---> Package pakchois.x86_64 0:0.4-10.amzn2.0.2 will be installed
---> Package perl-Error.noarch 1:0.17020-2.amzn2 will be installed
---> Package perl-srpm-macros.noarch 0:1-8.amzn2.0.1 will be installed
--> Running transaction check
---> Package efivar-libs.x86_64 0:31-4.amzn2.0.4 will be installed
---> Package elfutils-libelf-devel.x86_64 0:0.170-4.amzn2 will be installed
--> Processing Dependency: pkgconfig(zlib) for package: elfutils-libelf-devel-0.170-4.amzn2.x86_64
---> Package kernel-headers.x86_64 0:4.14.146-119.123.amzn2 will be installed
---> Package libmodman.x86_64 0:2.0.1-8.amzn2.0.2 will be installed
---> Package nettle.x86_64 0:2.7.1-8.amzn2.0.2 will be installed
---> Package trousers.x86_64 0:0.3.14-2.amzn2.0.2 will be installed
--> Running transaction check
---> Package zlib-devel.x86_64 0:1.2.7-17.amzn2.0.2 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================
 Package               Arch   Version                          Repository  Size
================================================================================
Installing for group install "Development Tools":
 autoconf              noarch 2.69-11.amzn2                    amzn2-core 701 k
 automake              noarch 1.13.4-3.1.amzn2                 amzn2-core 679 k
 bison                 x86_64 3.0.4-6.amzn2.0.2                amzn2-core 674 k
 byacc                 x86_64 1.9.20130304-3.amzn2.0.2         amzn2-core  66 k
 cscope                x86_64 15.8-10.amzn2.0.2                amzn2-core 204 k
 ctags                 x86_64 5.8-13.amzn2.0.2                 amzn2-core 157 k
 diffstat              x86_64 1.57-4.amzn2.0.2                 amzn2-core  35 k
 doxygen               x86_64 1:1.8.5-3.amzn2.0.2              amzn2-core 3.5 M
 elfutils              x86_64 0.170-4.amzn2                    amzn2-core 284 k
 flex                  x86_64 2.5.37-3.amzn2.0.3               amzn2-core 291 k
 gcc                   x86_64 7.3.1-5.amzn2.0.2                amzn2-core  22 M
 gcc-c++               x86_64 7.3.1-5.amzn2.0.2                amzn2-core  13 M
 gcc-gfortran          x86_64 7.3.1-5.amzn2.0.2                amzn2-core  11 M
 git                   x86_64 2.17.2-2.amzn2                   amzn2-core 217 k
 indent                x86_64 2.2.11-13.amzn2.0.2              amzn2-core 150 k
 intltool              noarch 0.50.2-7.amzn2                   amzn2-core  59 k
 libtool               x86_64 2.4.2-22.2.amzn2.0.2             amzn2-core 588 k
 patch                 x86_64 2.7.1-10.amzn2.0.2               amzn2-core 111 k
 patchutils            x86_64 0.3.3-4.amzn2.0.1                amzn2-core 104 k
 rcs                   x86_64 5.9.0-5.amzn2.0.2                amzn2-core 231 k
 rpm-build             x86_64 4.11.3-25.amzn2.0.3              amzn2-core 145 k
 rpm-sign              x86_64 4.11.3-25.amzn2.0.3              amzn2-core  46 k
 subversion            x86_64 1.7.14-11.amzn2.0.2              amzn2-core 1.0 M
 swig                  x86_64 3.0.12-11.amzn2.0.3              amzn2-core 1.4 M
 systemtap             x86_64 4.1-0.20190208git4e76869512d2.amzn2.0.2
                                                               amzn2-core  12 k
Installing for dependencies:
 apr                   x86_64 1.6.3-5.amzn2.0.2                amzn2-core 118 k
 apr-util              x86_64 1.6.1-5.amzn2.0.2                amzn2-core  99 k
 apr-util-bdb          x86_64 1.6.1-5.amzn2.0.2                amzn2-core  19 k
 avahi-libs            x86_64 0.6.31-19.amzn2                  amzn2-core  62 k
 cpp                   x86_64 7.3.1-5.amzn2.0.2                amzn2-core 9.2 M
 dwz                   x86_64 0.11-3.amzn2.0.2                 amzn2-core  99 k
 efivar-libs           x86_64 31-4.amzn2.0.4                   amzn2-core  68 k
 elfutils-libelf-devel x86_64 0.170-4.amzn2                    amzn2-core  38 k
 emacs-filesystem      noarch 1:25.3-3.amzn2.0.1               amzn2-core  64 k
 gdb                   x86_64 8.0.1-30.amzn2.0.3               amzn2-core 3.2 M
 gettext-common-devel  noarch 0.19.8.1-2.amzn2.0.2             amzn2-core 410 k
 gettext-devel         x86_64 0.19.8.1-2.amzn2.0.2             amzn2-core 320 k
 git-core              x86_64 2.17.2-2.amzn2                   amzn2-core 4.0 M
 git-core-doc          noarch 2.17.2-2.amzn2                   amzn2-core 2.3 M
 glibc-devel           x86_64 2.26-32.amzn2.0.1                amzn2-core 989 k
 glibc-headers         x86_64 2.26-32.amzn2.0.1                amzn2-core 508 k
 gnutls                x86_64 3.3.29-9.amzn2                   amzn2-core 673 k
 kernel-devel          x86_64 4.14.146-119.123.amzn2           amzn2-core  13 M
 kernel-headers        x86_64 4.14.146-119.123.amzn2           amzn2-core 1.1 M
 libatomic             x86_64 7.3.1-5.amzn2.0.2                amzn2-core  40 k
 libcilkrts            x86_64 7.3.1-5.amzn2.0.2                amzn2-core  80 k
 libgfortran           x86_64 7.3.1-5.amzn2.0.2                amzn2-core 538 k
 libitm                x86_64 7.3.1-5.amzn2.0.2                amzn2-core  79 k
 libmodman             x86_64 2.0.1-8.amzn2.0.2                amzn2-core  29 k
 libmpc                x86_64 1.0.1-3.amzn2.0.2                amzn2-core  52 k
 libmpx                x86_64 7.3.1-5.amzn2.0.2                amzn2-core  46 k
 libproxy              x86_64 0.4.11-10.amzn2.0.3              amzn2-core  61 k
 libquadmath           x86_64 7.3.1-5.amzn2.0.2                amzn2-core 186 k
 libsanitizer          x86_64 7.3.1-5.amzn2.0.2                amzn2-core 649 k
 libsecret             x86_64 0.18.5-2.amzn2.0.2               amzn2-core 153 k
 m4                    x86_64 1.4.16-10.amzn2.0.2              amzn2-core 256 k
 mokutil               x86_64 1:0.3.0-10.amzn2.0.1             amzn2-core  39 k
 mpfr                  x86_64 3.1.1-4.amzn2.0.2                amzn2-core 208 k
 neon                  x86_64 0.30.0-3.amzn2.0.2               amzn2-core 166 k
 nettle                x86_64 2.7.1-8.amzn2.0.2                amzn2-core 329 k
 pakchois              x86_64 0.4-10.amzn2.0.2                 amzn2-core  14 k
 perl-Data-Dumper      x86_64 2.145-3.amzn2.0.2                amzn2-core  48 k
 perl-Error            noarch 1:0.17020-2.amzn2                amzn2-core  32 k
 perl-Git              noarch 2.17.2-2.amzn2                   amzn2-core  70 k
 perl-TermReadKey      x86_64 2.30-20.amzn2.0.2                amzn2-core  31 k
 perl-Test-Harness     noarch 3.28-3.amzn2                     amzn2-core 302 k
 perl-Thread-Queue     noarch 3.02-2.amzn2                     amzn2-core  17 k
 perl-XML-Parser       x86_64 2.41-10.amzn2.0.2                amzn2-core 223 k
 perl-srpm-macros      noarch 1-8.amzn2.0.1                    amzn2-core 4.7 k
 subversion-libs       x86_64 1.7.14-11.amzn2.0.2              amzn2-core 929 k
 system-rpm-config     noarch 9.1.0-76.amzn2.0.8               amzn2-core  80 k
 systemtap-client      x86_64 4.1-0.20190208git4e76869512d2.amzn2.0.2
                                                               amzn2-core 3.5 M
 systemtap-devel       x86_64 4.1-0.20190208git4e76869512d2.amzn2.0.2
                                                               amzn2-core 2.2 M
 trousers              x86_64 0.3.14-2.amzn2.0.2               amzn2-core 294 k
 zlib-devel            x86_64 1.2.7-17.amzn2.0.2               amzn2-core  50 k

Transaction Summary
================================================================================
Install  25 Packages (+50 Dependent packages)

Total download size: 103 M
Installed size: 339 M
Downloading packages:
Delta RPMs disabled because /usr/bin/applydeltarpm not installed.
--------------------------------------------------------------------------------
Total                                               49 MB/s | 103 MB  00:02
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : mpfr-3.1.1-4.amzn2.0.2.x86_64                               1/75
  Installing : libmpc-1.0.1-3.amzn2.0.2.x86_64                             2/75
  Installing : m4-1.4.16-10.amzn2.0.2.x86_64                               3/75
  Installing : apr-1.6.3-5.amzn2.0.2.x86_64                                4/75
  Installing : apr-util-bdb-1.6.1-5.amzn2.0.2.x86_64                       5/75
  Installing : apr-util-1.6.1-5.amzn2.0.2.x86_64                           6/75
  Installing : avahi-libs-0.6.31-19.amzn2.x86_64                           7/75
  Installing : libquadmath-7.3.1-5.amzn2.0.2.x86_64                        8/75
  Installing : git-core-2.17.2-2.amzn2.x86_64                              9/75
  Installing : perl-Thread-Queue-3.02-2.amzn2.noarch                      10/75
  Installing : 1:emacs-filesystem-25.3-3.amzn2.0.1.noarch                 11/75
  Installing : patch-2.7.1-10.amzn2.0.2.x86_64                            12/75
  Installing : git-core-doc-2.17.2-2.amzn2.noarch                         13/75
  Installing : libgfortran-7.3.1-5.amzn2.0.2.x86_64                       14/75
  Installing : cpp-7.3.1-5.amzn2.0.2.x86_64                               15/75
  Installing : perl-XML-Parser-2.41-10.amzn2.0.2.x86_64                   16/75
  Installing : zlib-devel-1.2.7-17.amzn2.0.2.x86_64                       17/75
  Installing : elfutils-libelf-devel-0.170-4.amzn2.x86_64                 18/75
  Installing : efivar-libs-31-4.amzn2.0.4.x86_64                          19/75
  Installing : 1:mokutil-0.3.0-10.amzn2.0.1.x86_64                        20/75
  Installing : gdb-8.0.1-30.amzn2.0.3.x86_64                              21/75
  Installing : trousers-0.3.14-2.amzn2.0.2.x86_64                         22/75
  Installing : dwz-0.11-3.amzn2.0.2.x86_64                                23/75
  Installing : libsanitizer-7.3.1-5.amzn2.0.2.x86_64                      24/75
  Installing : libatomic-7.3.1-5.amzn2.0.2.x86_64                         25/75
  Installing : libmpx-7.3.1-5.amzn2.0.2.x86_64                            26/75
  Installing : kernel-headers-4.14.146-119.123.amzn2.x86_64               27/75
  Installing : glibc-headers-2.26-32.amzn2.0.1.x86_64                     28/75
  Installing : glibc-devel-2.26-32.amzn2.0.1.x86_64                       29/75
  Installing : perl-TermReadKey-2.30-20.amzn2.0.2.x86_64                  30/75
  Installing : perl-srpm-macros-1-8.amzn2.0.1.noarch                      31/75
  Installing : system-rpm-config-9.1.0-76.amzn2.0.8.noarch                32/75
  Installing : perl-Data-Dumper-2.145-3.amzn2.0.2.x86_64                  33/75
  Installing : autoconf-2.69-11.amzn2.noarch                              34/75
  Installing : perl-Test-Harness-3.28-3.amzn2.noarch                      35/75
  Installing : automake-1.13.4-3.1.amzn2.noarch                           36/75
  Installing : gettext-common-devel-0.19.8.1-2.amzn2.0.2.noarch           37/75
  Installing : nettle-2.7.1-8.amzn2.0.2.x86_64                            38/75
  Installing : gnutls-3.3.29-9.amzn2.x86_64                               39/75
  Installing : libcilkrts-7.3.1-5.amzn2.0.2.x86_64                        40/75
  Installing : libmodman-2.0.1-8.amzn2.0.2.x86_64                         41/75
  Installing : libproxy-0.4.11-10.amzn2.0.3.x86_64                        42/75
  Installing : elfutils-0.170-4.amzn2.x86_64                              43/75
  Installing : libsecret-0.18.5-2.amzn2.0.2.x86_64                        44/75
  Installing : libitm-7.3.1-5.amzn2.0.2.x86_64                            45/75
  Installing : gcc-7.3.1-5.amzn2.0.2.x86_64                               46/75
  Installing : kernel-devel-4.14.146-119.123.amzn2.x86_64                 47/75
  Installing : systemtap-devel-4.1-0.20190208git4e76869512d2.amzn2.0.2.   48/75
  Installing : systemtap-client-4.1-0.20190208git4e76869512d2.amzn2.0.2   49/75
  Installing : pakchois-0.4-10.amzn2.0.2.x86_64                           50/75
  Installing : neon-0.30.0-3.amzn2.0.2.x86_64                             51/75
  Installing : subversion-libs-1.7.14-11.amzn2.0.2.x86_64                 52/75
  Installing : 1:perl-Error-0.17020-2.amzn2.noarch                        53/75
  Installing : perl-Git-2.17.2-2.amzn2.noarch                             54/75
  Installing : git-2.17.2-2.amzn2.x86_64                                  55/75
  Installing : gettext-devel-0.19.8.1-2.amzn2.0.2.x86_64                  56/75
  Installing : intltool-0.50.2-7.amzn2.noarch                             57/75
  Installing : subversion-1.7.14-11.amzn2.0.2.x86_64                      58/75
  Installing : systemtap-4.1-0.20190208git4e76869512d2.amzn2.0.2.x86_64   59/75
  Installing : gcc-gfortran-7.3.1-5.amzn2.0.2.x86_64                      60/75
  Installing : gcc-c++-7.3.1-5.amzn2.0.2.x86_64                           61/75
  Installing : libtool-2.4.2-22.2.amzn2.0.2.x86_64                        62/75
  Installing : rpm-build-4.11.3-25.amzn2.0.3.x86_64                       63/75
  Installing : cscope-15.8-10.amzn2.0.2.x86_64                            64/75
  Installing : flex-2.5.37-3.amzn2.0.3.x86_64                             65/75
  Installing : bison-3.0.4-6.amzn2.0.2.x86_64                             66/75
  Installing : byacc-1.9.20130304-3.amzn2.0.2.x86_64                      67/75
  Installing : rcs-5.9.0-5.amzn2.0.2.x86_64                               68/75
  Installing : indent-2.2.11-13.amzn2.0.2.x86_64                          69/75
  Installing : patchutils-0.3.3-4.amzn2.0.1.x86_64                        70/75
  Installing : rpm-sign-4.11.3-25.amzn2.0.3.x86_64                        71/75
  Installing : diffstat-1.57-4.amzn2.0.2.x86_64                           72/75
  Installing : swig-3.0.12-11.amzn2.0.3.x86_64                            73/75
  Installing : ctags-5.8-13.amzn2.0.2.x86_64                              74/75
  Installing : 1:doxygen-1.8.5-3.amzn2.0.2.x86_64                         75/75
  Verifying  : patch-2.7.1-10.amzn2.0.2.x86_64                             1/75
  Verifying  : 1:emacs-filesystem-25.3-3.amzn2.0.1.noarch                  2/75
  Verifying  : 1:doxygen-1.8.5-3.amzn2.0.2.x86_64                          3/75
  Verifying  : 1:perl-Error-0.17020-2.amzn2.noarch                         4/75
  Verifying  : gettext-devel-0.19.8.1-2.amzn2.0.2.x86_64                   5/75
  Verifying  : flex-2.5.37-3.amzn2.0.3.x86_64                              6/75
  Verifying  : glibc-headers-2.26-32.amzn2.0.1.x86_64                      7/75
  Verifying  : pakchois-0.4-10.amzn2.0.2.x86_64                            8/75
  Verifying  : perl-Thread-Queue-3.02-2.amzn2.noarch                       9/75
  Verifying  : gnutls-3.3.29-9.amzn2.x86_64                               10/75
  Verifying  : ctags-5.8-13.amzn2.0.2.x86_64                              11/75
  Verifying  : swig-3.0.12-11.amzn2.0.3.x86_64                            12/75
  Verifying  : git-2.17.2-2.amzn2.x86_64                                  13/75
  Verifying  : system-rpm-config-9.1.0-76.amzn2.0.8.noarch                14/75
  Verifying  : libmpc-1.0.1-3.amzn2.0.2.x86_64                            15/75
  Verifying  : systemtap-4.1-0.20190208git4e76869512d2.amzn2.0.2.x86_64   16/75
  Verifying  : libitm-7.3.1-5.amzn2.0.2.x86_64                            17/75
  Verifying  : libproxy-0.4.11-10.amzn2.0.3.x86_64                        18/75
  Verifying  : cscope-15.8-10.amzn2.0.2.x86_64                            19/75
  Verifying  : diffstat-1.57-4.amzn2.0.2.x86_64                           20/75
  Verifying  : gcc-gfortran-7.3.1-5.amzn2.0.2.x86_64                      21/75
  Verifying  : subversion-libs-1.7.14-11.amzn2.0.2.x86_64                 22/75
  Verifying  : 1:mokutil-0.3.0-10.amzn2.0.1.x86_64                        23/75
  Verifying  : libsecret-0.18.5-2.amzn2.0.2.x86_64                        24/75
  Verifying  : elfutils-0.170-4.amzn2.x86_64                              25/75
  Verifying  : subversion-1.7.14-11.amzn2.0.2.x86_64                      26/75
  Verifying  : libmodman-2.0.1-8.amzn2.0.2.x86_64                         27/75
  Verifying  : libcilkrts-7.3.1-5.amzn2.0.2.x86_64                        28/75
  Verifying  : nettle-2.7.1-8.amzn2.0.2.x86_64                            29/75
  Verifying  : gettext-common-devel-0.19.8.1-2.amzn2.0.2.noarch           30/75
  Verifying  : perl-Test-Harness-3.28-3.amzn2.noarch                      31/75
  Verifying  : autoconf-2.69-11.amzn2.noarch                              32/75
  Verifying  : intltool-0.50.2-7.amzn2.noarch                             33/75
  Verifying  : rpm-sign-4.11.3-25.amzn2.0.3.x86_64                        34/75
  Verifying  : apr-util-1.6.1-5.amzn2.0.2.x86_64                          35/75
  Verifying  : glibc-devel-2.26-32.amzn2.0.1.x86_64                       36/75
  Verifying  : perl-Git-2.17.2-2.amzn2.noarch                             37/75
  Verifying  : gcc-c++-7.3.1-5.amzn2.0.2.x86_64                           38/75
  Verifying  : mpfr-3.1.1-4.amzn2.0.2.x86_64                              39/75
  Verifying  : elfutils-libelf-devel-0.170-4.amzn2.x86_64                 40/75
  Verifying  : perl-Data-Dumper-2.145-3.amzn2.0.2.x86_64                  41/75
  Verifying  : perl-srpm-macros-1-8.amzn2.0.1.noarch                      42/75
  Verifying  : perl-TermReadKey-2.30-20.amzn2.0.2.x86_64                  43/75
  Verifying  : automake-1.13.4-3.1.amzn2.noarch                           44/75
  Verifying  : apr-util-bdb-1.6.1-5.amzn2.0.2.x86_64                      45/75
  Verifying  : gcc-7.3.1-5.amzn2.0.2.x86_64                               46/75
  Verifying  : bison-3.0.4-6.amzn2.0.2.x86_64                             47/75
  Verifying  : cpp-7.3.1-5.amzn2.0.2.x86_64                               48/75
  Verifying  : git-core-2.17.2-2.amzn2.x86_64                             49/75
  Verifying  : kernel-headers-4.14.146-119.123.amzn2.x86_64               50/75
  Verifying  : patchutils-0.3.3-4.amzn2.0.1.x86_64                        51/75
  Verifying  : libtool-2.4.2-22.2.amzn2.0.2.x86_64                        52/75
  Verifying  : libmpx-7.3.1-5.amzn2.0.2.x86_64                            53/75
  Verifying  : libatomic-7.3.1-5.amzn2.0.2.x86_64                         54/75
  Verifying  : indent-2.2.11-13.amzn2.0.2.x86_64                          55/75
  Verifying  : apr-1.6.3-5.amzn2.0.2.x86_64                               56/75
  Verifying  : libgfortran-7.3.1-5.amzn2.0.2.x86_64                       57/75
  Verifying  : libquadmath-7.3.1-5.amzn2.0.2.x86_64                       58/75
  Verifying  : libsanitizer-7.3.1-5.amzn2.0.2.x86_64                      59/75
  Verifying  : avahi-libs-0.6.31-19.amzn2.x86_64                          60/75
  Verifying  : dwz-0.11-3.amzn2.0.2.x86_64                                61/75
  Verifying  : trousers-0.3.14-2.amzn2.0.2.x86_64                         62/75
  Verifying  : neon-0.30.0-3.amzn2.0.2.x86_64                             63/75
  Verifying  : gdb-8.0.1-30.amzn2.0.3.x86_64                              64/75
  Verifying  : efivar-libs-31-4.amzn2.0.4.x86_64                          65/75
  Verifying  : rcs-5.9.0-5.amzn2.0.2.x86_64                               66/75
  Verifying  : kernel-devel-4.14.146-119.123.amzn2.x86_64                 67/75
  Verifying  : byacc-1.9.20130304-3.amzn2.0.2.x86_64                      68/75
  Verifying  : rpm-build-4.11.3-25.amzn2.0.3.x86_64                       69/75
  Verifying  : m4-1.4.16-10.amzn2.0.2.x86_64                              70/75
  Verifying  : zlib-devel-1.2.7-17.amzn2.0.2.x86_64                       71/75
  Verifying  : perl-XML-Parser-2.41-10.amzn2.0.2.x86_64                   72/75
  Verifying  : systemtap-devel-4.1-0.20190208git4e76869512d2.amzn2.0.2.   73/75
  Verifying  : systemtap-client-4.1-0.20190208git4e76869512d2.amzn2.0.2   74/75
  Verifying  : git-core-doc-2.17.2-2.amzn2.noarch                         75/75

Installed:
  autoconf.noarch 0:2.69-11.amzn2
  automake.noarch 0:1.13.4-3.1.amzn2
  bison.x86_64 0:3.0.4-6.amzn2.0.2
  byacc.x86_64 0:1.9.20130304-3.amzn2.0.2
  cscope.x86_64 0:15.8-10.amzn2.0.2
  ctags.x86_64 0:5.8-13.amzn2.0.2
  diffstat.x86_64 0:1.57-4.amzn2.0.2
  doxygen.x86_64 1:1.8.5-3.amzn2.0.2
  elfutils.x86_64 0:0.170-4.amzn2
  flex.x86_64 0:2.5.37-3.amzn2.0.3
  gcc.x86_64 0:7.3.1-5.amzn2.0.2
  gcc-c++.x86_64 0:7.3.1-5.amzn2.0.2
  gcc-gfortran.x86_64 0:7.3.1-5.amzn2.0.2
  git.x86_64 0:2.17.2-2.amzn2
  indent.x86_64 0:2.2.11-13.amzn2.0.2
  intltool.noarch 0:0.50.2-7.amzn2
  libtool.x86_64 0:2.4.2-22.2.amzn2.0.2
  patch.x86_64 0:2.7.1-10.amzn2.0.2
  patchutils.x86_64 0:0.3.3-4.amzn2.0.1
  rcs.x86_64 0:5.9.0-5.amzn2.0.2
  rpm-build.x86_64 0:4.11.3-25.amzn2.0.3
  rpm-sign.x86_64 0:4.11.3-25.amzn2.0.3
  subversion.x86_64 0:1.7.14-11.amzn2.0.2
  swig.x86_64 0:3.0.12-11.amzn2.0.3
  systemtap.x86_64 0:4.1-0.20190208git4e76869512d2.amzn2.0.2

Dependency Installed:
  apr.x86_64 0:1.6.3-5.amzn2.0.2
  apr-util.x86_64 0:1.6.1-5.amzn2.0.2
  apr-util-bdb.x86_64 0:1.6.1-5.amzn2.0.2
  avahi-libs.x86_64 0:0.6.31-19.amzn2
  cpp.x86_64 0:7.3.1-5.amzn2.0.2
  dwz.x86_64 0:0.11-3.amzn2.0.2
  efivar-libs.x86_64 0:31-4.amzn2.0.4
  elfutils-libelf-devel.x86_64 0:0.170-4.amzn2
  emacs-filesystem.noarch 1:25.3-3.amzn2.0.1
  gdb.x86_64 0:8.0.1-30.amzn2.0.3
  gettext-common-devel.noarch 0:0.19.8.1-2.amzn2.0.2
  gettext-devel.x86_64 0:0.19.8.1-2.amzn2.0.2
  git-core.x86_64 0:2.17.2-2.amzn2
  git-core-doc.noarch 0:2.17.2-2.amzn2
  glibc-devel.x86_64 0:2.26-32.amzn2.0.1
  glibc-headers.x86_64 0:2.26-32.amzn2.0.1
  gnutls.x86_64 0:3.3.29-9.amzn2
  kernel-devel.x86_64 0:4.14.146-119.123.amzn2
  kernel-headers.x86_64 0:4.14.146-119.123.amzn2
  libatomic.x86_64 0:7.3.1-5.amzn2.0.2
  libcilkrts.x86_64 0:7.3.1-5.amzn2.0.2
  libgfortran.x86_64 0:7.3.1-5.amzn2.0.2
  libitm.x86_64 0:7.3.1-5.amzn2.0.2
  libmodman.x86_64 0:2.0.1-8.amzn2.0.2
  libmpc.x86_64 0:1.0.1-3.amzn2.0.2
  libmpx.x86_64 0:7.3.1-5.amzn2.0.2
  libproxy.x86_64 0:0.4.11-10.amzn2.0.3
  libquadmath.x86_64 0:7.3.1-5.amzn2.0.2
  libsanitizer.x86_64 0:7.3.1-5.amzn2.0.2
  libsecret.x86_64 0:0.18.5-2.amzn2.0.2
  m4.x86_64 0:1.4.16-10.amzn2.0.2
  mokutil.x86_64 1:0.3.0-10.amzn2.0.1
  mpfr.x86_64 0:3.1.1-4.amzn2.0.2
  neon.x86_64 0:0.30.0-3.amzn2.0.2
  nettle.x86_64 0:2.7.1-8.amzn2.0.2
  pakchois.x86_64 0:0.4-10.amzn2.0.2
  perl-Data-Dumper.x86_64 0:2.145-3.amzn2.0.2
  perl-Error.noarch 1:0.17020-2.amzn2
  perl-Git.noarch 0:2.17.2-2.amzn2
  perl-TermReadKey.x86_64 0:2.30-20.amzn2.0.2
  perl-Test-Harness.noarch 0:3.28-3.amzn2
  perl-Thread-Queue.noarch 0:3.02-2.amzn2
  perl-XML-Parser.x86_64 0:2.41-10.amzn2.0.2
  perl-srpm-macros.noarch 0:1-8.amzn2.0.1
  subversion-libs.x86_64 0:1.7.14-11.amzn2.0.2
  system-rpm-config.noarch 0:9.1.0-76.amzn2.0.8
  systemtap-client.x86_64 0:4.1-0.20190208git4e76869512d2.amzn2.0.2
  systemtap-devel.x86_64 0:4.1-0.20190208git4e76869512d2.amzn2.0.2
  trousers.x86_64 0:0.3.14-2.amzn2.0.2
  zlib-devel.x86_64 0:1.2.7-17.amzn2.0.2

Complete!
+ yum -y install curl wget jq awscli
Loaded plugins: extras_suggestions, langpacks, priorities, update-motd
191 packages excluded due to repository priority protections
Package curl-7.61.1-11.amzn2.0.2.x86_64 already installed and latest version
Package wget-1.14-18.amzn2.1.x86_64 already installed and latest version
Package awscli-1.16.102-1.amzn2.0.1.noarch already installed and latest version
Resolving Dependencies
--> Running transaction check
---> Package jq.x86_64 0:1.5-1.amzn2.0.2 will be installed
--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.amzn2.0.2.x86_64
--> Running transaction check
---> Package oniguruma.x86_64 0:5.9.6-1.amzn2.0.1 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================
 Package         Arch         Version                    Repository        Size
================================================================================
Installing:
 jq              x86_64       1.5-1.amzn2.0.2            amzn2-core       154 k
Installing for dependencies:
 oniguruma       x86_64       5.9.6-1.amzn2.0.1          amzn2-core       128 k

Transaction Summary
================================================================================
Install  1 Package (+1 Dependent package)

Total download size: 282 k
Installed size: 894 k
Downloading packages:
--------------------------------------------------------------------------------
Total                                              2.0 MB/s | 282 kB  00:00
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : oniguruma-5.9.6-1.amzn2.0.1.x86_64                           1/2
  Installing : jq-1.5-1.amzn2.0.2.x86_64                                    2/2
  Verifying  : oniguruma-5.9.6-1.amzn2.0.1.x86_64                           1/2
  Verifying  : jq-1.5-1.amzn2.0.2.x86_64                                    2/2

Installed:
  jq.x86_64 0:1.5-1.amzn2.0.2

Dependency Installed:
  oniguruma.x86_64 0:5.9.6-1.amzn2.0.1

Complete!
+ '[' 1 == 0 ']'
+ [[ us-east-1 =~ ^cn- ]]
+ curl -s -L -o /tmp/aws-cfn-bootstrap-latest.tar.gz https://s3.amazonaws.com/cloudformation-examples/aws-cfn-bootstrap-latest.tar.gz
+ easy_install -U /tmp/aws-cfn-bootstrap-latest.tar.gz
Processing aws-cfn-bootstrap-latest.tar.gz
Writing /tmp/easy_install-vRJCSg/aws-cfn-bootstrap-1.4/setup.cfg
Running aws-cfn-bootstrap-1.4/setup.py -q bdist_egg --dist-dir /tmp/easy_install-vRJCSg/aws-cfn-bootstrap-1.4/egg-dist-tmp-qTpEIJ
zip_safe flag not set; analyzing archive contents...
cfnbootstrap.packages.requests.certs: module references __file__
cfnbootstrap.packages.requests.certs: module references __file__
creating /usr/lib/python2.7/site-packages/aws_cfn_bootstrap-1.4-py2.7.egg
Extracting aws_cfn_bootstrap-1.4-py2.7.egg to /usr/lib/python2.7/site-packages
Adding aws-cfn-bootstrap 1.4 to easy-install.pth file
Installing cfn-elect-cmd-leader script to /usr/bin
Installing cfn-get-metadata script to /usr/bin
Installing cfn-hup script to /usr/bin
Installing cfn-init script to /usr/bin
Installing cfn-send-cmd-event script to /usr/bin
Installing cfn-send-cmd-result script to /usr/bin
Installing cfn-signal script to /usr/bin

Installed /usr/lib/python2.7/site-packages/aws_cfn_bootstrap-1.4-py2.7.egg
Processing dependencies for aws-cfn-bootstrap==1.4
Finished processing dependencies for aws-cfn-bootstrap==1.4
+ mkdir -p /etc/chef
+ chown -R root:root /etc/chef
+ curl --retry 3 -L https://www.chef.io/chef/install.sh
+ bash -s -- -v 14.2.0
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 23097  100 23097    0     0   609k      0 --:--:-- --:--:-- --:--:--  609k
el 7 x86_64
Getting information for chef stable 14.2.0 for el...
downloading https://www.chef.io/stable/chef/metadata?v=14.2.0&p=el&pv=7&m=x86_64
  to file /tmp/install.sh.19907/metadata.txt
trying wget...
sha1    bf0bd662c5b46d81418c943ac4bc6b84c095aa9c
sha256  abdb676a8d55fc9807b4eabe5313c54d3946977d7ae3eecd7303cd388b04042a
url     https://packages.chef.io/files/stable/chef/14.2.0/el/7/chef-14.2.0-1.el7.x86_64.rpm
version 14.2.0
downloaded metadata file looks valid...
downloading https://packages.chef.io/files/stable/chef/14.2.0/el/7/chef-14.2.0-1.el7.x86_64.rpm
  to file /tmp/install.sh.19907/chef-14.2.0-1.el7.x86_64.rpm
trying wget...
Comparing checksum with sha256sum...
Installing chef 14.2.0
installing with rpm...
warning: /tmp/install.sh.19907/chef-14.2.0-1.el7.x86_64.rpm: Header V4 DSA/SHA1 Signature, key ID 83ef826a: NOKEY
Preparing...                          ########################################
Updating / installing...
chef-14.2.0-1.el7                     ########################################
Thank you for installing Chef!
+ /opt/chef/embedded/bin/gem install --no-rdoc --no-ri ridley:5.1.1 berkshelf:7.0.4
Successfully installed retryable-2.0.4
Successfully installed httpclient-2.8.3
Building native extensions. This could take a while...
Successfully installed nio4r-2.5.2
Successfully installed hitimes-2.0.0
Successfully installed timers-4.0.4
Successfully installed celluloid-0.16.0
Successfully installed celluloid-io-0.16.2
Successfully installed buff-ruby_engine-1.0.0
Successfully installed buff-shell_out-1.1.0
Successfully installed buff-ignore-1.2.0
Successfully installed buff-extensions-2.0.0
Successfully installed varia_model-0.6.0
Successfully installed buff-config-2.0.0
Successfully installed ridley-5.1.1
Successfully installed concurrent-ruby-1.1.5
Successfully installed sawyer-0.8.2
Successfully installed octokit-4.14.0
Successfully installed molinillo-0.6.6
Successfully installed solve-4.0.2
The `minitar` executable is no longer bundled with `minitar`. If you are
expecting this executable, make sure you also install `minitar-cli`.
Successfully installed minitar-0.9
Successfully installed cleanroom-1.0.0
Successfully installed berkshelf-7.0.4
22 gems installed
+ curl --retry 3 -s -L -o /etc/chef/aws-parallelcluster-cookbook.tgz https://s3.us-east-1.amazonaws.com/us-east-1-aws-parallelcluster/cookbooks/aws-parallelcluster-cookbook-2.4.1.tgz
+ curl --retry 3 -s -L -o /etc/chef/aws-parallelcluster-cookbook.tgz.date https://s3.us-east-1.amazonaws.com/us-east-1-aws-parallelcluster/cookbooks/aws-parallelcluster-cookbook-2.4.1.tgz.date
+ curl --retry 3 -s -L -o /etc/chef/aws-parallelcluster-cookbook.tgz.md5 https://s3.us-east-1.amazonaws.com/us-east-1-aws-parallelcluster/cookbooks/aws-parallelcluster-cookbook-2.4.1.tgz.md5
+ vendor_cookbook
+ mkdir /tmp/cookbooks
+ cd /tmp/cookbooks
+ tar -xzf /etc/chef/aws-parallelcluster-cookbook.tgz
+ HOME_BAK=
+ export HOME=/tmp
+ HOME=/tmp
+ . /tmp/proxy.sh
++ ls /tmp/cookbooks
+ for d in '`ls /tmp/cookbooks`'
+ cd /tmp/cookbooks/aws-parallelcluster-cookbook-2.4.1
+ LANG=en_US.UTF-8
+ /opt/chef/embedded/bin/berks vendor /etc/chef/cookbooks --delete
Resolving cookbook dependencies...
Fetching 'aws-parallelcluster' from source at .
Fetching cookbook index from https://supermarket.chef.io...
Installing apt (7.0.0)
Using aws-parallelcluster (2.4.1) from source at .
Installing build-essential (8.1.1)
Installing hostname (0.4.2)
Installing hostsfile (3.0.1)
Installing iptables (4.5.0)
Installing line (1.0.6)
Installing mingw (2.1.0)
Installing nfs (2.5.1)
Installing ohai (5.3.0)
Installing openssh (2.6.3)
Installing poise (2.8.2)
Installing poise-archive (1.5.0)
Installing poise-languages (2.1.2)
Installing poise-python (1.7.0)
Installing pyenv (3.1.0)
Installing selinux (2.1.1)
Installing seven_zip (3.1.1)
Installing sysctl (1.0.5)
Installing tar (2.1.1)
Installing ulimit (1.0.0)
Installing windows (6.0.0)
Installing yum (5.1.0)
Installing yum-epel (3.1.0)
Vendoring apt (7.0.0) to /etc/chef/cookbooks/apt
Vendoring aws-parallelcluster (2.4.1) to /etc/chef/cookbooks/aws-parallelcluster
Vendoring build-essential (8.1.1) to /etc/chef/cookbooks/build-essential
Vendoring hostname (0.4.2) to /etc/chef/cookbooks/hostname
Vendoring hostsfile (3.0.1) to /etc/chef/cookbooks/hostsfile
Vendoring iptables (4.5.0) to /etc/chef/cookbooks/iptables
Vendoring line (1.0.6) to /etc/chef/cookbooks/line
Vendoring mingw (2.1.0) to /etc/chef/cookbooks/mingw
Vendoring nfs (2.5.1) to /etc/chef/cookbooks/nfs
Vendoring ohai (5.3.0) to /etc/chef/cookbooks/ohai
Vendoring openssh (2.6.3) to /etc/chef/cookbooks/openssh
Vendoring poise (2.8.2) to /etc/chef/cookbooks/poise
Vendoring poise-archive (1.5.0) to /etc/chef/cookbooks/poise-archive
Vendoring poise-languages (2.1.2) to /etc/chef/cookbooks/poise-languages
Vendoring poise-python (1.7.0) to /etc/chef/cookbooks/poise-python
Vendoring pyenv (3.1.0) to /etc/chef/cookbooks/pyenv
Vendoring selinux (2.1.1) to /etc/chef/cookbooks/selinux
Vendoring seven_zip (3.1.1) to /etc/chef/cookbooks/seven_zip
Vendoring sysctl (1.0.5) to /etc/chef/cookbooks/sysctl
Vendoring tar (2.1.1) to /etc/chef/cookbooks/tar
Vendoring ulimit (1.0.0) to /etc/chef/cookbooks/ulimit
Vendoring windows (6.0.0) to /etc/chef/cookbooks/windows
Vendoring yum (5.1.0) to /etc/chef/cookbooks/yum
Vendoring yum-epel (3.1.0) to /etc/chef/cookbooks/yum-epel
+ export HOME=
+ HOME=
+ mkdir /opt/parallelcluster
+ echo aws-parallelcluster-2.4.1
+ tee /opt/parallelcluster/.bootstrapped
aws-parallelcluster-2.4.1
+ '[' NONE '!=' NONE ']'
+ cd /tmp
+ cfn-init -s parallelcluster-slurmonbatch -v -c default -r MasterServer --region us-east-1
Traceback (most recent call last):
  File "/bin/cfn-init", line 4, in <module>
    __import__('pkg_resources').run_script('aws-cfn-bootstrap==1.4', 'cfn-init')
  File "/usr/lib/python2.7/site-packages/pkg_resources/__init__.py", line 750, in run_script
    self.require(requires)[0].run_script(script_name, ns)
  File "/usr/lib/python2.7/site-packages/pkg_resources/__init__.py", line 1518, in run_script
    .format(**locals()),
pkg_resources.ResolutionError: Script 'scripts/cfn-init' not found in metadata at None
+ error_exit 'Failed to run cfn-init. If --norollback was specified, check /var/log/cfn-init.log and /var/log/cloud-init-output.log.'
+ cfn-signal --exit-code=1 '--reason=Failed to run cfn-init. If --norollback was specified, check /var/log/cfn-init.log and /var/log/cloud-init-output.log.' --stack=parallelcluster-slurmonbatch --resource=MasterServer --region=us-east-1
Traceback (most recent call last):
  File "/bin/cfn-signal", line 4, in <module>
    __import__('pkg_resources').run_script('aws-cfn-bootstrap==1.4', 'cfn-signal')
  File "/usr/lib/python2.7/site-packages/pkg_resources/__init__.py", line 750, in run_script
    self.require(requires)[0].run_script(script_name, ns)
  File "/usr/lib/python2.7/site-packages/pkg_resources/__init__.py", line 1518, in run_script
    .format(**locals()),
pkg_resources.ResolutionError: Script 'scripts/cfn-signal' not found in metadata at None
+ exit 1
Sep 27 16:41:12 cloud-init[4883]: util.py[WARNING]: Failed running /var/lib/cloud/instance/scripts/part-002 [1]
/usr/bin/yum
which: no apt-get in (/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin)
Not apt system
Sep 27 16:41:12 cloud-init[4883]: cc_scripts_user.py[WARNING]: Failed to run module scripts-user (scripts in /var/lib/cloud/instance/scripts)
Sep 27 16:41:12 cloud-init[4883]: util.py[WARNING]: Running module scripts-user (<module 'cloudinit.config.cc_scripts_user' from '/usr/lib/python2.7/site-packages/cloudinit/config/cc_scripts_user.pyc'>) failed
Cloud-init v. 18.2-72.amzn2.0.7 finished at Fri, 27 Sep 2019 16:41:12 +0000. Datasource DataSourceEc2.  Up 98.14 seconds

Config File

[global]
cluster_template = slurmonbatch

[aws]
aws_region_name = us-east-1

[cluster slurmonbatch]

base_os = alinux

scheduler = slurm

key_name = s4-sinaia-valinor-nphi

master_instance_type = t2.medium

compute_instance_type = t2.2xlarge

initial_queue_size = 2

max_queue_size = 20

cluster_type = spot

compute_root_volume_size = 200

custom_ami = ami-0fe6de8b16a7dd4b4

s3_read_resource = arn:aws:s3:::s4-sinaia-valinor-nphi/*

s3_read_write_resource = arn:aws:s3:::s4-sinaia-valinor-nphi/*

#placement_group = DYNAMIC

#placement = compute

scaling_settings = sc

vpc_settings = internal

fsx_settings = sharedfs


[fsx sharedfs]

shared_dir = /cromwell_root

fsx_fs_id = fs-0b075096c965438a1

[vpc internal]

vpc_id = vpc-0b9824d9c0aeda460

master_subnet_id = subnet-0d65ac4e8f80420e9

compute_subnet_id = subnet-0d65ac4e8f80420e9

use_public_ips = false

vpc_security_group_id = sg-05064c6cc174f416d


[scaling sc]

scaledown_idletime = 20

The issue seems to be with the cfn-init command as when it is attempted to be loaded from the bin directory and not the opt directory then it fails. Not sure if this is a change in amazon linux or something else.

So an update I may have come up with a temporary although not foolproof way if fixing this issue. I simply symlinked the binaries in /opt/aws/bin to /usr/local/sbin and then created and AMI and that seems to have solved the issue.

Hi @medcelerate thank you for your analysis and your logs.

I see you are using a _custom_ami_.
It could be a problem related to your custom ami.

  1. Did you test without the _custom_ami_ parameter?
  2. Which process did you follow to build your custom AMI?
  3. Which is the source AMI Id of your AMI (if is it public)?

Thank you

Yes, I tested without a custom ami using amazon Linux , I spun up a machine
added the necessary tools and then generated an image. The image isn’t
public at the moment. It seems to be an issue with the intel mpi repo as
well. The imported key wasn’t checking properly.

On Mon, Sep 30, 2019 at 4:12 AM Enrico Usai notifications@github.com
wrote:

Hi @medcelerate https://github.com/medcelerate thank you for your
analysis and your logs.

I see you are using a custom_ami.
It could be a problem related to your custom ami.

  1. Did you test without the custom_ami parameter?
  2. Which
    https://docs.aws.amazon.com/parallelcluster/latest/ug/tutorials_02_ami_customization.html
    process did you follow to build your custom AMI?
  3. Which is the source AMI Id of your AMI (if is it public)?

Thank you

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/aws/aws-parallelcluster/issues/1334?email_source=notifications&email_token=AHYKRGNA235FYN7RYPPWBSDQMGYG7A5CNFSM4I3HHWCKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD742BBI#issuecomment-536453253,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AHYKRGOHJFIFPLUBVJKEIV3QMGYG7ANCNFSM4I3HHWCA
.

I'm seeing a similar problem with an AMI that was working until recently. Below is the tail output of cfn-init.log. This may be a related issue: https://github.com/kubernetes/kubernetes/issues/60134

failure: repodata/repomd.xml from intel-mpi-repo: [Errno 256] No more mirrors to try.
https://yum.repos.intel.com/mpi/repodata/repomd.xml: [Errno -1] repomd.xml signature could not be verified for intel-mpi-repo
Importing GPG key 0x1911E097:
 Userid     : ""CN = Intel(R) Software Development Products", O=Intel Corporation"
 Fingerprint: bf43 85f9 1ca5 fc00 5ab3 9e1c 1a84 97b1 1911 e097
 From       : https://yum.repos.intel.com/mpi/setup/PUBLIC_KEY.PUB
https://yum.repos.intel.com/mpi/repodata/repomd.xml: [Errno -1] repomd.xml signature could not be verified for intel-mpi-repo
Trying other mirror.


 One of the configured repositories failed (Intel(R) MPI Library),
 and yum doesn't have enough cached data to continue. At this point the only
 safe thing yum can do is fail. There are a few ways to work "fix" this:

     1. Contact the upstream for the repository and get them to fix the problem.

     2. Reconfigure the baseurl/etc. for the repository, to point to a working
        upstream. This is most often useful if you are using a newer
        distribution release than is supported by the repository (and the
        packages for the previous distribution release still work).

     3. Disable the repository, so yum won't use it by default. Yum will then
        just ignore the repository until you permanently enable it again or use
        --enablerepo for temporary usage:

            yum-config-manager --disable intel-mpi-repo

     4. Configure the failing repository to be skipped, if it is unavailable.
        Note that yum will try to contact the repo. when it runs most commands,
        so will have to try and fail each time (and thus. yum will be be much
        slower). If it is a very temporary problem though, this is often a nice
        compromise:

            yum-config-manager --save --setopt=intel-mpi-repo.skip_if_unavailable=true

failure: repodata/repomd.xml from intel-mpi-repo: [Errno 256] No more mirrors to try.
https://yum.repos.intel.com/mpi/repodata/repomd.xml: [Errno -1] repomd.xml signature could not be verified for intel-mpi-repo
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  462k  100  462k    0     0  7119k      0 --:--:-- --:--:-- --:--:-- 7119k
cp: missing destination file operand after ‘tuning_skx_shm-ofi.dat’
Try 'cp --help' for more information.
---- End output of "bash"  "/tmp/chef-script20190930-3348-8ydlce" ----
Ran "bash"  "/tmp/chef-script20190930-3348-8ydlce" returned 1

2019-09-30 15:02:31,996 [ERROR] Error encountered during build of chefConfig: Command chef failed
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/site-packages/aws_cfn_bootstrap-1.4-py2.7.egg/cfnbootstrap/construction.py", line 542, in run_config
    CloudFormationCarpenter(config, self._auth_config).build(worklog)
  File "/usr/local/lib/python2.7/site-packages/aws_cfn_bootstrap-1.4-py2.7.egg/cfnbootstrap/construction.py", line 260, in build
    changes['commands'] = CommandTool().apply(self._config.commands)
  File "/usr/local/lib/python2.7/site-packages/aws_cfn_bootstrap-1.4-py2.7.egg/cfnbootstrap/command_tool.py", line 117, in apply
    raise ToolError(u"Command %s failed" % name)
ToolError: Command chef failed
2019-09-30 15:02:31,996 [ERROR] -----------------------BUILD FAILED!------------------------
2019-09-30 15:02:31,996 [ERROR] Unhandled exception during build: Command chef failed
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/site-packages/aws_cfn_bootstrap-1.4-py2.7.egg/EGG-INFO/scripts/cfn-init", line 171, in <module>
    worklog.build(metadata, configSets)
  File "/usr/local/lib/python2.7/site-packages/aws_cfn_bootstrap-1.4-py2.7.egg/cfnbootstrap/construction.py", line 129, in build
    Contractor(metadata).build(configSets, self)
  File "/usr/local/lib/python2.7/site-packages/aws_cfn_bootstrap-1.4-py2.7.egg/cfnbootstrap/construction.py", line 530, in build
    self.run_config(config, worklog)
  File "/usr/local/lib/python2.7/site-packages/aws_cfn_bootstrap-1.4-py2.7.egg/cfnbootstrap/construction.py", line 542, in run_config
    CloudFormationCarpenter(config, self._auth_config).build(worklog)
  File "/usr/local/lib/python2.7/site-packages/aws_cfn_bootstrap-1.4-py2.7.egg/cfnbootstrap/construction.py", line 260, in build
    changes['commands'] = CommandTool().apply(self._config.commands)
  File "/usr/local/lib/python2.7/site-packages/aws_cfn_bootstrap-1.4-py2.7.egg/cfnbootstrap/command_tool.py", line 117, in apply
    raise ToolError(u"Command %s failed" % name)
ToolError: Command chef failed
2019-09-30 15:02:32,227 [DEBUG] CloudFormation client initialized with endpoint https://cloudformation.us-east-1.amazonaws.com
2019-09-30 15:02:32,228 [DEBUG] Signaling resource MasterServer in stack parallelcluster-perm-clust with unique ID i-0b35b63dcee58a1ac and status FAILURE

@medcelerate @jflournoy There's an issue with the GPG key required for Intel MPI, we're currently working on a fix.

The other issue as well should be addressed in regards to the location of the cfn-init bin directory.

Hi @medcelerate,
can you provide the source AMI id that you used to create your
custom_ami = ami-0fe6de8b16a7dd4b4?

thanks

The source id was 294706254702/p2qami

I just saw from your previous log (cloud-init) that you are trying to use Amazon Linux 2, which is currently unsupported by ParallelCluster.
The supported OSs are Amazon Linux, Centos 6, Centos 7, Ubuntu 14.04 and Ubuntu 16.04.

Thanks

That was from another attempted run, these were with amazon Linux 1.

On Wed, Oct 2, 2019 at 4:40 AM Luca Carrogu notifications@github.com
wrote:

I just saw from your previous log (cloud-init) that you are trying to use
Amazon Linux 2, which is currently unsupported by ParallelCluster.
The supported OSs are Amazon Linux, Centos 6, Centos 7, Ubuntu 14.04 and
Ubuntu 16.04.

Thanks

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/aws/aws-parallelcluster/issues/1334?email_source=notifications&email_token=AHYKRGMTQI2CGY4FC6GIKYLQMRM67A5CNFSM4I3HHWCKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEAEAGRY#issuecomment-537396039,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AHYKRGJXO4BE6OTZRMMJJJDQMRM67ANCNFSM4I3HHWCA
.

Ok,
can you please post the current custom_ami value you are using and the AMI id that you used as a source to create that custom AMI?

AMI id has the same format of the custom_ami option value, so should be something like ami-*

Thanks

This issue has been automatically closed because there has been no response to our request for more information from the original author. With only the information that is currently in the issue, we don't have enough information to take action. Please reach out if you have or find the answers we need so that we can investigate further.

this is the custom ami id ami-044fd82af685b78c3

I can see that the AMI you reported is created from the public alinux AMI (Amazon Linux AMI 2018.03.0.20190826 x86_64 HVM gp2) and is not pre-baked with ParallelCluster recipes.

In order to create a custom AMI that works with ParallelCluster please follow one of the two approaches reported here: https://docs.aws.amazon.com/parallelcluster/latest/ug/tutorials_02_ami_customization.html

In case you want to spin-up a machine, install the tools and then make an AMI out of it just make sure you start from the AMIs published by ParallelCluster. Refer to the ones that match your pcluster cli version. Here is a list for version 2.5.0: https://github.com/aws/aws-parallelcluster/blob/v2.5.0/amis.txt

Also in case this fails again please report the latest logs/erros since the previous ones were related to alinux 2.

I'm going to resolve this one but feel free to reopen in case you still have issues or need support :)

Was this page helpful?
0 / 5 - 0 ratings