Awx: SCM update stuck on TASK [detect requirements.yml]

[alex-peyrard]

ISSUE TYPE

• Bug Report

SUMMARY

On a newly installed awx with docker compose, when launching a job with a git SCM, the SCM Update job hangs on the TASK [detect requirements.yml] step indefinitely

ENVIRONMENT

• AWX version: 9.0.1
• AWX install method: docker on linux
• Ansible version: 2.9.1
• Operating System: Centos7
• Web Browser: Firefox

STEPS TO REPRODUCE

Install awx on centos7 with docker-compose
Create git credential
Create machine credential
Create inventory
Create project using this git credential
Create job template
Run job template

EXPECTED RESULTS

SCM Update step checks out the git repository and succeeds

ACTUAL RESULTS

SCM Update job stays stuck on TASK [detect requirements.yml] step

[ryanpetrello]

@alex-peyrard,

Have you done any debugging on the underlying host to see if the ansible-playbook process seems to be stuck/hung? Any screenshots you could share?

This seems fairly innocuous:

https://github.com/ansible/awx/blob/devel/awx/playbooks/project_update.yml#L133

[alex-peyrard]

Here's some screenshots,

This job has been running for about an hour.

The project:

The job template:

The playbook is a pretty simple one i've been using for testing, but I don't think It matters here.
Here's the git files. I have tried both with and without a requirements.yml

I am not sure how to debug this or where to find helpful logs.
However, I see the hosts memory is almost full, I will try increasing the memory.

[alex-peyrard]

After increasing my hosts memory, the tasks now finishes successfully.

Thank you

[marvingoetz]

@alex-peyrard Got the same problem, with how much memory did it solve the problem?

[alex-peyrard]

@marvingoetz I found this in the install guide, so I set it to 4GB
https://github.com/ansible/awx/blob/devel/INSTALL.md#system-requirements

[r-okui]

In my case, this happens only once time after updating AWX.
When "detect collections/requirements.(yml/yaml)" task gets stuck, cancel and relaunch the job will success.
(docker on linux, AWX 15.0.1, Ansible 2.9.15, CentOS 7, 2GB mem)