Am I missing it or Is there a way to setup ftp connection in the docs? I have searched through issues and docs and cant find any way to do this and I am fairly new to devops.
Assuming that you can have SSH connection to your server, you can for sure use SFTP in the same way. For example, in FileZilla:

If you want to FTP to your apps (containers), you just need to know their volume path:
$ docker volume ls # this will show you a list of disk volumes
$ docker volume inspect volume-name # volume-name is found using the previous command. This will show you the Mountpoint which is the location of volume on disk
Note that you cannot SFTP to an app without volume, because anything that is not in a disk volume is ephemeral, meaning that it does not survive container restart and it will always go back to the original state.
Most helpful comment
Assuming that you can have SSH connection to your server, you can for sure use SFTP in the same way. For example, in FileZilla:
If you want to FTP to your apps (containers), you just need to know their volume path:
Note that you cannot SFTP to an app without volume, because anything that is not in a disk volume is ephemeral, meaning that it does not survive container restart and it will always go back to the original state.