Carla: Is there a way to see the UE4 window on a remote server?

Created on 3 Aug 2020  路  4Comments  路  Source: carla-simulator/carla

I am running ./CarlaUE4.sh on a powerful remote server. I have tried X forwarding and VNC viewer, but they fail to show the window popped up. Is there a way to see the UE4 window from a local PC while running CARLA on a remote server?

question

Most helpful comment

I am not sure if the Xforwarding is going to work, but in any case it seems your problem is not with the X forwarding yet, but with the configuration of the Xorg server.

It is possible to configure CARLA to run in a headless server, but it takes a few steps.

  • Make sure you have a Ubuntu 18.04 system
  • Fetch the latest NVIDIA driver: wget http://download.nvidia.com/XFree86/Linux-x86_64/450.57/NVIDIA-Linux-x86_64-450.57.run
  • Install the driver: sudo /bin/bash NVIDIA-Linux-x86_64-450.57.run --accept-license --no-questions --ui=none
  • Install xserver related dependencies: sudo apt-get install -y xserver-xorg mesa-utils libvulkan1
  • Configure xserver: sudo nvidia-xconfig -a --virtual=1280x1024
  • Run xserver: sudo X :0 &
  • Run CARLA: DISPLAY=:0.GPU_ID SDL_VIDEODRIVER=x11 ./CarlaUE4.sh -vulkan

Notes:

  • Make sure that within the container the env variable SDL_VIDEODRIVER is set to x11, i.e., SDL_VIDEODRIVER=x11
  • Make sure that within the container libvulkan1 is installed

That should launch the CARLA server in a headless node using vulkan. You can check that this is working by running any carla example.

Regarding the X forwarding, I am not sure if the X forwarding will forward the server window. In the worst case you can fetch the spectator camera (which is the camera the server shows) and display it locally using the CARLA API.

Hope this information helps.

All 4 comments

also interested in knowing this!

I am running ./CarlaUE4.sh on a powerful remote server. I have tried X forwarding and VNC viewer, but they fail to show the window popped up. Is there a way to see the UE4 window from a local PC while running CARLA on a remote server?

Hi, i am also trying that on server. When i launch Xorg, there is an error (EE) Fatal server error (EE) no screens found
Then i use P100 with CUDA10.2 and nvidia-smi works.

I am not sure if the Xforwarding is going to work, but in any case it seems your problem is not with the X forwarding yet, but with the configuration of the Xorg server.

It is possible to configure CARLA to run in a headless server, but it takes a few steps.

  • Make sure you have a Ubuntu 18.04 system
  • Fetch the latest NVIDIA driver: wget http://download.nvidia.com/XFree86/Linux-x86_64/450.57/NVIDIA-Linux-x86_64-450.57.run
  • Install the driver: sudo /bin/bash NVIDIA-Linux-x86_64-450.57.run --accept-license --no-questions --ui=none
  • Install xserver related dependencies: sudo apt-get install -y xserver-xorg mesa-utils libvulkan1
  • Configure xserver: sudo nvidia-xconfig -a --virtual=1280x1024
  • Run xserver: sudo X :0 &
  • Run CARLA: DISPLAY=:0.GPU_ID SDL_VIDEODRIVER=x11 ./CarlaUE4.sh -vulkan

Notes:

  • Make sure that within the container the env variable SDL_VIDEODRIVER is set to x11, i.e., SDL_VIDEODRIVER=x11
  • Make sure that within the container libvulkan1 is installed

That should launch the CARLA server in a headless node using vulkan. You can check that this is working by running any carla example.

Regarding the X forwarding, I am not sure if the X forwarding will forward the server window. In the worst case you can fetch the spectator camera (which is the camera the server shows) and display it locally using the CARLA API.

Hope this information helps.

Thanks all. I find that carlaviz is a good solution.

Was this page helpful?
0 / 5 - 0 ratings

Related issues

imran514 picture imran514  路  3Comments

syinari0123 picture syinari0123  路  3Comments

robertnishihara picture robertnishihara  路  4Comments

hc167 picture hc167  路  4Comments

kartikye picture kartikye  路  3Comments