python custom_env.py
Running the the provided rllib example custom_env.py without error, there is no tf summary in ray_results/PPO/PPO_SimpleCorridor_*
https://github.com/ray-project/ray/blob/master/rllib/examples/custom_env.py
which tensorflow version are you using?
2.0.0
Sigh this is so painful - can you try this? https://github.com/ray-project/ray/pull/5953/files
I checked your branch, using the script custom_env.py it's working now, there are summaries :+1:
Most helpful comment
Sigh this is so painful - can you try this? https://github.com/ray-project/ray/pull/5953/files