Rpcs3: Regressions caused by #6112 (optimizations)

[jacob1218]

There seems to be a regression after https://github.com/RPCS3/rpcs3/pull/6112 . Gran Turismo 6 used to go ingame, now crashing on car select or hanging after it displays the name of the track. Log attached.
RPCS3 hang.log.gz

[legend800]

Same thing happens in Wipeout HD now too.

[kd-11]

It would be better to not restart the game over and over in the same instance. It would also be much more helpful to have a log with a crash instead of a silent hang. If this is really related to the wipeout issue, then this build should hide the issue. It will take a long time to finish though.

[jacob1218]

With that new build, still hung. Clean log posted
RPCS3.log.gz

[legend800]

Wipeout (which may be a diff. issue) still hangs as well.

RPCS3.zip

[kd-11]

New build with the issue properly fixed. https://ci.appveyor.com/project/kd-11/rpcs3/builds/25622170
The commits are still a bit rough, I'll try and clean them up in the next few days for a PR. Multiple issues were identified, some introduced with optimizations and others existing even before that.

[kd-11]

I've upgraded this ticket to handle all regressions from optimizations PR as they are likely all related.

[legend800]

Wipeout HD fine again on fix build:

[incognitoh]

big regression in MLB 2k7. Before #6112 , the game was almost perfect but #6112 broke it quite a bit. This title requires WCB and cpublit but looked good prior to this PR. The game uses a lot of zoom-in and DOF effects which is what seems to be the issue. I've tried with Async, MSAA and Multi RSX disabled and enabled but the issue remains and is a constant issue throughout this game. here are a couple quick comparison gifs of the issue, using Vulkan:

Before #6112:

After #6112

(gtx1070 gpu) also, I tried the newest PR listed here and it does not fix it.

[kd-11]

@incognitoh Please provide comparison renderdoc traces with renderdoc 1.4