INT/VW doesn't update properly while spectating

Interior and virtual world actually update, but visually they don't, all I see is the blank spectation screen when switching between players and I have to re-/spec twice in order to see them.

I'm updating the VW/INT under OnPlayerInteriorChange and a custom function OnPlayerVirtualWorldChange, none of them seem to work properly and when I switch from a player that's outside of interiors to someone who's inside an interior - the following happens:

Player A (VW 0 | INT 0): http://prntscr.com/hvnvvj
Switching to player B (VW 948 | INT 10): http://prntscr.com/hvnwgw


Any help is appreciated, will upload video if needed.