It seems there is a dilation filter applied or something like that that also needs to be reversed when using depth inversion