I have GTX 970 and I don't have problem like that.
Like a lot of folks here, the only problem I'm getting is unstable FPS: I was at constant 120+ FPS then all of sudden it's drop to 28-45 FPS and going in back up after few seconds (happen a lot in open world at world boss fight) and my PC is not low performance gaming PC :)