Slight freeze into either fast forward or disconnect in Cross Server Dungeons

[Shujinko]

So what would happen is during a dungeon run everything would just stop and it would either fast forward or just straight up boot me from the game with a disconnect error.

I have afked in hogshead for an hour and just did my 24 man raids with no freezes or disconnects. My question is why is this happening and does anyone know a way I can fix this?