This usually means that the opposite ear is affected – it is called Alexander's law and is due to asymmetric gaze evoked nystagmus.
Vestibular schwannoma |