That's why you had a spike. Stop doing that. If sound on things you can control is discomforting to you then lower the volume to a comforting level.
Over protection makes hyperacusis worse it. In short, it starved the auditory system of sound. Therefore your auditory system ramps up everything...