Bad synchronizer is correct. Mine are wearing out so I have trouble sometimes up shifting and down shifing in 1st and 2nd (even shifting down into second from 3rd). If I'm not going the right speed or the engine isn't at the right rpm I have to double clutch. All of our gears are in constant mesh and one synchronizer is actually attached to 2 gears.
The center section moves back and fourth. When you hear grinding gears during shifting you are actually hearing the synchros grinding and once the pointed end of the dog teeth are gone you end up not being able to shift unless the center section and teeth are spinning at approximately the same speed and closely aligned.