A headphone amplifier is a circuit that raises a signal to a level that can drive headphones. Eurorack signals are not strong enough on their own, and plugging headphones into a regular output often sounds quiet and weak.
Many mixers and output modules include one, and dedicated modules are available.