Does every soundcard support MIDI?

My friend wants me to build him a computer and all the other parts are fine but he's really into music producing and has keyboards he'd like to use with his computer and he says the sound card MUST have MIDI output. I'm not exactly sure what he means by this. Is there an actual existing MIDI port that you plug things into, does every sound card have this or just the high end ones?