1889, "tall hat;" also used synechdochically for men who wear such hats; figurative meaning "swelled head" is from 1923. Drum set sense is from 1934.
(also high-hatty): his high-hat posturings/ high-hatty pretentions (1925+)
noun: How come you're high-hatting me, old buddy? (1925+)