Likewise, I think I enabled an option to always show it.

Its under System Settings → Accessibility → Display → Show window title icons