I removed the search text-box by right clicking on the task bar, this brought up the Personalisation>Taskbar settings menu. The top item under Taskbar Items is search, toggle the switch from on to off. As a side-note, I'm in EU, so perhaps you don't have this option in other regions?