The Houthis have repeatedly stated they are only targeting ships heading to/from Israeli ports. Everyone else SHOULD be able to proceed on their merry way, but I understand the rationale of risk avoidance by simply avoiding the whole region.
> I wonder why we don't see Egypt's and Saudi Arabia's navy sending ships to the coast of Yemen.
Hmmmm, Saudi Arabia is in an awkward position. They've been at war with the Houthis partly because they are Iranian proxies. But now they are starting to repair relations with Iran. Also the Saudis need to maintain credibility with the Islamic world as a whole, and it would be a very bad look if they were interdicting Yemeni efforts to support the struggle for Palestinian liberation.
Egypt might be similarly passive, but more for domestic reasons. Western-leaning government prefers relatively normal relations with Israel (and booming Suez Canal traffic), but likely large portions of their population doesn't. "Do nothing" is an easy middle ground.