It'd have to be a big private yacht, as Pitcairn has no sheltered harbours.

For a small yacht, even in the lee of the island, it would be difficult to stay for long, and you'd have to be prepared to leave whenever the weather changed.