Neotree `close_if_last_window` config setting is helpful for this case.