Unfortunately I can't exclude organisation altogether, GitHub applications have access to organisation with the permissions that the user has allowed the app. However now GitHub Notifier only asks for read permissions :)