Yes, but it may require you update things manually. You can disable the Play store and any other apps and only use F-Droid.