If your needs are simple enough, built-in Django function-based views will do. When you outgrow those, DRF's complexity is often warranted.
This is the bit I find not really true.
My needs are simple (10-20 basic get/post/put/delete APIs, many at the business logic layer than true REST) but I still would really like the OpenAPI docs, auto-generated schema definitions, etc etc. If I can get that with just some simple decorators on my existing views and pydantic models for the inputs and outputs .... that would be awesome.