Yeah those would just be separate endpoints/requests. text/html vs application/json. Instead of serving a static html file that bootstraps your react app, you're serving a rendered component.
Not really any different from building say a PHP app that serves an API to a mobile app.