For read only it can be a great option. But even then I would choose D1 which has an amazing free tier and is sqlite under da hood.
D1 is a simplified wrapper around DO, but D1 does not put your DB on the same machine. You need to use DO directly to get local DBs.
https://developers.cloudflare.com/durable-objects/
(I am the lead engineer for Cloudflare Workers.)