Cool. Another AI project written in Rust! The local model has been a great idea for privacy and compliance! Which local models do you think can support this kind of agent? I suppose you need at least a 140B model to work well?
But I highly believe open source models will catch up soon and there are lots of potentials there comparing to closed cloud models.