Cool. Another AI project written in Rust! The local model has been a great idea for privacy and compliance! Which local models do you think can support this kind of agent? I suppose you need at least a 140B model to work well?
The OpenYurt project provides a lightweight Kubernetes solution for Edge Computing. Running edge functions in WasmEdge WebAssembly containers generates significant savings in resources and allows k8s to manage ever smaller devices.
We can use the exact same tools to manage WebAssembly applications, enabling Docker-like Linux containers and WebAssembly apps to run side-by-side in the same system.