688 karma · joined September 1, 2017
All the _just works_ feeling and reliability seem to be gone. Tahoe is so unstable that I now restart the Mac every day, when in the past it happened on software updates only. Apple Music is another huge mess, I can’t comprehend how can it be so unreliable.
Looking for exits as well and kind of looking forward to migrating to Graphene OS, self-hosted Immich, and Navidrome
[0]: https://orbstack.dev
For the LLM I’m currently using Mistral-Small-3.2-24B-Instruct instead of Nemotron 3 and it works well for my use case
The work is based on a repo by pipecat that I forked and modified to be more comfortable to run (docker compose for the server and client), added Spanish support via canary models, and added Nvidia Ampere support so it can run on my 3090.
The use case is a conversation partner for my gf who is learning Spanish, and it works incredibly well. For LLM I settled with Mistral-Small-3.2-24B-Instruct-2506-Q4_K_S.gguf
I'm going to use this setup as the base for a language learning App for my gf :)
It is a especially bad choice considering that a lot of the data stored in it is IoT-like and the system creates a single document per event :facepalm:
On the analytics side of things we are starting to use DuckDB for some development efforts, but we are keen on potentially replacing some or all of our Snowflake usage with DuckDB.
Now I mount the NAS volumes to a host at the same location and sftp to it. It’s still dog slow at 30MB/s but that’s the NAS limitation.
Direct access to the NAS can also be achieved via Subnet Routers