23 karma · joined September 26, 2014
if you are able to run something like mlx-community/MiniMax-M2.5-3bit (~100gb), my guess if the results are much better than 35b-a3b.
the fun fact, is that if you manually reduce the power limit to 65W the initial single thread results so virtually no loss in ST performance vs 170W, and it appears that the original AMD slides stating 75% more efficient cores at that level not too far off.
For a long time the workarounds I've used to deal with this issue:
1) Charge from the ports on the right! The charging circuit on the left aggravates the issue.
2) Disable turbo charge by setting the mac into low power mode inside system preferences -> Battery
3) Raise the computer from the table for increased air flow, and not be in contact with latent warm from the table. Which has been heated by the mac itself.
4) Lower AC temperature
5) Change the Fan Speed from Automatic (default) to fullblast, or make it sensor based but lower the min/max temperatures for the fans to start spinning faster 38-60 celsius
Positioning as an opensource Splunk would be an interesting play. Going through your docs the union() function looks like it returns a set, akin to splunk values(), is there the equivalent to list()?
Elastic is great in its lane, but it requires more resources and has a monolith weight, that has left a sour taste from our internal testing. Doing a minimal ElasticSearch compatible API would open up your target audience, are there any plans to do you it in a short term horizon (< 1 year)?
Funding (1) $1.7M
Yearly Revenue (2) <$5M
How much funding can they realistic provide for those priorities? State grants from Horizon Europe projects or similar could be an alternative source for funding, probably with better recurring probabilities but it would require a champion to lead through the burocracy and in the end it's a coin toss (or lower) to get approved.
Sources: (1) https://www.crunchbase.com/organization/pine64 (2) https://www.zoominfo.com/c/pine64-inc/372007622
I find the API nice and easy specially for those familiar with CSP or go. Performance should improve once it gets the necessary love for it to be released to be on by default.
Windows requires a lot of boring work, especially considering most of the core devs use Linux / MacOS. Once they make it as priority it should be doable within a few months of work.
Compiling isn't fast. By the language design it won't ever be possible to be in the same ballpark as golang. It's common for us that our 5k lines app, take >1m to build in release mode as we added more and more dependencies for integrations with different nosql databases (elastic, rocksdb etc).
Using LLVM as backend is great for getting top notch performance, but to generate multiple IR methods for each type signature consumes a lot of time, especially when doing optimisation in release mode builds. I guess it's a similar problem that cranelift is trying to fix in Rust.
Open classes makes it hard to cache compilation results from dependencies / libraries.