HNHacker News
TopNewBestAskShowJobs

ixaxaar

277 karma · joined November 5, 2018

submissionscomments
ixaxaar··on AutoDev: Automated AI-driven development by Microsoft
To prove some kind of superiority over all programmers?

I think that would fit idiot savant logic very well.

ixaxaar··on Ollama now supports AMD graphics cards
Hey I did, and sorry for the self promo,

Please check out https://github.com/geniusrise - tool for running llms and other stuff, behaves like docker compose, works with whatever is supported by underlying engines:

Huggingface - MPS, cuda VLLM - cuda, ROCm llama.cpp, whisper.cpp - cuda, mps, rocm

Also coming up integration with spark (TorchDistributor), kafka and airflow.

ixaxaar··on Show HN: Matrix Multiplication with Half the Multiplications
I think that's the reason for its dead end.

However if this is really the biological analogue of credit assignment, this might scale better than training llms from scratch every time. Even if say it could approx gradients to a certain degree given a new network, normal backprop could further tune for a few epochs or so dramatically reducing overall training costs.

ixaxaar··on Show HN: Matrix Multiplication with Half the Multiplications
I think that image is from the paper and was not created by me. Looks cool indeed!
ixaxaar··on Show HN: Matrix Multiplication with Half the Multiplications
Correct, I think I mistook it as "use a small neural net to approximate matrix multiplication" instead it seems as "use cheaper replacements of matrix mul without much acc loss".

Wellll that means I can give dni another try :D

ixaxaar··on Show HN: Matrix Multiplication with Half the Multiplications
Man I remembered something similar I had tried working on in 2018, but gave up after all my PhD applications got rejected.

https://github.com/ixaxaar/pytorch-dni

The concept here goes a bit further and tries to replicate backprop with an external network, arguing that that's probably what the brain actually does.

ixaxaar··on Zerodha Tech – Hello, World
Last month few of my shares disappeared, stock splits gone wrong, disputes appearing for stocks I don't own. The platform was probably the best in India, but it now crumbling.

Groww and upstox are total crap as well. But who cares, majority of the country operates with portfolio sizes of USD 100.

Larger accounts are better off with traditional brokers who offer personal relationships than some app made by a great tech team.

ixaxaar··on 'If anything happens, it's not suicide': Boeing whistleblower before death
Oh so in Russia its jumping out a window and in the USA its some random method of suicide?

Why not be specific, and consistent, like Russia?

ixaxaar··on OpenAI's Lies and Half-Truths
Indeed this is the new formula for "disruptions".

Another take: is real true value creation only possible outside of capitalism? Hence those communist pockets like academia and practices like treating everything as public property are allowed to exist, otherwise there would be no innovation etc just a bunch of companies suing each other?

ixaxaar··on Stealing Part of a Production Language Model
The United States.
ixaxaar··on K8s Service Meshes: The Bill Comes Due
K8s, service meshes, all this infrastructure complexity to me seems like more of a band-aid to bad backend practices and lack of standardization.

This kind of world arises if an org has, say 1000 engineers, or ~100-200 teams, and every team wants to do their own thing with accountability improperly mapped etc.

And infrastructure engineers turn into police with an obvious overemphasis on observability.

I guess a large amount of complexity in infra and wastage is done to hide human inefficiencies.

ixaxaar··on Geniusrise – inference APIs for text, vision, audio, multi-modal AI models
Geniusrise is a modular, loosely-coupled AI-microservices framework.

It can be used to perform various tasks, including hosting inference endpoints, performing bulk inference, fine tune etc with open source models or closed source APIs.

- The framework provides structure for modules and operationalizes and orchestrates them. - The modular ecosystem provides a layer of abstraction over the myriad of models, libraries, tools, parameters and optimizations underlying the operationalization of modern AI models.

1. Install geniusrise and libs

    pip install torch
    pip install geniusrise
    pip install geniusrise-vision # vision multi-modal models
    pip install geniusrise-text # text models, LLMs
    pip install geniusrise-audio # audio models

2. Create YAML file

    version: '1'
    
    bolts:
        my_multimodal_api:
            name: VisualQAAPI
            state:
                type: none
            input:
                type: batch
                args:
                    input_folder: ./input
            output:
                type: batch
                args:
                    output_folder: ./output
            method: listen
            args:
                model_name: 'llava-hf/bakLlava-v1-hf'
                model_class: 'LlavaForConditionalGeneration'
                processor_class: 'AutoProcessor'
                device_map: 'cuda:0'
                use_cuda: True
                precision: 'bfloat16'
                quantization: 0
                max_memory: None
                torchscript: False
                compile: False
                flash_attention: False
                better_transformers: False
                endpoint: '*'
                port: 3000
                cors_domain: 'http://localhost:3000'
                username: 'user'
                password: 'password'

3. Launch API service

    genius rise


    MY_IMAGE=/path/to/test/image

    (base64 -w 0 $MY_IMAGE | awk '{print "{\"image_base64\": \""$0"\", \"question\": \"<image>\nUSER: Whats the content of the image?\nASSISTANT:\", \"do_sample\": false, \"max_new_tokens\": 128}"}' > /tmp/image_payload.json)
    curl -X POST http://localhost:3000/api/v1/answer_question \
        -H "Content-Type: application/json" \
        -u user:password \
        -d @/tmp/image_payload.json | jq

More: https://docs.geniusrise.ai/guides/usage/ and https://github.com/geniusrise/examples
ixaxaar··on TurboTax maker Intuit spent millions in record lobbying blitz
Meanwhile in India - https://www.incometax.gov.in/iec/foportal/

Individual Registered Users - 118,911,572

No. of returns filed (AY 23-24) - 82,194,557

I've hired a few devs from intuit before and they tell me the Indian portal is far more usable than whatever they were building.

ixaxaar··on RustPython
Pretty much. Ecosystem brings most of the value than any programming language.
ixaxaar··on Hugging Face and Google partner for AI collaboration
Soooo, ai.azure.com coming soon for GCP?
ixaxaar··on Is the emergence of life an expected phase transition in the evolving universe?
https://www.santafe.edu/research/sfi-press

BTW these books were up on amazon India for like $10-$15 each (books with slight printing defects were being dumped in the 3rd world) so I lapped up the entire collection :P

ixaxaar··on Is the emergence of life an expected phase transition in the evolving universe?
I think the complexity researchers over the years have created a wide range of tooling for analysing complex systems across a large number of domains.

Consider complexity economics, computational social sciences, network sciences and cascading networks, evolutionary theories, parts of systems biology, connectomics and computational neuroscience etc.

The Santa Fe institute has been at the forefront and has an amazing collections of publications in their own press. David krakaeur's book "Worlds Hidden in Plain Sight: The Evolving Idea of Complexity at the Santa Fe Institute" is like a 20 year survey paper and an amazing read.

ixaxaar··on Is the emergence of life an expected phase transition in the evolving universe?
I think Kauffman has been developing this set of ideas for a while now. I remember reading his "the origins of order" and find a lot of the ideas from the book here in more evolved forms. He really got me into visualising complex systems and their state spaces etc.
ixaxaar··on US developers can offer non-app store purchasing, Apple still collect commission
UPI in India has 0 fees, currently doing about 52% of all digital transactions in the country.
ixaxaar··on 'Rich Dad, Poor Dad' author Robert Kiyosaki reveals he's $1B in debt
on no these are like fund houses, HNI family fund house clusters etc. The news is more than a year old BTW. (I was trying to sell an asset management SAAS to these).
ixaxaar··on 'Rich Dad, Poor Dad' author Robert Kiyosaki reveals he's $1B in debt
How is this guy wrong in hedging against the declining dollar and rising price of commodities? At a time when all central banks are de-dollarizing and buying gold, wouldn't this be the perfect hedge?

I know for a fact that most fund managers (at least in India) have been converting as much as 10-20% of their portfolios into gold and other commodities.

ixaxaar··on "Anna's Archive" blocked following publishers' complaint
You are right in this. It seems they're also in the process of figuring it out.
ixaxaar··on "Anna's Archive" blocked following publishers' complaint
I guess whoever tries to enforce copyright at this point ends up losing in the AI race. On the other hand, countries like Japan have literally chosen to be the Cayman Islands of AI. I wonder how countries with a stronger foundation of copyright are going to navigate this conundrum against middle-income countries which have a stronger incentive to be ambiguous on this issue.
ixaxaar··on Spotify starts divesting from France in response to new music-streaming tax
isn't this similar to what Canada was/is trying to do to podcasts?
ixaxaar··on Change of Name: Coq –> The Rocq Prover
Cool, now I can recommend it to female devs to learn, without anyone getting uncomfortable.

With the growth of lean, I suppose its time to get more serious in popularizing and attracting community instead of trying to pursue harmless chuckles.

Edit:

And I immediately get labeled as a "tranny protector". I'm not from the western world and we do not have the same cultural issues.

What I meant is, in a world where English nevertheless dominates as a common language by far, perhaps naming matters in the English context much more than any other language, particularly when building something for everyone.

Edit Edit:

I mean I had no idea there were such strong feelings of what i suppose is being perceived as American/English cultural interference that's felt so strongly by the French.

Maybe that's what Africans feel who were colonised by French Coqs (national animal)?

I now completely agree it is a brilliant idea to name something "cunt" in honour of Louvre Cuntadoodleur. :D

ixaxaar··on The Rust I used to know (2022)
I've worked in automotive where literally everything except the infotainment systems are in C.

Almost all, if not all, firmware is in C.

Also, not to mention every operating system.

I really don't know where the "bugs are horrible" argument grounds itself on. I've worked on large C, rust, go, python and even Haskell codebases. Everyone of them had their share of super corner case bugs.

The systems which use the simplest concepts and tools tend to have the least bugs cause they are more readable and hence fixable.

ixaxaar··on The Rust I used to know (2022)
I think the world of programmers have spent a bit too much time trying to avoid pointers, inventing a whole bunch of different languages, mechanisms and with them a horde of other problems and useless complexities. Instead of this utter wastage, why not just use C?
ixaxaar··on Challenging projects every programmer should try (2019)
Also, I'd add that doing HoTT or other such "high theory" stuff actually enhances my understanding of the fundamentals and gives me the machinery to handle complexities systematically that building a mere web search engine would not. I already have a job for building such commodity stuff everyday.
ixaxaar··on The era of American computer magazines has drawn to a close
Hey, I had a very similar experience. Growing up in Bombay in the late 90s, chip and digit were literally my introduction to computing. Though I was not that much into gaming, they made me a fan of computer architecture, of graphics cards and so on. I guess being a nerd hanging around lamington road, almost harassing the shopkeepers for deeper tech specs of every component was more education than any university could ever provide.

Then came Linux for you, and made me try my first Linux distro - xandros 2003. Then there was the complete 3 DVD Debian distro on LFY made me create an openmpi HPC in college among so many other things completely ignored by the formal education system.

I think there is a real value to limited, quality information like these magazines that the internet ruined. Devs these days have unlimited information at their fingertips - the internet and now chatgpt. But now the onus is on us - are we asking the right questions?

ixaxaar··on Google is apparently struggling to contain an ongoing spam attack
Why not just block bing and save 70% straight away? Nobody uses bing anyway.
← PreviousPage 2 of 3Next →