Hacker News Reader

Hacker News

Comment by unixhero | Hacker News Reader

Parent Full thread

unixhero

What are hybrid algorithms supposed to be anyways? Half algorithm & half dictionary?

Half algorithm & half user manual?

Half algorithm & half class?

View on HN

Generally the concept of hybrid algorithms is:

- Half "hard maths" algorithms. i.e. cominbatorics, geometry, etc.

- Half "fuzzy maths" algorithms. i.e. heuristics, approximation, machine learning.

The idea being to solve the parts that can be easily solved by hard maths with those hard maths so that you can reduce the problem space for when you apply the fuzzy maths to solve the rest of the problem.

In other words, it's taking the problem, breaking out discrete pieces to solve with well established hard maths, using heuristics & numerical solutions to tackle the remaining known problems without "easy" analytical solutions, then using ML to fill in all the gaps and glue the whole thing together.

Half conventional HPC simulation that runs best on CPU, half Neural Networks that need GPUs. As proposed for example here

https://www.nature.com/articles/s41586-019-0912-1

and here

https://www.nature.com/articles/s42256-021-00374-3

> The next step will be a hybrid modelling approach, coupling physical process models with the versatility of data-driven machine learning.

The Frontier HPC system that AMD just delivered is aimed fully at that problem.

https://en.wikipedia.org/wiki/Frontier_(supercomputer)

The article gives a concrete example in the same paragraph: "For example, AI algorithms could get close to a solution quickly and efficiently, and then the gap between the AI answer and the true solution can be filled by high-precision computing."

Interestingly the example is backwards (statistical reasoning first, hard reasoning second) compared to traditional usage of "hybrid" in AI and control contexts.

That's not concrete at all.

From the article it looks like half AI guessing the solution, half some static algorithm fixing the result to be better. Not sure how it's supposed to really work.

one variant of this is sciml approaches where you use an ODE solver wrapped around a NN. the ODE solver guarantees you get the right conversation laws which NNs don't do well and the NN is more accurate than the hand written model since it doesn't ignore the higher order effects.

Half SQL statements and half array.sort() methods I assume.

    (solve (this :by strong-ai) (that :by weak-ai))

Reply on news.ycombinator.com