HNHacker News
TopNewBestAskShowJobs

deepnet

1,376 karma · joined May 12, 2015

Reinforcement Learning with Deep Convolutional Neural Networks for Agent and Robot Control.

Machine Intelligence, functional programming, photogrammetry, and Machine creativity.

Currently : Transferring learning between modalities in robotic neural nets.

[deepnet] [\@] jmhz [\.] net

submissionscomments
deepnet··on History of Virtual Reality
Oddly no mention of VRML the mid-90s Virtual Reality Markup Language !
deepnet··on Matryoshka Representation Learning
How do they sort the dimensions so the most salient are at the front and thus retained ?
deepnet··on A journalist goes undercover to reveal the absurdity of the art scene
No I am not, it used to be thought useful on hnews to summarise & tl;dr the article.

I guess not so much now.

I think this looks like an interesting book and have pre-ordered it from Waterstones.

I was hoping to see a bit of hnews discussion on the article. I make and like art.

deepnet··on UK Wind Farms Are Overstating Their Output
This is very interesting can you link somedata sources for funding and capacity ?

Your insightful comment is much appreciated.

Many thanks for sharing your research

deepnet··on UK Wind Farms Are Overstating Their Output
Why is there so much less tidal power.

The tides are constant, unlike wind and sun.

The UK has a lot of coast and a lot of tides.

deepnet··on Why is Maxwell's theory so hard to understand? (2007) [pdf]
Natural language can conjure the visual imagination of intuition, but it is less specific than images themselves.

Einstein reportedly ran thought experiments in his imagination.

His intuition was visual and dynamic.

That is images that change - animations.

A natural language description of relativity is one step removed from the moving images of Einstein's intuition.

Fields are not grounded in everyday experience but most modern movie-goers are happy with rapid and grand changes of scale and thanks to wizard and superhero movies there exists a sophisticated visual grammar of rapidly propagating fields, strange paradoxes and simultanous weakly interacting realities.

Many of the concepts of quantum field theory can be grasped by a wide audience when presented as animations.

deepnet··on Show HN: Librarian - Semantic Bookmark Search Using Transformers
Thanks for releasing your work, this is useful and interesting.
deepnet··on scrapscript.py
Elegant and pure.

I also like the Javascript lambda calculus this is a fork of.

Like early Haskell when it was just for fun before Haskell's Meta-monadic library sprawl that upped the learning curve

deepnet··on Nicholas Saunders and "Alternative London" changed British food
Artisanal bootstrapping, pretty good sustainable ecoomic model described here.

In short: self-fund, do good, be cool.

This is the Neal behind Neal's Yard & Monmouth Coffee

A few Unicorns set-up by this man such as Neal's Yard Remedies bought by Doring-Kindersly: £220,000,000 per annum

Also :-D the origin of The famous Monty Python Cheese Shop Sketch was inspired by John Cleese trying to buy cheese from Neal's Yard Dairy.

And he wrote the UK's 'Whole Earth Catalogue', quite a guy.

deepnet··on I Found David Lynch's Lost 'Dune II' Script
Lynch's Dune is vibrant, transgressive and weird. Every detail is unsettling in the way only Lynch is. The scale invokes awe. Excited frisson and disgust overlap uncomfortably. The emotions evoked are grand and complex. It is a challenging film, a masterpiece.

Villeneuve's dune is an enjoyable film, it conforms to expectations, and easily lauded. As such it is somewhat anodyne and flat. It is only rich where it borrows from Lynch. The scale feels small like tilt-shift does.

deepnet··on Advice for new software devs who've read all those other advice essays
A balancing act between premature optimisation and technical debt.
deepnet··on Wheel-Hand-Leg-Arms Open Doors Playfully
Curiosity (in this context) is a Loss function based on the error between the observed next state and agent's prediction of the next state given the current state and an action.

The states are encoded in a feature space that ignores irrellivancies that don't effect and are out of the agent's control ( e.g. leaves blowing on trees )

Curiosity provides a method to learn this feature space from the raw pixel input via inverse dynamics.

The feature space is compact, relevant, sufficient, & stable which is ideal for RL.

This Curiosity Loss function entices the agent to explore states it has not been in and areas with complex dynamics.

These are states with high uncertainty which the agent reduces by becoming familiar with them.

This is a self-supervised method with no extrinsic human designed reward.

The agent aquires general knowledge about its enviroment and it is analagous to being curious.

deepnet··on A third of North America’s birds have vanished
The Oasis effect of habitat is valuable and can form part of corridors so insects and birds can migrate and breed.

So your actions alone can be valuable.

Your may inspire others or be part of a chain of things which inspires them.

Your hard won knowledge awaits their questions.

You may have to fight HOAs and disaproval. Your battles lay the groundwork for those that follow to succeed - setting precendent and raising issues, sometimes even by losing.

Even if others don't follow your practice you may pique their interest - which may change their opinions. Opinions are the mandate by which local officials and politicians act?

Many of these good consequences may be invisible to you. Doing good is never useless. The causes of change can be unpredictable and subtle. The future can be radically altered by small effects in the past.

Perhaps the life of a native bumble bee that survives by virtue of your planting may be the one that mutates enough so his descendants survive the coming changes.

Increase the luck surface for a good future.

Stay hopeful.

deepnet··on Get ready for light-based Wi-Fi, because it's now an official standard
https://www.bbc.co.uk/programmes/m001n8d9

Harald Haas on making waves in light communication

The Life Scientific

Jim Al-Khalili talks to Harald Haas about his breakthrough invention, LiFi, and how light can be used to access the internet.

deepnet··on Anna’s Archive: Open-source data library
Dementors to take one to Azkhaban
deepnet··on PayPal “Buy Now” buttons have been broken for a week
I found customers with popup blocking (firefox) were causing bank verification to fail.
deepnet··on Don’t emotionally bootstrap your startup
"It can be lonely at top".

It can be lonely anywhere, peer support is very helpful.

Founders have to make decisions and cope with crunches and quick decisions amidst many emotions.

It can be hard to unpick a bundle of new emotions to find ones gut feeling.

Especially as most situations will be new and unique. Time spent sharing with other founders is very valuable.

Peer groups and mentors should be in place from the get go

deepnet··on Playing sounds of healthy coral on reefs makes fish return (2019)
Here is a dry land analogue. [1] Tree roots grow towards the sound of water.

[1] https://ec.europa.eu/research-and-innovation/en/horizon-maga...

deepnet··on HuggingGPT: Solving AI tasks with ChatGPT and its friends in HuggingFace
Add a expert human in the loop, e.g. Terence Tao and this might be feasible.
deepnet··on Was there a tech-hiring bubble? Job postings data suggest so
In the often adverserial world of exchanging labour and creativity for money, shares, prestige, and because we programmers care please don't blame us for not being able to assess how much the business should pay us.

Our job is attempt to know our expected potential worth and then negotiate for that recompense.

There are things we often don't know, i.e. megacorps may hire us to stop us working elsewhere.

If a business chooses to neglect to know this because it is either not worth it to them find out or they are incapable that is not on the worker.

This is esentially an attempted value crash or hyperdeflation of the monetary value of labour.

This meme of we can do more with hugely vastly less talent is a spreadsheet fancy of MBAs far from the coal face of code or customers.

The real cost is all the top talent people bail and only those who can't or won't leave remain.

But management think they can properly assess the value of people finessing a process they can't do and little understand and probably are insulated from and only see through metrics to which Goodhart's law means the stats are juked.

deepnet··on How Nvidia’s CUDA Monopoly in Machine Learning Is Breaking
The bottleneck is memory bus bandwidth as current Neural Net scaling is parameter count over compute so most A100s only operate at 60% of capacity.

Operator fusion ( function composition ) has helped but devs time is impacted by the ever growing list of fused operations.

This is a great overview of what Pytorch 2.0, TorchInduction, and OpenAI's Triton potentially bring to the table.

Namely compilation to LLVM bypassing CUDA, fusing operators and compiling graphs at a lower level allowing other arcitectures, kept out by CUDA's NVIDIA exclusivity, to potentially offer competeting compilers - other compilation toolchains are very early days though.

Backward comptibility is vital and the article details that these innovations are succesfully tested against existing Neural Net code.

NVIDIA still rules the roost in science and industry compute. In this rapidly growing market competition is healthy so this is a good thing for everyone - especially those differentiators like ARM competing on Watts per FLOP.

deepnet··on Seawater electrolysis ignites new hope for affordable green hydrogen
Tidal turbines are a good contender. The tides are constant.
deepnet··on Gödel’s first incompleteness theorem – an interactive tutorial
ASCII has 7 bits

ASCII encodes strings as powers of 128.

:-D

Otherwise seems legit

deepnet··on An unexpected revival of Firefox OS
https://capyloon.org/

Capyloon for freedom, runs most anywhere ( Desktop too )

It runs FirefoxOS apps.

Runs on top of Android on any phone as a GSI.

Comes with a SDK out of the box

Pragmaticly free in that it runs anywhere

deepnet··on Performance reviews don’t assess performance
I like the sound of your newsletter but sadly I am not seeing the pre-signup examples mentioned on the landing page so can't easily assess.
deepnet··on Recording the Grateful Dead: The Culture of Tapers
The overlap between early nerd culture and The Grateful Dead was very significant.

Taping and sharing culture and its benefits were very apparent in many net forums.

As were democratisation of the new tools, public terminals with BBS access and the Deadheads community spirit exemplified on Usenet and Arpanet.

Look no further than John Perry Barlow, EFF co-founder and his Manifesto of Cyberspace - he was a Grateful Dead Lyricist !

https://www.wired.com/2016/02/its-been-20-years-since-this-m...

Barlow's paradigm seems cheeky without awareness of the Net's public roots, how it came up through BBS and Fidonet culture, is forgotten by those who only saw the view of the Net as a gift from the ivory towers of academia and the military rather than bedroom z80 & 6502 modem culture.

q.v. Fidonet BBS documentary

https://m.youtube.com/watch?v=Dddbe9OuJLU

deepnet··on What I’ve learned from users
How ?

https://stylus-lang.com/

deepnet··on My productivity system
Bit by bit add all the links, phone numbers and information to do the task to the todo, once it is all right there then it becomes much more possible.

You are correct that many tasks cannot be made that small, if they cannot be achieved then the task becomes locate and ask for assistance.

deepnet··on My productivity system
Breaking task down into small single actions can be very helpful for those with executive function disorders.

This is part of GTD.

deepnet··on Omega-3 fatty acids and exercise: a review of their combined effects (2011) [pdf]
“There is no difference between a stick of butter and your brain.”, Hibbeln

- https://www.newscientist.com/article/mg17523575-800-the-happ...

"A study by JR Hibbeln showed that around the world, countries that consume the least amount of fatty fish show the highest levels of major depression (MDD) in their population. And countries where fatty fish is the main diet show the lowest incidence of MDD."

- https://www.loricalabresemd.com/blog/effect-of-fatty-acids/

← PreviousPage 3 of 23Next →