HNHacker News
TopNewBestAskShowJobs

bra-ket

2,953 karma · joined January 25, 2013

submissionscomments
bra-ket··on Ask HN: Why does Pinterest dominate Google text search results?
Facebook users are linking a lot to Pinterest
bra-ket··on University of Helsinki free MOOC on the Ethics of AI
no, I'm saying that "ethics" discourse has been hijacked by militant activists pushing political agenda.
bra-ket··on University of Helsinki free MOOC on the Ethics of AI
Bias is natural and inevitable, and it has to be acknowledged in research. The problem is, liberals want to shut down anyone who disagrees with their own bias. It's not about 'snooping around asking questions', but more like slandering and aggressively silencing people for having a different opinion.

You'd think it would never affect you as a liberal but it was funny to watch Google's very progressive & liberal research leads labeled 'racists', and evil incarnates for standing in the way of the activist mob. I mean they're are still trying to 'cancel' Jeff Dean, of all people, for firing some activist [1], and Nando de Freitas for merely supporting both sides[2].

If this is your ethics discourse, I'd rather AI be unethical.

[1] https://docs.google.com/document/u/0/d/1f2kYWDXwhzYnq8ebVtuk...

[2] https://twitter.com/NandoDF/status/1336030085640548354

bra-ket··on University of Helsinki free MOOC on the Ethics of AI
I think it's premature to talk about "AI ethics" when AI is nowhere to be seen.

In the US this whole "ethics" trend is being used as a tool to politicize and censor research[1].

[1] https://spectator.us/militant-liberals-politicizing-artifici...

bra-ket··on The NeurIPS 2020 broader impacts experiment
> 'Regardless of scientific quality or contribution, a submission may be rejected for ethical considerations, including methods, applications, or data that create or reinforce unfair bias'

In other words science has to pass trough political filter of the day. If reality is wrong, unfair or politically incorrect (in our subjective view), we're going to reject reality.

Prof. Pedro Domingos published a great piece on this https://spectator.us/militant-liberals-politicizing-artifici...

bra-ket··on Google told its scientists to ‘strike a positive tone’ in AI research
Gebru was fired for unprofessional behavior, not because of her research.

Jeff Dean’s letter with details: https://docs.google.com/document/u/0/d/1f2kYWDXwhzYnq8ebVtuk...

bra-ket··on Netflix's Metaflow: Reproducible machine learning pipelines
Netflix actually organized a major machine learning competition more than a decade ago[1] with thousands of the best researchers trying to beat some internal benchmark by a few percent, for $1M prize, I'm wondering where did all that "learning" go.

My guess is that whatever rankings they currently produce maximize some internal revenue target and that target' user base is not me or you.

[1] https://en.wikipedia.org/wiki/Netflix_Prize

bra-ket··on Researchers propose faster, more efficient alternatives to backpropagation
but we did have quite a few advances at the time of the first airplane, for example by that time steam & combustion engines were already invented, which required non-trivial understanding of physics, chemistry and material science was very advanced.

I hold a pessimistic view that we are still in hunter-gatherer mode as it comes to understanding cognition.

bra-ket··on Researchers propose faster, more efficient alternatives to backpropagation
I'd say Gottfried W. Leibniz is the true author, as it's all comes down to calculus. The particular implementation for "neural nets" is just a special case of function minimization by taking derivatives.
bra-ket··on Researchers propose faster, more efficient alternatives to backpropagation
the problem with that analogy is trying to build an airplane before you figured out the laws of physics.
bra-ket··on Researchers propose faster, more efficient alternatives to backpropagation
The best part of the article is a quote by G. Hinton, the father of "deep learning", at the end: "My view is throw it all away and start again, I don’t think that’s how the brain works."
bra-ket··on Alien Hunters Discover Mysterious Signal from Proxima Centauri
how long does it take for this signal to reach Earth?
bra-ket··on MacKenzie Scott, ex-wife of Jeff Bezos, says she gave $4.2B to charity
you can terraform Mars with all those gazillions of charity money, that mostly go to bureaucrats anyway.
bra-ket··on Show HN: An anti-book recommendation tool, to help you escape your echo chamber
The real 'bubble-breaker' for Ayn Rand would be something from Dostoyevsky or Tolstoy.

Not "Secret lives of Millionaires". C’mon man.

bra-ket··on Pichai’s promises do little to quell outrage over Timnit Gebru’s firing
she was fired for toxic behavior - demanding to doxx colleagues, calling for sabotage in mass emails, throwing ultimatums, slandering people on social media.

It was a good call to let her go, way overdue in fact, but very badly handled PR-wise.

bra-ket··on 1MW Molten-Salt Test Reactor by Copenhagen Atomic for €88k [video]
amazingly cheap shipping for 900kg device.

and then you can resell it I assume ("used but in good condition, minor wear & tear, hardly noticeable leftovers of thorium salts")

bra-ket··on 1MW Molten-Salt Test Reactor by Copenhagen Atomic for €88k [video]
regulation
bra-ket··on Google CEO pledges to investigate exit of top AI ethicist
The ends do not justify the means.

What I see is a bunch of bullies forcing their opinions on everyone else, spreading lies and propaganda on media, attacking and 'cancelling' anyone who stands in their way.

Whatever seed of 'social justice' motivation was there, the activist movement completely discredited themselves, and the ideas they so aggressively promote. And the more I interact with them the more it seems their primary motivation is promoting themselves.

bra-ket··on Russian 'doomsday' plane's radio equipment stolen by thieves
never underestimate the lengths American Intelligence will go to (for a couple of bottles).
bra-ket··on YouTube to remove content that alleges widespread election fraud
thanks for proving my point.
bra-ket··on YouTube to remove content that alleges widespread election fraud
yeah, there are 80M people like you and just 74M like me, congratulations.

Both groups are influenced by media and social circles but the first group tends to trust others opinions more, methinks.

The fact mainstream media was pretty much unified in anti-Trump stance strengthen that theory.

If every day for 4 years you hear just how bad is the orange man (from someone you trust) it would definitely shape a certain reality in ones mind.

bra-ket··on YouTube to remove content that alleges widespread election fraud
it's funny the lies this time are coming not from the government but from the opposition and their propaganda machinery.

I'd never consider myself government supporter, but with Trump it's like the last bastion before the country is overrun with far-left SJW hordes swayed by misinformation.

It's ironic the ultimate win for democracy manifests itself in stolen elections.

bra-ket··on Google CEO pledges to investigate exit of top AI ethicist
>"corroborated" stories of dozens

It's a "boy who cried wolf" for me. I've seen these activists promoting lies to us the entire summer of protests for completely made-up causes. I've seen them distorting facts and pushing misinformation through media. I've also seen them bullying people via social media 'witch hunts', which is happening now with Jeff Dean, Nando de Freitas and whoever stands in their way.

The whole activism movement is toxic and whoever brings it to the workplace.

bra-ket··on Google CEO pledges to investigate exit of top AI ethicist
this case had nothing to do with censorship though. It was Gebru' unprofessional conduct - she gave ultimatum to her managers demanding to disclose names of the reviewers who criticized her work or she would resign, and broadcasting emails to entire team literally calling for sabotage.

Her behavior fits the definition of 'toxic employee', it was unprofessional by any standard.

Here is Jeff Dean's letter sent to the Google Research team with the details of what actually happened: :https://docs.google.com/document/d/1f2kYWDXwhzYnq8ebVtuk9CqQ...

bra-ket··on Binary Decision Diagrams (2010)
I wouldn't do it justice[1], it deserves a blog post or a book [2] but in general solving almost any boolean algebra problem, in hundreds, and hundreds of thousands variables, very efficiently and in very compact representation (via ordered sparse bit vectors[3]).

While with Karnaugh maps you can simplify a boolean function with a few variables, BDDs can solve for thousands, fast.

And no need to explain applications of high-dimensional boolean algebra on HN, with boolean algebra you can solve any logic problem expressed as boolean function, any combinatorial problem (except for those with nasty functions), classic graph theory problems.

Surprisingly it allows to solve optimization problems[4], like boolean programming, SAT solver, max independent set or max cut in graphs, very efficiently, it can be used in something like belief propagation or lattice induction for inference, but if that's not enough you can use it for random number generation, lossless compression, perfect hashing, etc, etc.

I haven't seen such a versatile data structure elsewhere, most of the other things developed in the last 35 years, like the ones in the comment below are solving special cases, BDD is truly one of the most fundamental and severely underrated "swiss army knives" (that is in CS, EE people know it very well in logic synthesis and verification, BDD's first "killer app").

It's probably easier to list what you can't do with BDD, kind of like what you can't do with (high-dimensional) boolean logic.

I think it skipped the radar of CompSci community at large because it was too quickly siloed into "that circuit analysis/verification tool used by electrical engineers".

Yes, it's "just" a DAG but with very particular (and very simple) constraints which allow it to solve infinite variety of problems in a very elegant and surprising way [5].

[1] it's really worth watching the lecture on BDDs by Don Knuth , starting around 13:32, his enthusiasm is contagious: https://www.youtube.com/watch?v=SQE21efsf7Y&t=13m32s

Part 2 on ZDD: https://www.youtube.com/watch?v=-HzQYeqS9Wc

[2] TAOCP, volume 4A, Combinatorial Algorithms, p.202 - 280: https://www.amazon.com/Art-Computer-Programming-Combinatoria...

There is a free preprint here https://www-cs-faculty.stanford.edu/~knuth/fasc1b.ps.gz

[3] https://en.wikipedia.org/wiki/Zero-suppressed_decision_diagr...

[4] Bergman, David, et al. "Discrete optimization with decision diagrams." INFORMS Journal on Computing 28.1 (2016): 47-66.

[5] Bryant, Randal E. "Graph-based algorithms for boolean function manipulation." Computers, IEEE Transactions on 100.8 (1986): 677-691.

I hope that answers your question, dang, and sorry for title mishap.

bra-ket··on More than 1,200 Google workers condemn firing of AI scientist Timnit Gebru
the paper was not the problem, her attitude & reaction to peer review was the problem - giving ultimatums, demanding to disclose names of the reviewers, and broadcasting emails to entire team calling for sabotage.

Her behavior fits the definition of 'toxic employee', it was unprofessional by any standard.

bra-ket··on Ask HN: What's the best paper you've read in 2020?
also on neurolinguistics:

Pulvermüller, Friedemann. "Words in the brain's language." Behavioral and brain sciences 22.2 (1999): 253-279.

Pulvermüller, Friedemann. "Brain embodiment of syntax and grammar: Discrete combinatorial mechanisms spelt out in neuronal circuits." Brain and language 112.3 (2010): 167-179.

Buzsáki, György. "Neural syntax: cell assemblies, synapsembles, and readers." Neuron 68.3 (2010): 362-385.

Lau, Ellen F., Colin Phillips, and David Poeppel. "A cortical network for semantics:(de) constructing the N400." Nature Reviews Neuroscience 9.12 (2008): 920-933.

-->On cognitive maps, spacial & abstract navigation:

Bellmund, Jacob LS, et al. "Navigating cognition: Spatial codes for human thinking." Science 362.6415 (2018).

Peer, Michael, et al. "Processing of different spatial scales in the human brain." ELife 8 (2019): e47492.

Kriegeskorte, Nikolaus, and Rogier A. Kievit. "Representational geometry: integrating cognition, computation, and the brain." Trends in cognitive sciences 17.8 (2013): 401-412.

Mok, Robert M., and Bradley C. Love. "A non-spatial account of place and grid cells based on clustering models of concept learning." Nature communications 10.1 (2019): 1-9.

Chrastil, Elizabeth R., and William H. Warren. "From cognitive maps to cognitive graphs." PloS one 9.11 (2014): e112544.

-->On graph navigation and 'rich club' networks:

Watts, Duncan J., and Steven H. Strogatz. "Collective dynamics of ‘small-world’networks." nature 393.6684 (1998): 440-442.

Kleinberg, Jon M. "Navigation in a small world." Nature 406.6798 (2000): 845-845.

Ball, Gareth, et al. "Rich-club organization of the newborn human brain." Proceedings of the National Academy of Sciences 111.20 (2014): 7456-7461.

Malkov, Yury A., and Alexander Ponomarenko. "Growing homophilic networks are natural navigable small worlds." PloS one 11.6 (2016): e0158162.

Givoni, Inmar, Clement Chung, and Brendan J. Frey. "Hierarchical affinity propagation." arXiv preprint arXiv:1202.3722 (2012).

--> On concept formation, memory & generalization

Bowman, Caitlin R., and Dagmar Zeithamova. "Abstract memory representations in the ventromedial prefrontal cortex and hippocampus support concept generalization." Journal of Neuroscience 38.10 (2018): 2605-2614.

Garvert, Mona M., Raymond J. Dolan, and Timothy EJ Behrens. "A map of abstract relational knowledge in the human hippocampal–entorhinal cortex." Elife 6 (2017): e17086.

Collin, Silvy HP, Branka Milivojevic, and Christian F. Doeller. "Hippocampal hierarchical networks for space, time, and memory." Current opinion in behavioral sciences 17 (2017): 71-76.

Kumaran, Dharshan, et al. "Tracking the emergence of conceptual knowledge during human decision making." Neuron 63.6 (2009): 889-901.

DeVito, Loren M., et al. "Prefrontal cortex: role in acquisition of overlapping associations and transitive inference." Learning & Memory 17.3 (2010): 161-167.

Gallistel, Charles Randy, and Louis D. Matzel. "The neuroscience of learning: beyond the Hebbian synapse." Annual review of psychology 64 (2013): 169-200.

Martin, A., and W. K. Simmons. "Structural Basis of semantic memory." Learning and Memory: A Comprehensive Reference. Elsevier, 2007. 113-130.

Zeithamova, Dagmar, Margaret L. Schlichting, and Alison R. Preston. "The hippocampus and inferential reasoning: building memories to navigate future decisions." Frontiers in human neuroscience 6 (2012): 70.

Tenenbaum, Joshua B., and Thomas L. Griffiths. "Generalization, similarity, and Bayesian inference." Behavioral and brain sciences 24.4 (2001): 629.

bra-ket··on Ask HN: What's the best paper you've read in 2020?
sure, my email is in my profile.

I'm not an expert though, just curious about "mind computations".

bra-ket··on Ask HN: What's the best paper you've read in 2020?
Some CogSci & Neuro papers I found interesting in 2020:

Constantinescu, Alexandra O., Jill X. O’Reilly, and Timothy EJ Behrens. "Organizing conceptual knowledge in humans with a gridlike code." Science 352.6292 (2016): 1464-1468.

Kriegeskorte, Nikolaus, and Katherine R. Storrs. "Grid cells for conceptual spaces?." Neuron 92.2 (2016): 280-284.

Klukas, Mirko, Marcus Lewis, and Ila Fiete. "Efficient and flexible representation of higher-dimensional cognitive variables with grid cells." PLOS Computational Biology 16.4 (2020): e1007796.

Moser, May-Britt, David C. Rowland, and Edvard I. Moser. "Place cells, grid cells, and memory." Cold Spring Harbor perspectives in biology 7.2 (2015): a021808.

Quiroga, Rodrigo Quian. "Concept cells: the building blocks of declarative memory functions." Nature Reviews Neuroscience 13.8 (2012): 587-597.

Stachenfeld, Kimberly L., Matthew M. Botvinick, and Samuel J. Gershman. "The hippocampus as a predictive map." Nature neuroscience 20.11 (2017): 1643.

Buzsáki, György, and David Tingley. "Space and time: The hippocampus as a sequence generator." Trends in cognitive sciences 22.10 (2018): 853-869.

Umbach, Gray, et al. "Time cells in the human hippocampus and entorhinal cortex support episodic memory." bioRxiv (2020).

Eichenbaum, Howard. "On the integration of space, time, and memory." Neuron 95.5 (2017): 1007-1018.

Schiller, Daniela, et al. "Memory and space: towards an understanding of the cognitive map." Journal of Neuroscience 35.41 (2015): 13904-13911.

Rolls, Edmund T., and Alessandro Treves. "The neuronal encoding of information in the brain." Progress in neurobiology 95.3 (2011): 448-490.

Fischer, Lukas F., et al. "Representation of visual landmarks in retrosplenial cortex." Elife 9 (2020): e51458.

Hebart, Martin, et al. "Revealing the multidimensional mental representations of natural objects underlying human similarity judgments." (2020).

Ezzyat, Youssef, and Lila Davachi. "Similarity breeds proximity: pattern similarity within and across contexts is related to later mnemonic judgments of temporal proximity." Neuron 81.5 (2014): 1179-1189.

Seger, Carol A., and Earl K. Miller. "Category learning in the brain." Annual review of neuroscience 33 (2010): 203-219.

Neurolinguistics:

Marcus, Gary F. "Evolution, memory, and the nature of syntactic representation." Birdsong, speech, and language: Exploring the evolution of mind and brain 27 (2013).

Dehaene, Stanislas, et al. "The neural representation of sequences: from transition probabilities to algebraic patterns and linguistic trees." Neuron 88.1 (2015): 2-19.

Fujita, Koji. "On the parallel evolution of syntax and lexicon: A Merge-only view." Journal of Neurolinguistics 43 (2017): 178-192.

bra-ket··on Binary Decision Diagrams (2010)
not my words but Don Knuth's from his lecture "Fun With Binary Decision Diagrams" at Stanford in 2008: https://news.ycombinator.com/item?id=25342643

it's really amazing what you can do with it.

← PreviousPage 3 of 17Next →