HNHacker News
TopNewBestAskShowJobs

romaniv

2,750 karma · joined February 2, 2011

submissionscomments
romaniv··on Google's AlphaZero Beats Stockfish In 100-Game Match
What I'm reading: an existing chess engine that runs on much poorer hardware and for some weird reason was deprived of its usual initialization data achieved 73% draw rate against a ridiculously hyped "deep" neural network/MCTS algorithm.

It's interesting that AlphaZero was finally applied to a different game, though. I wonder what architectural changes they had to make. I've read that pure MCTS isn't that good at playing Chess. How true is that?

romaniv··on Leela Zero – Go engine with no human-provided knowledge
I think this is a very interesting idea. Except I would probably use a random forest instead of ANN for something like this. It is trivially parallelizable, you can train on subsets of features, you can slit and merge your ensembles/forests and so on.
romaniv··on Leela Zero – Go engine with no human-provided knowledge
> Recomputing the AlphaGo Zero weights will take about 1700 years on commodity hardware

We're seeing the reversal of PC revolution and most people don't seem to notice or care.

romaniv··on Oberon – The Overlooked Jewel [pdf]
Those languages are simple to learn. And it's not necessarily about the language anyway. Also, two of those three operating systems were developed by couple dozen people at most, so you shouldn't need hundreds of programmers, as long as the ones you have are competent.
romaniv··on Oberon – The Overlooked Jewel [pdf]
One would think that in 2017 we would be using an OS that takes the best ideas from Xerox Park/Star, Oberon and Cloud 9. At least on new devices (like tablets) which don't have to keep backward compatibility.
romaniv··on What is a Source Map
Smaller files are never a bad thing in themselves, but increasingly complex toolchains have a maintenance cost that people don't seem to notice. And I'm not just talking about making them work. I'm talking about everything, including choosing, learning, upgrading, replacing, dealing with problems people talk about here and even reading this article.

I'm not sure how we got to the point where something that worked without minification on year 2000 networks no longer works without per-processing on year 2017 networks.

romaniv··on Reality vs. Kurzweil’s expectations
If you want an example of clear thinking about the future, I highly recommend reading Summa Technologiae by Stanislaw Lem. Instead of predicting low-level tech advances he speaks about what drives technology development in general and drafts several possible trajectories for the future. I've only read it this year and the sheer fact that a 1964 book about technology doesn't seem hopelessly outdated in 2017 speaks in its favor.
romaniv··on Using SVG as image placeholders
>To use progressive JPG, you have to pre-recode (if you don't have money to dish out for FPGA to recode on the fly) and store recoded images.

Not sure why progressive JPG isn't the default. It's not any larger.

romaniv··on How to Get Rich Playing Video Games Online
>There are legions of people that watch these streams, just to watch someone doing something that they could do themselves (but maybe not win as much).

This is an interesting comment. I watch couple of streamers regularly, but not in real-time. I just watch their content on YouTube.

Why?

Some of them actually put good effort into creating interesting in-game situations and running entertaining commentary. It's less of a reality show and more of a comedy/talk show. Maybe.

Some of them are very good at the game, and watching the stream is an opportunity to learn something new. If the game is competitive, it sort of makes sense.

But overall, I agree that streaming and YouTube are becoming the new TV. Maybe the motivations I outline above are somewhat pathological in the sense that they don't justify the time spent on such simplistic entertainment.

A lot of videos are about competitive online games, and come to think of it the direct experience in those games isn't always great. For example, when you're watching a game on YouTube it's effectively per-selected. This way you can "skip" the games that are boring or have something broken or have annoying/rude players. You can cancel/pause at any time without loosing rank or annoying other people. In some ways it's a sad state of affairs. Games should be entertaining in their own right.

romaniv··on WebAssembly support now shipping in all major browsers
IE can account for a fraction of total traffic, but it still can affect large percentage of users. The same person can use several devices (work, home, mobile) to browse the web at different times. I can't recount how many times I saw some page at work only to send myself the link to read it later. I'm not forced to use IE anywhere, but if I were, loosing that initial visit would also lower the number of visits from other browsers.
romaniv··on Cornell Natural Language Visual Reasoning Dataset
Pretty amazing.

It seems today people write off those demos as showy, shallow and misleadingly optimistic. But if you think about it, the exact same thing can be said about modern ML demonstrations. A lot of them hint at nearly human-level intelligence, but that's often achieved through careful restriction on the problem domain and by choosing the most successful examples.

Considering that old-school AI was operating on laughable hardware with tiny hand-made datasets, with no crowd-sourcing options... I wonder, did attempts to generalize some of that research fail because the approach was fundamentally flawed, or was it because such efforts themselves weren't as good as initial projects?

I mean, the article on Wikipedia talks about "more realistic level of ambiguity and complexity", but the demonstrated domain is already more complex than 90% of all programming problems I solve on day-to-day basis.

* * *

I though Minsky also did something similar, but with physical blocks and a robotic arm, and without the NLP interface. Anyone knows about that? Or am I making it up? I was looking for info about this recently and couldn't find anything.

romaniv··on Senators push to ditch social security numbers in light of Equifax hack
On the other hand, there are countries that use national IDs to restrict the freedom of their citizens.

You can't base your reasoning about something like this solely on what's happening in some countries right now. That's how SSN mess started in the first place. They weren't intended as a global identifier, there were concerns that they will be used as such, but those concerns were ignored.

Also, I'm not convinced that spinning up a new ID system is necessary to solve the issue at hand.

romaniv··on How Adversarial Attacks Work
> They are only "essential" properties according to the limitations of your particular perceptual system. To a bee that can see UV light, a stick bug may look entirely different from an actual stick. An animal that hunts by scent would find them clearly distinct.

This is a very confused statement. Fist, since we are talking about image recognition we are - by definition - talking about vision in the spectrum that can be captured by a digital camera and encoded in a typical image format. Second, there definitely is such a thing as essential property. It is a matter of correlation with reality, as well as internal consistency. For example, plants are green and have leaves because of the way they use sunlight. So permuting color of all leaves in the picture is fundamentally different from permuting luminosity of some random pixels.

romaniv··on Almost everything on computers is perceptually slower than it was in 1983
The thing that horrifies me about all of this is that instead of criticizing or fixing issues most people adapt what they do and even how they think to match all the deficiencies in software. Often, users simply can't imagine systems that work fundamentally differently and better. Often, when deficiencies are pointed out people start defending the mess and pointing out all the clever (half-assed, really) workaround and hacks they came up with. They are proud of all the time they spent (wasted) learning about obscure and counter-intuitive software functionality. They are proud that barely-working plugin/extensions/add-on they found and set up. All of that to do thing that should be trivial to begin with.

One counter-point, though.

> I make no secret of hating the mouse.

If you look at the original uses of the mouse it was great. Especially in systems like Xerox Star. Star allowed people to perform complex tasks with almost no learning curve.

https://www.youtube.com/watch?v=Cn4vC80Pv6Q

(Note how they weren't shy of using keyboard either. There are dedicated hardware buttons for standard commands like copy, find, repeat, "properties" and even for common text editing actions. Meanwhile, our keyboards don't have dedicated keys for undo, redo, cut, copy and paste - operations that are used in almost every application today.)

Trouble is, we lost most of the driving ideas behind Xerox-style interfaces. Using a predefined set generic, powerful commands. Object-oriented UI. Uniformity of representations. Modern system have those things only as vestigial traits and in very limited contexts.

I don't think there were any quantum leaps in conceptual UI design since Xerox Park times. There were some minor improvements in very specialized apps and significant regression in software that's used universally. For examples, phones and tables almost completely lost drag-and-drop functionality and generic file UI.

For example, drag-and-drop is a very powerful concept, because it allows you to perform actions by combining things you already know about - and those "things" figure out how to interact in the best way possible. So, for example, instead of having N "Print" buttons in N applications you can have a singe drag-file-onto-printer-icon action that does different things based on the type of the file. [BTW, this is also the key idea behind the original notion of OOP.] Unfortunately, that's not how it works in modern UIs. They don't use either the keyboard or the mouse to their full potential.

romaniv··on How Adversarial Attacks Work
The comparison in disingenuous. This illusion has nothing to do with image classification and heavily relies on adding misleading context to the object to alter the perception of one of its properties. Most optical illusions are like that. That is not what is being done with adversarial examples.
romaniv··on How Adversarial Attacks Work
Problem is, mimicry involves copying essential properties of the target object: color, texture, shape, movement dynamics and so on. It relies on true ambiguity. Adversarial examples against neural networks (the interesting ones, anyway) involve a combination of insignificant, seemingly random permutations that only work in their totality. That's a very important difference.
romaniv··on The Future of Programming (2013)
Yeah. Almost every time I watch a Marvin Minsky or Alan Kay video of any kind I'm surprised with info on some awesome technology or research from the 60s or 70s.
romaniv··on AlphaGo Zero: Learning from scratch
This just illustrates that surpassing "human level" performance is a silly and arbitrary benchmark, because there is no such thing as general human level performance. But I bet Kasparov would be pretty good at Go, and Sedol would be pretty good at chess.

Universality is the real hard problem of AI. In the long run, a mediocre AI that does a lot of different things is far more useful that most targeted "superhuman" AIs. Most domains simply don't require better-than-human performance, but could still reap tremendous benefits from automation.

romaniv··on AlphaGo Zero: Learning from scratch
> They have a new reinforcement learning algorithm that should be generically applicable to anything where a long sequence of moves results in a specifically gradable outcome.

Statements like these always make me wonder why certain obvious things weren't tried. If it's so generic, why wasn't it tried on Chess? Or was it tried, failed to impress and thus didn't make it into the press release?

This is a big problem with all these public discussion on AI. Almost no one speaks about algorithm failures. I haven't seen a single research paper that said "oh, and we also tried algorithm in X domain and it totally sucked".

romaniv··on Librem 5 Phone Funded
>It's honestly very difficult to imagine how a small group, no matter how talented and driven, can possibly succeed where open source giants Canonical and Mozilla couldn't.

How many people worked on Xerox Alto? They had to do everything from scratch, including bootstrapping their own tools and they had far worse computing capabilities/hardware available to them at the time.

romaniv··on Facebook Quietly Enters StarCraft War for AI Bots
Didn't they restrict the game to a single hero and a subset of all items to make it tractable for AI? And didn't people find a way to break that bot?
romaniv··on IBM pitched Watson as a revolution in cancer care, but it’s nowhere close
>Pretty much all attempts at AI are pattern recognition systems.

All attempts in modern AI. Most interesting research from the 60s and 80s wasn't based on pattern recognition.

romaniv··on Why I hate your Single Page App
. - If I mis-enter information into a form, your error handling forgets all my information and I have to re-enter it.

Funny that you mention it. Loosing form data on page refresh or clicking "back" button was a problem on the Web until browsers started keeping form state along with page history. Suddenly millions of websites got this new feature without actually doing anything differently. But that was only possible because page transfers were semantic. Frameworks of that time that tried to manage their own form state (like ASP.NET WebForms) didn't have real page transfers, so they didn't get this "upgrade" and currently are significantly worse off in terms of usability.

I think there is a lesson here.

romaniv··on Why I hate your Single Page App
. - If I mis-enter information into a form, your error handling forgets all my information and I have to re-enter it.

This was fixed in browsers years ago when they started keeping form state along with page history. I can refresh this page, go back and forth in history, and this text box will keep my comment. Ironically, websites that tried to be clever about form state management and faked page transfers (like ASP.NET WebForms) didn't benefit from the fixes and currently are significantly worse off in terms of usability than websites that used vanilla forms.

I think there is a lesson here.

romaniv··on Ask HN: What is your favorite CS paper?
I don't have a favorite research paper, but there is a long Ph.D. thesis I've recently read in its entirety and found a lot of interesting ideas:

Programming with Agents: http://alumni.media.mit.edu/~mt/thesis/mt-thesis-Contents.ht...

Here is a short paper with a clear description of an ingenious idea.

Engineered Robustness by Controlled Hallucination: http://web.mit.edu/jakebeal/www/Publications/NIAI-2008.pdf

I like the simplicity of it. Most CS researches seem to be afraid of describing things that are simple, even if those things are non-obviosu and valuable.

romaniv··on The Web in 2050
If I was to bet, I would bet that in 2050 the web will be mostly replaced by some kind of VR network with a lot of sound, 3D videos and interactive objects. The web as it is already decays due to tons legacy cruft, insane complexity of doing trivial things, oceans of bad content and hyper-centralization. And all of these things are getting worse every year. VR is our best bet for a clean start.
romaniv··on Custom Elements v1: Reusable Web Components
It's one of the biggest problems in fronted development right now and it's something conceivably can be addressed by the... well, let's call it "guiding structural paradigm" for the lack of a less pretentious term.
romaniv··on Custom Elements v1: Reusable Web Components
It's true that I don't know for sure, but I haven't seen any citations, or verbal references, or any similarities in the APIs that would indicate familiarity with the relevant research I had in mind.

Also, a lot of research in this field is done through working proof-of-concept systems, so there is no point in implying that those designs don't work "in practice".

romaniv··on Firefox 55 and Selenium IDE
UI-level tests are the only kind that reliably test the full stack of your application. No amount of unis testing will catch a missing button or a wrong config setting.

And while recorders present some challenges, manually coding UI-level tests make the maintainability issue an order of magnitude worse.

The best way to make web UI tests stable is to involve engineers and make sure that the pages are structured in the way that make automation and validation easy. Usually the changes required for this are trivial. When they're not, it often points out something in the UI that doesn't make sense anyway, like having no confirmations for user actions.

And in any case, automated UI tests are still better than manual UI test, which is what a lot of people are stuck with.

romaniv··on Firefox 55 and Selenium IDE
We started to adapt Selenium IDE to allow people who don't have extensive coding backgrounds to automate manual testing they're already doing. It provided massive time savings when used properly. This news will likely completely kill the initiative.
← PreviousPage 8 of 30Next →