HNHacker News
TopNewBestAskShowJobs

iblaine

716 karma · joined May 6, 2012

Data Engineer doing Data Engineer things www.iblaine.com
submissionscomments
iblaine··on Amazon Quantum Ledger Database
https://cacm.acm.org/news/232751-quantum-clouds-leap-ahead/f...

If Quantum computers become a thing, then coining a new database 'QLDB', is a bad idea, despite what 'quantum' may mean in the dictionary.

iblaine··on Amazon Quantum Ledger Database
The idea is immutable micro-transactions to track operations in a complex inventory system. Consider a situation where a customer finds a nail in their banana. This 'blockchain' db could be used to recognize where the banana was sold, what truck delivered it, where that specific banana and was sourced.

It can be an interesting solution or vaporware depending on your level of interest. I personally think micro-transactions and blockchain do not go well together but reading debates about the tech is still interesting.

iblaine··on Amazon Quantum Ledger Database
QLDB = Quantum Ledger Database

Seeing 'quantum' in that acronym is so cringeworthy. I'd prefer Immutable Ledger Database, or a word that shares more with the technology than media hyperbole.

iblaine··on Engineers Shouldn’t Write ETL
Airflow and tools like it are probably the biggest reason for the shift. Another issue is the need to integrate different technologies requires having the skills of a software engineer.

When the landscape for tech in DE was oracle, mysql and Cognos, DE's didn't need to know about OOP or consensus algorithms. Because the landscape now includes hadoop, redshift, kafka, spark, airflow, notebooks, TiDB and lord knows what else, DE's need to have most of the skills of a software engineer to be successful.

iblaine··on A Tale of Two Kickstarter Campaigns: A $500K Difference from Marketing
The same arguments can be made for Beats headphones. There are better products for less money but your average consumer is not going to figure that out. It follows to say that the Public Relations industry has more value than most engineers realize.
iblaine··on Q: Run SQL Directly on CSV Files
> Have you ever stared at a text file on the screen, hoping it would have been a database so you could ask anything you want about it?

Not really. I could see this being helpful for debugging, but at that point you can get by with some simple bash string operations. Doing that same operation w/SQL seems like overkill.

iblaine··on Elon Musk on working 120 hours a week: You'll go 'bonkers'
> Musk said while "80 is pretty sustainable," the increase in suffering when you work more than that is dramatic. "The pain level for hours increases exponentially. It's like nonlinear above 80," Musk said

Sounds about right. Below 80 you can still set aside a few hours or maybe most of day on the weekend for yourself. Above 80 starts to get interesting. Weekends are no long yours and days bleed into each other.

iblaine··on Engineers Shouldn’t Write ETL
> March 16, 2016

It's 2018. A lot has changed since 2016. The line between sw engineering & data engineering is much thinner.

iblaine··on The Growth of Reddit
Over the past few years, both Twitter and Reddit have seen a huge growth of bot accounts. I'd put an asterisk next to any growth* figure by either company.
iblaine··on Uber’s Big Data Platform: 100+ Petabytes with Minute Latency
Being litter with tools is not necessarily a bad thing. A tool is a modular reusable component that acts a building block for something more complex.

Consider Netflix. They are big open source contributors to the data industry. Many of their tools interest me because I can see their value outside of Netflix. Uber on the other hand is solving esoteric problems with esoteric solutions.

iblaine··on Peloton raises $550M at a valuation of $4B
Small installments seem to be gaining traction. With video games, it's micro transactions. With large ticket items, it's installments. I'd never expect an exercise bike to be part of this trend but here we are.
iblaine··on Show HN: Musoq – Use SQL on various data sources
Pretty cool project. If you're someone dealing with disparate data types, this may be useful. That is a rare need, but interesting none the less.

Typically you create a connector once then walk away from it. Maybe this tool solves the problem of having to create that connector.

iblaine··on Why you should not use Google Cloud
"Why you should not use Google Cloud" if you're a small business. A large business will have contacts, either on their own or through a consulting firm, that can call Google employees and get help. As a small company, you're at the mercy of what Google thinks is adequate support for the masses.
iblaine··on Classic 1984 video game Robot Odyssey available online
Wow, I spent so much time on this game. The minecraft of its era.
iblaine··on I Don’t Believe in Full-Stack Engineering
Full stack engineer means knowing CS fundamentals. With that you can do most anything, except good UI/UX development. Leave that to the web developers.
iblaine··on Launch HN: The Lobby (YC W18) – 1-on-1 calls with company insiders to get hired
First thing that comes to my mind is will any of these calls violate part of an employment agreement.

Consider a tech company that has unique problems for candidates to solve. A service like this could encourage an employee to get paid to release these problems to the public. In theory you'd hope an NDA stops this type of thing, but in practice a bit of money could incentivize people to do otherwise.

iblaine··on MtGox: Announcement of Commencement of Civil Rehabilitation Proceedings [pdf]
I had money in mtgox. I tried checking for proof of claim a few months ago and their website was broken.
iblaine··on Show HN: Why Do I Procrastinate? – Web MD for Procrastination
Site needs a favicon.ico
iblaine··on Tesla short sellers lose $1B
Reminds me of Bill Ackman's bet against Herbalife.
iblaine··on Reddit just passed Facebook as #3 most popular website in US
But which site gets more traffic from Russian bots, facebook or reddit?
iblaine··on How We Found Great Talents for Our Remote Company Without Spending a Fortune
I fully expected to see jobs for 'Media Marketing Ninja' or 'Social Media Hacker', but the jobs listings are normal. Was not surprised to see it's an SEO company. Making the internet a better place one backlink at a time!
iblaine··on How I Write SQL, Part 1: Naming Conventions (2014)
> Avoid reserved words

Glad you cleared this up for the rest of us.

FWIW, naming conventions are like opinions. Everyone has them, and they usually differ from person to person. The best naming convention is a consistent naming convention. Also, naming conventions differ greatly by environment. A group of SQL Server engineers are going to have different standards than those of people working on mysql.

iblaine··on Coinbase acquires Earn.com
Wow, that was fast.
iblaine··on CoinTracker raises $1.5M to make tracking cryptocurrency investments easy
I wish people would refer to crypto as a service and not an investment. The goal of these alt coins is to enable services. People are doing a disservice to the industry by referring to them or using them as an investment.
iblaine··on Facebook is banning all ads promoting cryptocurrencies
People are shilling ICOs like they're selling a discounted big mac. The SEC doesn't like it. Surely Facebook recognizes this and is protecting themselves.
iblaine··on ICOs at the End of 2017: What We Think We Know and What We Don't Know
Tell that to the taxi drivers who are now selling their once coveted medallions at a loss.
iblaine··on The Equifax Hack Didn't Have to Be This Bad
SWIM used to have access to Equivax data from home. In the early 90s, you could log into Equifax, type in a strangers address, and get their credit history, social, bills, and prior addresses among other things. Access was through tymnet using an <account_id>+<password>. That is it. The account_id was a ~16 digit number. The password was a 1 alpha + 1 alphanumeric. In those days it was security through obscurity, so I presume. Get an account number and after 936, you are in. Given this recent breach has nothing to do with how Equivfax/CBI was run years ago, it does make me cringe a bit.
iblaine··on U.S. probes Uber for possible bribery law violations
Every large, 100+ person sharing economy company has done this. I'm a former employee at one of them. I'd bet my 401k on it.
iblaine··on Reddit raises $200M at a $1.8B valuation
I completely agree. Part of what has made reddit great has been being scrappy. Reddit hardly had the resources to roll out new features. Like craigslist, the site has remained relatively unchanged over the years. This $200M will be used to expand the operations. The new employees will be put to work on new features. And those new features are going to kill reddit. It'll be like Digg all over again.
iblaine··on Lyft's Business Is Growing Faster Than Uber's
Sure, it's easier to go from 100 to 110 rides than it is to go from 200 to 220 rides. As they say, there are lies, damned lies and statistics.
← PreviousPage 7 of 14Next →