HNHacker News
TopNewBestAskShowJobs

iblaine

716 karma · joined May 6, 2012

Data Engineer doing Data Engineer things www.iblaine.com
submissionscomments
iblaine··on Ask HN: Who is hiring? (November 2019)
One Medical | San Francisco, CA | Full-time | https://www.onemedical.com/careers/ One Medical is the fastest-growing primary care system in the country with over 70 locations in major cities nationwide. You’ll find us in Boston, Chicago, Los Angeles, New York, Phoenix, Seattle, the San Francisco Bay Area, Washington, DC and most recently, San Diego.

Core technologies: Angular 7, Python, AWS, Spark, Ruby, MySQL, Android, GraphQL, REST, Java, Cypress, Hadoop, PySpark

- Senior Infrastructure Engineer (Data) - https://www.onemedical.com/careers/all-departments/1455513/

- Principal Software Engineer (Fullstack) - https://www.onemedical.com/careers/all-departments/1152584/

- Senior QA Engineering Manager - https://www.onemedical.com/careers/all-departments/1636119/

- Clinical/IT/Legal/Marketing/Operations/Sales/etc - https://www.onemedical.com/careers/all-departments/

In my own words, One Medical is a technology company that exists within the health care industry. It's inclusive, you work on problems that provide measurable benefits to peoples lives, we had a big group going to Grace Hopper, and it's in a hyper growth phase. If you're in San Francisco or willing to relocate, I'd encourage you to check it out.

iblaine··on We need new data books, so we started one: Cloud Data Management
I see Panoply is part of this effort. Panoply creates a lot of spam on hackernews, reddit, twitter, and elsewhere.

As an example, doing ETL with drag n drop tools, and not in code, is a dying skill in the industry.

[edit] Basically I'm wary of companies commenting on data standards, where those same companies also sell a product in the data industry. You're probably going to find more honesty on guidelines from open source contributors like LinkedIn, Netflix, Sitchfix, etc.

iblaine··on I Accidentally Uncovered a Nationwide Scam on Airbnb
It's Oct 31st so this thread seems like a good place to post Airbnb horror stories.

The first Airbnb I rented was part of an interview at Airbnb. I was given a credit for a free Airbnb for the purpose of experiencing the product. The Airbnb I rented was in San Francisco and clearly used only as an Airbnb rental.

The second Airbnb I rented was with my family while on vacation in Italy. One afternoon we returned to find out the locks were changed. This was scheduled building maintenance and I was not notified. I chose a place with a special ~'locals badge' only to find out the owner was an American living in the US.

Given this is a tiny sample, Airbnb generally seems to have a problem with borderline fraud.

iblaine··on The benefits of a more asynchronous workplace
This article conveniently overlooks problems when remote workers need supervision to keep them in line with expectations. I’ve had both good and bad experiences managing remote teams. The difference seems to be the quality of the remote workers. The quality of a remote persons work is inversely proportional to the supervision they require.
iblaine··on Ken Thompson's Unix Password
This brings back memories of a common exploit w/tftp, such that you could download an unshodowed /etc/passwd file from a remote machine, decrypt it, log into that remote system, collect new hosts from /etc/hosts, then rinse and repeat. Hash rate were pretty slow back then, but the fact that people used passwds straight out of dictionaries helped, so I'm told...
iblaine··on SQL queries don't start with SELECT
"SQL queries don't start [optimizing] with SELECT"

The title is missing a word. Interestingly, part of the industry is moving towards databases that optimize themselves (ex Snowflake & Oracle Autonomous Database), plus projects that do it for you (Apache Calcite).

iblaine··on New In Postgres 12: Generated Columns
1% of the people that want this feature are surely thrilled. It is a cool feature. The other 99% of us are looking at this like a potential land mine that will show up unsuspectingly when trying to refactor old code, or migrating from postgres.
iblaine··on Starship Prototype Unveiled
Musk thinks like a software engineer. Create simple, reusable, components that can scale efficiently. I’m taking some liberties in saying this, but the gist remains the same. Musk keeps it simple and focused.
iblaine··on Ask HN: Who is hiring? (September 2019)
One Medical | San Francisco, CA | Full-time | https://www.onemedical.com/careers/

One Medical is the fastest-growing primary care system in the country with over 70 locations in major cities nationwide. You’ll find us in Boston, Chicago, Los Angeles, New York, Phoenix, Seattle, the San Francisco Bay Area, Washington, DC and most recently, San Diego.

Core technologies: Angular 7, Python, AWS, Spark, Ruby, MySQL, Android, GraphQL, REST, Java, Cypress, Hadoop, PySpark

- Senior Infrastructure Engineer (Data) - https://www.onemedical.com/careers/all-departments/1455513/

- Principal Software Engineer (Fullstack) - https://www.onemedical.com/careers/all-departments/1152584/

- Senior QA Engineering Manager - https://www.onemedical.com/careers/all-departments/1636119/

- Clinical/IT/Legal/Marketing/Operations/Sales/etc - https://www.onemedical.com/careers/all-departments/

In my own words, One Medical is a technology company that exists within the health care industry. It's inclusive, you work on problems that provide measurable benefits to peoples lives, we have a big group going to Grace Hopper, and it's in a hyper growth phase. If you're in San Francisco or willing to relocate, I'd encourage you to check it out.

iblaine··on Show HN: Prophecy.io – Cloud Native Data Engineering
Very cool that you can go between drag-n-drop and code for development. How is Prophecy different from datacoral.com or Astronomer.io? Will it be open sourced (ex, dbt, airflow, Dagster)?
iblaine··on The reliability pillar of the AWS Well-Architected Framework [pdf]
Thank you
iblaine··on The reliability pillar of the AWS Well-Architected Framework [pdf]
Interesting that security is 1 of 5 pillars and hardly gets a mention in this paper. Who wrote this and why?
iblaine··on Google Search is routinely gamed by private blog networks
Ah yes, the home contracting industry is ripe for SEO due to so many long tail keywords. A project I'm not proud of managed to get 100M pages indexed (about 1% of Google at the time), all related to home contracting services. This was done with a combination of using mod_rewrite to manufacture unique URLs, creating a CMS platform, hiring students to write content, using natural linking algorithms, and some software to automate creating unique inbound links from wikis/blogs to deep URLs. Sad to see the same kind of thing can be done today. I regret not putting that effort towards something more productive, but when you're in advertising, the race to the bottom can be tempting.
iblaine··on Ask HN: Can we create a new internet where search engines are irrelevant?
This is true, and DMOZ was used heavily by Google's earlier search algorithms to rank sites within Google. Early moderators of DMOZ had god like powers to influence search results.
iblaine··on Ask HN: Can we create a new internet where search engines are irrelevant?
Yes, it was called Yahoo and it did a good job of cataloging the internet when hundreds of sites were added per week: https://web.archive.org/web/19961227005023/http://www2.yahoo...

I'm old enough to remember sorting sites by new to see what new URLs were being created, and getting to that bottom of that list within a few minutes. Google and search was a natural response to solving that problem as the number of sites added to the internet grew exponentially...meaning we need search.

iblaine··on Google Calendar Is Down
Google Calendar being down for nearly an hour settles it. No meetings today. Everyone is free to 'work from home'!
iblaine··on Google to Acquire Looker
Before this acquisition: Looker > Tableau > QlikView > Superset (now preset.io)

After this acquisition: Superset (now preset.io) > Looker > Tableau > QlikView

Now that Looker is owned by a corporation, the innovation is going to diminish. The creative forces will cash out and move on. I think Superset is going to fill the void that these BI corporations leave behind.

iblaine··on Relicensing CockroachDB
Quicksort is an algorithm, a copyright on it would not hold up, but a creative use of it may hold up. Kafka is not part of the public domain, but available through an open source license, that AWS is arguably exploiting to make some money off the back of open source contributors.
iblaine··on Relicensing CockroachDB
Even if cloud providers give back more than they take, there nothing legally stopping them from stealing an open source project as their own. The Business Source License (BSL) seems like a good reaction. What Amazon did to confluent.io and so many others seems pretty cold hearted.
iblaine··on Andreessen invests $22M in PlanetScale’s database-as-a-service
What kind of customers is PlanetScale going after and how does the product compare? This seems like a very niche product.
iblaine··on Ask HN: Who is hiring? (June 2019)
One Medical | San Francisco | Onsite | https://www.onemedical.com

At One Medical we are passionate about revolutionizing the primary care industry by offering a new approach to primary care. We combine people-centered design, technology, and a team of talented health care providers to give our members an amazing experience.

One Medical is the fastest-growing primary care system in the country with over 70 locations nationwide in Boston, Chicago, Los Angeles, New York, Phoenix, Seattle, the San Francisco Bay Area, and Washington, DC.

Open roles: All Departments, Software Engineer (Fullstack), Senior Infrastructure Engineer (Data), Project Management, Marketing, Finance, Sales

Here are our open roles: https://www.onemedical.com/careers

(I work as a Sr Data Engineer at One Medical. We're solving meaningful problems, it's a great company, and I encourage you to check it out.)

iblaine··on Maintainable ETL Practices at Stitchfix
One comment is CTEs don’t use indexes, so you may want to avoid using them in production code. That’s something to consider if you may need to port code to/from databases where indexes may be available.
iblaine··on One SQL to Rule Them All: Management of Streams and Tables
Is the point of this paper that SQL should be used to in streaming data pipelines? Aren’t people doing this already?
iblaine··on Ask HN: How do I represent a hierarchy in RDBMS?
One possible solution is a junction table: https://en.wikipedia.org/wiki/Associative_entity

An RDBMs within indexes is probably fine.

iblaine··on Scalable Python Code with Pandas UDFs
Great, glad this was confirmed as I am about to solve a similar problem and my expectation is that Apache Arrow will be needed. So pyarrow = Apache Arrow.
iblaine··on Scalable Python Code with Pandas UDFs
Could this same problem be solved by using Apache Arrow, to convert to/from pandas, and cut down the complexity in the process?
iblaine··on We Can Do Better Than SQL
Academically, EdgeDB is very interesting, but practically, it seems to be solving a problem that does not exist. SQL is great for simple set operations and will lose its efficiency as you move towards more advanced features. The industry has accepted SQLs limitations and created new ways to interface with data, such as UDFs, pig, and pyspark. Those widely accepted alternatives can save you from doing something in SQL that you really shouldn't be doing in the first place.
iblaine··on Python at Netflix
Netflix does have people from MySpace, which could explain the annoying auto play feature, but the reality is Netflix has a mature process of AB testing. If autoplay is permanently on then it's because AB testing wills it so. ¯\_(ツ)_/¯
iblaine··on Databricks open-sources Delta Lake to make data lakes more reliable
What's the difference between a Delta Lake and Change Data Capture? Seems like in both cases you're creating a type 2 dimension against a source table.
iblaine··on Cadence: Uber's Workflow Orchestration Engine
Very interesting. Can you give an example where you'd want to track a process that takes days or months to execute?
← PreviousPage 5 of 14Next →