HNHacker News
TopNewBestAskShowJobs

tayloramurphy

109 karma · joined January 31, 2021

AI PM @ Astronomer

Prev. Founder/CEO @ Arch.dev, Maintainer of Meltano, Data @ GitLab

Email me <firstname.lastname> @ <company domain>

submissionscomments
tayloramurphy··on Launch HN: Common Paper (YC W23) – SAFEs for Commercial Contracts
Big fans of Jake and the team at Common Paper - we're happy users at Meltano. Congrats on the launch!
tayloramurphy··on Replacing my best friends with an LLM trained on 500k group chat messages
Loved the whole Bobiverse series. Highly recommended for folks who want a relatively easy sci-fi read.
tayloramurphy··on Ask HN: How are you using GPT to be productive?
I had it come up with a new data concept that was quite funny:

Data Flambulation Coefficient (DFC)

Unveiling the groundbreaking Data Flambulation Coefficient (DFC), a novel concept that redefines how we perceive and analyze the intricacies of our data. DFC evaluates the "entwining" of data, delving into the deep interconnectedness between seemingly unrelated data points. This sophisticated metric combines the principles of glomerosity and the innovative dinglemorf analysis, offering unparalleled insights into the underlying structures and patterns of complex datasets.

By leveraging the Data Flambulation Coefficient, businesses and researchers can reveal hidden nuggets of zibberfex and unriddle vast swathes of yaltrizite, leading to more robust decision-making and a competitive edge in data-driven landscapes. DFC is set to become a staple in data analytics, providing the means to unlock the full potential of data's intertwined narratives.

tayloramurphy··on Ask HN: How are you using GPT to be productive?
I fed it some documentation I wrote that had 2 FAQs and asked it what additional questions a user might have after reading the page. It came up with 10 additional questions, about half of which I added to our actual FAQ section!
tayloramurphy··on How to Become the Next Gitlab: 31 “Simple” Steps to Build a COSS Company
Only 31 simple steps? Sign me up
tayloramurphy··on Bifurcate the Problem Space
I was fortunate enough to learn this strategy outside of a software context first. In grad school I was responsible for maintaining our GC-MS and LC-MS machines (Gas/Liquid Chromatograph / Mass Spectrometer) in addition to using them for my own experiments on a regular basis. They were complex pieces of equipment that had a ton of fiddly components.

The best way to troubleshoot these machines was to split the problem in half again and again until you found the part that needed to be cleaned, repaired, or replaced. The way to do that was to run different known chemicals with their own known signatures through the machine again and again. For example, you could run a single chemical (maybe ethanol - I honestly don't remember which ones at this point) and see if it goes straight through the GC and gives you the peak you expect. If it doesn't you could look at the result and see if the timing was off (indicates something with the GC or gas flow) or if the peak was wonky (indicates something with the MS). And then you just keep going. (Sounds a lot like unit and integration tests right?)

Applying that same strategy works wonders for data pipelines as well. Is it something with the extractor or loader (or god forbid Airflow)? Break it down and go from there.

My only nit on this is that while bifurcate is technically accurate (or is it actually?) it feels unnecessarily complex sounding for folks learning this skill.

tayloramurphy··on Portugal proposes to end Golden Visas, curtail Airbnb rentals
As someone who was considering this for the future (10+ years) its disappointing, but I understand it. Both Portugal and Ireland were on my list. I could 100% imagine how this program was ripe for abuse and would have side effects that citizens would not want. I suppose dual citizenship will have to come the old fashioned way!
tayloramurphy··on Show HN: Syncing data to your customer’s Google Sheets
Meltano[0] might be of interest to you. Easy way to move data that should be very familiar for software engineers. If a connector doesn't exist our SDK makes it easy to build it.

[0] https://github.com/meltano/meltano

(disclaimer - I work at Meltano)

tayloramurphy··on Airbyte makes 100 alpha / beta connectors free
We're exploring whether or not we can support Airbyte connectors on our upcoming Meltano Cloud offering. As it stands we have some community members running Airbyte connectors in their production environment with Meltano and they seem quite happy with it!

As with anything there are tradeoffs though - gaining the ability to have a connector in a non-Python language comes with the overhead of running (likely) Docker-in-docker. Also, connectors not built on our SDK[0] are missing out on some nice features like batch message[1] support (for bulk loading) and stream maps[2] for inline data transformations.

[0] https://sdk.meltano.com/ [1] https://sdk.meltano.com/en/latest/batch.html [2] https://sdk.meltano.com/en/latest/stream_maps.html

tayloramurphy··on Four thousand weeks
Thank you for making this! I read the book twice last year and it made a deep impact on me and my relationship to basically everything. The book, coupled with coaching has greatly improved my life.

Your site is a great summary reminder of the key points and it brought me back into the experience of reading the book.

For folks reading this, I do recommend reading the book since the website is just a taste of the book. It's lessons may hit different not having gone through the full journey.

Thanks again for making the tribute!

tayloramurphy··on Four thousand weeks
Have you read the book this tribute is based on? It doesn't focus on time as much as you're implying. More that it tries to cultivate a deep understanding that we essentially are time. I'm not doing the concept justice here, but I read the book twice last year and find this tribute a good reminder of the ideas and suggestions in it.

It's worth a read, but perhaps it found me at the right time in my life.

tayloramurphy··on Going full time on my SaaS after 13 years
Never!
tayloramurphy··on Going full time on my SaaS after 13 years
Very cool to see you on HN Matt!

I know Matt from the data world where his SQL Style Guide[0] was always at odds with the one we maintained at GitLab[1]. :-D

Posts like this are great to show folks just how long it can take to do things. I love his story and am eager to watch Preceden grow!

[0] https://github.com/mattm/sql-style-guide [1] https://about.gitlab.com/handbook/business-technology/data-t...

tayloramurphy··on Mochary Method Curriculum
I'm guessing this was posted because he was on Lenny's Podcast[0] very recently. I do recommend this episode as I found it quite informative.

[0] https://www.lennyspodcast.com/how-to-fire-people-with-grace-...

tayloramurphy··on Modern Data Stack in a Box with DuckDB
...and with Meltano, dbt, and Superset! :-D

Awesome to see this on here - great folks working on each part of this setup.

tayloramurphy··on TLDR explains what a piece of code does
Before clicking through I thought this was for this great command line tool [0]. I'm skeptical about GPT-3 generated comments, but I can recommend the other TLDR whole heartedly!

[0] https://github.com/tldr-pages/tldr

tayloramurphy··on Scratch is a big deal
This is genuinely amazing - I'd love to give it a try. Any chance any of the work your team put into it is open source?
tayloramurphy··on My macOS keyboard shortcuts
I still use https://github.com/jigish/slate on Monterey and it works great!
tayloramurphy··on Show HN: I Made a Stupid Game
I'm seeing this as well. Sends me to some home loan page.
tayloramurphy··on MongoDB Wire Protocol Specification License
Reading why RethinkDB failed may provide additional context as to how Mongo was successful.

https://www.defmacro.org/2017/01/18/why-rethinkdb-failed.htm...

tayloramurphy··on Salesforce completes acquisition of Slack
It's pretty frustrating how many OSS projects use Slack but there are no options available to pay for a discounted pro plan. We'd love to pay a flat-ish fee for the community but it creates a disincentive to grow. Their active user fair pricing helps a bit, but it's not great.
tayloramurphy··on Meltano raises $4.2M seed round
I can't find the issue, but originally it stood for different parts of the data lifecycle - Model, Extract, Load, Transform, Analyze, Notebook, Orchestrate. We don't really highlight that much anymore, but there's no denying the roots!
tayloramurphy··on Six charged in Silicon Valley insider trading ring
Thank you for sharing this! I'm going to add it to my listening queue.
tayloramurphy··on Tabula – Extract tables from PDF files
I used Tabula quite a bit at the startup I used to work at (> 3 yrs ago). We were curating and organizing genetic testing information and much of the data was sent to us with PDFs.

It didn't work everytime, but when it did, it was awesome!

tayloramurphy··on Monday.com Files IPO
The Work OS category is confusing since I was more familiar with WorkOS[0] already. I didn't connect how these were related (which they really aren't).

[0] https://workos.com/

tayloramurphy··on We scaled the GitHub API with a sharded, replicated rate limiter in Redis
I originally thought this article was going to be about John Berryman's proposed Redis rate limiter [0]

[0] http://blog.jnbrymn.com/2021/03/18/estimated-average-recent-...

tayloramurphy··on A simplified take on the Singer specification
We also published a short blog post on this if anyone is curious!

https://meltano.com/blog/2021/04/07/a-simplified-take-on-the...

tayloramurphy··on Meltano: ELT for the DataOps era
The GitLab Data Team is running Meltano in production[0]. We're currently extracting Zoom data with it and have plans for several more extractors (Slack, GMail, PTO by Roots, EdCast, and a few more). I just made this MR[1] to update the list of Extractors to include Zoom too.

[0] https://about.gitlab.com/handbook/business-ops/data-team/pla... [1] https://gitlab.com/gitlab-com/www-gitlab-com/-/merge_request...

tayloramurphy··on Meltano: ELT for the DataOps era
This article[0] from Census is a good primer on the difference and what's driving it. But the TL;DR is that storage is cheap and it's easier to change SQL-based transformations using something like dbt[1] than to re-extract the data when the business logic changes.

[0] https://blog.getcensus.com/dbt-the-etl-elt-disrupter/ [1] https://www.getdbt.com/

tayloramurphy··on Meltano: ELT for the DataOps era
We're working on an SDK[0] for building taps that should make it much easier to build to the Singer spec with all of the features out of the box. In theory if you can write some python against whatever you're pulling data out of, then it can work within the Singer ecosystem and Meltano. It's nearly ready to go but we'd love feedback if you decide to test it out!

[0] https://gitlab.com/meltano/singer-sdk

← PreviousPage 2 of 3Next →