HNHacker News
TopNewBestAskShowJobs

smilliken

2,370 karma · joined February 10, 2010

MixRank (YC S11) Founder/CEO/CTO, mathematician, programmer, database & distributed systems enthusiast.

Contact: scott at company name dot com or deltaex dot com.

submissionscomments
smilliken··on Ask HN: Who is hiring? (April 2024)
MixRank (YC S11) | Software Engineers | 100% REMOTE (Global) | Full-Time

MixRank processes petabytes of data every month from web crawling. We have hundreds of customers using our data products including Google, Amazon, Facebook, Intel, and Adobe, across industries Sales, Marketing, Finance, and Security.

Team is 41 full-time, full-remote from 20+ countries. We're growing, profitable, employee-owned, no dependence on outside funding. Applicants from all geographies and backgrounds are welcome.

We are looking for passionate individuals for whom programming is not just a job but it’s something they love to do. We're obsessed with computers, programming, big data, databases, compilers, hardware, math, data science, and the internet. Does this sound like you? Please apply to join our team.

Our code base is very friendly to new contributors. You'll have a fully-functional development environment within hours (fully automated) and be pushing commits on your first day. Deployments to production happen multiple times per day and finish in less than 2 minutes. Effectively all of our codebase is written in Python, Rust, SQL, Javascript/TypeScript, and Nix. The core technologies you'll need familiarity with to be productive are Python, PostgreSQL, Linux, and Git.

We operate at a larger scale than typical startups. We operate two datacenters with high performance servers we've built that are capable of dealing with the volumes of data we process. We've implemented our own distributed file system. We do full-scale web crawls. We download and perform static analysis on the entire universe of Android APKs and iOS IPAs that are published. Unlike a typical startup where you'll spend half of your time in meetings, and the other half fixing bugs from Jira tickets— at MixRank you'll get to challenge yourself with difficult technical problems that will help you to grow as an individual.

--

Junior Software Engineer - Remote (Global), Full-Time

We're looking for remote junior engineers that have 0-3 years of professional experience in software, and 5+ years of curiosity exploring computers, programming, and technical hobby projects. This is an open-ended entry role with mentorship and diverse opportunities to work on all areas of our product: databases, distributed systems, infrastructure and tooling, data analysis, machine learning, frontend/backend web development, APIs, data mining, data modeling, and more. To stand out, please highlight what makes you unique: passion for computing, curiosity and side projects, work ethic, niche research, etc.

Ideally you've already graduated, but if you still have one or more years left of school, please feel free to apply anyway, and if you're the right fit for the team we'll figure out a way to accommodate your schedule.

--

Software Engineer - Remote (Global), Full-Time

We're hiring generalist software engineers to work on web applications, data mining, machine learning/data science, data transformation/ETL, data modeling, database scaling, infrastructure, devops, and more. We'll cater the role to whatever subset of these areas match your interests.

Beneficial experience includes PostgreSQL, Python, Rust, Linux, TypeScript, Nix, frontend/backend web development, and data mining.

--

I'm Scott, Founder/CEO/CTO. Please apply here: https://www.ycombinator.com/companies/mixrank/jobs

smilliken··on Kolmogorov Complexity and Compression Distance (2023)
I have an encoding improvement that can reduce the length of that program by 100% to an unbeatable 0 symbols (patent pending).
smilliken··on Show HN: Hancho – A simple and pleasant build system in ~500 lines of Python
It can go either way. If you duplicate code, but the two copies need to stay in sync, then you've made it a bit harder and more error-prone to maintain. But the worse offense is if you have some code that serves two conflicting sets of requirements, but you keep the code together with increasing complexity to thread the needle of satisfying all the requirements.

The latter is the worse offense because it's much harder to decouple two systems than it is to notice a similarity in two bits of code and to extract the commonality.

smilliken··on Storing binary data in playing cards (2014)
He isn't making the claim that it can encode more bits than the information theoretic maximum you suggest _on average_. On average his method is similar or worse than optimal. But some messages are effectively compressed in this encoding, and so more plaintext bits can be encoded. These better than average messages "borrow" bits from the worse than average messages, similar to how a compression algorithm works.
smilliken··on Ask HN: Who is hiring? (March 2024)
MixRank (YC S11) | Software Engineers | 100% REMOTE (Global) | Full-Time

MixRank processes petabytes of data every month from web crawling. We have hundreds of customers using our data products including Google, Amazon, Facebook, Intel, and Adobe, across industries Sales, Marketing, Finance, and Security.

Team is 41 full-time, full-remote from 20+ countries. We're growing, profitable, employee-owned, no dependence on outside funding. Applicants from all geographies and backgrounds are welcome.

We are looking for passionate individuals for whom programming is not just a job but it’s something they love to do. We're obsessed with computers, programming, big data, databases, compilers, hardware, math, data science, and the internet. Does this sound like you? Please apply to join our team.

Our code base is very friendly to new contributors. You'll have a fully-functional development environment within hours (fully automated) and be pushing commits on your first day. Deployments to production happen multiple times per day and finish in less than 2 minutes. Effectively all of our codebase is written in Python, Rust, SQL, Javascript/TypeScript, and Nix. The core technologies you'll need familiarity with to be productive are Python, PostgreSQL, Linux, and Git.

We operate at a larger scale than typical startups. We operate two datacenters with high performance servers we've built that are capable of dealing with the volumes of data we process. We've implemented our own distributed file system. We do full-scale web crawls. We download and perform static analysis on the entire universe of Android APKs and iOS IPAs that are published. Unlike a typical startup where you'll spend half of your time in meetings, and the other half fixing bugs from Jira tickets— at MixRank you'll get to challenge yourself with difficult technical problems that will help you to grow as an individual.

--

Junior Software Engineer - Remote (Global), Full-Time

We're looking for remote junior engineers that have 0-3 years of professional experience in software, and 5+ years of curiosity exploring computers, programming, and technical hobby projects. This is an open-ended entry role with mentorship and diverse opportunities to work on all areas of our product: databases, distributed systems, infrastructure and tooling, data analysis, machine learning, frontend/backend web development, APIs, data mining, data modeling, and more. To stand out, please highlight what makes you unique: passion for computing, curiosity and side projects, work ethic, niche research, etc.

Ideally you've already graduated, but if you still have one or more years left of school, please feel free to apply anyway, and if you're the right fit for the team we'll figure out a way to accommodate your schedule.

--

Software Engineer - Remote (Global), Full-Time

We're hiring generalist software engineers to work on web applications, data mining, machine learning/data science, data transformation/ETL, data modeling, database scaling, infrastructure, devops, and more. We'll cater the role to whatever subset of these areas match your interests.

Beneficial experience includes PostgreSQL, Python, Rust, Linux, TypeScript, Nix, frontend/backend web development, and data mining.

--

I'm Scott, Founder/CEO/CTO. Please apply here: https://www.ycombinator.com/companies/mixrank/jobs

smilliken··on Nebula is not the fastest mesh VPN, but neither are the others
The issue with iOS is that the system will kill the VPN process if it uses more than a tiny amount of RAM (including buffers to send data over the connection). You also have to be sure to do keep-alive heartbeats or it will be killed for being idle. VPNs on Android work reliably, I haven't noticed any issue.
smilliken··on Ask HN: Who is hiring? (February 2024)
MixRank (YC S11) | Software Engineers | 100% REMOTE (Global) | Full-Time

MixRank processes petabytes of data every month from web crawling. We have hundreds of customers using our data products including Google, Amazon, Facebook, Intel, and Adobe, across industries Sales, Marketing, Finance, and Security.

Team is 41 full-time, full-remote from 20+ countries. We're growing, profitable, employee-owned, no dependence on outside funding. Applicants from all geographies and backgrounds are welcome.

We are looking for passionate individuals for whom programming is not just a job but it’s something they love to do. We're obsessed with computers, programming, big data, databases, compilers, hardware, math, data science, and the internet. Does this sound like you? Please apply to join our team.

Our code base is very friendly to new contributors. You'll have a fully-functional development environment within hours (fully automated) and be pushing commits on your first day. Deployments to production happen multiple times per day and finish in less than 2 minutes. Effectively all of our codebase is written in Python, Rust, SQL, Javascript/TypeScript, and Nix. The core technologies you'll need familiarity with to be productive are Python, PostgreSQL, Linux, and Git.

We operate at a larger scale than typical startups. We operate two datacenters with high performance servers we've built that are capable of dealing with the volumes of data we process. We've implemented our own distributed file system. We do full-scale web crawls. We download and perform static analysis on the entire universe of Android APKs and iOS IPAs that are published. Unlike a typical startup where you'll spend half of your time in meetings, and the other half fixing bugs from Jira tickets— at MixRank you'll get to challenge yourself with difficult technical problems that will help you to grow as an individual.

--

Junior Software Engineer - Remote (Global), Full-Time

We're looking for remote junior engineers that have 0-3 years of professional experience in software, and 5+ years of curiosity exploring computers, programming, and technical hobby projects. This is an open-ended entry role with mentorship and diverse opportunities to work on all areas of our product: databases, distributed systems, infrastructure and tooling, data analysis, machine learning, frontend/backend web development, APIs, data mining, data modeling, and more. To stand out, please highlight what makes you unique: passion for computing, curiosity and side projects, work ethic, niche research, etc.

Ideally you've already graduated, but if you still have one or more years left of school, please feel free to apply anyway, and if you're the right fit for the team we'll figure out a way to accommodate your schedule.

--

Software Engineer - Remote (Global), Full-Time

We're hiring generalist software engineers to work on web applications, data mining, machine learning/data science, data transformation/ETL, data modeling, database scaling, infrastructure, devops, and more. We'll cater the role to whatever subset of these areas match your interests.

Beneficial experience includes PostgreSQL, Python, Rust, Linux, TypeScript, Nix, frontend/backend web development, and data mining.

--

I'm Scott, Founder/CEO/CTO. Please apply here: https://www.ycombinator.com/companies/mixrank/jobs

smilliken··on The things nobody wants to pay for
You frame it as a negative thing, but FOSS is a positive for society. I contribute to FOSS in ways that directly benefit myself, and incidentally benefit others. Incidentally I benefit from others' contributions to FOSS, as a consumer, and also as a business.

It's a positive sum good for everyone, not some adversarial zero-sum game.

It's so good that we need to be doing a lot more of it, and (I think we'd all agree) figure out more ways to allocate capital to FOSS.

smilliken··on Ask HN: Who is hiring? (January 2024)
MixRank (YC S11) | Software Engineers | 100% REMOTE (Global) | Full-Time

MixRank processes petabytes of data every month from web crawling. We have hundreds of customers using our data products including Google, Amazon, Facebook, Intel, and Adobe, across industries Sales, Marketing, Finance, and Security.

Team is 41 full-time, full-remote from 20+ countries. We're growing, profitable, employee-owned, no dependence on outside funding. Applicants from all geographies and backgrounds are welcome.

We are looking for passionate individuals for whom programming is not just a job but it’s something they love to do. We're obsessed with computers, programming, big data, databases, compilers, hardware, math, data science, and the internet. Does this sound like you? Please apply to join our team.

Our code base is very friendly to new contributors. You'll have a fully-functional development environment within hours (fully automated) and be pushing commits on your first day. Deployments to production happen multiple times per day and finish in less than 2 minutes. Effectively all of our codebase is written in Python, Rust, SQL, Javascript/TypeScript, and Nix. The core technologies you'll need familiarity with to be productive are Python, PostgreSQL, Linux, and Git.

We operate at a larger scale than typical startups. We operate two datacenters with high performance servers we've built that are capable of dealing with the volumes of data we process. We've implemented our own distributed file system. We do full-scale web crawls. We download and perform static analysis on the entire universe of Android APKs and iOS IPAs that are published. Unlike a typical startup where you'll spend half of your time in meetings, and the other half fixing bugs from Jira tickets— at MixRank you'll get to challenge yourself with difficult technical problems that will help you to grow as an individual.

--

Junior Software Engineer - Remote (Global), Full-Time

We're looking for remote junior engineers that have 0-3 years of professional experience in software, and 5+ years of curiosity exploring computers, programming, and technical hobby projects. This is an open-ended entry role with mentorship and diverse opportunities to work on all areas of our product: databases, distributed systems, infrastructure and tooling, data analysis, machine learning, frontend/backend web development, APIs, data mining, data modeling, and more. To stand out, please highlight what makes you unique: passion for computing, curiosity and side projects, work ethic, niche research, etc.

Ideally you've already graduated, but if you still have one or more years left of school, please feel free to apply anyway, and if you're the right fit for the team we'll figure out a way to accommodate your schedule.

--

Software Engineer - Remote (Global), Full-Time

We're hiring generalist software engineers to work on web applications, data mining, machine learning/data science, data transformation/ETL, data modeling, database scaling, infrastructure, devops, and more. We'll cater the role to whatever subset of these areas match your interests.

Beneficial experience includes PostgreSQL, Python, Rust, Linux, TypeScript, Nix, frontend/backend web development, and data mining.

--

I'm Scott, Founder/CEO/CTO. Please apply here: https://www.ycombinator.com/companies/mixrank/jobs

smilliken··on PostgreSQL 16 Bi-Directional Logical Replication
Agreed. Also exclusion constraints (a generalization of unique constraints). Also foreign key constraints, because one database might delete a record simultaneously with another database adding a reference to it.
smilliken··on NixOS has one fatal flaw
Nix is hard in the way that programming is hard. Not everyone gets over the activation energy to be successful. The ones that do don't regret the effort. Nix is complex because the problems it solves are high complexity problems that other systems don't solve. Docker is not a substitute for Nix.

The solution isn't to use a weaker tool, because the weaker tool doesn't solve your problem. It's not uncommon to see a programmer use a spreadsheet, but you wouldn't expect to see a programmer use a spreadsheet where a database is needed. And you don't see people trying to use garbage-collected languages to write operating systems, even though they are easier to use than C. It's perhaps inefficient when a tool is too powerful for what you need, but it's a fatal flaw if the tool you use is too weak for what you need.

Nix let's you control your dependencies in a way no other tool even attempts. I can pin and patch any combination of dependencies, even conflicting ones in single environment, with reproducible builds— I'm in control of every detail. I would never consider a downgrade from that, but I'm open to upgrades if something even more capable came along.

smilliken··on Mozilla expands extension support for Firefox for Android
May I remind you that Firefox has over 300M users. If that's not worthy of admiration, scarcely anything is.
smilliken··on Tacit Knowledge Is Dangerous
My rule of thumb is to hesitate before giving advice if I can't come up with an anecdotal story to support it. Stories are more useful than generalizations because they come with the context, and can be dismissed in different contexts. At risk of presently breaking this rule of thumb, I'll give an example. When I notice code being structured with class inheritance, I'll point out a part of the codebase where I did similar, and how poorly it turned out, which someone can observe for themself. It started out nice, as it usually does, but devolved over time as complexity accumulated in parent classes to handle scenarios in child classes.
smilliken··on Debian discusses vendoring again (2021)
> Language specific packagers are broken because they can't express dependencies across the language barrier in a good and automated way. > The latter seems easier to solve as long as there is someone that actually wants to solve it.

This is solved by Nix. Packages of any type can depend on eachother.

smilliken··on Ask HN: Who is hiring? (November 2023)
Thank you for applying, we'll be sure to follow up.
smilliken··on Ask HN: Who is hiring? (November 2023)
Hi Mohammed! Thabks for applying, we'll be sure to follow up.
smilliken··on Ask HN: Who is hiring? (November 2023)
Apologies, I've asked someone to check into your application.
smilliken··on Ask HN: Who is hiring? (November 2023)
We are a growing company. We've grown headcount about 50% year over year the last several years.
smilliken··on Ask HN: Who is hiring? (November 2023)
You're right, there's many qualified applicants in that pool! These aren't singular positions, but evergreen positions we're consistently hiring for every month.

The reason I don't vary the job descriptions is because I would rather start with an excellent candidate and customize the position to match them than to start with an excellent job description and look for someone to match it. The person is the important part, not the job description.

The reason for the junior position is because some of the most talented people are overly humble and don't think they are qualified to apply, but are more willing when they see a junior position is available.

smilliken··on Ask HN: Who is hiring? (November 2023)
I assure you that he has had nothing to do with the company in a long time, since before any of those newsworthy events took place. I'm the only person at the company that's ever spoken with him, and if you got to know me you'd understand that I'm at 0 risk of being involved in anything shady like that. I don't blame you for bringing it up, that news is still so shocking to me that I can't believe it's real.
smilliken··on Ask HN: Who is hiring? (November 2023)
Thank you for applying. I've asked someone to double check into your application.

We started receiving 20x more applicants than usual about this time last year when other tech companies were increasingly doing hiring freezes and layoffs. We're hiring consistently every month (including 5 new hires in the last month), especially from applicants from hacker news. Unfortunately we're not able to hire all the talented people that reach out. We have budget to grow faster, but internally, we have to be careful to not hire too quickly so that it's not chaotic for new people on the team with too little support from long-standing team members. We're trying our best to manage the higher volume of applicants, but clearly we let you down on communication so please accept my apology.

smilliken··on Yann LeCun: AI one-percenters seizing power forever is real doomsday scenario
A good heuristic if you care more about false positives than false negatives.
smilliken··on Ask HN: Who is hiring? (November 2023)
MixRank (YC S11) | Software Engineers | 100% REMOTE (Global) | Full-Time

MixRank processes petabytes of data every month from web crawling. We have hundreds of customers using our data products including Google, Amazon, Facebook, Intel, and Adobe, across industries Sales, Marketing, Finance, and Security.

Team is 41 full-time, full-remote from 20+ countries. We're growing, profitable, employee-owned, no dependence on outside funding. Applicants from all geographies and backgrounds are welcome.

We are looking for passionate individuals for whom programming is not just a job but it’s something they love to do. We're obsessed with computers, programming, big data, databases, compilers, hardware, math, data science, and the internet. Does this sound like you? Please apply to join our team.

Our code base is very friendly to new contributors. You'll have a fully-functional development environment within hours (fully automated) and be pushing commits on your first day. Deployments to production happen multiple times per day and finish in less than 2 minutes. Effectively all of our codebase is written in Python, Rust, SQL, Javascript/TypeScript, and Nix. The core technologies you'll need familiarity with to be productive are Python, PostgreSQL, Linux, and Git.

We operate at a larger scale than typical startups. We operate two datacenters with high performance servers we've built that are capable of dealing with the volumes of data we process. We've implemented our own distributed file system. We do full-scale web crawls. We download and perform static analysis on the entire universe of Android APKs and iOS IPAs that are published. Unlike a typical startup where you'll spend half of your time in meetings, and the other half fixing bugs from Jira tickets— at MixRank you'll get to challenge yourself with difficult technical problems that will help you to grow as an individual.

--

Junior Software Engineer - Remote (Global), Full-Time

We're looking for remote junior engineers that have 0-3 years of professional experience in software, and 5+ years of curiosity exploring computers, programming, and technical hobby projects. This is an open-ended entry role with mentorship and diverse opportunities to work on all areas of our product: databases, distributed systems, infrastructure and tooling, data analysis, machine learning, frontend/backend web development, APIs, data mining, data modeling, and more. To stand out, please highlight what makes you unique: passion for computing, curiosity and side projects, work ethic, niche research, etc.

Ideally you've already graduated, but if you still have one or more years left of school, please feel free to apply anyway, and if you're the right fit for the team we'll figure out a way to accommodate your schedule.

--

Software Engineer - Remote (Global), Full-Time

We're hiring generalist software engineers to work on web applications, data mining, machine learning/data science, data transformation/ETL, data modeling, database scaling, infrastructure, devops, and more. We'll cater the role to whatever subset of these areas match your interests.

Beneficial experience includes PostgreSQL, Python, Rust, Linux, TypeScript, Nix, frontend/backend web development, and data mining.

--

I'm Scott, Founder/CEO/CTO. Please apply here: https://www.ycombinator.com/companies/mixrank/jobs

smilliken··on Get all your sources
I'll share my personal answer: it made computers fun again. I was miserable with debugging flaky builds on large dependency trees and "works on my machine" issues. After switching to nix, now I see dependencies as being almost free, and it doesn't feel like I'm taking on a responsibility to fix build issues indefinitely into the future. It's really powerful when you take something that used to be expensive and make it cheap— it changes your perspective and has all sorts of unexpected benefits. So I'll click any link on HN about Nix or NixOS.
smilliken··on All GB/s without FLOPS – Nvidia CMP 170HX Review
I'm interested! Email in profile.
smilliken··on What's New in Python 3.12
The issue is if the dictionary has a key defined and the value is None. Your get expression will return None, causing your next access to raise an error.
smilliken··on Every database will become a vector database sooner or later
Btree isn't a very useful index type for a vector, though. GIN, GIST, and the handful of new extensions optimizing for vector search are what you'd want (and don't have this limitation).

Aside, you can increase the size of tuples you can index in a postgresql btree by increasing the postgresql page size (requires a recompile and creating a new database instance).

smilliken··on Pg_branch: Experimental Postgres extension brings Neon-like branching
PostgreSQL + ZFS is controversial. My experience was that it was inefficient on space and CPU, and especially memory. It would hang for 10+ minutes at a time one every day or two (doing a single threaded sweep across all RAM). And sometimes it would totally hang the system, requiring a reboot. I would describe the experience as hellish. Some of these symptoms only appear when the database has high load, so basic testing on a staging system doesn't tell you about stability on a production system.

PostgreSQL + ext4 is uneventful, lower latency, and less wasteful of resources.

smilliken··on Ask HN: Who is hiring? (October 2023)
MixRank (YC S11) | Software Engineers | 100% REMOTE (Global) | Full-Time

MixRank processes petabytes of data every month from web crawling. We have hundreds of customers using our data products including Google, Amazon, Facebook, Intel, and Adobe, across industries Sales, Marketing, Finance, and Security.

Team is 41 full-time, full-remote from 20+ countries. We're growing, profitable, employee-owned, no dependence on outside funding. Applicants from all geographies and backgrounds are welcome.

We are looking for passionate individuals for whom programming is not just a job but it’s something they love to do. We're obsessed with computers, programming, big data, databases, compilers, hardware, math, data science, and the internet. Does this sound like you? Please apply to join our team.

Our code base is very friendly to new contributors. You'll have a fully-functional development environment within hours (fully automated) and be pushing commits on your first day. Deployments to production happen multiple times per day and finish in less than 2 minutes. Effectively all of our codebase is written in Python, Rust, SQL, Javascript/TypeScript, and Nix. The core technologies you'll need familiarity with to be productive are Python, PostgreSQL, Linux, and Git.

We operate at a larger scale than typical startups. We operate two datacenters with high performance servers we've built that are capable of dealing with the volumes of data we process. We've implemented our own distributed file system. We do full-scale web crawls. We download and perform static analysis on the entire universe of Android APKs and iOS IPAs that are published. Unlike a typical startup where you'll spend half of your time in meetings, and the other half fixing bugs from Jira tickets— at MixRank you'll get to challenge yourself with difficult technical problems that will help you to grow as an individual.

--

Junior Software Engineer - Remote (Global), Full-Time

We're looking for remote junior engineers that have 0-3 years of professional experience in software, and 5+ years of curiosity exploring computers, programming, and technical hobby projects. This is an open-ended entry role with mentorship and diverse opportunities to work on all areas of our product: databases, distributed systems, infrastructure and tooling, data analysis, machine learning, frontend/backend web development, APIs, data mining, data modeling, and more. To stand out, please highlight what makes you unique: passion for computing, curiosity and side projects, work ethic, niche research, etc.

Ideally you've already graduated, but if you still have one or more years left of school, please feel free to apply anyway, and if you're the right fit for the team we'll figure out a way to accommodate your schedule.

--

Software Engineer - Remote (Global), Full-Time

We're hiring generalist software engineers to work on web applications, data mining, machine learning/data science, data transformation/ETL, data modeling, database scaling, infrastructure, devops, and more. We'll cater the role to whatever subset of these areas match your interests.

Beneficial experience includes PostgreSQL, Python, Rust, Linux, TypeScript, Nix, frontend/backend web development, and data mining.

--

I'm Scott, Founder/CEO/CTO. Please apply here: https://www.ycombinator.com/companies/mixrank/jobs

smilliken··on CloudNativePG – Postgres Operator for Kubernetes
PostgreSQL is the very best of the clunky 80s unix software. Its features and reliability are unmatched. The core contributors have earned the trust of the community.

You lose a lot of features and performance when you go from a single server database to a distributed system. Distributed systems are significantly more complex to set up, administer, and debug. For nearly all databases in use, the tradeoff isn't worth it.

It's really no wonder that postgresql is as popular as it is.

← PreviousPage 3 of 15Next →