58 karma · joined February 5, 2008
https://twitter.com/edwin
Our interest is straightforward: If coding agents scaffold a growing share of new apps, their defaults will become prevalent. Not necessarily because they’re objectively best, but because the choices are frictionless. The model becomes the gatekeeper of early architectural decisions that used to happen in a meeting room.
So we measured what those defaults actually are.
We ran structured app-building prompts through Claude Code, captured the generated repos, and extracted stack choices: auth, UI framework, database, deployment assumptions, package management, etc.
A few observations that stood out: - Deployment assumptions are shifting toward Vercel and Railway, and away from AWS/GCP-first patterns. - Defaults evolve as models update. For example, Opus 4.6 recommends Drizzle more frequently than Prisma.
Prompts, raw outputs, and parsing logic are here: https://github.com/amplifying-ai/claude-code-picks
This is a snapshot in time. An interesting question is how quickly these defaults drift.
* AI answers shift a lot. In classic search a page-1 spot can linger for weeks; in our runs, the AI result set often changed overnight.
* Google’s new “AI Mode” and ChatGPT gave the same top recommendation only ~47 % of the time on identical queries.
* ChatGPT isn’t even consistent with itself. Results differ sharply depending on whether it falls back to live retrieval or sticks to its training data.
* When it does retrieve, ChatGPT leans heavily on publications it has relationships with (NYPost and People.com for product recs) instead of sites like rtings.com
Writeup: https://amplifying.ai/blog/why-ai-product-recommendations-ke...
Only the older completion models (davinci, curie, babbage, ada) are avaialble for fine-tuning.
Here's a quote about the lack of undo: "The consequences of careless work were immediate and unavoidable, and the amount of focus, resilience and perseverance required by these chairs was immense."