282 karma · joined August 17, 2018
This seems like it would be the largest and first closed-source model Cerebras has offered till date
Yeah i feel separating compute from data is one of the best directions the industry can move towards, it means less lock-in, more flexibility and user agency as well as more personal compute utilisation (increasingly important with the cloud compute pricing-in the RAM supply crisis).
Could i ask, what made you decide to work on this ? personal and/or enterprise ?
If there's any hope for reliability, auditability, predictability to be had it lies in contraining and LlMs grammar whilst delegating freeform behavior to a more passive substrate.
The problem with products like this is that for search to be useful, you need, well... data. And when your data is crowdsourced, you need, well... a crowd. That was the chicken-and-egg situation I found myself in.
So the way I solved it was by painstakingly clipping and recording ~8500 websites myself.
But the great thing about that arduous process is that it forces you to put yourself in the shoes of your typical user. And really, the only way to make good products is to have a deep level of empathy for that user. In my case, that meant streamlining the data creation process itself, the act of pinning a screenshot or recording, because I had to do it over and over again. Making it easier for myself ended up making it better for everyone else too.
Of course, all that data-seeding effort goes to waste if search engines and potential users cannot discover it. So you have to go all in on SEO, especially sitemaps, and on programmatic socials where possible. This is especially true for a product like mine.
A lot of these marketplaces also have relatively homogenous data, which is actually useful, because it means you can present it through templates and publish pages at scale automatically.
Agents can search for design inspiration from production websites using semantic search. Since this inspiration comes from live websites, their design tokens; colors, typography usage, layout data are also available.
Would instead of the RL step a constrained decoding say via something like xgrammar fix syntax generation issue ?
Although this was in Nigeria, we have this certain camaraderie through hardship, it was still extremely surprising seeing a group of 6 men come out of nowhere, having nothing to do with each other aside being passerbys join hands, exerting sweaty effort to get my car out a ditch by 8pm.
Left me quite an impression
I'm curious how anyone has solved this
https://fontofweb.com/u/fontofweb
I was tired of inspiration sites like Dribbble full of polished mockups that aren't practical. Or awwward like sites that don't represent the mundanity of most websites.
So, I spent a while building a tool that captures website design snippets. It's now a collection of 4,363 designs from 544 different domains.
For every design, it extracts:
The exact fonts used on the page (so far 561 unique font families I've found)
The precise color palette
A direct link to the live site
You can check out the full free collection here: https://fontofweb.com/u/fontofweb