I’ve been fooling around with a lot of consumer GPU hardware and having a fun time. There are so many rabbit holes and interesting parts available to piece a Rube Goldberg of a performant clanker together.
99 karma · joined July 20, 2020
My favorite result: a P2P copy across the four R9700s moved 54.7 GB/s in total, about twice the ~28 GB/s the x16 uplink carries one way, so that traffic never leaves the switch.
The kernel was less cooperative. Current kernels (7.0.6 on this box at the moment) size the switch's bridge window too small for four 32 GB BARs, so two of the R9700s just came up without them. I ended up writing a small module that lays out the BARs before amdgpu loads to get around it.
It was a very fun adventure and I have a few more posts coming later this week about some rabbit holes I fell into along the way.
A couple of other things turned up along the way. vLLM was returning a truncated tool call as if it finished (half a file on disk, "wrote successfully"), and Bifrost was shuffling the tool definition fields between requests so the prefix cache missed. I have PRs (now merged) with Bifrost and mcp-go for the shuffling.
It was a very interesting learning experience about model serving and harnesses. This post really only covers the latter, but I'll do another on the vLLM side soon.
https://doug.sh/posts/route53-as-a-key-value-store-2026-edit...
I might add the custom filler word functionality and/or perhaps just make the filler word list configurable.
This really is a big thing. Same hardware, same workload, double the performance. That doesn't happen often, especially for a project that got its start in the 1980s and is still growing today.
EDB builds products and solutions based on the world’s best database, Postgres. We have many of the core Postgres contributors on staff and continuously contribute back to the open source community. We're also fully remote.
We're looking for an engineer to focus on tooling and developer experience, by building modern and Postgres dev tools with a focus on usability. These tools will be used in production, development, experimentation, and testing. This role will be especially interesting - and challenging - as we develop highly available distributed database systems of varying architectures.
We use a large mixture of languages, but Go + Python experience is preferable. Experience with C, and database internals knowledge is a huge plus, especially Postgres. Previous work with cloud architecture, specifically AWS, is also nice to have.
https://www.enterprisedb.com/careers/job-openings?gh_jid=510...
doug.calobrisi[at]enterprisedb.com
EDB builds products and solutions based on the world’s best database, Postgres. We have many of the core Postgres contributors on staff and continuously contribute back to the open source community.
We're looking for an engineer to focus on tooling and developer experience, by building modern and Postgres dev tools with a focus on usability. These tools will be used in production, development, experimentation, and testing. This role will be especially interesting - and challenging - as we develop highly available distributed database systems of varying architectures.
We use a large mixture of languages, but Go + Python experience is preferable. Experience with C, and database internals knowledge is a huge plus, especially Postgres. Previous work with cloud architecture, specifically AWS, is also nice to have.
This role will be formally posted on our site in the next few days, I’ll reply with a comment when it's up. Until then, reach out to me directly with interest and questions:
doug.calobrisi[at]enterprisedb.com
EDB builds products and solutions based on the world’s best database, Postgres. We have many of the core Postgres contributors on staff and continuously contribute back to the open source community.
We're looking for a Senior Software Engineer (Tooling) to help build Postgres tools. We're working on modernizing Postgres tools, used in production, development, and testing. You would be designing and building these tools, specifically around high-availability, distributed database architectures, and deployment tooling. We have a lot of challenging projects in our backlog, and you definitely won't get bored.
We're also looking for a Senior Software Engineer (Automation) to help build Postgres automation. You would be designing and building automation and tools to ensure our Postgres solutions will work perfectly for our customers. We need to ensure that our full solutions, including components such as multiple variants of Postgres, HA and pooling, bi-directional replication, deployment tools, and more, all fully work together for customer scenarios. To reach that goal, we're building a lot of cool methods/tools to verify our products and solution architectures.
We work on a lot of fun and interesting projects. We also use a lot of Go, Python, Ansible, etc, but we're always open to adding the right tools and frameworks to our stack. The roles are 100% remote, and always will be.
These roles are directly on my team and I'm happy to answer any questions via email.
All EDB openings: https://grnh.se/3ee0435d3us
You can email me at doug.calobrisi[at]enterprisedb.com
EDB builds products and solutions based on the world’s best database, Postgres. We have many of the core Postgres contributors on staff and continuously contribute back to the open source community.
We’re currently looking to fill many roles as we continue to rapidly grow.
We're looking for a Staff Software Engineer to help design and build the future of Postgres development automation in our automation team. This role will be involved in creating tools to remove friction from processes and make our development teams more efficient.
Link: https://grnh.se/e6c27b9b3us
We're also looking for a Senior Performance Engineer with extensive Postgres (or other RDBMS) experience. This role would work on designing and optimizing our BDR (Bi-Directional Replication) solution for Postgres. This is a newly opened role without a proper posting yet, so please email me directly with interest.
All openings: https://grnh.se/3ee0435d3us
You can reach out to me at doug.calobrisi[at]enterprisedb.com
EDB builds products and solutions based on the world’s best database, Postgres. We have many of the core Postgres contributors on staff and continuously contribute back to the open source community.
We’re currently looking to fill many roles as we continue to rapidly grow.
We're looking for a Staff Software Engineer to help design and build the future of Postgres development automation in our automation team. This role will be involved in creating tools to remove friction from processes and make our development teams more efficient.
Link: https://grnh.se/e6c27b9b3us
All openings: https://grnh.se/3ee0435d3us
You can reach out to me at doug.calobrisi[at]enterprisedb.com
EDB builds products and solutions based on the world’s best database, Postgres. We have many of the core Postgres contributors on staff and continuously contribute back to the open source community.
We’re currently looking to fill many roles as we continue to rapidly grow.
We need several Principal Software Engineers to join our BDR (bi-directional replication) development team. BDR is a multi-master Postgres solution with a wide breadth of functionality for high-availability and replication. 100% remote.
We're also currently looking for a junior software engineer to assist with automation and tooling efforts. This role will be involved in creating tools to remove friction from processes and make our development teams more efficient. Please contact me directly if you're interested in this role, the posting is not live yet.
All openings: https://grnh.se/3ee0435d3us
You can reach out to me at doug.calobrisi[at]enterprisedb.com
EDB builds products and solutions based on the world’s best database, Postgres. We have many of the core Postgres contributors on staff and continuously contribute back to the open source community.
We’re currently looking to fill many roles as we continue to rapidly grow.
We need several Principal Software Engineers to join our BDR (bi-directional replication) development team. BDR is a multi-master Postgres solution with a wide breadth of functionality for high-availability and replication. 100% remote.
All openings: https://grnh.se/3ee0435d3us
You can also reach out to me at doug.calobrisi[at]enterprisedb.com