Expensive compared to what? DynamoDB has the cheapest 4ms writes I can find...

But yes, absolutely prototype and measure costs with real workloads