This is super cool. Using LLMs to mix together two songs that don't belong mixed together is a great usecase.
243 karma · joined April 23, 2025
1. Can the app differentiate one article of clothing from background / other articles 2. Can the app group together identical articles of clothing
To answer 1. The app has decent performance with test set pixel level mean accuracy of 0.80 and mIoU of 0.69, the test set is all real world fit pix from myself and friends. The 0.8 is a bit misleading though as the errors often occur at clothing boundaries so in poor lighting there can be some border gore.
As for 2. this remains to be seen. Currently clothing aggregation (Grouping together two segmentations of the same shirt) is manual. I'm doing some studies on tuning cosign-sim thresholds but I think long term there may need to be a more robust approach.