Hacker News Reader

Comment by nostromo | Hacker News Reader

I love it!

It'd be nice if there was a way to say what is and is not changeable.

For example, I noticed it usually improves the view outside of the windows to be beautiful vistas -- not something you can do without moving. Being able to request that other things not change, like the floor plan or the flooring for example, would be nice.

I like how the AI will randomly turn furniture into a dog, as if to say, "improve this room with a furry friend." :)

View on HN

Glad you like it! I understand your point; I'll work on object segmentation and let users decide what to change. Thanks for the feedback

Please do! Adding in a Segment Anything Model UI to the app would be great. You can then click on the items you want removed and use the segments as inpainting masks for the generative model.

Leveraging multiple models here (Segment Anything is a good candidate) seems like a must to build a defensible product. Using just SD with basic control net and maybe some additional finetuning makes it very cloneable. If you leverage other models you can do things like identify what elements of the room must be preserved (walls, windows) and what can be safely removed or edited. This could allow you to generate a simulated image of the room without furniture as a base. Derive a 3d projection to allow the user to place basic 3d furniture stubs within the space. Then use those stubs to create subject masks with the furniture-less base to render a final room.

Reply on news.ycombinator.com