Segment ids are all you need (probably)