You could have also just looked at the documentation linked in the original post...
We're actively working on this!
Our ML team has noted that the segmentation masks in particular from PaLiGemma are a bit tedious and unintuitive to decode. We should be pushing out (more!) open source software that uses this model in the coming days.
Look forward to an easy way to fine-tune PaLiGemma and broader support for its task types in `inference`, the package used in the blog post.
the blog post details it but essentially to convert from PaliGemma tokens to bbox:
y0 / 1024 * h
x0 / 1024 * w
y1 / 1024 * h
x1 / 1024 * w
have not played with segmentation yet.