I know you probably have nothing besides the display in the card to keep it small, but that probably increases the number of Pogo pins you need if you need to run the entire display protocol over Pogo. If you had a demultiplexer in the card you could use only 3 Pogo pins.