You can use https://wiki.ubuntu.com/Kernel/LTSEnablementStack to get a newer X server and kernel while otherwise staying on 12.04 LTS.