In the article you recommend Ramnode. Does Docker actually work on their OpenVZ servers? Their KVM servers are quite a bit more expensive than the $1/month you mentioned...
EDIT: Damn, you're right. It complains about the kernel... Does anyone know of another cheap VPS I can recommend? OVH is at $3, but there are straight-up proxies at that price point.