Maybe take a look at the various debian bootstrap methods then you can create minimal sd-images and even apply some changes to the root fs and partition table before booting the rpi.
This way you could implement encryption of the root partition or specification of partition size etc.
Here is one of the many bootstrap methods: http://liw.fi/vmdebootstrap/