Do you have a link to where you can search census data by address? Most of the standard sites let you search by name.
hit the address tab on the top of the search page
Edit: Seems a bit scammy.
Additionally turns out I didn't use the census information on it - it was Valuation Rolls which in Scotland listed the occupiers, information about the house, occupations and so on.
I imagine if you get the occupiers via valuation rolls or similar (which are address searchable) you can then go on to census records.