>I don't think any responsible bank would let you withdraw using just an account number
What do you think a check is? It's a piece of paper with your account number, who to pay, and how much. There's a signature field, but it's not checked too closely (I don't think my bank even asked for a signature sample when opening my account) and signatures are trivial to forge.