Use fitday.com or something to ACTUALLY TRACK (yes, actually, as in EVERY DAY) the calories you eat. You can't "guess" something like this. Furthermore, google for 'daily caloric expenditure calculator' and find out exactly how much someone of your height and build is burning, and eat accordingly.
Stop guessing! It obviously doesn't work.