I've never seen it take more than 100MB of RAM. What is your OS and amount of RAM reported by your OS?
with only a couple of modules in my rack going, the rack process is hogging 50% of my cpu. about the audio glitches - they seem happen whenever i use my os regularly outside of rack (switching between apps, scrolling and clicking).