Lots of things can wreck your internet performance. For instance, when I first got Frontier DSL it was often subjectively slower than dialup because the DNS servers sucked and could take 4 seconds or so to get back.

I installed djbdns and it got much much better.