It's probably people like me, who try to open 53 webcomic pages in tabs at once.
And the connection upgrading would only help the pipe into drew, not the connection from the library to you. So if there are a lot of people in your dorm downloading stuff, it'll slow down your connection even if the Drew pipe can handle much more.
That being said, I've been noticing some slowdown lately also. Not that much, but some.