10mm pilot for 11mm final? :D
That's most of your problem right there, running it at 500rpm with 0.5mm engagement compounds the mistake as it will rip the edges off a drill bit more often than not, a 5mm pilot would be better.
This is not a case of a drill fault, it's tool abuse ;-)