Hi Bob,
Machine or hand reamer?
Because I invariably use machine reamers, I would wack the hole thru about .5mm smaller (0.020"), and chunk it out under power, but in your situation I would make it about 0.004" to 0.008" smaller so if you use a 3mm or 3.1mm drill this should leave you about 0.004 to 0.008" to clean up the hole with a reamer.
Some people might say go to 0.002" undersize, but a wobbly drill can easily take you oversize to start with.
The difference between the hand and machine reamers is that the hand held one has a tapered lead in that can be as much as 1/3rd of the length of the reamer whereas a machine reamer usually has just a small lead in, I have some carbide ones with no lead in at all.
I always say that by using a hand reamer, your hole just might be slightly oversized because you can't easily control the side pressure that you put on it by doing it by hand, especially in the smaller sizes.
John