I love my mill to little tiny pieces, but you can do an aweful lot with a lathe and a comparably sized drill press. The 'secondary' machines (drill press, sander etc) that you may already have can go a long way before you go and buy a mill.
One great person to chime in on this one would be...