Delrin is pretty easy to work - turns well on a lathe; in general it works as readily as a hardwood. I did think after saying I probably have some suitable steel that while what I've got is to known tolerances, I don't know what tolerances your punch is! Pepe would probably be the sensible point to start from.
Bookmarks