I always polish everything before I set a stone, but the pusher always ruins the finish so I end up having to polish up the setting AGAIN. I know different stones are stronger than others... but which ones are barrel proof (because I use all sorts)?

At the moment I'm setting a diamond in my engagement ring and I'm pretty sure a diamond will survive... but I just had to ask before I went for it I've got the diamond nerves HELP!