How tough are they really!!?

You need to take him to the vet anyway, because he may have internal injuries that you can't see, and if you let it go, thinking he is ok, and he has problems because of it later on, then you will never forgive yourself. Because of the fact that he is so small, and fragile, it's better to be safe than sorry.