What if rat's and Mice went extinct?

What if man made some sort of super poison/trap that was so effective against rodents that it wiped them out would the effect on the environment be severe or miniscule as sadly many people think?