Removal of magic from England

I would like to furthur discuss the possibility that magic may have been removed from England those 300 years ago. The small magical acts that Strange and Norrell perform are nothing compared to the union between English magicians and the trees, rocks, and water that Strange brings back to England. People expect the trees, rocks, and water to behave in a predictable manner, and a world where that was not true would be terrifying. What if the faeries were given the trees, rocks, and water to command to leave England those 300 years ago? We have all seen the commotion they cause, and surely they would love the power enough to agree. If this is not the case, how was the magic lost? The Raven King may have had to leave and vowed to return again leaving a small group of people from northern England that were devoted to him.