I don't doubt that there have been books written that documented secret powers, which may even been written from alien interactions.
Since most people couldn't read, back in the day, the sorcerers could also have claimed the instructional book, Riding a Camel 101, was the gateway to their secret powers, which the people accepted.
Somewhere there is another secret book with secret knowledge waiting to be discovered.