"Holyrollers" pay taxes like anyone and thus have as much right as any of the rest of the public to have a say/use in the library.
If you force people to pay taxes for something, then they are going to have influence with it, if you don't like it then support privatizing libraries and the problem is solved.
It's not like you see such intense conflicts between religious and non-religious folk over what Chapters decides to sell, because both parties know and respect that it's Chapters decision to sell what they want and they have less reason to feel as if it's their place to interfere.
Also, you can use the money to lower taxes and pay down the deficit.