What do you think? Should a privately-owned business be able to tell people to go elsewhere on the basis of their religious beliefs?

Absolutely. And let people vote with their feet, taking their money elsewhere. I certainly wouldn't do business with a coffee shop that discriminates like that. If enough people boycotted them, they'd go out of business.