Some libraries have coffee shops, some allow coffee in covered mugs. This varies from city to city (and occasionally branch to branch), of course.