I've used this library before and really liked it. I made a really simple roguelike with it:

https://github.com/melloc/roguelike

I remember running into some minor issues, but for the most part it's an awesome, mature library.