Those aren't just "books", it's going to helping "literacy and gender equality" in third world education. For example, fact that women are often under-educated is a major source of issues in these countries. So yes while it's still about having to allocate things differently, don't just write off "books".
So go ahead -- contribute to books, knowing that really you're just taking away from clean water and shelter. Merry Christmas!