I was under the impression that you can build up your tolerance to the sun by slowly increasing your exposure to it each day. Does this not apply for certain skin types?

For some skin types the effect is so small that you can just not take it into account. Especially people with red hair are known to have these skin types (hair and skin color are both dependent on malanin)