At least at one point, most of the delay in starting GIMP seemed to be it groveling through the HD looking for fonts, and getting them into a format it could use (e.g., showing the font properly in the font selection dialog).

I don't know if that's still the case.