Baloo (KDE) and Tracker (Gnome) are typically the first things I disable on any Linux desktop install that requires either of them. Tracker is hot garbage and a pain to disable. Baloo at least is granular and configurable enough to turn off file indexing without breaking search on the entire DE.