Even the extremely light gedit (gnome default editor) has this problem.

I think plugins should automatically disable themselves if the file is over x KB.