I was recently in a very similar situation to you and found that the $PATH of my git bash contained a network drive. Removing this for me made it still slow but useable.

This also made any programs I was running in it - like vim - useable too.