Here is a non-nefarious situation:

Let's say your side project is for a political party. Then, two years later, you apply for a job and the hiring manager is from a different political party, and has strong views on the matter. You don't get the interview.