Depends on the state. New York requires an ejectment hearing since he's family but in most states he doesn't have any more rights than a regular guest, since by his own admission he has never been asked to pay rent or contribute to expenses. Outside of certain cities with local protection laws, you can just change the locks when they leave.