If you're thinking of the inconsistency of the suggested contacts, it is based on content, source app, etc. For pictures, there's even analysis of picture contents. All on device. Unfortunately, there's no way to remove someone from being suggested, except to delete your message thread with them.