Depends on the virus. For diseases like dengue you get antibody mediated enhancement of the infection, making it far worse, so the first time you're nearly asymptomatic and the second time you're on deaths door. For other diseases, even partial binding helps make the disease more mild. Biology is super variable.