This clause is meant to prevent the Executive from preventing a meeting of Congress. It is not a blanket protection from criminal charges. The key phrase is "during their attendance" and "in going to and returning from".