The really old ones didn't even have a "remember this choice" checkbox.
The only thing more annoying is when it ignores the remember this site checkbox.
The current ones will ignore the remember this site probably due to a stupid group policy.
Possibly forgets on logoff
For whatever reason, old Internet Explorers (9? 10? not sure..) do that too...