Nope. I’m not mistaken. What you’re talking about only applies to Xbox 360. For Xbox One, you lose access to your claimed Free Games with Gold when your subscription lapses until you resubscribe. The same is true for the free games to PlayStation Plus subscribers.