> I am a bit worried about the side effects so I haven't ever taken more than thrice a week

This sounds ideal. Like pretty much anything, I can testify that in my experience you can develop tolerance and it loses its effectiveness (at least for cognition) when taken daily.