Coffee is not just caffeine, it contains many other psychoactive chemicals and some of them like to stay in brain fatty tissues for extended periods of time.