IQ is defined as relative to your age group, but absolute IQ test scores start to decline in your 40s at a rate of approximately 6 points per decade.