Some people would be fine with it. But enough people do care that we have separate terms for "doctor" and "medical enthusiast". It's simply your priorities and those of society at large that determine the importance of the distinction.