Click on the timestamp of the comment. It will give you additional options, including "favorite."

Upvotes will privately bookmark things you like. Favorites are public.

I use them occasionally to actually have some hope of finding something again. But if you don't want people to know, then don't use "favorite."