Have you seen https://hypothes.is/? Not to discourage you, I'm just seeing because maybe it is exactly the same thing you are building here, and that should be good, right?