If someone looking at the service can tell that it is nearly coincident with their own service then I think there is unlikely to be sufficient inventive step that is undisclosed.
AFAICT that is not how things are measured though, use in public except at specific trade fairs is prior use that voids a patent.
There is a lot of room for spending money on patent lawyers within the argument as to what is and is not public use though - http://www.ladas.com/Patents/Biotechnology/USPharmPatentLaw/... is a good summary IMO.
IANAPL
But I think it's more likely that we're talking about a software invention, in which case any non-disclosed implementation details could be a way to avoid potential infringement.
If someone looking at the service can tell that it is nearly coincident with their own service...
Plenty of inventions produce similar results yet have vastly different (and therefore individually patentable) implementations. In the case of an online service, there's little chance of the actual implementation being disclosed or somehow transferred to the end-user. My guess is that the inventive part of the service is executed server-side, and thus isn't accessible to the general public.
Not unless you google "pagerank" ;)