In a recent interview [1] Elon stated that empty booster "has the density of an empty beer can" which is a great mental aid. So it will certianly float.

But part of it will be underwater, initially the very expensive flamey part (engines). They will not "be the same" after the experience.

[1] https://www.youtube.com/watch?v=t705r8ICkRw