That is roughly correct. For a curve with smooth parametrization f(t) = (x(t), y(t)), with f'(t) ≠ 0 for all t, the curvature at the point f(t) is defined to be κ := |(f'(t)/|f'(t)|)'| -- the magnitude of the first derivative of the unit tangent vector. This is a nonnegative quantity, and is well defined, that is, independent of the specific parametrization of the curve (as legosexmagic said, you need to do something like this to get a quantity independent of the parametrization, but it is essentially a "normalized" second derivative).

The curvature comb consists (it seems to me) of a normal line segment at each point, whose length is directly proportional to the curvature there.