I would have thought most people would be more familiar with the heaviside layer (than the step function), even if only from the reference in the musical cats.