If they manage to create one with almost no velocity, it would keep falling through the Earth, down, up and down again, for either something between atoseconds or centuries, until it either explodes or hits enough matter to get big enough to matter.

Or, more realistically (as realistic as we can be talking about the LHC creating black holes, AKA, not realistic at all), it will be launched into space in some random direction.