Some clients / chat services will have a delay on notifications, which is probably the way to go; chat shouldn't be about "you have to be aware of this within one second".

When building a chat system with notifications, it's also important that you can recall notifications. Wouldn't want someone's accidentally pasted password to be retained in notifications.