It would only work for music; for video or games or anything else a large buffer would mean terribly unsynchronized and delayed audio. Humans will feel something is off with just a few tens of milliseconds of buffer.