News for hackers. Stuff that matters.
Re:Universal LLM Deployment Engine with ML Compilation by zhye on Friday June 07, 2024 @06:32PM (#40613644)
Glad to see MLC is becoming more mature :) I can imagine the unified engine could help build agents on multiple devices.

Any ideas on how those edge and cloud models collaborate on compound tasks (e.g. the compound ai systems: https://bair.berkeley.edu/blog/2024/02/18/compound-ai-system...)

There are no comments on this comment yet.