Re:Show HN: Open-Source Alternative to OpenAI Platform, for ...
by abhimazu1006 on Wednesday January 29, 2025 @10:13AM
(#42865807)
I tried the tool, works flawlessly on mac. Finetuning was quick, do you support model conversion as well ? To TensorRT ?
[ Parent
| on HN ]
Re:Show HN: Open-Source Alternative to OpenAI Platform, for ...
by aliasaria on Wednesday January 29, 2025 @10:18AM
(#42865897)
The functionality in Transformer Lab comes from plugins. Plugins are just Python scripts behind the scenes. So anything that can be done in Python can be done as a plugin.
Right now we have export plugins for going to GGUF, MLX and LlamaFile but if you know a good library for exporting to TensorRT, let's make a plugin for this! (Feel free to join our Discord if you want help)