News for hackers. Stuff that matters.
Re:Show HN: Open-Source Alternative to OpenAI Platform, for ... by abhimazu1006 on Wednesday January 29, 2025 @10:13AM (#42865807)
I tried the tool, works flawlessly on mac. Finetuning was quick, do you support model conversion as well ? To TensorRT ?
Re:Show HN: Open-Source Alternative to OpenAI Platform, for ... by aliasaria on Wednesday January 29, 2025 @10:18AM (#42865897)
The functionality in Transformer Lab comes from plugins. Plugins are just Python scripts behind the scenes. So anything that can be done in Python can be done as a plugin.

Right now we have export plugins for going to GGUF, MLX and LlamaFile but if you know a good library for exporting to TensorRT, let's make a plugin for this! (Feel free to join our Discord if you want help)