Re:Show HN: Truss – Serve any ML model without boilerplate code
by gorg93 on Friday July 29, 2022 @12:39PM
(#32279113)
Looks interesting, what if I need to write some logic (pre/post prediction) in the prediction server?
[ Parent
| on HN ]
Re:Show HN: Truss – Serve any ML model without boilerplate code
by b10_bola on Friday July 29, 2022 @12:55PM
(#32279279)
Every time that you make a truss to package your model, you can add custom pre/post processing to every request/response. We've done our best to document it.
https://truss.baseten.co/reference/structure#model
https://truss.baseten.co/develop/processing
Take a look at `{truss_name}/model/model.py` to add the code.
Please open up an issue or PR if you think we can improve on the documentation!