Zero-Shot Text Classification on a low-end CPU-only machine?

Re:Zero-Shot Text Classification on a low-end CPU-only machine? by pilotneko on Monday October 07, 2024 @08:38AM (#41765403)

Hugging Face does maintain a package named Text Embedding Inference (TEI) with GPU/CPU-optimized container images. While I have only used this for hosting embedding models, it does appear to support Roberta architecture classifiers (specifically sentiment analysis).

https://github.com/huggingface/text-embeddings-inference

You can always run a zero shot pipeline in HF with a simple Flask/FastAPI application.

[ Parent | on HN ]

Re:Zero-Shot Text Classification on a low-end CPU-only machine? by backend-dev-33 on Monday October 07, 2024 @10:32AM (#41766407)

thanks for Text Embedding Inference (never heard about it before)

> you can always run a zero shot pipeline in HF with a simple Flask/FastAPI application.

Yeah, sometimes things that are right in front of your nose, you don't see them. you mean this? https://huggingface.co/docs/api-inference/index

[ Parent | on HN ]

Re:Zero-Shot Text Classification on a low-end CPU-only machine? by pilotneko on Thursday October 10, 2024 @08:38AM (#41798215)

Sorry, life got busy and I haven’t been able to get back to you. I was referring to pipelines in the Transformers package from Hugging Face. https://huggingface.co/docs/transformers/v4.45.2/en/main_cla...

These are essentially function calls for you to run pre-trained models. If you want to continue this conversation elsewhere, feel free to shoot me an e-mail. It’s just my username @ gmail.

[ Parent | on HN ]