mwitiderrick
I built a free Eleven Labs alternative: No login
Show HN: SmallFame – Find Verified AI Micro-Influencers (10K–100K) in Minutes
Hi HNI just launched SmallFame, a real-time database of AI-focused micro-influencers (10K–100K subs) with verified contact info.The problem: finding the right influencers is painful. Manual searching takes 5–10 hours per influencer between research, verification, and chasing contact info. Most platforms are broad, expensive, and don’t focus on the AI niche.Our solution:1,085+ verified AI...
Show HN: I made an app that turns scripts to videos in minutes
Transform YouTube videos into engaging social media content
Scripts in the Style of Top YouTubers
AGI in 2026: Anthropic CEO
Pushing the Boundaries of Mixed-Precision LLM Inference with Marlin
Fast Llama 2 on CPUs with Sparse Fine-Tuning and DeepSparse
Fine-tune 7B LLM on Single GPU
Build Scalable NLP and Computer Vision Pipelines with DeepSparse
Sparsify Image Classification Models Faster with SparseML and Deep Lake
YOLOv8 Detection 10x Faster with DeepSparse
Image Segmentation: Your Ultimate Guide to Easy Deployment and Fast Inferencing
But need to find an answer from the documents
And at the same time, get the document where the answer is coming from
You could open and search the documents one by one
But that would take forever
Enter Extractive Question Answering with Sparse Transformers
With Extractive Question Answering, you input a query into the system
And in return, you get the answer to your question and the document containing the answer.
Extractive Question Answering enables you to search many records and find the answer.
It works by: - Retrieving documents that are relevant to answering the questions. - Returns text that answers that question.
Language models make this possible.
For example, the receiver can be a masked language model.
The reader can be a question-answering model.
The challenge of these language models is that they are quite large.
The size makes it hard to deploy the models for real-time inference.
For example, deploying big models is not possible on mobile devices.
Furthermore, inference time, latency, and throughput are also critical.
The solution is to reduce the model's size while maintaining its accuracy.
Making the model small is easy but maintaining accuracy is challenging.
These can be achieved by pruning and quantizing the model.
Pruning involves removing some weight connection from an otherwise overprecise and overparameterized model.
Furthermore, you can reduce the precision of the floating points to make the model smaller.
In today's article, I cover this in more detail. Including: Document retrieval with DeepSparse and arXiv dataset Document retrieval with a dense and sparse model Comparing the performance between dense and sparse models
Search Documents Quickly with Extractive Question Answering
How do you stay up to date with the data science and machine learning field?
How do you stay up to date with what's happening in the data science and machine learning field?Which newsletter do you follow here are mine.Deep Learning Weekly https://lnkd.in/d3yR6t27KDnuggets https://www.kdnuggets.com/The Variable by Towards Data Science towardsdatascience.comThe Batch by DeepLearning.AI https://lnkd.in/dszi8JvhData Science Weekly https://lnkd.in/dNcuG5zDPyCoder's Weekly...
However, documents in the real world can be arbitrarily long. For instance, reviews from customers.
Classifying these reviews fast can help a business in engaging with its customers quickly. Fort instance, flagging negative reviews to reduce churn and customer complaints.
The problem?
Language models are usually very large making them slow at inference and difficult to deploy. These models are usually overprecise and over-parameterized. You can drop some of the weight connections in these networks to achieve a small model while maintaining accuracy. This is known as sparsification. Furthermore, you can reduce the precision of the floating points in the network to reduce its size further.
In my latest article, I explore how to perform text classification on long documents using sparse Hugging Face Transformers. I illustrate that it’s possible to use a 90% sparse transformer model— meaning that 90 percent of the model's weights are removed, and the rest of the parameters quantized— and still achieve accuracy similar to a dense model.
Using a sparse transformer achieves a 4.8X increase in performance over the dense baseline. It also results in a smaller model which is easy to deploy on commodity CPUs, hence no expensive accelerator hardware is required.
Try it yourself https://neuralmagic.com/blog/accelerate-customer-review-clas...
Accelerate Customer Review Classification with Sparse Transformers
Free Deep learning with TensorFlow and Keras eBook
Distributed Training with Jax and Flax
Today, Layer goes open-source to make machine learning more accessible
Can We Query a Table with T5?
Model Serving with TFX
What is Model Serving?
What is TensorFlow Serving?
TensorFlow Serving architecture
How to set things up with TensorFlow Serving?
Installing Docker
Installing TensorFlow Serving
Building an image classification model
Serving a model with TensorFlow Serving
Communication protocols
Creating gRPC and REST endpoints
Making a request to the model
Challenges of working with TensorFlow Serving
Common errors you might face when working with TensorFlow Serving
Best tips, practices, and gotchas when working with Tensorflow Serving