News for hackers. Stuff that matters.
Re:Ask HN: Better ways to extract skills from job postings? by azeusCC on Tuesday December 17, 2024 @04:29PM (#42445504)
Do you think SBERT + SVM is a good fit for handling ambiguous or less common phrases, or do you still end up needing some post-processing rules for edge cases?
Re:Ask HN: Better ways to extract skills from job postings? by PaulHoule on Wednesday December 18, 2024 @07:56AM (#42450067)
I haven't tried classifying anything as small as a phrase (assuming you've extracted it yet) with SBERT+SVM so I really don't know.

Another thing to consider is a T5 model. A T5 model maps strings to strings so it can be trained to take an input like

"Extract the skills from this resume: ..."

with the output like

"Excel, Pandas, Python, Cold Fusion, C#, ..."

and it will try to do the same. You'll probably still find it makes some mistake that drives you up the wall that need some pre- or post- processing.