"""
The following English text contains several French phrases. List all of them.
Text: Gabonese President Ali Bongo Odimba was deposed in a coup d'etat spearheaded by his father's former aide-de-camp Brice Oligui Nguema, shortly after the announcement that Bongo had won the 2023 election.
List of French phrases from the text:
-
"""
Response:
"""
coup d'etat
- aide-de-camp
"""
2. Prompt:
"""
Turn all words in the following text into their lemma form.
Text: Gabonese President Ali Bongo Odimba was deposed in a coup d'etat spearheaded by his father's former aide-de-camp Brice Oligui Nguema, shortly after the announcement that Bongo had won the 2023 election.
Lemmatized text:
"""
Response:
"""
Gabonese President Ali Bongo Odimba be depose in a coup d'etat spearhead by his father's former aide-de-camp Brice Oligui Nguema, shortly after the announcement that Bongo have win the 2023 election.
"""
Maybe too slow or too inaccurate or too expensive compared to bespoke solutions, but certainly not completely useless.
If you want a different tokenization, just turn the LLM response back into text and retokenize it.
That's what renders it nearly useless for such tasks, because you always have to check everything.
And whether you always have to check everything is a separate question from nondeterminism. You could have a deterministic heuristic that is often wrong in a domain where mistakes are fatal, or you could have a nondeterministic model that is almost always correct for a task where errors cost next to nothing.
https://ai.plainenglish.io/gpt-4-is-non-deterministic-af2028...
FYI, your source is medium-walled blog spam of https://152334h.github.io/blog/non-determinism-in-gpt-4/
As a consequence, the model is no longer deterministic at the sequence-level, but only at the batch-level
They could sell you a version where you shove in a whole batch, pay $batch_size as much, and always get the same result for the same batch.
ChatGPT changes this seed under the hood with each request
https://ai.plainenglish.io/gpt-4-is-non-deterministic-af2028...
But LLMs are deterministic when all the parameters are the same between inferences
1. Identifying (and highlighting/extracting) the language that spans of text are in within a different language (e.g. a French phrase in English).
2. Text search and highlighting, where you need to do things like performing word stemming or lemmatization on the search input, find matching documents, and highlight spans.
Also, LLMs have a different tokenization model, so you have tokens like "don"/"'t!" -- this makes them difficult to work with in downstream NLP applications where having words, numbers, punctuation, and symbols as specific tokens are more useful.
NLP is not a solved task, as things like part of speech classification (identifying nouns, adjectives, etc.) are not 100% accurate, and tend to have a lower sentence accuracy compared to word accuracy.