As you should.
I think 'taught ChatGPT to invent a' is hyperbolic though, this is more like 'taught ChatGPT my invented' - the only thing it invents itself are the 'relex' word->word mappings.
I'm now wondering how the AI would cope with one of my conlangs. I have example sentences already - https://docs.google.com/document/d/1YT9KzgvFu8DNWVL02t1NGgRS...
marks the date
The structure of that test (this was a while back - couldn't do an unconstrained one) had a panel composed of some chat bots and some humans (10 total, though the number isn't too important). Each was limited to the area of their specialty - I think there was a chatbot that had its specialty of bartending drinks.
The people evaluating them rated them on a distinct 1-10(?) scale. The question was trying to find a "what is the most human like chat bot."
Part of it was that the human expert in Shakespeare was considered to be more computer like than many of the chatbots in part because of the depth of knowledge in that domain.
https://github.com/ishan0102/aoc-2022-chatgpt
> Day 5: Supply Stacks
> This day actually threw me for a loop because parsing the input is so challenging. After spending a while on prompting I wasn't able to produce anything meaningful. I might actually stop after today if the puzzles keep getting harder because I don't want to spend all this time messing with input parsing. This highlights some of the limitations well, we still need human input to coax the model into understanding how to break down a hard problem.
For that repo (not mine - mine is over at https://github.com/shagie/AoC_2022 ), day 5 is where they got to the point where the complexity of the description of the problem is greater than the complexity of the problem itself.
Edit: I asked it; and it knows about Lojban but it clearly only parroting the Wikipedia entry or something similar.
After the read, I find myself pleasantly surprised. My initial suspicion that the language would turn out to be Just Another Relex (make a new language by replacing English words with invented words, keeping the grammar and syntax the same) was clearly a waste of a suspicion. Furthermore I can see this approach being really useful to writers/game makers/etc who want to include a smattering of conlang in their work - for instance a non-relex naming language for placenames, overheard snatches of conversations, etc - to add an extra layer of spice to it.
So, I don't feel threatened by this novel use of AI. It could prove to be a really useful tool to help with some often laborious tasks (creating test translations to try out an idea, etc). I just hope the AI had as much fun inventing its language as I've had inventing mine!