Show HN: Get conversational practice in over 20 languages by talking to an AI
https://talk.quazel.com/chat/try
Hi everyone,Let me introduce you to Quazel, where we want to enable people to talk their way to fluency.
We have all tried various language learning apps and tools, however, one aspect of language learning current services are really bad at is conversational practice. You might get a chat-like interface, but in the end, the conversation partner will only respond with a predefined "if the users say X I say Y".
With Quazel that's completely different. In completely dynamic and unscripted conversation you can talk about pretty much anything you want. For example, you can try ordering food at a restaurant and even hold a philosophical discussion with Socrates. Additionally, you can analyze the grammar of your responses or use hints to help you out when you get stuck.
We want to change how languages are learned from a grammar-centric approach to a more natural, conversation-focused one.
SO... I'm highly suspecting that, behind the scenes, the "real" conversation is happening in English, and it's translating in both directions. Which is always going to be fairly disastrous, particularly with short snippets of conversational text. (In contrast, machine translation does best with long sentences of highly technical writing.)
So the concept is very intriguing, but the problem is that it needs to rely on native language models per-language. (Or if it already is, then those models need a vastly better or larger training corpus.)
So A+ for proof of concept, but I'd never recommend anybody practice with this in order to learn/practice a language, because with the quality where it is, it will make you a worse speaker -- not better. The things it says are just too weird.
Of course there are differences, but both Dutch and English are West Germanic languages (descended from proto-Germanic) whereas Portuguese is a Romance language (descended from Latin).
Here is a handy tree showing how various languages are related to each other:
https://d1sjtleuqoc1be.cloudfront.net/wp-content/uploads/201...
It's word ordering and idioms where AIs stand or fall. Things that show very little correlation in the evolution of language.
It describes genetic descent.
https://en.m.wikipedia.org/wiki/Literal_translation
For this reason I prefer DeepL over Google Translate. The former has a much more curated corpus.
Source: learning languages for 10+, have met students as described above.
The difference between standard Portuguese and oral language in Brazil is enormous.
Native speakers are lazy: even though they know perfectly well how to conjugate the numbers, it’s easier to rephrase things so you don’t have to.
Languages are fascinating!
The speech recognition is flawless as far as I can tell. The AI occasionally gets itself into a loop of repeating my question or itself, but I think this has been a problem with a lot of chatbots. The only glaring errors I've seen so far are these kinds of AI-specific issues, like forgetting context, getting geographical facts wrong, etc.
>こんにちは。今日はどちらへお出かけですか? (Hello. Where are you headed?)
京都に行きます. (I'm going to Kyoto)
>素晴らしい都市ですね。行ったことはありますか? (It's a great city. Have you been?)
いや初めてです。お勧めの場所はありますか?. (Nope, it's my first time. Any places you suggest?)
>京都は歴史のある美しい都市です。たくさんのお寺や神社を訪れることができます。(Kyoto is a beautiful city with history. You can visit plenty of temples and shrines.)
そうですね。清水寺とか聞いたことがある。行きたいんだ. (True. I've heard of like, Kiyomizudera, and I want to go.)
>清水寺は必見です!とても人気のあるお寺で、市内を一望できるんですよ(Kiyomizudera is a must-see! It's a very popular temple, and you can see the whole area at once)
Not only does it know about Kyoto, but it knows about a specific temple (picked it up via speech recognition too). Translations are rough and by me, not quazel.
This could be a real game changer if the other languages are this good.
Additionally, if you register an account then you get access to the "Scene builder" which lets you set up a situation to start the conversation in. I have found that you can redirect any conversation to pretty much anything, but I thought it was a cool idea that many people here averse to account-making might have missed.
In another one it asked me if it was okay to sit next to me and I replied with いや、遠慮しときます (which was marked as a "grammar mistake") and the AI just said ありがとうございます and "sat down" next to me nonetheless.
So far I'm not impressed, it looks like a chatbot piped through Google translate.
AI: こんにちは。今日はどこに行くんですか? Me: 今日は家にいますよ。 AI: それは素晴らしいご安全に。 [?!]
Very strange reply.
Me: よく出かけたりしますか。 AI: そうです。私は新しい場所を探索するのが好きです。
Good that the たりします form didn't trip it up.
AI: こんにちは。今日はどこに行くんですか? Me: 三重県に行こうかなと思っていましたが、今回は愛知県にしました。楽しみです。 AI: 愛知県はとても良いところです。きっと楽しい時間を過ごせると思います。楽しみにしていることはありますか? Me: 特にないかな。訪れてみたいと思っただけなんです。. AI: さて、愛知は見どころがたくさんありますね。名古屋城、トヨタ自動車博物館、そしてもちろん明治村の野外博物館もあります。 Me: なるほど。行かれたことはありますか。 AI: いや、まだチャンスがないんだ。でも、いい噂は聞いていますよ。
Not bad. It didn't falter with my 三重県のひっかけ either. The んだ felt a bit odd, but pretty solid.
AI: こんにちは!今日はどこに行くんですか? Me: 今のところ、目的地は特にありません。 AI: では、今のところ、目的地は特にありません。 [笑] Me: そういう感じなんです。すみません。. AI: 大丈夫ですよ。あなたがどこに行きたいか、お手伝いしますよ。 Me: 愛知県内で自然がたくさんあるところに行きたいかな。 AI: 愛知県内には自然がたくさんあるんですよ。どこか特定の場所をお探しですか?
Line 3 was pretty odd, but again not bad beyond that.
It's a good start, at least. It could be interesting to see how this develops.
i've watched enough wuxia/xianxia now to recognize about 10% of the mandarin words/phrases, but have almost no understanding of the grammar. the real key to learning seems to be (going through the often frustrating process of) communicating in real time, not just reading and listening.
Second, where are the companies that are doing this type of thing for NPC dialogue in games.
Imagine playing Mass Effect or Skyrim but where you get to ask whatever and the NPC responds with something that fits within the space of possible answers based on the prompt that defined their existence.
The AAA studies leave nothing to chance when it is about the game play. Once "AI" speech comes to a level where the NPC will only answer with pre-sanctioned content they might jump onto the band wagon ... but seeing that it is very much possible to generate porn with "censored" stable diffusion ... we won't see "free" AIs in games any time soon.
The main problem with this type of content is that it needs to be solid enough that it adds to the experience. If you're allowed to have a conversation with any NPC you need to keep track of what they know, their responses need to be consistent with the world, and the time to generate the response needs to be reasonable.
Old RPGs such as The Elder Scrolls: Daggerfall used to allow you to go up to any of thousands of NPCs and ask them about anything! And practically all the results were uninspiring cookie-cutter replies either saying they don't know or relaying some vague common knowledge on the subject. For me it lost its novelty very quickly. In Dwarf Fortress you can play Adventure Mode and go to any randomly generated NPC to talk about anything! Those NPCs are highly complex with intricate personalities, relationships, and emotional states. Their responses are... mainly the same type of response you'd get from Daggerfall. With a good helping of completely inconsistent replies. I once asked someone about another NPC, they said it was their husband. So I asked where that NPC was and they replied "I do not know who that is". Trying to talk to characters in AI Dungeon is similarly frustrating, with the added hilarity of the AI sometimes getting mixed up about who is who between you and them.
There have been a lot of experiments with more ambitious use of AI in games. The most well-known publicly disclosed failure being Oblivion's Radiant AI which was meant to be a lot more impressive than it turned out, because they had to seriously scale it down due to random irrational behaviour.
I’ve only heard the marketing speak (“amazing!!!!”) followed by the actual product (“get X for Y at Z, 5 times”). I’ve never seen anything that explained the disconnect, aside from Todd just being a sheister.
I think those even were used in a couple games ages ago. But they are not very good at steering the player and keeping him on track, which is how dialog systems are usually used in game design. They might be useful in a truly open world where the player discovers the story themselves (maybe like Fallout 1/2), but the AAA gaming industry has largely abandoned that idea in favor of "linear scripted stories in an open world".
[1] https://en.wikipedia.org/wiki/ELIZA
ultimately we care more about our character than the NPC being "realistic".
It's just a headache that I wouldn't want, I guess.
People have apparently already found workarounds for Midjourney's nudity filter.
StabilityAI was smart enough to realize people will get around that, and allowed the objectionable content filter to be removed via commenting out a few lines of code.
It's our sensibilities that need to change, not our tools.
Maybe an AI could generate incidental dialog, things NPCs yell out in reaction to things around them, to keep it from always being from the same list of two or three reactions.
Just my two cents. I want to play a well written and fun game, not a chat bot.
Some AI ideas I think make a lot of sense in a video game off the top of my head:
- Posters on walls
- NPC to NPC conversations (overheard in a bar, etc.)
- Flora/fauna generation
- Loudspeaker announcements
Anything part of story or lore, I'd rather have a team of good storytellers give me what they got.
Every character using the same three lines doesn't seem like a technology problem. Getting voice acting out of the time-critical path by automating it might help, but I'm doubtful about the usefulness of AI-generated scripts.
I'd put good money on AAA studios actively working on this. Voice acting budgets make up a non-trivial portion of expenses and actively constrain the scope of games. Studios are definitely investing in this, game dev cycles just take a lot of time on top of the R&D.
This type of thing is solving the problem of generating infinite variation of text, which might make the NPC more realistic than hearing a series of predefined recordings. But you still have the problem of text2speech, you still need a realistic one if you want to include this into the game.
"Event[0]"[0] is based on a great implementation of a chatbot NPC/adversary, and there's a nice video by Game Maker's Toolkit explaining how they achieved it [1].
[0] https://en.wikipedia.org/wiki/Event_0
[1] https://youtu.be/bCJw4hQkPj4
I'm no insider, but I imagine the same sort of reasoning is applied to when companies don't invest enough in opponent AI to make them continuously competitive: people want to play with other humans.
But I suspect this will change if it's marketed well. I will like to see that happen!
Unreal Engine is popular because it removes the effort of designing and building a 3D engine from game creation (and it's my understanding that because it has fairly reasonable licensing agreement).
PRATTLE, or Persistent Realistic AI for Talk and Text Language & Engagement, could be the Unreal Engine of procedurally generated NPC speech in games! And it already has a name... all we have to do is, you know... the hard work...
For the answers to make sense the NPC needs to be consistent
I've never seen one of these chat bots that doesn't produce occasional nonsensical answers
There's also the problem that as the designer you don't even know what your NPC is going to tell the player
You can do a bunch of testing but its still unpredictable
https://youtu.be/fPqpv__NiD0?t=189
People who use language learning apps are focused in learning English most of the time. Still those who speak fluently are trying to improve their speaking and listening.
And the first language which appeared for me was Brazilian Portuguese which is my mother language.
[Edit] I was trying the Brazilian Portuguese mode, and apparently it is Portuguese from Portugal, because the answer given used a verb tense that is not common in Brazil.
It's also the difference between active and passive command of the language.
Exactly this. For example, I am learning German and have changed the language of my reading tablet's UI to German. That in itself is a useful learning tool.
It's because Reading / Writing can train oneself but conversation must be training in both sides, which always inadequate in some area, such as HK, since we don't talk in English but we can read quite well
You've been bookmarked, I'll be back in a few days. This looks amazing.
I think the author underestimated the interest of folks in such a product and it may be having HN 'kiss of death'
I've spent last year cca 5000$ on tons of conversation/grammar lessons via zoom to get to French B1 and do Swiss FIDE certificate, starting from very low A1 I would say.
Given, the guy was properly good and he helped me to get better tremendously (and I got the cert). The biggest issue with language learning is finding a buddy that would not run away after few mins disgusted by my torture of language, as many french unfortunately do (tells you something about their school system and archaic language, but those are other topics for other places). I mean people in remote France offer this for something like 25 euro/hour.
This tool may be perfect for that active part of learning, up to certain level I presume since I don't expect very high level finesse to be present (sorry I am a bit sceptic when it comes to AI/ML). This is the hardest part of learning // actively speaking, but also one where one grows the most.
If you notice this is how adults talk to babies and children to help them learn the language.
It'd also be great if my sentence was scored for 'natural-ness' -- how close was it to native speech? If this could be done regionally, that'd be better still (e.g. Spanish as spoken in Spain vs Mexico vs Argentina, etc).
I'd also love to know what age level am I speaking at. A child? A teen? An adult? A more educated person? A professional author? Am I being ambiguous? Too direct?
What is the tone I am using? Friendly? Demanding? Too formal? Culturally clueless? Improper to someone older or to the opposite sex?
In fact, these same feedbacks could be really valuable even in your own native language. Learning how to communicate more clearly, precisely, positively, professionally, respectfully, literately, or even in a different style would be great practice to improve a person's basic communication skills in any language.
Some languages have well defined language levels for foreigners learning the language, such as HSK levels for Chinese. Would be cool to leverage that somehow.
I was using Google (via some speech to text notebook web app) to practice Thai pronunciation and had the opposite problem, where the machine understood when I’m pretty sure my pronunciation was bad enough an average Thai would not understand me.
That said, I would absolutely pay for something like this if it covered the language I’m trying to learn, even if imperfectly. And at least for beginners, forcing you to speak plainly is not necessarily a bad thing.
Any plans for pricing? Subscription or by use or…?
Obviously you don't want to be spammed by ads in every conversations and it's going to be tricky how they come across. Do you think something like that would be greepy or ok? Or would you say it's better to have it a premium subscription based service? We are trying to figure this stuff out ourselves atm...
Also possibly concerning, is the financial incentive to push conversations into areas where the ads are discussed. People dont always talk about consumer goods, but with the ad model you might have the situation where AI keeps bringing them up anytime it is remotely relevant. turning conversations into commercials, and missing opportunities for learning generic words by replacing them with named brands.
You: "Hi how are you?"
AI: "Thanks to my Frosted Flakes and cup of Folgers that I bought from ShopRite this morning, I am feeling great! Have you tried Frosted Flakes?"
Reality: "I'm good, you?"
that said, there could be some value in seeing brands you recognize around the words they represent (like saying "frosted flakes cereal" above instead of just "frosted flakes") since the context will help you remember what the generic words mean.
Also dont underestimate the issues you might have getting Brands on board with this. you are asking them to give you permission to use their brand name in conversations that they cannot approve of in advance. that's very tricky too
I'm sure everyone knows by now that if the product is free, "you're the product".
[1] I wouldn't even care if the conversation went off on a massive tangent temporarily to include the advert. The point is that not everyone can afford to pay for such a service, and advertising can solve that issue.
1. Whatever you do to make it work for useful ads ("Oh, you like Goddard? Check this out on Netflix...") could also be super creepy ("Oh, you have ED? So sorry, have you tried Superdrug?") and I don't think there's any way you're going to know ahead of time. As a techie sure I see how it would be cool to have the "AI" just "say the ad" but... at least be very, very selective about what can be advertised.
2. If it works, it'll be a slippery slope. First it's our conversation about the movies, then it's movie mentions our previous conversations, eventually it's all our conversations ever, dumped into another AI to target the ads -- at which point, Facebook buys you I guess, so there's that.
If I were you I'd target the education market, make it subscription based, offer some kind of big-ish discount for public schools, and also offer some kind of specific features for language schools. For instance my teachers give me homework, why not have them seed your program with some key phrases I need to practice?
Anyway, data point of one, but if it had an iPhone app and Thai was an option, I'd pay $10/mo without thinking about it.
---
Quazel: 告诉我吧!你是如何安排你的家具的?
Me (in halting, broken chinese): 窗户旁边有一个沙发,中间是电视和桌子。我的工作就是在这里.
Quazel: 所以你的沙发是面向窗户的?那真的很好。我敢打赌,这样你会得到很多自然光。沙发后面是什么呢?
translated
Quazel: How do you arrange your furniture?
Me: There is a couch next to the window, with a TV and table in the middle. This is where I work.
Quazel: So you have your couch facing the window? That's really nice. I bet you get a lot of natural light that way. And what is behind the couch?
---
holy. shit. its like a very very patient language teacher who doesnt judge you, who understands objects and context.
Maybe the weirdness is an innate characteristic of machine translation, so I'm not being too harsh here. But IMO it cannot take the place of a human teacher (at least now).
but i gotta say as someone who doesnt like people waiting for me to come up with words, this beats a human teacher for the basic activation of neural pathways for vocab
Me: How are you?
Q: I am well
Me: What do you do?
Q: I am an engineer
Me: What kind of engineer?
Q: I am a civil engineer
That's when I got the pay/subscription wall.
However, it is impressive and probably has application elsewhere. I think this should be pivoted to law, customer service some other target market.
My only concern is how "correct" the tool or the AI is.
It is a fundamentally important property of society. We should not be afraid to even speak. Everyone has a different reality, mistakes are often highly relative. Richness of culture (and lack of political tyranny) comes from this interaction and lack of it is almost always bad.
I play Go (the board game) at a fairly high level and have been participating in clubs and teaching Go for the better part of 15 years. The simplest and easiest way to get better is to play the game a lot, hopefully against someone a little bit better than you are. You don't even have to spend a ton of time on it, just play and once you're done think about the moves you made and maybe a place or two where you could have done better. There's several websites where you can make a free account and just click up button to say "hey, I'd like to play now!" and within minutes (or longer, this depends on the server and the level that you're playing at) you'll have a game you can get done in 30minutes.
It's crazy how hard it is to get people to play other people.
Most recently I've taught 5 people at my current workplace how to play. I've gotten them to play me, and, sometimes, each other. They've all made accounts on various sites to play, I've played them on those sites! They'll even sometimes play a robot on those sites (playing a bot isn't the best, but it is a little helpful).
Not a single one of them are willing to start a game with a stranger.
I'm sure nerves are part of it. But the reasoning I've heard time and time again, and not just with these 5, but with the dozens of people I've taught over the years, is some variation of "I don't want to waste their(my opponents) time".
They seriously feel like because they are still so new to the game, and still so unskilled that they would not be worth playing, that they would be "wasting" their opponent's time.
Take this to language learners, a lot of people do feel like as a beginner, talking to someone who is fluent is wasting the time of the fluent person. You're not paying them in the language exchange, you're just babbling to them like a 3 year old, a grown up who can't even carry on a whole conversation beyond "donde esta la biblioteca?".
You are right, language exchanges and just speaking with someone _is_ the best way to learn! It's super hard to break through the fear, embarrassment, and feelings of wasting another person's time with your own drivel.
Something like this, like the bots that play Go, are a way to bridge the gap.
Still, whatever, I'm obviously not everyone.
Good luck!
People don't want to bother someone else when their problem seems "elementary" or too low on the "beginner level".
I've observed the same when tutoring others in math, programming, or physics. Even though we have an existing relationship where I will help them work through school work people tend to be very anxious about asking for that help.
I've seen it with new coworkers who spend waaaay too much time trying to figure something out by themselves when they could have just walked over and just asked for the answer.
"I didn't want to bother you" is a refrain I've heard a lot from others in a large number of situations, teaching Go is one where it's more directly analogous to learning a language through speaking, because it requires another human's time, and the resources are extremely easy to access.
Really impressive & great. Congrats on the launch! Really awesome work.
Micro bug report: clicking "Install Quazel" shows a dialog with a small 404 icon/image. Cheers
I suspect that is using one of the off the shelf NLP chat bots and speech recognition, perhaps from a platform like Hugging Face, since you are allowed to chat about anything you want and have a dozen or so languages enabled. While really cool, as others have pointed out in complex responses received, I suspect it is a long way for being useful to a language learner because the user has no way of knowing if what the chatbot is saying makes any sense. For example I used keyboard entry to speak in Japanese with it. The bot said hello and asked my name. I replied with my name in katakana and the desu (I am fragment) in hiragana. The bot responded in a way that just smashed those together as my name grammatically which is incorrect.
Perhaps the language models can get so good some day one could just prompt a model to "teach me Japanese through conversation from the beginning", but for now I think it is difficult enough to make an engine for a single language pair. If one is far enough along in a language to be conversational, it is low-cost, or even free, to find an actual language exchange conversation partner.
for example instead of Ты (you singular) it should say вы (you plural)
Duolingo explains:
Humans, when speaking the language, connect to other humans through emotions and feelings. That is what gets us going. That is what keeps the conversation interesting (even for intermediate students).
This is the same reason why ads from Apple always show how family meets, or a kid scores a goal in a match and not just simply says "1.8GHz, 4GB ram" that only speaks to our neocortex.
That's why unless computers pass the Turing test, it is unlikely this will "enable people to talk their way to fluency".
I do agree though it is a cool tech.
I spoke few french phrases with it and it explained to me why it loves french.
Also, you should add english language! It is being learned by 1 billion people as a second language and probably it would be a lot easier to make a great model in english.
If I were you, I would nail english language first and after that focus on adding more languages.
Anyway, great product!!!
Not so sure ..
With an android phone
>a descent internet connection for streaming
Lots of free public WiFi spots and cafes
>available at any time of the day instantly
Why instantly? Uber-style, whoever is around
>ready to have a 2 minutes stupid conversation about anything random
Script it
You're right that nothing beats the convenience of the AI, but real people have other certain advantages.
It would shock you how many elderly are so desperately lonely, and more so how a simple phone call would pick up their spirits. Pretty crazy.
Small request: for japaneese, it would be great to include a japaneese phonetic transcription of the text in western alphabet. It would help distinguish words and make it easier to learn new vocabulary..
This is _so cool_ for an MVP.
Perhaps in the beginning, it could even accept English speech and reply in the language of choice -- it's easier to build recognition first.
On the whole, fantastic work. I'm curious about the audio processing backend, (and if you could use some help in that area ;-).
When I started I wanted to be sure that every single word/sentence was "correct" (i.e. a native speaker agreed that all the words/grammar were correct/natural in that context). LMs have improved since I started, but for me, that requirement still stands and ML approaches still need a heavy human touch IMO.
In general, practicing something allows you to do it with less and less effort until you barely have to think about it at all, but if you're practicing making mistakes , that just means you'll be making mistakes without thinking about it. To get better, you also need to notice your mistakes to change what you're doing accordingly.
So I think a bot that can guess what you were trying to say and can tell you what you should've said instead might be a bit more useful.
For kickstarting a language practice, this site honestly seems ideal..
I did some experiments and using the same prompt but without translating it seem to lead to better results.
For the FAQ: How long have y'all been at it? Who is in the core team and what are your backgrounds? Would love to know the background story of the team. Just figured y'all are based out of ZH (ch) and SF (us) and noted the their.news submission but know nothing else. Super curious!
Concreteley we are:
Philipp (that's me, technical, https://www.linkedin.com/in/pmhadjimina/ )
David (technical, https://www.linkedin.com/in/david-niederberger-aba7a7177/)
Sam (biz-wiz, https://www.linkedin.com/in/samuel-bissegger/)
and Gurnek (biz-wiz, https://www.linkedin.com/in/gurneksingh/)
Send me a DM on linkedin or at [email protected]
Background wise David and I met in while doing CS in undergrad at ETH Zurich, I know Sam since highschool and met Gurnek at UC Berkeley. I have been working on Quazel fulltime for 1 week, before then I still had to finish my thesis (which was a pain in a*), but have been working on it for a few months before then just part time.
In all fairness, I bailed on Duo about a year ago after a full year of maintaining a streak and feeling I wasn't learning much.
I switched to Seedlang(Learning Deustch) And its miles better, and this projects looks promising too!
Although they cover different use cases.
Edit: same issue in Chrome:
Access to XMLHttpRequest at 'https://firebasestorage.googleapis.com/v0/b/nextjs-yak.appsp...' from origin 'https://talk.quazel.com' has been blocked by CORS policy: Response to preflight request doesn't pass access control check: No 'Access-Control-Allow-Origin' header is present on the requested resource.
What makes you think 15000 hours of listening would improve anything, more than spending those 15000 hours on any other activity ? And do you have any specifics results that could give credit to your theory ?
For reference, it is estimated that for hard languages, ~2200 hours of practice is required : https://linguapath.com/how-many-hours-learn-language/
There are a number of reasons why you would want to focus on input early on. For starters, with very little exposure to a language, you have very little idea of what it is supposed to sound like. Not just pronunciation but word choice, grammar, and phrasing as well. So when outputting early you will make your best effort attempts, which are almost certainly going to be incorrect. Odds are these poor "best effort" attempts will stick as muscle memory and continue to be bad habits well into fluency, if you make it that far. I'm sure you've encountered many foreign speakers in English that are very fluent but have poor pronunciation or use incorrect grammar.
I've never heard that "producing" a language is more efficient to learning it than "consuming" it. How can you learn anything by producing it without having "consumed" it first? That's not learning, that's inventing, and you don't want to be in the business of inventing language unless you're William Shakespeare. If you're interested in learning more about this idea, check out Stephen Krashen's Input Hypothesis [0]. In particular this quote from the Wikipedia article is salient:
> Talking (output) is not practicing. Krashen stresses yet again that speaking in the target language does not result in language acquisition. Although speaking can indirectly assist in language acquisition, the ability to speak is not the cause of language learning or acquisition. Instead, comprehensible output is the effect of language acquisition.
[0] https://en.wikipedia.org/wiki/Input_hypothesis#Input_hypothe...
That's all muddied by AI/programmed learning (how much connection do you get from Duolingo?) now but I think the kernel is still true. People largely learn languages to talk, not to listen, it's no wonder things are structured that way and good luck trying to sell people otherwise.
Though I do think there is value in watching tv series or movies you've already seen in another language _without_ subs. You're able to focus more on the dialog and pair it against your knowledge of the story structure without getting distracted. You can't only do that however, which I don't think you're suggesting. You need to have studied the language to know what words you can pick out/know/dont know.
…but let’s face it: either extreme (only input, only output) is clearly stupid.
Predictive models require a feedback loop; if you don’t have any means of correcting the predictions of good output, you’ll never refine your model.
This is true of AI models, and it’s true of humans. It can’t not be true.
The point is that you can only learn meaningfully from annotated inputs, like tv, or like talking to people. The input just has to be at the right level.
...
Should people start with listening instead of talking to people? Probably not. Probably they should do both. Why not do both? It's crazy to suggest you should only one or the other.
Probably, the feedback loop in deep immersion of a language, where you have it around you all the time, in a country where that is the native language is the best possible way to encounter lots of examples at lots of different levels to learn from. Probably, you get better input from speaking, because it means people talk to you at a level similar to what you're already at.
Is it about actually speaking? No.
…but it’s patently ridiculous to suggest you could go to another country and just sit silent and listen for three months.
This is pretty interesting tech, and frankly, amazing that it works at well.
Is it perfect? No. Is it another useful tool? It certainly is.
If you can't grab hold of context of what's being said you won't really pick much up.
That's why total immersion isn't effective for beginners.
This is only relevant if your goal is fluency and not having think so much before speaking.
I'm unconvinced to be honest, as pretty much everything else that human learn is made better by practice, but I'm not a linguist.
I still think that proposing to start learning a language by spending 15000 hours (or 1500, or 150) listening to it, instead of trying to practice early on is a very inefficient way to learn a language, compared to pretty much anything
I'm sure speaking helps most people who study languages simply by exposing them to more input more frequently then they would otherwise be exposed to. I just don't think it is as efficient as focusing on listening first. It will lead to having an accent, grammer issues and pauses to think about how to say things.
That being said good luck finding any program that doesn't focus on speaking early.
Working in Sweden, where tech companies speak English internally, I've been able to follow the language learning journeys of quite a few people (including some using the strategy "don't bother"), and the people who end up the best speakers (with regard to accent, grammar and vocabulary) are invariably those who try to speak the language as much as possible as early as possible.
Yes, they will have a strong accent in the beginning, but it goes away with time (though accents rarely disappear entirely). The native English speakers who've lived in the country for twenty years without speaking much Swedish daily still have strong accents.
But that may not be that realistic for most at least not without a accommodating and capable tutor.
My anecdote - learning Mandarin, which is tonal, is absurdly hard before you develop an ear and tongue for tones. I think trying to practice speaking in tones helps to then hear them, because you understand the sounds people make better. How they abbreviate/slant or modify tones based on surrounding tones - why? Because it feels better in the mouth. So until you experience that, you won't understand slant tones and such.
Also, when you are reading you are most likely speaking with your inner voice. If you don't know the proper pronunciation, you may reinforce bad intonation/pronunciation habits. It happens to me when I'm reading a text with names that I'm too lazy to properly read. I just register the shape of the word with the first/last letters and length, then I pattern match in the rest of the text to know who we are talking about and that's it. More then once when talking with friends about books/articles/..., I could not tell the name of the person of interest. If it was written I would recognize it but I couldn't vocalize it.
Considering this doesn't work without having to create an account, you need to provide some information about how people's inputs are being recorded, how it's used, and who it's sent to.
This is a dark pattern and it's disconcerting that people's questions are going unanswered, especially since you mentioned that you would be seeking an accelerator for this project.
There's some key points of advice I'd give:
- Allow multiple languages under an account. People that learn languages tend to learn more than one. I'd personally like to practice my Spanish AND Chinese.
- Forget the lessons (for now at least. You're jumping in too fast and even the basic lesson requires quite a large barrier to entry). Make an easy way to just get to the chat in a specific language. That's the greatest utility of the tool, make it shine.
- There's also some ease of use things like lack of pinyin/latinization for some languages. Or like not being able to delete your message when in the translation (and that pressing the record again appends instead of rewrites). But this all seems like it'll be worked out by dogfooding.
Great job though! I'm excited to use it and have already shared with a few friends.
As a (CV) ML researcher, I'm curious what backends you're using and your control flow.
Feature request: Allow you to switch between written and verbal modes once you've loaded the chat interface. Right now you need to reload everything to switch modes.
A few feature requests:
- save conversations and come back to them
- history of past conversations
- auto speak the sentence
- larger buttons particularly for the microphone
- Noted
- Not 100% sure what you mean with that. So, you want to automatically speak a sentence that you enter in translator? The normal messages you get from the AI, should already be spoken automatically (though I had to implement a hack on safari, b.c. you can't automatically play audio there)
- Noted
AIs simply do not sound like people. They can fool me for a little while, but eventually you realize it's just a bot. But that's when I'm a native speaker. How will I be able to detect this when I struggle with the language?
I can't help but think it's dangerous to give a non native speaker access to this, and lead them to believe they're learning to speak like a real person. They aren't -- they're learning to speak like GPT-2.
The chief sin of AI is: this model is sufficiently close to a human. (How'd that work out for the resume filter? Or the AI responsible for setting bail?)
The worse sin is teaching someone to emulate what the AI does. You take whatever biases the AI has, and encode it into a living, breathing person.
Why would a language learner be concerned about that? If I thought it was a real person, I'd become alarmed, because that's not what it was presented to me as.
> You take whatever biases the AI has, and encode it into a living, breathing person.
Biases towards certain adjectives? I don't even understand this comment. It could lead you into speaking weird Spanish if it speaks weird Spanish, but I imagine that would be something they were trying to improve if they noticed it. And growing up in a weird place or having a weird family could also result in you speaking weird Spanish. You still speak Spanish, which is what language learners are looking for, and if you want to sound like a particular class of Spanish speaker, you would hang out with them and consume their media.
I mean, my own English is pretty bad in my opinion, but it's a dream level for an aspiring language learner. Practicing their English with me would be useful, even if my speaking is somehow "biased." Are you telling me that language practice with an AI is worthless, or even a sin?
I really don't understand a bit of this comment. So much so that I'm suspicious that it was generated by a model.
It's a suggestion for improvement but it's already very good and I think I'm going to use it a lot.
By the way, just in case you don't know and you find it interesting, in the case of Chinese there was a crowdfunding campaign about a hardware speaker that would do something like this (https://webmarketkings.com/lily-chinese-scam/). It never delivered. I was one of the backers... but well, that's life with Kickstarter and the like, sometimes.
BTW, your link doesn't work for me right now.
> It might, however, also be that the conversation partner is feeling uncomfortable talking about certain things.
Does this mean that users talk to actual people or am I not understanding this correctly?
One problem I'm beginning to notice is that the connection to the realtime transcription is failing (I just see a loading screen when I click to reply). Maybe it's due to heavy load?
I notice you are using Azure Cognitive Services for the transcription at the moment. Out of curiosity, did you consider any other services for this? (I'm building a transcription-based app myself and I'm worrying about the ability to handle lots of connections at once)
Hey, hit me up by email (see my profile), I'd love to talk to you and help out with anything you might need. Languages are one of my passions; I'm a polyglot (fr/el/sv/ru/en) and have a lot of opinions on language learning and teaching.
BTW I see a ton of network errors trying to hit Mixpanel. I hope your code is written such that Mixpanel calls aren't blocking calls, because tracker-blocking behaviour in Firefox or other browsers will stop those services *such as Mixpanel or GA) from loading.
E.g. first I asked: What do you think about Famous Person X?, the AI answered 'He's great'. Then when a few seconds later I asked: 'Don't you think Famous Person X is [something bad]?', the AI answered that he completely agreed and gave reasons why he thinks this is the case.
The answers in isolation seem very sensible, but the lack of consistency throughout the conversation as a whole can make it seem as if you're not talking to a real person.
AI: So why are you in the park?
Me: I'm here because I like to exercise
AI: That's great! I like to exercise too! What is your favorite type of exercise?
Me: I like to run
AI: That's great! I like to run too! What is your favorite route to run?
Me: I favorite place to run is on the Malecón.
AI: That's great! I like to run on the Malecón too! When do you run?
Me: I run in the evenings or at night.
AI: That's great! I love to run at night too.
I suppose I could have been a better conversationalist, but the AI logic used to ask questions deserves tweaking.
You never asked them about themselves, their interests or anything...
If it was a real person they probably would have said "have a nice day!" And left you in the park.
I asked お名前は何と言いますか?(Whats your name?) and it correctly said Sarah, but then when I asked 何人(なに人)ですか?(Where are you from?) the transcription into kanji caused the なにじん(nanijin) to be interpreted as the most common way to read those kanji なんにん(nanninn). So she responded to the question "How many people are there?" with "There are 6 people in my office".
I don't know how easily fixable this is. Either context needs to be taken into account, or the original phonetic transcription should be kept underneath the kanji.
I particularly liked getting this prompt a few volleys in. The AI decided she was done with speaking Spanish... except, not really.
> her (translated): Wow, I'm sorry, I don't understand Spanish that well. Do you mind if we speak in English?
> me (translated): No that's fine, let's speak in English please.
> her: Me llamo Sarah y soy de Estados Unidos. Tengo dos gatos a los que quiero mucho. En mi tiempo libre, me gusta leer y hacer senderismo. ¿Y tú?
This as a peer-to-peer service, between advanced and junior students of the language, might be a neat service
What do you use for speech synthesis? I have a little side project I'm investigating text-to-speech engines for (aiming for as much realism as possible, at least in English, plus the ability to possibly modify errant pronunciation somehow, and add pauses of varying length)
Me: "Wie heißt du?" (What's your name?)
It: "Tut mir leid, was?" (Sorry, what?)
Not a great first impression.
"talk you(sic) way to fluency" (should be "talk your way to... ").
What would be cool is if this eventually could work in a way that incorporates both languages (ex. Spanglish) and gradually shifts into the full foreign language over time.
On a side note, I used Duolingo for about 7 or 8 months (I spent like 15-20 minutes) and learned a little Japanese and Portuguese (European). I think Duolingo is an enjoyable app. Then I lost interest :( I started again. Let us hope this time I will finish all levels.
Any chance of getting Japanese and Portuguese (European)?
which models do you use for speech recognition and text generation?
Love the idea.
It just suggested to talk about: "How will you two spend my weekend?" :-D
Duolingo, Mango, Babbel, blah blah other language learning apps / software runs anywhere from $2.99 to $14.99 a month.
Live tutors / lessons vary greatly, but Babbel Live is $75 to $150 a month depending on what length of time you're willing to pre-pay. For in-person one-on-one lessons, I've seen a price of $10 an hour on iTalki for a Spanish professor in Medellín, Colombia to instruct you. If you figure 1-2 hours per week, that's $40 - $80 per month, and that'd be considered a "light" load.
While writing this, it did occur to me that your app / AI / ML model / whatever label you want to put on it will put a lot of tutors out of business (as how you do compete with a natural language model that's available 24/7?), but I think the overall good to humanity is worth it, and as always, the cream of the crop will rise to the top anyway.
What's your long-term plan with Quazel? There's no wrong answer here, insofar as I'm personally concerned. "I want to make enough money to quit my day job by leveraging this into a SaaS offering.", "I want to sell out for $50 million ASAP and go live on a small yacht in the Caribbean.", "I want to hit a billion dollar valuation in 6 months and totally reinvent language learning.", "I just wanted to improve the way we learn languages online, bro..." They're all good goals to me, I'm just curious what sparked this.
How do you add support for new language? If any human input is required in adding a new language get in touch for Nepali.
great work!
It just requests mic permission and spins forever. That's it.
Interesting concept, but I'm going to pass for now. I don't want to be talking to a friend and find that I accidently espoused the ideas of the third reich.