News for hackers. Stuff that matters.
Re:Autocomplete Using Markov Chains by rijoja on Wednesday February 20, 2019 @03:25AM (#19206476)
This is really cool and an inspiration of mine. As a matter of fact I am working on something very similar to this.

I don't know if you are familiar with the Dasher project for text input, but as of know I'm trying to improve on that work partly by improving on how many letters are available simultaneously by protecting the line of text upon a fractal surface. Something that should be a more efficient use of a 2d surface, theoretically infinitely so.

As far as autocomplete is concerned my approach is to try to do exactly this but on a character basis. I think this can lead to some interesting advantages, for example different dialects gives rise to words that not always conform to dictionary specifications.

The next level would be to go one step higher so to speak. If we imagine Markov Chain on letters as the first level and said chains level, I'd say that the third level in our hierarchy would be to apply markov chain on groups of words grouped by proximity in a word2vec space.

Having markov chains working on groups of word2vec words would give us a statistical analogy of grammar. However without having to implement it programatically, something that inevitably would lead to missed corner cases and if not that a too strict algorithm that would hinder intentional abuse of grammar by purpose.

Maybe this is already being implemented, as it to me seems as the logical next step. Anybody got any info on this?

Re:Autocomplete Using Markov Chains by ben_w on Wednesday February 20, 2019 @06:23AM (#19207099)
A friend of mine worked on Dasher (hi Alan, if you’re reading this!); I thought they achieved the same goal with a hyperbolic space rather than a fractal space?

Given this was about a decade ago, there are probably better predictive models than whatever was in the demo he showed me, but I wouldn’t be surprised if their model was a Markov chain where the size of each next-letter option was a function of probability.

(Memory haze: I was more excited by the hyperbolic space than the word model when he showed it to me, and it was c. 2008)

Re:Autocomplete Using Markov Chains by bryanrasmussen on Wednesday February 20, 2019 @04:35AM (#19206766)
I am familiar with Dasher (although my only considerations regarding it are as a tool to improve user accessibility), but I don't understand what is meant by "protecting the line of text upon a fractal surface"

Even if I change protecting to projecting I don't get it.

Re:Autocomplete Using Markov Chains by rijoja on Wednesday February 20, 2019 @11:06AM (#19208963)
Woops what an embarrassing typo sorry about that.

Well imagine if you would like to draw as many intervals of any given shape but with the same length on a line.

Let's start out with a line. Then you can only have so many symbols given by the height.

To continue if we instead where to space them out over the circumference of a circle, we would on the same width have more symbols.

If we go even further and give the circle jagged edges that go in and out. Theoretically we have an infinite length on the line, but resolution on screen and eyes sets an stop to that.

So basically making use of the area of the screen instead of only a line.

Did I make more sense to you? The fractal thingy is just an experiment and not the main point of the comment so I gave a very brief description of it. It may very well be that my capabilities of describing it in proper mathematical is a bit lacking.

Will have a demo of it within a few days or so if you are interested keep your eyes open.

Re:Autocomplete Using Markov Chains by bryanrasmussen on Wednesday February 20, 2019 @11:29AM (#19209182)
Ok thanks, I probably need to see it, not the most visual thinker so hard for me to envision the idea.
Re:Autocomplete Using Markov Chains by rijoja on Wednesday February 20, 2019 @05:15PM (#19212591)
Yeah at first I did this as a fun sideproject a fun way of doing something of absolutely no use to anybody. Then I thought of accessibility issues, now my focus is somewhat on VR, where I envision that keyboards will break the immersion and pointing and moving a pointer on a virtual keyboard would be fun for consumer tasks, but for actual work say programming and whatnot it simply doesn't cut it.