https://github.com/faheel/msmd
"Monkey see, monkey do" (msmd) lets you draw a rectangle over text on a macOS screen, recognizes that region with Apple's built-in Vision framework, and emits the recognized characters as keyboard events. An amber border remains around the capture region while OCR and typing are active.It's a simple utility script to explore native vision and OCR functionality on macOS, and will soon expand...
> When multiple moves have the top score, they are all top moves, even if visual markers (like move arrows) suggest the engine prefers one over the other.
Since all moves that checkmate the opponent will have the same score (M1 or -M1) they'll all be illegal.
One use case could be that a complete beginner to programming can enter some natural commands (e.g. "X is a list of numbers", "read 10 values in X") without worrying about the syntax and convert them to a working program in one of the target languages.
Also, the input doesn't have to be in English as it can be easily trained with samples from other languages. So people can write/speak in their native language and get it translated to working code.
This is very different from how Codex/Autopilot work as it is trained using an NLU framework [3] which is usually used for training chatbots.
[1]: https://github.com/Flex-lang/transpiler/tree/master/transpil...
[2]: https://github.com/Flex-lang/transpiler/tree/master/transpil...
https://github.com/Flex-lang/transpiler
Flex [1] is a transpiler that converts a series of statements in natural language to either Python, Java or C++, and is trained using Rasa NLU [2], an open-source framework usually used for training chatbots and voice assistants.Flex is a project I made in college in 2018 along with two of my classmates, Gourav and Sanjay. The initial idea was to create a voice assistant you could speak to that...
[0]: https://marketplace.visualstudio.com/items?itemName=RandomFr...
For instance, Animall (one of the companies mentioned in the article) is working towards building an online marketplace for cattle (like Amazon) rather than just a discovery platform (like eBay or OLX) and will be handling verification and logistics (think "Amazon Fulfilled"). This would solve fraud and also reduce the cost and effort for sellers/buyers in trading cattle.
P.S. I work at Animall