News for hackers. Stuff that matters.
Re:Why Probabilistic Programming Matters by joe_the_user on Saturday January 05, 2013 @08:23PM (#5014840)
The question I'd have about creating a new programming language for a new technique is what does the syntax give you to compensate for the costing of learning a new language?
Re:Why Probabilistic Programming Matters by tikhonj on Saturday January 05, 2013 @08:33PM (#5014866)
This is not an issue of syntax. You can have probabilistic languages with existing syntax--Church, for example, uses Scheme syntax[1].

[1]: http://projects.csail.mit.edu/church/wiki/Mixture_models

You can even embed your new language in another, well-known general-purpose language, letting you reuse the host language's syntax. Haskell is great for this sort of work.

This is entirely a question of semantics. And what do probabilistic semantics give you? They make writing complex models for data much more natural. These languages allow you to abstract away much of the incidental complexity of specifying these models, making the logic clearer. In turn, this simplifies reasoning about the problem and working on a solution.

More generally, this is the motivation behind most domain-specific languages. The core idea is to express yourself in a way that fits the domain you're working in. For machine-learning, you want to express your program in terms of probability distributions. For writing parsers, you want to express yourself in terms of CFGs. As people like to repeat, a program written more for people to read than computers to execute, and reading something in terms relevant to the domain is easier than trying to force the domain to fit an existing programming language and paradigm.

Re:Why Probabilistic Programming Matters by cf on Sunday January 06, 2013 @02:40AM (#5015708)
The trouble with probabilistic programming is it requires very unnatural control flow to run inference on the models. Now there any solutions like Factorie, Figaro and Infer.NET where they are just a library you call into your code. The trouble is because of the representation you end up with much more verbose code.

The cost of learning a new language isn't one you can avoid even if it weren't a language. To write these programs in any system you have to get used to thinking of your data as generated by this unobserved process. Thinking in that way isn't something you can avoid and is actually the main stumbling block.