Re:A DSL in 5 Languages: Ruby, Python, PHP, C#, Java
by judofyr on Tuesday August 03, 2010 @01:16PM
(#1571894)
A quick tips when creating block DSLs in Ruby:
def search(&blk)
if blk.arity == 1
blk.call(self)
else
self.instance_eval(&blk)
end
end
# Then the user can decide what he want to use:
Foo.search { bar }
Foo.search { |s| s.bar }
Re:A DSL in 5 Languages: Ruby, Python, PHP, C#, Java
by judofyr on Tuesday August 03, 2010 @02:52PM
(#1572240)
Yeah, but the whole point is really repeating local variables vs capturing self:
# This wouldn't work because it binds the block to Foo, and the @bar
# would lookup inside Foo instead of the proper context:
Foo.search { bar == @bar }
# This works fine though:
Foo.search { |s| s.bar == @bar }
Besides, if you're setting accessor, it can get a little weird:
# Explicit and nice:
Foo.search { |s| s.foo = 123 }
# This actually sets a local variable:
Foo.search { foo = 123 }
# In order to fix it, we're back to the explicit one:
Foo.search { self.foo = 123 }
There is no silver bullet here, and I believe the best way is to provide both techniques and let the user decide.
Re:A DSL in 5 Languages: Ruby, Python, PHP, C#, Java
by Nycto on Tuesday August 03, 2010 @05:55PM
(#1572898)
For the PHP version: Why is the search method static? You are forcing whatever class you are using to be tightly coupled. Dependency injection can be done in PHP, too.
Also, please make sure the search method returns an iterator, not an array. Just because PHP allows you to shoot yourself in the foot, doesn't mean you should.
Re:A DSL in 5 Languages: Ruby, Python, PHP, C#, Java
by postfuturist on Tuesday August 03, 2010 @01:20PM
(#1571906)
Python tip: instead of making the user contstruct a list literal, just use (star)args in the function definition. Python will automatically pack up any number of positional arguments into a list for you!
def search(*args) : ... # args is a sequence
search(this, that, the_other_thing)
Edit: found the HN FAQ entry on formatting comments, finally.
Re:A DSL in 5 Languages: Ruby, Python, PHP, C#, Java
by CodeMage on Tuesday August 03, 2010 @02:08PM
(#1572072)
Just to clarify for anyone who isn't familiar with Python: it's asterisk followed by "args". The problem here is that HN comments system interprets asterisk as italic formatting ;)
Re:A DSL in 5 Languages: Ruby, Python, PHP, C#, Java
by koenigdavidmj on Wednesday August 04, 2010 @02:12AM
(#1573798)
Python 3 lets you have named keyword arguments too. Anything after the star-args is a named keyword argument, and you can have a simple star if you do not want the argument list:
def search(foo, bar, *, baz):
Then, foo and bar would be named arguments, and baz would need to be passed by keyword.
Re:A DSL in 5 Languages: Ruby, Python, PHP, C#, Java
by kevingadd on Tuesday August 03, 2010 @12:51PM
(#1571797)
Not using 'var' (or LINQ, for that matter) in C# seems an odd choice. 'Separate steps for creating the request and performing the search' seems more like an advantage (for Java and C#) to me than a disadvantage, since you can easily eliminate the overhead with a helper function and the separation of a request and a search means that you can reuse a single request instance if you see the need.
I also consider statements like 'search.amount.between "10.00", "20.00"' or 'Amount.Between(10.00M, 20.00M)' to be vastly inferior to the native alternatives: for example, in C#, you could write that predicate as '(amount) => (amount > 10.00M && amount < 20.00M)' and in Python, it would become the even shorter 'lambda amount : 10 > amount > 20'. In each case the native way of expressing the logic requires no special knowledge of the 'fluent' API.
Re:A DSL in 5 Languages: Ruby, Python, PHP, C#, Java
by drewolson on Tuesday August 03, 2010 @01:03PM
(#1571842)
kevingadd -
We tend to use var when the return type is obvious, but we wanted to be explicit in the examples. Unfortunately, LINQ is not an option for us as we support .NET 2.0.
Your C# and Python predicate examples are quite readable, but in this case they don't work for us. The return type of each of these statements would be true or false, whereas we are building XML requests to be sent to a server to perform the searches. The call to Amount.Between(...) builds an XML node behind the scenes representing the search data.
Re:A DSL in 5 Languages: Ruby, Python, PHP, C#, Java
by ecoffey on Tuesday August 03, 2010 @11:25PM
(#1573559)
You mean you support C# 2.0, since var, LINQ, et al run on .Net 2.0 :-P
Doing a full blown Linq Provider would be pretty cool, but would also be very very very time consuming to get right. Expression trees are pretty cool, but you're still dealing with the AST so it gets crazy. There needs to be a Linq Provider framework / library to work at a slightly higher abstraction level.
Re:A DSL in 5 Languages: Ruby, Python, PHP, C#, Java
by confuzatron on Tuesday August 03, 2010 @02:18PM
(#1572106)
Ignoring the .NET version problem, not using LINQ probably makes plenty of sense, given that implementing a LINQ solution would be much much more complicated to implement than what you've done. Breaking apart expressions to get to your XML requests would be hard. I also think the proposal above where each criteria is expressed as an individual lamdba is the worst of both worlds in terms of ease of implementation and readability.
Re:A DSL in 5 Languages: Ruby, Python, PHP, C#, Java
by jeswin on Tuesday August 03, 2010 @02:13PM
(#1572092)
Fluent interfaces are cool, but they throw away the semantics of the programming language like meaningful return values.
The DSL in the article is a good example of this problem:
OrderId.StartsWith("a2d")......
So the StartsWith() returns a TransactionSearch, instead of a bool as you would expect. Once you do this often enough, you really get objects full of state-information, rather than methods with return values.
An alternative to doing this is using Expression Trees, but somewhat harder (and not without faults)
It would look like this:
Two benefits come to mind:
1. StartsWith() can return a bool as you would expect.
2. You can use StartsWith() on strings, like OrderId
--- I am not sure how you pulled this off in the DSL example (is OrderId a custom type, since you can't use Extension methods there?)
The biggest drawback of course is:
1. Harder - You will need to parse the Expression Tree.
def search(**kwargs):
for arg, value in kwargs.items():
action = arg.split('__')
attr = getattr(self, action[0])
if len(action) == 2:
method = getattr(attr, action[1])
method(value)
etc.
.....
EDIT: removed unneeded quotes, thanks for correction, postfuturist
Re:A DSL in 5 Languages: Ruby, Python, PHP, C#, Java
by drewolson on Wednesday August 04, 2010 @02:40PM
(#1575381)
When we began building our Python library, we looked at both django[1] and sqlalchemy[2] for inspiration in designing our search DSL. Your example seems to closely match the django style. We preferred the sqlalchemy style, but both are solid choices.
Re:A DSL in 5 Languages: Ruby, Python, PHP, C#, Java
by extension on Tuesday August 03, 2010 @01:12PM
(#1571875)
In Java, I would do this:
new Search().equal(Search.NAME,"Joe")
.between(Search.AGE,18,25)
.go();
Just as concise with less voodoo. And it's a single statement.
With the existing method, you can still ditch the empty parens by using public final fields. You just have to pre-populate them all with respective grammar objects.
Re:A DSL in 5 Languages: Ruby, Python, PHP, C#, Java
by pgr0ss on Tuesday August 03, 2010 @01:31PM
(#1571944)
Your syntax is definitely simpler. One reason we did it the way we did was to get compiler checking for operators. We've tried to follow idioms in different client libraries, and for the statically compiled languages, we've tried to make it so if it compiles, it will work.
Since the field comes first (orderId().startsWith()), if you try to call an operator on a field that does not support it, it will not compile.
Re:A DSL in 5 Languages: Ruby, Python, PHP, C#, Java
by d0m on Tuesday August 03, 2010 @01:28PM
(#1571938)
I really enjoy reading these articles comparing different implementations in different languages. I wish we had more of that on HN.
Concerning the article, call me grumpy if you want, I like better when there is no mass overloading even thought it's more verbose. From my maintenance experience working on various project, I always cry when after 3 hours of searching I find that "+" is overloaded and that's where the bug was hidden.
Also, for this particular implementation, we could simply use a builder.
Even thought it's more verbose, we clearly see that we configure the builder as we want, and then, we create the search object. A good side effect of that is that we get an immutable Search object. Also, we could use the "fluent" interface on the builder.
Another verbose approach might be using lots of Objects..
Re:A DSL in 5 Languages: Ruby, Python, PHP, C#, Java
by jacquesm on Tuesday August 03, 2010 @01:46PM
(#1571989)
Overloading basic operators is the road to hell. Yes, you can do wonderful and elegant things but when it goes wrong your whole mechanism for analysing what you look it is screwed up because the more experience you have in a language the more you tend to be on autopilot for stuff like that.
'test your assumptions' suddenly expands to include checking if basic language operators still do what you expect them to do.
and
v2 = vec_add(v1,v3);
really isn't that much better than
v2 = v1 + v3;
I know this is not a popular opinion but that's how I've always felt about it and those that complain about how difficult languages like c++ care usually painted themselves in a corner by excessive use of such features.
Re:A DSL in 5 Languages: Ruby, Python, PHP, C#, Java
by dan_manges on Tuesday August 03, 2010 @07:19PM
(#1573100)
I used to vertically align things into columns in Ruby. It's easy to maintain when you're editing individual lines, but it can easily be messed up with a find-and-replace in file. At that point, it becomes harder to read with some lines off, and a pain to maintain the alignment.
Re:A DSL in 5 Languages: Ruby, Python, PHP, C#, Java
by scott_s on Tuesday August 03, 2010 @11:17PM
(#1573544)
I've grown to dislike that habit in all languages. It's too cute and it doesn't scale with code changes. It's easier for me to read code that's formatted in a standard way, even if that means conceptual columns don't line up.
Re:A DSL in 5 Languages: Ruby, Python, PHP, C#, Java
by devcjohnson on Wednesday August 04, 2010 @03:00AM
(#1573865)
I'm confused in that none of the examples look like a DSL to me. They look like a library API - implemented in five different languages but I can hardly classify any of them as a DSL. Am I really that obtuse concerning this question?
Re:A DSL in 5 Languages: Ruby, Python, PHP, C#, Java
by kjbekkelund on Tuesday August 03, 2010 @06:38PM
(#1573006)
What about doing it like this in Ruby:
collection = Braintree::Transaction.search do
order_id /^a2d/
customer_website /\.com$/
billing_first_name "John"
status :authorized, :settled
amount 10..20
end
collection.each do
puts id
end
It might be more difficult not having the specific methods (in, starts_with_ ends_with, and so on), but I think it's quite readable. If we don't want the regexps, we could go for a MySQL style '%.com' and 'a2d%' or something similar.
Re:A DSL in 5 Languages: Ruby, Python, PHP, C#, Java
by icode on Tuesday August 03, 2010 @02:40PM
(#1572185)
Why dont they just take a string as the argument to search() and parse it? They could use a very SQL like Syntax:
$collection = Braintree_Transaction::search("
orderId LIKE 'a2d%'
AND customerWebsite LIKE '%.com'
AND billingFirstName='John'
AND status() IN ('AUTHORIZED','SETTLED')
AND amount>=10
AND amount<=20.00)
");
Re:A DSL in 5 Languages: Ruby, Python, PHP, C#, Java
by rndmcnlly0 on Tuesday August 03, 2010 @03:37PM
(#1572444)
One of the big reasons to build the DSL in the first place is to let the host language's syntax help you spot problems in your query. Syntax errors can be spotted from editor-provided syntax highlighting directly or slightly later when the code is read by the interpreter -- much sooner than when your runtime library finally decides to look at it (at search time).
Re:A DSL in 5 Languages: Ruby, Python, PHP, C#, Java
by st0p on Tuesday August 03, 2010 @04:09PM
(#1572579)
Yeah, i've never done any research into DSL's, but I always thought they would have some sort of custom syntax. Since DSL's seem quite the hype ATM, I'm a bit dissapointed by these examples. Sure, nice coding and all that (even though I would have used LINQ myself, but then again I'm not restricted to C# 2.0), but I fail to to see where the L of DSL comes into play.
If this is the latest hype I didn't have time for to research, I'm not missing out.
Re:A DSL in 5 Languages: Ruby, Python, PHP, C#, Java
by Lewisham on Tuesday August 03, 2010 @11:57PM
(#1573605)
There are two types of DSLs, internal and external. External ones are the custom syntax you talk of, internal are DSLs that use features or quirks of a host language to appear different.
XML or SQL are external DSLs, much of the cool Ruby stuff like Rake and Rails are internal DSLs. The examples presented are all internal (presumably for a good reason). There are advantages to both approaches. Read Martin Fowler's discussion at http://martinfowler.com/dslwip/
Better:
If you're really up to it, there is no reason you couldn't use an even more fluent interface in PHP... Also, please make sure the search method returns an iterator, not an array. Just because PHP allows you to shoot yourself in the foot, doesn't mean you should.No, no, remember: all other languages need a chance to incrementally catch back up to Lisp. :)
Edit: Parent comment fixed by postfuturist.
Really? Where?
I also consider statements like 'search.amount.between "10.00", "20.00"' or 'Amount.Between(10.00M, 20.00M)' to be vastly inferior to the native alternatives: for example, in C#, you could write that predicate as '(amount) => (amount > 10.00M && amount < 20.00M)' and in Python, it would become the even shorter 'lambda amount : 10 > amount > 20'. In each case the native way of expressing the logic requires no special knowledge of the 'fluent' API.
We tend to use var when the return type is obvious, but we wanted to be explicit in the examples. Unfortunately, LINQ is not an option for us as we support .NET 2.0.
Your C# and Python predicate examples are quite readable, but in this case they don't work for us. The return type of each of these statements would be true or false, whereas we are building XML requests to be sent to a server to perform the searches. The call to Amount.Between(...) builds an XML node behind the scenes representing the search data.
Drew Olson (Braintree Dev)
Doing a full blown Linq Provider would be pretty cool, but would also be very very very time consuming to get right. Expression trees are pretty cool, but you're still dealing with the AST so it gets crazy. There needs to be a Linq Provider framework / library to work at a slightly higher abstraction level.
The DSL in the article is a good example of this problem:
So the StartsWith() returns a TransactionSearch, instead of a bool as you would expect. Once you do this often enough, you really get objects full of state-information, rather than methods with return values.An alternative to doing this is using Expression Trees, but somewhat harder (and not without faults) It would look like this:
Two benefits come to mind: 1. StartsWith() can return a bool as you would expect. 2. You can use StartsWith() on strings, like OrderId --- I am not sure how you pulled this off in the DSL example (is OrderId a custom type, since you can't use Extension methods there?)The biggest drawback of course is: 1. Harder - You will need to parse the Expression Tree.
[1]http://docs.djangoproject.com/en/1.2/topics/db/queries/#chai... [2]http://www.sqlalchemy.org/docs/ormtutorial.html#common-filte...
With the existing method, you can still ditch the empty parens by using public final fields. You just have to pre-populate them all with respective grammar objects.
Since the field comes first (orderId().startsWith()), if you try to call an operator on a field that does not support it, it will not compile.
Concerning the article, call me grumpy if you want, I like better when there is no mass overloading even thought it's more verbose. From my maintenance experience working on various project, I always cry when after 3 hours of searching I find that "+" is overloaded and that's where the bug was hidden.
Also, for this particular implementation, we could simply use a builder.
SearchBuilder sb;
sb.equal(Search.Name, ".."); sb.equals(Search.AGE, ..);
Search s = new Search(sb);
Even thought it's more verbose, we clearly see that we configure the builder as we want, and then, we create the search object. A good side effect of that is that we get an immutable Search object. Also, we could use the "fluent" interface on the builder.
Another verbose approach might be using lots of Objects..
Search s; s.add_contraint(SearchEqual(Search.Name, "bob"));
This way, it make it easier to add constraint without modifying the Search class.
'test your assumptions' suddenly expands to include checking if basic language operators still do what you expect them to do.
and
really isn't that much better than I know this is not a popular opinion but that's how I've always felt about it and those that complain about how difficult languages like c++ care usually painted themselves in a corner by excessive use of such features.If this is the latest hype I didn't have time for to research, I'm not missing out.
XML or SQL are external DSLs, much of the cool Ruby stuff like Rake and Rails are internal DSLs. The examples presented are all internal (presumably for a good reason). There are advantages to both approaches. Read Martin Fowler's discussion at http://martinfowler.com/dslwip/