I actually felt that R functions and data structures are more straight forward to use than SQL commands. But sadly the data only exists in memory..
The memory issue actually isn't "that bad." There are many different solutions and Spark and R are looking like amazing.
Here is the announcement link: https://groups.google.com/forum/#!topic/apache-spark-user-mi...
What's a good complement?