News for hackers. Stuff that matters.
Re:Examples and best practices for building recommendation s... by emourkai on Friday January 18, 2019 @08:50AM (#18939248)
this really should've been named "recommendations for building recommendation systems"
Re:Examples and best practices for building recommendation s... by hoaphumanoid on Friday January 18, 2019 @03:08PM (#18942536)
hey one of the authors here. We are planning to create some notebooks on recommendation about recommendation algos :-)
Re:Examples and best practices for building recommendation s... by yueguoguo1024 on Friday January 18, 2019 @10:19PM (#18945110)
LOL brilliant idea! just don’t hesitate to create an issue and follow that with a PR!
Re:Examples and best practices for building recommendation s... by anjc on Friday January 18, 2019 @07:19AM (#18938773)
If you're the author, I'm not sure that the definition of recall@k is correct.

>Recall@k is a metric evaluate how many items, in the recommendation list, are relevant (hit) in the ground-truth data.

Re:Examples and best practices for building recommendation s... by hoaphumanoid on Friday January 18, 2019 @03:10PM (#18942561)
thanks for the comment, would this definition be clearer: "Recall at k is the proportion of relevant items found in the top-k recommendations"?
Re:Examples and best practices for building recommendation s... by tandav on Saturday January 19, 2019 @02:48AM (#18945880)
My collection of usefull links about recommender systems (dirty) https://gist.github.com/tandav/a2f87e91cb5c441c57657cceb788c...
Re:Examples and best practices for building recommendation s... by tandav on Friday January 18, 2019 @03:12PM (#18942580)
Sadly but evaluation metrics are only implemented in pyspark.mllib (RDD API) but not in pyspark.ml (Dataframe API)

Also worth mention about implicit feedback

Re:Examples and best practices for building recommendation s... by yueguoguo1024 on Friday January 18, 2019 @08:28PM (#18944671)
It is also my sadness - AFAIK pyspark.ml does not support ranking metrics (does it?). So we wrapped the RDD and expose data frame as interfaces in our own implementations (the `reco_utils`). Implicit feedback is mentioned in a notebook under `staging` branch (https://github.com/Microsoft/Recommenders/blob/staging/noteb...). Will be there soon in the next release (1st of Feb)!