News for hackers. Stuff that matters.
Re:Machine Learning: Full-Text Search in JavaScript – Releva... by diegolo on Saturday March 23, 2019 @03:48PM (#19472031)
"a general search can be machine learning" I don't get this sentence: Machine learning is about building a mathematical model of sample data, known as "training data".

If you want to talk about machine learning and search you should probably talk about learning to rank (https://en.m.wikipedia.org/wiki/Learning_to_rank)

Re:Machine Learning: Full-Text Search in JavaScript – Releva... by snotrockets on Saturday March 23, 2019 @05:16PM (#19472401)
I'd argue that you're too restrictive in your definition. e.g. unsupervised clustering has no sample training data.

The usual definition (due to Mitchell) is that machine learning is a system s.t. its performance on a given task improves by past experience.

Re:Machine Learning: Full-Text Search in JavaScript – Releva... by thegginthesky on Sunday March 24, 2019 @06:15AM (#19475469)
Actually, any unsupervised method, including clustering, still has training data. The only difference is it doesn't have a target y variable in the training set to minimize the error metric, hence the name unsupervised.

But the definition you mention is right. Yet, any dataset that you use to fit your model will be your training set, even if you don't have a train test split or the like, because you used it to train your model over.

Re:Machine Learning: Full-Text Search in JavaScript – Releva... by snotrockets on Monday March 25, 2019 @12:37AM (#19480324)
K-means has no "training data" per se.
Re:Machine Learning: Full-Text Search in JavaScript – Releva... by inertiatic on Saturday March 23, 2019 @03:02PM (#19471818)
Search is now machine learning? Interesting introduction to the topic otherwise.
Re:Machine Learning: Full-Text Search in JavaScript – Releva... by softwaredoug on Saturday March 23, 2019 @05:48PM (#19472528)
I would say this isn't machine learning, but relevance in general is an interesting topic to apply supervised learning. Of course the training data is the hard part,

An article on the topic, https://opensourceconnections.com/blog/2017/08/03/search-as-... (disclaimer I wrote it...)

Re:Machine Learning: Full-Text Search in JavaScript – Releva... by inertiatic on Sunday March 24, 2019 @03:19AM (#19474936)
I also work on this field so I do have an idea of what's possible if you apply machine learning techniques to improve relevance rankings.

But to my intuition, basic search doesn't feel like a machine learning task. After reading some of the responses to my post however I'm trying to come up with a meaningful reason why I wouldn't consider IDF to be machine learning, given that it is updated as more documents enter the corpus and your system "learns" to re-rank existing result sets based on these new documents.

Re:Machine Learning: Full-Text Search in JavaScript – Releva... by Cybiote on Saturday March 23, 2019 @05:50PM (#19472539)
These categorizations tend to be arbitrary and inconsistent because what is an intelligence is probably subjective. People consider kNN and naive bayes to be machine learning. One is "just" sorting and the other is just counting. The learning in naive bayes and even in some higher order bayesian networks is of a similar flavor as the count structures generated for IR.

Because we understand how these algorithms work, we can always reduce them to just this or that. Prediction in many linear classifiers is just dot products. relu neural networks are just lots of clamped dot products. Random projections on simple count data can generate word embeddings.

Whether or not something is merely model-fitting, super-scaling, compression or AI, AI art and machine learning will depend on the field it originated from. It's indisputable that the algorithms are so reducible but I tend to think that we should care more about functional capabilities when compared to an appropriate subset of a known intelligence's abilities than details of implementation.

Re:Machine Learning: Full-Text Search in JavaScript – Releva... by ma2rten on Saturday March 23, 2019 @03:27PM (#19471940)
In general search can be machine learning. Google certainly uses machine learning as part of it's ranking.

I guess you can make the argument that even tf-idf as described in the article is a form of unsupervised machine learning because you obtain ("learn") the idf from the data.

Re:Machine Learning: Full-Text Search in JavaScript – Releva... by jahewson on Saturday March 23, 2019 @03:40PM (#19472003)
TF-IDF is a feature extracted from the data, much like a simple count of words, but it is not learned. It is simply computed. An example of learned features are word embeddings where it is necessary to train on data to obtain them.

If you want to apply machine learning to search then you need clickstream data, embeddings, or learned feature weights.

Re:Machine Learning: Full-Text Search in JavaScript – Releva... by yorwba on Saturday March 23, 2019 @04:28PM (#19472182)
Word embeddings are also "simply computed." If you use GloVe, then the vectors are obtained by factoring a matrix of co-occurence counts.

The difference between machine learning and "simple" feature extraction is mostly just in the choice of metaphors used to describe the computation, not in any fundamental properties.

Re:Machine Learning: Full-Text Search in JavaScript – Releva... by ma2rten on Saturday March 23, 2019 @05:18PM (#19472409)
Right. Naive Bayes is considered to be a machine learning algorithm, but also consists of just "simple counting".
Re:Machine Learning: Full-Text Search in JavaScript – Releva... by drongoking on Saturday March 23, 2019 @05:40PM (#19472500)
Your distinction between TFIDF as simply computed vs embeddings as learned is odd and artificial. Both are computations from data, but TFIDF has an understandable closed form and word embeddings do not. As for machine learning, it has to do with improvement and doesn't even necessarily need data.
Re:Machine Learning: Full-Text Search in JavaScript – Releva... by jahewson on Sunday March 24, 2019 @01:27AM (#19474543)
I think you’re right. It’s the improvement in the learning process that’s the important bit. TF-IDF lacks that.
Re:Machine Learning: Full-Text Search in JavaScript – Releva... by pilooch on Saturday March 23, 2019 @03:49PM (#19472036)
Search is often formulated as 'learning to rank'.
Re:Machine Learning: Full-Text Search in JavaScript – Releva... by inertiatic on Sunday March 24, 2019 @03:14AM (#19474918)
AFAIK learning to rank refers to things more advanced than simple TFIDF.
Re:Machine Learning: Full-Text Search in JavaScript – Releva... by humbleMouse on Saturday March 23, 2019 @02:42PM (#19471733)
Reading your site on my phone and it reloads every 10 seconds. Annoying.
Re:Machine Learning: Full-Text Search in JavaScript – Releva... by rajangdavis on Saturday March 23, 2019 @05:57PM (#19472565)
Curious to see how this might compare against Postgres's full-text search.

The text search vector type is pretty much a poor man's bag of words model (with removing stop words and some lemmatization) but instead of counts, you get placement of where the words occur.

Re:Machine Learning: Full-Text Search in JavaScript – Releva... by eggie5 on Saturday March 23, 2019 @05:01PM (#19472334)
he generated query-document features. Now he just needs to collect relevance labels for the documents, then he can learn a ranker a la LTR.
Re:Machine Learning: Full-Text Search in JavaScript – Releva... by ElD0C on Saturday March 23, 2019 @02:36PM (#19471699)
(2015)
Re:Machine Learning: Full-Text Search in JavaScript – Releva... by magma17 on Saturday March 23, 2019 @04:35PM (#19472220)
relevance==frequency?

anything is ML now...

Re:Machine Learning: Full-Text Search in JavaScript – Releva... by 4FNET7 on Saturday March 23, 2019 @01:35PM (#19471390)
thanks --