News for hackers. Stuff that matters.
Re:Transformers as Support Vector Machines by revskill on Sunday September 03, 2023 @04:40AM (#37368776)
What is hyperplane ?
Re:Transformers as Support Vector Machines by noduerme on Sunday September 03, 2023 @04:46AM (#37368808)
it's a word (a made up word)
Re:Transformers as Support Vector Machines by MattPalmer1086 on Sunday September 03, 2023 @04:56AM (#37368856)
All words are made up!
Re:Transformers as Support Vector Machines by noduerme on Sunday September 03, 2023 @07:54AM (#37369671)
Yeah, but only a few are made up to seem like terms of art designed to obfuscate their actual meaning; and usually prepending "hyper-" to something is a signal that a more clear description of the thing doesn't yet exist.

Downvote away, fellas.

Re:Transformers as Support Vector Machines by adamnemecek on Sunday September 03, 2023 @12:02PM (#37371467)
Re:Transformers as Support Vector Machines by adamnemecek on Sunday September 03, 2023 @04:54AM (#37368845)
For 2d, a line, for 3d a plane, for nd a hyperplane.

https://en.wikipedia.org/wiki/Hyperplane

Re:Transformers as Support Vector Machines by shakow on Sunday September 03, 2023 @05:42AM (#37369032)
A subspace of dimension n-1 of a n-dimensional vector space. It is an extension of the well-known concept of a 2d-plane in a 3d-space to nd-spaces.
Re:Transformers as Support Vector Machines by eru on Sunday September 03, 2023 @06:17AM (#37369185)
You could also describe a hyperplane as the set of solutions of a system of linear equations.
Re:Transformers as Support Vector Machines by shakow on Sunday September 03, 2023 @04:53PM (#37374452)
Or as the subspace of all the vectors are orthogonal to a given single vector, or as the subspace generated by any orthogonal basis with one base vector removed, or as the kernel of a linear form, ... – but a more visual explanation is probably better as a first foray in the question.
Re:Transformers as Support Vector Machines by eru on Sunday September 03, 2023 @09:19PM (#37376237)
I agree that a more visual explanation is better in general.

I was trying to hint how the visual explanation relates to the long vectors of numbers we actually feed our machine learning contraptions with. Not sure I was successful.

Re:Transformers as Support Vector Machines by revskill on Monday September 04, 2023 @01:54AM (#37377541)
This is really good !
Re:Transformers as Support Vector Machines by loehnsberg on Sunday September 03, 2023 @06:36AM (#37369264)
A hyperplane is a multi-dimensional linear function that splits space into two distinct regions. In the context of a classifier, it splits feature space into disjunct sub-spaces (one for each class). SVMs effectively place a hyperplane with maximum margin, thereby separating classes in an optimal way.
Re:Transformers as Support Vector Machines by im3w1l on Sunday September 03, 2023 @12:17PM (#37371603)
Worth keeping in mind that though it may be optimal according to some mathematical criterion, that is no guarantee that it's the best for the purposes you have in mind.
Re:Transformers as Support Vector Machines by blt on Sunday September 03, 2023 @03:32PM (#37373572)
a partition of Euclidean space into two convex sets ;)