Re:Alpaca- An Instruct Tuned Llama 7B. Responses on par with...
by magicalhippo on Monday March 13, 2023 @07:22PM
(#35144675)
> If you try to order nodes so that adjacent nodes are uncorrelated the performance loss might be manageable.
shower thought
In graphics we use barycentric coordinates to encode the position within an arbitrary triangle using two coordinates (u,v), with the third being constrained to be 1-u-v. If you order nodes to be correlated, could you use a similar trick to encode three weights for the price of two?
shower thought
In graphics we use barycentric coordinates to encode the position within an arbitrary triangle using two coordinates (u,v), with the third being constrained to be 1-u-v. If you order nodes to be correlated, could you use a similar trick to encode three weights for the price of two?