Re:Llamafile lets you distribute and run LLMs with a single ...
by jart on Thursday November 30, 2023 @05:46PM
(#38480312)
So you have a Sandybridge processor with AVX support (but not AVX2). Could you open llamafile in a debugger and find out which instructing is faulting and what its address in memory is? I haven't personally tested Sandybridge but I'm reasonably certain we designed the build to not insert any incompatible instructions in there. Our intent is to support you. I also might be able to fish my old ThinkPad out of the closet if you don't have time. In any case it'll happen soon.
[ Parent
| on HN ]
Re:Llamafile lets you distribute and run LLMs with a single ...
by NoOn3 on Friday December 01, 2023 @11:40AM
(#38488750)
I tried but gdb showed me nothing, this screenshot(https://pxscdn.com/public/m/_v2/97422265439883264/bc40e5d2a-...). gdb layout asm shows "No Assembly Available". Maybe I'm not so skilled in debbuging such programs it's running under wine it seemed to me.