Interesting, in my experiments alpaca-lora performed worse but definitely possible that isn't the case generally.