suoko@feddit.it to LocalLLaMA@sh.itjust.worksEnglish · edit-228 days agoI dropped Qwen and Gemma for a 27B model that runs smoothly on my 8GB graphics card - Bonsai 27Bwww.xda-developers.comexternal-linkmessage-square20linkfedilinkarrow-up149arrow-down18
arrow-up141arrow-down1external-linkI dropped Qwen and Gemma for a 27B model that runs smoothly on my 8GB graphics card - Bonsai 27Bwww.xda-developers.comsuoko@feddit.it to LocalLLaMA@sh.itjust.worksEnglish · edit-228 days agomessage-square20linkfedilink
minus-squareBeefAndPoultry@lemmus.orglinkfedilinkEnglisharrow-up4·29 days agoYes they’re based on Qwen. Ornith 1.5 is a fine-tune of Qwen. Tiel Coder is based on Ornith 1.5, it’s technically just a quant and an improved template, but it seems like an improvement for people who are going to use Q4 anyways.
Yes they’re based on Qwen. Ornith 1.5 is a fine-tune of Qwen.
Tiel Coder is based on Ornith 1.5, it’s technically just a quant and an improved template, but it seems like an improvement for people who are going to use Q4 anyways.