suoko@feddit.it to LocalLLaMA@sh.itjust.worksEnglish · edit-21 month agoI dropped Qwen and Gemma for a 27B model that runs smoothly on my 8GB graphics card - Bonsai 27Bwww.xda-developers.comexternal-linkmessage-square20linkfedilinkarrow-up149arrow-down18
arrow-up141arrow-down1external-linkI dropped Qwen and Gemma for a 27B model that runs smoothly on my 8GB graphics card - Bonsai 27Bwww.xda-developers.comsuoko@feddit.it to LocalLLaMA@sh.itjust.worksEnglish · edit-21 month agomessage-square20linkfedilink
minus-squareShimitar@downonthestreet.eulinkfedilinkEnglisharrow-up5·1 month agoOrmit? Tiel? Can you elaborate? Are they based on qwen 35b A3B?
minus-squareBeefAndPoultry@lemmus.orglinkfedilinkEnglisharrow-up4·1 month agoYes they’re based on Qwen. Ornith 1.5 is a fine-tune of Qwen. Tiel Coder is based on Ornith 1.5, it’s technically just a quant and an improved template, but it seems like an improvement for people who are going to use Q4 anyways.
Ormit? Tiel? Can you elaborate? Are they based on qwen 35b A3B?
Yes they’re based on Qwen. Ornith 1.5 is a fine-tune of Qwen.
Tiel Coder is based on Ornith 1.5, it’s technically just a quant and an improved template, but it seems like an improvement for people who are going to use Q4 anyways.