• Baŝto@discuss.tchncs.de
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 days ago

    On Arch btw you can run it now with ollama-vulkan.

    I’m glad it’s finally here. Initially I ran a self-compiled fork for running stuff on Vulkan, but that wasn’t merged and quickly out of sync, so I had to go back to regular ollama to run newer and more efficient models.