Every Mac with Apple Silicon has a built-in LLM. Apple locked it behind Siri. apfel sets it free - as a CLI tool, an OpenAI-compatible server, and a chat.

Benötigt macOS Tahoe auf einem Mac mit M1 oder neuer.

  • connaisseur@feddit.orgOP
    link
    fedilink
    arrow-up
    4
    ·
    1 month ago

    There are much more powerful models for sure, this tool just taps into the convenience of using what is already on the device thanks to Apple frameworks. So it is fully local with no additional overhead.