IBM Granite

IBM Granite

A Family of Open, Performant, & Trusted AI Models

 View Only
Back to discussions
Expand all | Collapse all

Granite-Pi - Granite3.2:2b(Ollama) running locally on a Raspberry Pi 5(8gb)

  • 1.  Granite-Pi - Granite3.2:2b(Ollama) running locally on a Raspberry Pi 5(8gb)

    Posted 3 days ago

    Hello everyone,

    I wanted to start a project with a Raspberry Pi 5 device that incorporates Granite, to demonstrate that enterprise grade models can run locally on devices that are relatively affordable(RPi 5 Kit ~ $130). 

    I created a GitHub repo which stores the guide to setting up Granite3.2:2b locally on a Raspberry Pi, for a fun a DIY project!

    https://github.com/Jewelzufo/granitepi

    Diagram of Granite-Pi system


    #LLM

    ------------------------------
    Julian Gonzalez
    Generative AI Engineer
    CreativeAct Technologies
    Orlando, FL
    ------------------------------


Related Content