Profile

My apologies on the delay! Just now seeing this comment. Granite3.3:2b worked surprisingly well running solely on the RPi 5 CPU! Response time was reasonable enough to use for creating references tables when mixing audio in music production! Yesterday, I was experimenting with granite3-moe:1b ...

Want to push the boundaries of prompt engineering? Keep the fundamentals and forget the absolute "rules". Follow this and you will be amazed at what your brilliant brain will come up with. Run with your ideas, don't walk slowly. --- Always follow proper ethics when interacting ...

Thank you for sharing! I've been planning a computer vision asssitive technology for DeafBlind individuals. This will be useful! I too am interested in benchmarking! Feel free to reach out! ------------------------------ Julian Gonzalez Generative AI Engineer CreativeAct Technologies Orlando FL ...

Hello everyone, I wanted to start a project with a Raspberry Pi 5 device that incorporates Granite, to demonstrate that enterprise grade models can run locally on devices that are relatively affordable(RPi 5 Kit ~ $130). I created a GitHub repo which stores the guide to setting up Granite3.2:2b locally ...