Huh, what exactly are you using? I tried to run home assistant’s, well, assistant, and qwen 2.5 3B just didn’t properly call any tools. And bigger models become pretty slow on my ryzen 2400 “thinclient” home server. I’ve tried it via Ollama, even did some dirty hacks to use the iGPU, but that’s about the size that I can run without waiting a minute for a simple prompt.
It’s not impressive, but specifically it is: ByteSpeed Intel NUC 8i7BEH Intel i7-8559U 2.70GHz 16GB DDR4 RAM 256GB SSD
I’m actually not sure I’m using it to call any tools, so I might have been overly optimistic sounding. I set it up so that HA tries to answer any incoming requests but when it doesn’t understand something, it hands it to the AI. Reminders are not understood natively by HA, but I set up a pretty elaborate automation to handle it. As I understand it (I used Claude to help me set it up) the AI is parsing the {time} part of the automation, but it doesn’t quite work right. Basically if I say “Hey Jarvis, remind me at 8:15 PM to move my truck” it works, but if I say “remind me in two hours to move my truck”, it fails. I gotta spend some more time with it.
I’m using Voice PE to talk to it so I can say “hey Jarvis, blah blah blah” and if HA doesn’t recognize what I’m asking (ie: HA/PE understands “set a timer for 30 minutes” and will set a timer for you) it passes it to the AI. If I ask it “who was in the Beatles?” it takes about 3 seconds to think and then will respond with “The Beatles consisted of… <lists the members>”.
I would provide you with more detail but I’m out of town right now and don’t have direct access to it on this computer.
Huh, what exactly are you using? I tried to run home assistant’s, well, assistant, and qwen 2.5 3B just didn’t properly call any tools. And bigger models become pretty slow on my ryzen 2400 “thinclient” home server. I’ve tried it via Ollama, even did some dirty hacks to use the iGPU, but that’s about the size that I can run without waiting a minute for a simple prompt.
It’s not impressive, but specifically it is: ByteSpeed Intel NUC 8i7BEH Intel i7-8559U 2.70GHz 16GB DDR4 RAM 256GB SSD
I’m actually not sure I’m using it to call any tools, so I might have been overly optimistic sounding. I set it up so that HA tries to answer any incoming requests but when it doesn’t understand something, it hands it to the AI. Reminders are not understood natively by HA, but I set up a pretty elaborate automation to handle it. As I understand it (I used Claude to help me set it up) the AI is parsing the {time} part of the automation, but it doesn’t quite work right. Basically if I say “Hey Jarvis, remind me at 8:15 PM to move my truck” it works, but if I say “remind me in two hours to move my truck”, it fails. I gotta spend some more time with it.
I’m using Voice PE to talk to it so I can say “hey Jarvis, blah blah blah” and if HA doesn’t recognize what I’m asking (ie: HA/PE understands “set a timer for 30 minutes” and will set a timer for you) it passes it to the AI. If I ask it “who was in the Beatles?” it takes about 3 seconds to think and then will respond with “The Beatles consisted of… <lists the members>”.
I would provide you with more detail but I’m out of town right now and don’t have direct access to it on this computer.