Yeah that’s why I’m running it. Couldn’t get reminders to work with all the possible permutations of time notation without an LLM. It still doesn’t fully work properly but it’s good enough and it has the side effect that it can answer any question you ask, for better or for worse. It gets simple things right more than half the time I’d say.
I’m keeping my fingers crossed that the work being done by groups like GLM will allow something smarter to run on this hardware within the next year or so.
Huh, what exactly are you using? I tried to run home assistant’s, well, assistant, and qwen 2.5 3B just didn’t properly call any tools. And bigger models become pretty slow on my ryzen 2400 “thinclient” home server. I’ve tried it via Ollama, even did some dirty hacks to use the iGPU, but that’s about the size that I can run without waiting a minute for a simple prompt.
Qwen 2.5.
Can it be used for agentic workflows or just simple Q and A?
Yeah that’s why I’m running it. Couldn’t get reminders to work with all the possible permutations of time notation without an LLM. It still doesn’t fully work properly but it’s good enough and it has the side effect that it can answer any question you ask, for better or for worse. It gets simple things right more than half the time I’d say.
I’m keeping my fingers crossed that the work being done by groups like GLM will allow something smarter to run on this hardware within the next year or so.
Huh, what exactly are you using? I tried to run home assistant’s, well, assistant, and qwen 2.5 3B just didn’t properly call any tools. And bigger models become pretty slow on my ryzen 2400 “thinclient” home server. I’ve tried it via Ollama, even did some dirty hacks to use the iGPU, but that’s about the size that I can run without waiting a minute for a simple prompt.