• Notice regarding image hosts and attachments. See here.

AI Models thread

There are so many tools, configurations out there that's it's a bit overwhelming. Where do I start? What setup should I have, which tools? :D
I've been using Ollama & Aider and run aider from a batch file so I can switch between models (one batch file per model I use).
OpenCode + Openrouter is a good start if you don’t want to pay for Claude Code. There are usually some free models you can try out.
 
There are so many tools, configurations out there that's it's a bit overwhelming. Where do I start? What setup should I have, which tools? :D
I've been using Ollama & Aider and run aider from a batch file so I can switch between models (one batch file per model I use).
I've got a free week of Claude Pro I can give out if its allowed?
 
Are any LLM's as good as Claude Code? I've been using QWEN 3:14b and also QWEN 3.8:27b (bit of a struggle on a 5070 Ti) when feel 3 isn't good enough. Both struggled at a particular task, getting it wrong multiple times and not implementing a simple rule. I gave the code to Claude (Sonnet 5.5 I think) and it got it right first time. Same code, same prompt.
I'm still experimenting, and it might be in this due to the language being less widely used, but is there anything as good as or closed to the closed source models?
For locally hosting LLM have a look at Strata (https://github.com/niko1221/strata)

It utilises GPU, RAM, and storage to run Qwen3.8-Flash-Next at useable speeds.
 
I've got a free week of Claude Pro I can give out if its allowed?
Cheers but I've paid for Claude for months, only cancelling recently as go through periods where I don't need it and I managed to get done most of what I needed to do for now. Trialling local LLM's to see if can use any as a good alternative, moving forward.
 
Last edited:
Drowning in all of it at work at the moment. Misuse. Lack of understanding. Assumption that many of the platforms can be managed at an enterprise level of security. It's madness.

Exciting times, but mad.
 
Done some rejiggling on my CI server and made some existing jobs run on the intel IGPU, and having a go at running Qwen 3.8 coder with Strata. I don't expect it to be terribly good on a 9060XT but I'm interested in seeing how these simple local models can start doing some donkey work (i.e. driving my playtest sessions).
 
Back
Top Bottom