llm

Does anyone have experience of using AMD GPU's for offline AI? I'm currently running a 10gb RTX 3080 in my SFF living room PC connected to a 4k LG OLED TV. I use the PC for a mix of media consumption, gaming (recently discovered Helldivers 2), and some AI (mostly text-generation in LM Studio)...