Home » Uncategorized
How to set Power Limit with nvidia-smi on my Nvidia videocard
Today, I played around with local LLMs using Ollama. I ran Qwen 3.8 27B with Q3_K_S quantization, which fits easily into my RTX 5080 with 16GB VRAM. Unfortunately, the downside was maxed-out GPU/CPU utilization (100%), pushing temperatures up…
Read More »