WeSearch

I hate this group but not literally

· 0 reactions · 0 comments · 6 views

True story, I got interested in AI after seeing it at work and wanted to run models locally. I started with an M3 Ultra 96GB, quickly learned it was not enough for what I wanted, and kept upgrading hardware (including refurbished Mac Studios at 256GB/512GB and now an RTX Pro 6000 that arrived today). I tested many model families (Qwen, DeepSeek, Gemma, Minimax, etc.). My current favorite is MiniMax M2.7 230B/A10B. I’m also waiting for LM Studio support for DeepSeek v4 Flash. I have mixed feeling

Original article
LocalLlama
Read full at LocalLlama →
Anonymous · no account needed
Share 𝕏 Facebook Reddit LinkedIn Threads WhatsApp Bluesky Mastodon Email

Discussion

0 comments

More from LocalLlama

Bruh
LocalLlama·5
Qwen3.6-27B-NVFP4 - images
LocalLlama·6
Hybrid on-device inference on Android: llama.cpp + LiteRT + NPU/GPU routing
LocalLlama·6
MiniMax M2.7 AWQ-4bit on 2x Spark vs 2x RTX 6000 96GB - performance and energy efficiency
LocalLlama·5
Qwen3.6-27B at 72 tok/s on RTX 3090 on Windows using native vLLM (no WSL, no Docker), portable launcher and installer
LocalLlama·6
A Dark-Money Campaign Is Paying Influencers to Frame Chinese AI as a Threat
LocalLlama·6