Open SourceImportance: Low

Community builds voice, avatar, and fine-tuned projects around Gemma 4 31B

r/LocalLLaMAJul 2, 2026 · 10d ago

A wave of community projects has formed around the Gemma 4 31B model. One developer combined Nvidia's Parakeet , Gemma 4 31B served by Cerebras, and a custom Qwen3 TTS voice synthesizer into a real-time voice chat demo — a fully stack positioned as a drop-in replacement for OpenAI's .

It too, reaching similar latency on a MacBook Pro M3 with 36GB RAM using the smaller variant. A related project built a 3D avatar that talks face-to-face, deciding its own facial expressions and hand gestures through function tools, with fast replies again thanks to Cerebras's serving speed and lip-sync handled by a separate open tool.

Separately, an kernel project lets run on via the MLX library without needing CUDA, and its developer is also reworking Gemma 4 31B into a smaller 26B version by adjusting its local-attention layer structure. Other community members released a Gemma 4 31B fine-tune specialized for and creative writing that scored notably higher than the base model on a writing benchmark, and a paid API service now offers a roleplay-focused fine-tune of the same model.

Key points

  • Parakeet () + Gemma 4 31B (served by Cerebras) + Qwen3 TTS combine into a real-time, locally-runnable voice chat demo
  • A 3D avatar demo uses the same stack, deciding its own facial expressions and gestures during face-to-face conversation
  • An kernel project runs on via MLX, no CUDA required
  • A developer is rebuilding Gemma 4 31B into a smaller 26B version by adjusting its local-attention layers
  • A -focused fine-tune scored a large improvement over the base model on a writing benchmark

Sources covering this story (9)

Read original ↗