← Back to Complete Guide

Best Video Format for Plex & Jellyfin (Stop the Buffering)

One movie plays instantly, the next buffers every ten seconds — same server, same TV. The difference is never luck. It's whether your file direct-plays or forces a transcode. Here's the universal recipe, the per-client traps, and how to fix a whole library overnight.

By Hadi Karaki, maker of FormatifSeptember 4, 202611 min read

The only concept that matters: direct play vs transcode

Direct play = the server sends the file as-is; even a Raspberry Pi can serve 4K this way. Transcode= the server re-encodes live because the client can't handle something in the file; a single 4K transcode can saturate a desktop CPU. Buffering is almost always a transcode your server can't sustain — not a network problem. Every recommendation below exists to keep you in direct play.

The universal recipe (memorize this)

MP4 · H.264 video · AAC audio · SRT subtitles

This combination direct-plays on virtually every Plex and Jellyfin client ever made. Deviate from any of the four only for a reason — and know the cost below.

The three traps that force transcoding

Trap 1: image subtitles (PGS / VOBSUB)

Text subtitles (SRT) direct-play or direct-stream almost everywhere. Image subtitles — PGS from Blu-rays, VOBSUB from DVDs — are pictures, so most clients can't overlay them; the server burns them into the video, forcing a full video transcode. Converting PGS→SRT with OCR is the single highest-value buffering fix in most libraries.

Trap 2: premium audio (TrueHD, DTS-HD MA)

Beautiful on a home theater, poison for sticks and phones. Most clients can't decode TrueHD/DTS-HD, triggering at least an audio transcode (cheap) — but combined with subtitles it often cascades into video transcoding (expensive). Keep the HD track for the theater and an AAC stereo track for everything else; MKV holds both happily.

Trap 3: 4K HDR tone-mapping

H.265 HDR10 direct-plays on HDR clients — until someone watches on an SDR screen and the server must tone-map HDR→SDR live. Software tone-mapping a 4K stream is brutally CPU-heavy. Rule: keep a 1080p SDR copy next to every 4K HDR file for remote, mobile, and bedroom-TV viewing.

Per-client cheat sheet

ClientPlays nativelyWatch out for
Fire Stick / ChromecastH.264 MP4/MKV, AACH.265 on old sticks; PGS subs; TrueHD
Apple TV / iPhone / iPadH.264/H.265 MP4, AAC (Infuse plays everything)MKV in native apps; use Infuse for exotic files
Smart TVs (Tizen/webOS)H.264 MP4; H.265 on 4K setsCodec roulette by model year; ASS/PGS subs
PS5 / XboxH.264 MP4, AACLimited subtitle support; no TrueHD/DTS-HD
NVIDIA ShieldNearly everything incl. TrueHD/DTS-HDAlmost nothing — the reference client
Web browserH.264 + AAC only, effectivelyH.265, MKV quirks, all HD audio

Jellyfin clients behave the same way — the recipe and traps are identical; only the server software differs.

Fix it once, overnight

Pre-transcode the library instead of firefighting files.

The workflow: keep MKV masters with every track, and generate direct-play MP4s (H.264 + AAC + SRT) for anything that buffers. H.264 MKVs remux in seconds with zero loss; only true problem files need re-encoding. Server-side automators (Tdarr, Unmanic, FileFlows) do this hands-free — or point Formatif Pro ($8.95 one-time) at the library for a desktop batch with per-file status, no container setup, and no uploads.

Batch whole libraries, subfolders included
Remux where possible, re-encode where needed
Keep masters; generate direct-play copies
One-time purchase of $8.95 — no subscription

Plex & Jellyfin questions, answered

What is the best video format for Plex?

MP4 with H.264 video, AAC audio, and SRT subtitles — direct-plays on virtually every client with no transcoding.

Why does Plex keep buffering?

The server is transcoding something the client can't play — usually H.265 on old clients, TrueHD/DTS audio, PGS subtitles, or 4K HDR tone-mapping. Pre-transcode to the universal recipe.

Does Jellyfin need different formats?

No — same recipe, same traps. Direct-play-friendly files matter even more on Jellyfin.

Do subtitles force transcoding?

SRT almost never; PGS/VOBSUB usually do (burn-in). OCR image subs to SRT for the biggest single buffering fix.

Can Plex play 4K HDR without transcoding?

Yes if client, file, and display all agree. Keep a 1080p SDR copy for remote/mobile/SDR screens — tone-mapping 4K live melts CPUs.

Keep MKV or convert to MP4?

Keep MKV masters; generate MP4 direct-play copies for problem files. Remux H.264 MKVs in seconds, zero loss.

How do I convert the whole library?

Overnight batch: MP4 + H.264 + AAC + SRT, keep originals until spot-checked. Tdarr/Unmanic server-side, or a desktop batch tool with per-file status.

Keep learning

A library that never buffers.

Formatif Pro ($8.95 one-time) and Formatif AI ($12.95 one-time) handle video, image, and audio conversion offline — with batch workflows, no file size limits, and a 3-day free trial.

Server-side automators work too — this page exists so you pick the workflow that fits, with direct-play files either way.

HK

Written by

Hadi KarakiLinkedIn

Founder of Formatif, a local-first offline media processing suite for Windows and Linux. Hadi writes about video, image, and audio formats, compression, and privacy-first desktop workflows.