LongCat-Video: Meituan's Open-Source 13.6B Video Generation Model

LongCat-Video: Meituan's Open-Source 13.6B Video Generation Model

LongCat-Video is an open-source video generation model released by Meituan's LongCat team. It has 13.6 billion parameters, it handles text-to-video, image-to-video and video-continuation in a single model, and it was built specifically to keep going — producing videos that run for minutes rather than the five-second clips most open models top out at.

It is released under the MIT licence, weights included. That combination — long-form output, one model for three tasks, and a permissive licence — is what makes it worth a closer look, whether you are evaluating it for production or just want to know where open video generation currently stands.

The short version

  • 13.6B dense parameters, one unified model for Text-to-Video, Image-to-Video and Video-Continuation.
  • Minutes-long output without the colour drift and quality decay that usually creeps in after a few seconds.
  • 720p at 30fps in minutes, via coarse-to-fine generation plus Block Sparse Attention.
  • MIT licensed weights — commercial use is permitted, no trademark or patent rights granted.
  • Avatar 1.5 (May 2026) adds audio-driven talking characters with Whisper-Large lip sync and 8-step distilled inference.
  • Repo: github.com/meituan-longcat/LongCat-Video — ~6.5k stars, Python, MIT.

What LongCat-Video actually is

Most open video models are trained to do one thing. You pick a text-to-video checkpoint, and if you later want to animate a still image you fetch a different checkpoint with different weights, different quirks and a different prompt style.

LongCat-Video collapses that. One 13.6B model natively supports three tasks:

  • Text-to-Video — a prompt in, a clip out.
  • Image-to-Video — a still image becomes the first frame, and the model animates forward from it.
  • Video-Continuation — you hand it existing footage and it carries on from where the footage stopped.

The team describes it as a foundational model and calls it their first step toward world models — systems that hold a coherent internal picture of a scene and evolve it over time, rather than producing a handsome but disconnected sequence of frames. That framing explains most of the design decisions below.

Architecturally it is dense, not mixture-of-experts. Every one of its 13.6B parameters is active on every forward pass. Wan 2.2, its closest open-source comparison, is an MoE with 28B total parameters of which 14B activate per pass. Roughly the same compute per step, half the memory footprint for weights.

The four things it does well

1. One architecture, three tasks

Unification is not just a packaging convenience. Because Video-Continuation shares weights with Text-to-Video and Image-to-Video, the model's understanding of “what happens next” feeds directly into how it starts a clip. In practice this means you can chain tasks: generate an opening from a prompt, continue it, continue it again, and stay inside one model the whole way.

2. Long video generation, natively

This is the headline. LongCat-Video is pretrained on the Video-Continuation task rather than having continuation bolted on afterwards. The result, per the team, is minutes-long video without colour drifting or quality degradation.

3. Efficient inference

It targets 720p at 30fps in minutes, using a coarse-to-fine strategy along both the temporal and the spatial axis — generate something rough and short-stride first, then refine detail and fill in frames. Block Sparse Attention cuts the attention cost further, and the benefit grows with resolution, which is exactly where you want the savings.

4. Multi-reward RLHF

The model is tuned with multi-reward Group Relative Policy Optimization (GRPO). Rather than optimising one preference score, several reward signals are balanced at once — the practical reason a model can score well on prompt-following without its motion turning to soup. Meituan reports results comparable to leading open-source models and to recent commercial systems.

Why long video is the hard part

If you have generated video before, you know the failure mode. The first two seconds look great. By second six the colours have warped slightly warmer, textures have started to smear, and by second twelve the subject has quietly become a different person.

This happens because long clips are usually produced by generating a chunk, taking its last frame, and generating the next chunk from that. Every hand-off carries forward the previous chunk's small errors, and the next chunk adds its own. Errors compound. That is colour drift and quality degradation, and it is a property of the method, not of insufficient model size.

LongCat-Video's answer is to make continuation a first-class pretraining objective. A model that has spent its training seeing “here is real footage, produce what genuinely came next” learns to treat prior frames as constraints rather than as a loose style reference. That is what keeps a clip stable minute after minute.

The distinction that matters: most models can be made to output long video. LongCat-Video is trained for it. Those produce very different results at the two-minute mark.

LongCat-Video-Avatar 1.5

Alongside the base model, the team maintains an avatar line for audio-driven human video — you supply audio and a reference, and it generates a character speaking it, lip-synced.

The release history is short and quick:

DateReleaseWhat it brought
25 Oct 2025LongCat-VideoThe foundational model, with tech report and weights.
16 Dec 2025LongCat-Video-AvatarAudio-Text-to-Video, Audio-Text-Image-to-Video and continuation; single- and multi-stream audio.
21 May 2026LongCat-Video-Avatar 1.5Whisper-Large audio encoder, stylised domains, 8-step distilled inference.

Version 1.5 is the meaningful upgrade, and its changes are unusually concrete:

  • Whisper-Large replaces Wav2Vec2 as the audio encoder, for more accurate lip synchronisation. Whisper carries far more linguistic context than a raw acoustic encoder, and lip shapes depend on which phoneme is being spoken, not just on how loud the moment is.
  • Production-ready physical rationality and temporal stability, with robust long-video generation — the avatar line inherits the base model's staying power.
  • Generalises to stylised domains: anime, animals, and complex real-world conditions, not just a person in front of a clean background.
  • Single-stream and multi-stream audio, so more than one character can speak in the same generated scene.
  • 8-step inference via step distillation. This is the change you feel most — diffusion sampling is the dominant cost, and cutting the step count is close to a linear speed-up.

How it benchmarks

Meituan publishes Mean Opinion Score (MOS) results from human raters on their internal benchmark. Two things to keep in mind before reading them: MOS is subjective by construction, and these are the authors' own numbers. Useful for orientation, not a substitute for testing on your own prompts.

Text-to-Video

MOS scoreVeo3PixVerse-V5Wan 2.2-T2V-A14BLongCat-Video
AccessibilityProprietaryProprietaryOpen SourceOpen Source
ArchitectureMoEDense
Total / Activated params28B / 14B13.6B / 13.6B
Text-Alignment ↑3.993.813.703.76
Visual Quality ↑3.233.133.263.25
Motion Quality ↑3.863.813.783.74
Overall Quality ↑3.483.363.353.38

On text-to-video LongCat-Video takes the best overall score of the three non-Veo3 systems, edging past both PixVerse-V5 and Wan 2.2 — while running half the active parameters of Wan. Veo3 still leads overall, largely on text alignment and motion.

Image-to-Video

MOS scoreSeedance 1.0Hailuo-02Wan 2.2-I2V-A14BLongCat-Video
AccessibilityProprietaryProprietaryOpen SourceOpen Source
Image-Alignment ↑4.124.184.184.04
Text-Alignment ↑3.703.853.333.49
Visual Quality ↑3.223.183.233.27
Motion Quality ↑3.773.803.793.59
Overall Quality ↑3.353.273.263.17

Image-to-video is the weaker showing, and it is worth being straight about it: LongCat-Video comes last on overall quality here, pulled down mainly by motion quality (3.59 against roughly 3.8 for the others). It does take the top visual-quality score, and it beats Wan 2.2 on text alignment by a clear margin — so per-frame fidelity and prompt-following are fine. It is the movement that lags.

The practical read: prefer LongCat-Video when your priority is text-driven generation, or length, or both. If your workload is animating single stills where fluid motion is the whole product, benchmark it against alternatives before committing.

Installation

Clone the repository:

git clone --single-branch --branch main https://github.com/meituan-longcat/LongCat-Video
cd LongCat-Video

Set up the environment. The pinned versions matter here — FlashAttention in particular is fussy about the torch and CUDA it was built against:

# create conda environment
conda create -n longcat-video python=3.10
conda activate longcat-video

# install torch (configure according to your CUDA version)
pip install torch==2.6.0+cu124 torchvision==0.21.0+cu124 torchaudio==2.6.0 \
  --index-url https://download.pytorch.org/whl/cu124

# install flash-attn-2
pip install ninja
pip install psutil
pip install packaging
pip install flash_attn==2.7.4.post1

# install other requirements
pip install -r requirements.txt

If you also want the avatar models, add:

conda install -c conda-forge librosa
conda install -c conda-forge ffmpeg
pip install -r requirements_avatar.txt

FlashAttention-2 is enabled by default in the model config. You can switch to FlashAttention-3 or xformers by editing ./weights/LongCat-Video/dit/config.json once the alternative is installed — useful if your GPU generation or driver stack is happier with one than the other.

Which model to download

ModelUse it for
LongCat-VideoThe foundational model: text-to-video, image-to-video, continuation, long and interactive video.
LongCat-Video-AvatarSingle- and multi-character audio-driven video, using the wav2vec2 audio encoder.
LongCat-Video-Avatar-1.5The upgraded avatar model: Whisper-large-v3 encoder, distillation-based fast inference. Start here for avatar work.
pip install "huggingface_hub[cli]"

huggingface-cli download meituan-longcat/LongCat-Video \
  --local-dir ./weights/LongCat-Video

huggingface-cli download meituan-longcat/LongCat-Video-Avatar \
  --local-dir ./weights/LongCat-Video-Avatar

huggingface-cli download meituan-longcat/LongCat-Video-Avatar-1.5 \
  --local-dir ./weights/LongCat-Video-Avatar-1.5

You do not need all three. Pull the base model for general generation, or Avatar 1.5 for talking characters.

Running each task

Every demo follows the same shape: torchrun, a task script, and a checkpoint directory. Add --nproc_per_node=N and a matching --context_parallel_size=N to shard across GPUs. --enable_compile turns on torch compilation — slower on the first run, faster on every one after.

Text-to-Video

# single GPU
torchrun run_demo_text_to_video.py \
  --checkpoint_dir=./weights/LongCat-Video --enable_compile

# two GPUs
torchrun --nproc_per_node=2 run_demo_text_to_video.py \
  --context_parallel_size=2 \
  --checkpoint_dir=./weights/LongCat-Video --enable_compile

Image-to-Video

torchrun run_demo_image_to_video.py \
  --checkpoint_dir=./weights/LongCat-Video --enable_compile

Video-Continuation

torchrun run_demo_video_continuation.py \
  --checkpoint_dir=./weights/LongCat-Video --enable_compile

Long video

torchrun run_demo_long_video.py \
  --checkpoint_dir=./weights/LongCat-Video --enable_compile

Interactive video

torchrun run_demo_interactive_video.py \
  --checkpoint_dir=./weights/LongCat-Video --enable_compile

Avatar 1.5, single audio stream

Here --stage_1 picks the entry task: at2v for audio + text, ai2v for audio + image. --use_distill enables the 8-step path and --use_int8 quantises to save memory.

# audio + text to video
torchrun --nproc_per_node=2 run_demo_avatar_single_audio_to_video.py \
  --context_parallel_size=2 \
  --checkpoint_dir=./weights/LongCat-Video-Avatar-1.5 \
  --stage_1=at2v --input_json=assets/avatar/single_example_1.json \
  --use_distill --model_type avatar-v1.5 --use_int8

# audio + image to video, then continue for 5 segments
torchrun --nproc_per_node=2 run_demo_avatar_single_audio_to_video.py \
  --context_parallel_size=2 \
  --checkpoint_dir=./weights/LongCat-Video-Avatar-1.5 \
  --stage_1=ai2v --input_json=assets/avatar/single_example_1.json \
  --num_segments=5 --ref_img_index=10 --mask_frame_range=3 \
  --use_distill --model_type avatar-v1.5 --use_int8

Avatar 1.5, multiple audio streams

torchrun --nproc_per_node=2 run_demo_avatar_multi_audio_to_video.py \
  --context_parallel_size=2 \
  --checkpoint_dir=./weights/LongCat-Video-Avatar-1.5 \
  --input_json=assets/avatar/multi_example_1.json \
  --use_distill --model_type avatar-v1.5 --use_int8

The Streamlit demo

For clicking around instead of writing flags:

streamlit run ./run_streamlit.py --server.fileWatcherType none --server.headless=false

Making it faster

Three levers, roughly in order of payoff:

  1. Step distillation (Avatar 1.5). Eight steps instead of the usual dozens. Free, already in the checkpoint, enabled with --use_distill.
  2. Caching. The community project CacheDiT supports LongCat-Video with DBCache and TaylorSeer, reporting close to 1.7× speed-up without obvious precision loss. Diffusion transformers repeat a lot of near-identical work between adjacent steps; caching skips it.
  3. Context parallelism. --context_parallel_size=N splits the sequence across N GPUs. This is how you attack long clips specifically, since the sequence dimension is what grows with duration.

Add --use_int8 when memory rather than time is your constraint.

Licence and responsible use

The weights are released under the MIT Licence, and contributions to the repository are MIT unless stated otherwise. MIT is about as permissive as it gets: commercial use, modification and redistribution are all fine, provided the licence notice travels with the code.

Two caveats worth reading properly:

  • The licence does not grant rights to Meituan trademarks or patents. You can ship products built on the model; you cannot brand them as Meituan's.
  • The team is explicit that the model has not been evaluated for every downstream application. Their guidance is to assess accuracy, safety and fairness before deploying in sensitive or high-risk settings, and to comply with applicable law on data protection, privacy and content safety.

That second point deserves real weight for the avatar models in particular. A system that generates a convincing person speaking supplied audio is a synthetic-media tool, and the consent, disclosure and likeness questions that come with it are yours to answer, not the licence's.

Who should actually use this

Good fit if:

  • You need clips longer than a few seconds and are tired of stitching around drift.
  • You want text-to-video quality competitive with larger open models at a smaller active-parameter count.
  • You need audio-driven characters and want lip sync that holds up over a long take.
  • A permissive licence with downloadable weights is a hard requirement — on-premise, air-gapped, or simply no per-second API bill.
  • You want one model to maintain instead of three.

Look elsewhere if:

  • Your workload is dominated by image-to-video where motion quality is the deliverable — that is this model's weakest published result.
  • You have no CUDA GPUs available. The published path assumes torch with CUDA 12.4 and FlashAttention.
  • You want top-of-the-league overall quality regardless of cost or openness, in which case the proprietary systems still lead on several axes.

Frequently asked questions

Is LongCat-Video free for commercial use?

Yes. The model weights are released under the MIT Licence, which permits commercial use, modification and redistribution as long as the licence notice is preserved. The licence does not grant any rights to Meituan trademarks or patents, and the team notes the model has not been evaluated for every downstream application, so you remain responsible for assessing accuracy, safety and fairness in your own deployment.

How long a video can LongCat-Video generate?

Minutes. The model is natively pretrained on the Video-Continuation task, which is what allows it to keep extending a clip without the colour drifting or quality degradation that typically appears when long video is produced by chaining short generations together.

How big is LongCat-Video and what hardware does it need?

It has 13.6 billion parameters in a dense architecture, meaning all parameters are active on every forward pass. The published setup expects NVIDIA GPUs with PyTorch 2.6 built for CUDA 12.4 plus FlashAttention 2.7.4. Multi-GPU inference is supported through context parallelism, and an int8 mode is available for the avatar models to reduce memory use. Meituan does not publish a specific minimum VRAM figure.

What is the difference between LongCat-Video and LongCat-Video-Avatar?

LongCat-Video is the foundational model for text-to-video, image-to-video and video-continuation. LongCat-Video-Avatar is a separate line for audio-driven human video, where you supply audio and the model generates a lip-synced character speaking it. Version 1.5, released in May 2026, replaced the Wav2Vec2 audio encoder with Whisper-Large for more accurate lip sync, generalised to stylised domains such as anime and animals, supports single- and multi-stream audio, and cut inference to eight steps through step distillation.

How does LongCat-Video compare to Wan 2.2?

On Meituan's internal text-to-video MOS benchmark, LongCat-Video scores 3.38 overall against 3.35 for Wan 2.2-T2V-A14B, while using 13.6B active parameters compared with Wan's 14B active out of 28B total. On image-to-video the ranking reverses on overall quality, where LongCat-Video scores 3.17 against Wan's 3.26, mainly due to lower motion quality, although LongCat-Video leads on visual quality and text alignment in that test.

Can LongCat-Video run on a single GPU?

Yes. Every demo script runs single-GPU by default with torchrun. Multi-GPU is opt-in by adding --nproc_per_node and a matching --context_parallel_size, which shards the sequence across devices and is the most effective option for longer clips.

How do I make LongCat-Video generate faster?

Three approaches stack. Use the distilled 8-step path on Avatar 1.5 with --use_distill. Add caching through the community CacheDiT project, which reports close to a 1.7 times speed-up with DBCache and TaylorSeer without obvious precision loss. And shard across GPUs with context parallelism. The --enable_compile flag also helps after the first warm-up run, and --use_int8 trades a little precision for lower memory.

Sources and further reading

The team credits the Wan, UMT5-XXL, Diffusers and Hugging Face projects for their open research, and can be reached at longcat-team@meituan.com.

Building with open video models?

We work with teams putting models like this into real products — inference infrastructure, pipeline design, and the unglamorous parts around them. If that is where you are, get in touch.

DevGlaze
DevGlaze
DevGlaze builds web applications and writes about the tools, models, and open-source releases worth...

Comments (0)

Leave a Comment