README.md

---
license: apache-2.0
tags:
- video-generation
- multi-reference
- LTX-2.3
base_model:
- Lightricks/LTX-2.3
github: https://github.com/liconstudio/ComfyUI-Licon-MSR
library_name: diffusers
---

# Licon MSR V2 for LTX-2.3

## What's New in V2

Compared with V1, **Licon MSR V2** introduces significant improvements in three key areas:

### 1. Improved Consistency

- Better preservation of character identity, clothing, objects, and scene details
- More consistent appearance across frames
- Improved alignment between multiple reference images and the generated video
- Reduced identity drift and reference attribute loss

### 2. Improved Stability

- More reliable results across repeated sampling runs
- Reduced visual artifacts, flickering, and temporal inconsistencies
- More stable generation in complex multi-subject compositions
- Improved handling of motion and interactions between subjects

### 3. Improved Scene Logic

- Better understanding of spatial and action relationships described in prompts
- More natural subject positioning and interaction
- Improved temporal progression from the beginning to the end of a video
- More coherent composition of characters, objects, and backgrounds

## Overview

This model implements a novel approach to multi-reference video generation using **Multiple Subject Reference (MSR)**. Instead of introducing additional encoder branches or fusion modules, we transform multiple static reference images into a pseudo-video sequence that shares the same representation space as the target video.

## Usage

This LoRA requires the **[ComfyUI-Licon-MSR](https://github.com/liconstudio/ComfyUI-Licon-MSR)** plugin for ComfyUI. A sample workflow is included in the model files for easy testing and experimentation.

## Key Features

### Multi-Reference Visual Memory

- **Token-level reference preservation**: Multiple reference images are encoded as video latents, preserving fine-grained visual information at the token level instead of compressing them into a single embedding
- **Native self-attention retrieval**: Target video tokens directly access reference tokens through the model's existing self-attention mechanism, with no additional architectural components required
- **In-context conditioning**: References serve as visual memory within the main token sequence rather than as external conditioning inputs

### Flexible Reference Composition

- **2 to 5 reference images**: Supports varying numbers of reference inputs with increasing composition complexity
- **Complementary semantic roles**: Each reference image can provide different information:
  - Subject identity
  - Object or prop details
  - Scene or background
  - Local textures
  - Multiple viewpoints

## What It Can Do

### Identity Preservation Across References

Generate videos in which multiple reference identities are simultaneously preserved:

- Multiple characters from different reference images
- Character and object combinations
- Object and scene compositions

### Relation-Based Composition

Beyond identity preservation, the model can compose references according to textual relationship descriptions:

- Action interactions, such as handing, picking up, or pushing
- Spatial relationships, such as left and right or foreground and background
- Temporal event structures, such as start → process → result

### Cross-Reference Attribute Selection

The model learns to selectively retrieve attributes from different references:

- Face from reference A and clothing from reference B
- Object identity from one reference and pose or position from another
- Background elements from scene references

## Usage Tips

- **Prompt description**: Use concise but accurate descriptions of the reference images. Both excessive and insufficient descriptions may reduce consistency.
- **Reference roles**: Clearly describe the role of each referenced subject, object, or scene in the target video.
- **High-motion scenes**: 50 fps is recommended for smoother motion coherence.
- **Sampling**: Complex multi-subject interactions may still benefit from multiple sampling runs.

## V1 vs. V2 Comparison

### Comparison 1

| V1 | V2 |
|:---:|:---:|
| [▶ Play V1](Validition_V2/01/V1_1.mp4) | [▶ Play V2](Validition_V2/01/V2.mp4) |

### Comparison 2

| V1 | V2 |
|:---:|:---:|
| [▶ Play V1](Validition_V2/02/V1.mp4) | [▶ Play V2](Validition_V2/02/V2.mp4)