Skip to content

vllm.config.weight_transfer

WeightTransferConfig

Configuration for weight transfer during RL training.

Source code in vllm/config/weight_transfer.py 
 8
 9
10
11
12
13
14
15
@config
class WeightTransferConfig:
    """Configuration for weight transfer during RL training."""

    backend: Literal["nccl", "ipc"] | str = "nccl"
    """The backend to use for weight transfer. Validated against the
    `WeightTransferEngineFactory` registry at engine creation time.
    """

backend class-attribute instance-attribute 

backend: Literal['nccl', 'ipc'] | str = 'nccl'

The backend to use for weight transfer. Validated against the WeightTransferEngineFactory registry at engine creation time.