Framework

Supported versions

Supported OS

Supported Python versions

PyTorch

2.12.0, 2.11.0, 2.10.0

Linux

3.14, 3.13, 3.12, 3.11

2.12.0

Windows

JAX

0.10.0, 0.9.1

Linux

3.14, 3.13, 3.12, 3.11

vLLM

0.23.0
(gfx950, gfx942, gfx1200,
gfx1201, gfx1100, gfx1101,
gfx1102, gfx1152, gfx1151,
gfx1150 GPUs only
)

Linux

3.14 (requires PyTorch 2.11.0)

SGLang

0.5.13
(gfx950, gfx942, gfx1200,
gfx1201, gfx1100, gfx1101,
gfx1102, gfx1152, gfx1151,
gfx1150 GPUs only
)

Linux

3.14 (requires PyTorch 2.11.0)

MIGraphX

2.16
(gfx950, gfx942 GPUs only)

Linux

3.12

ONNX Runtime

1.23.2
(gfx950, gfx942 GPUs only)

Linux

3.12