Record 041 · Runtimes · 2018
50%18.41.U
ONNX Runtime
Microsoft
“A single runtime that runs ONNX graphs on CPU, CUDA, DirectML, CoreML, TensorRT.”
ORT is how a model trained in PyTorch becomes a thing a Windows NPU or a Mac can execute. The plumbing of local.
The portability layer of on-device inference.
- ONNX execution
- EP plugins (DML, CoreML, TensorRT)
- Cross-OS
The interchange runtime.
