Benchmarking

Benchmarking dashboard

• https://github.com/pytorch/executorch/tree/main/extension/benchmark

• apple platform

• android

Profiling

• https://pytorch.org/executorch/main/runtime-profiling.html

• Profiling in ExecuTorch gives users access to these runtime metrics:

  • Model Load Time.
  • Operator Level Execution Time.
  • Delegate Execution Time.
    • If the delegate that the user is calling into has been integrated with the Developer Tools, then users will also be able to access delegated operator execution time.
  • End-to-end Inference Execution Time.