Skip to content

README.md

Latest commit

 

History

History
73 lines (57 loc) · 2.58 KB

README.md

File metadata and controls

73 lines (57 loc) · 2.58 KB

ExecuTorch Samsung Exynos Delegate

The subtree contains Exynos delegate implementation for ExecuTorch. The target of delegation is deploying torch model to run with exynos NPU/DSP.

This backend is implemented on the top of EXYNOS_LITECORE Please prepare the SDK before you start, it is important to code compilation and runtime.

Delegate Options

Supported Chipset

  • Exynos 2500 (E9955)
  • Exynos 2600 (E9965)

Supported Inference Type

  • Quantized (i8/u8/i16/u16)
  • FP16

Directory Structure

backends/samsung
├── aot        # Codes for generating binary buffer for ENN runtime.
├── builders   # Codes for lowering each operators.
├── partition  # ENN Partitioner.
├── passes     # Various passes helping lower models to ENN backend.
├── python     # Places to put pybind artifacts for accessing samsung libraries.
├── runtime    # ENN runtime for executing lowered models.
├── scripts    # Misc supporting scripts, not related to core functionality.
└── serialization # Codes for building Graph IR for Exynos and serializing.

examples
└── samsung # Examples to run ENN backends.

How to build

Please download Exynos AI LiteCore, and set the root path of SDK directory to EXYNOS_AI_LITECORE_ROOT.
Please navigate to Android NDK and download a version of NDK. ANDROID_NDK refers the root path of NDK directory.

Set up environment variables

export LD_LIBRARY_PATH=${EXYNOS_AI_LITECORE_ROOT}/lib/x86_64-linux/

Build AOT Targets

Generates python artifacts that allow user call Compile interface to lower a model to Exynos backend in python script.

./backends/samsung/build.sh -b x86_64

Build ENN Executor Runner

./backends/samsung/build.sh -b android --ndk ${ANDROID_NDK}

ANDROID_ABI=arm64-v8a is default, necessary runtime executable generated in build_exynos_android directory.

Build Anroid Extension

This is later exposed Java app. Please turn on CMake option EXECUTORCH_BUILD_ENN, and ENN runtime will be added.

cmake extension/android \
  -DCMAKE_TOOLCHAIN_FILE="${ANDROID_NDK}/build/cmake/android.toolchain.cmake" \
  -DANDROID_ABI="${ANDROID_ABI}" \
  -DCMAKE_INSTALL_PREFIX=cmake-android-out \
  -Bcmake-android-out/extension/android

cmake --build cmake-android-out/extension/android -j8

Examples

python -m executorch.examples.samsung.aot_compiler --chipset e9955 (or e9965) -m ic3

Please see this README.md.