Skip to content
This repository was archived by the owner on Apr 18, 2023. It is now read-only.

WebML Examples Results on Different Backends and Platforms

Christywl edited this page May 18, 2020 · 55 revisions

Test Environments

Platform Device Name CPU GPU Memory
Windows 10 Dell XPS 13 Intel i5-8250U Intel UHD Graphics 620(Driver: 26.20.100.7107) 8GB
Linux Ubuntu 16.04 Dell XPS 13 Intel i7-8550U Intel UHD Graphics 620 16GB
macOS 10.14.5 MacBook Pro Intel i5-8259U Intel Iris Plus Graphics 655 16GB
Android 9 Samsung Galaxy Note 10+ SDM 855 Octa-Core SDR8150 Qualcomm Adreno 640 12GB

Example Results:

Windows:

Image Classification

Image Classification clDNN DNNL DirectML WASM WebGL
MobileNet v1(TFLite) Yes Yes Yes Yes Yes
MobileNet v1 Quant(TFLite) #74 #74 #74 Yes #74
MobileNet v2(TFLite) Yes Yes Yes Yes Yes
MobileNet v2 Quant(TFLite) #74 #74 #74 Yes #74
SqueezeNet(TFLite) Yes Yes Yes Yes Yes
Inception v3(TFLite) Yes Yes Yes Yes Yes
Inception v3 Quant(TFLite) #74 #74 #74 Yes #74
Inception v4(TFLite) Yes Yes Yes Yes Yes
Inception v4 Quant(TFLite) #74 #74 #74 Yes #74
Inception Resnet v2(TFLite) Yes Yes Yes Yes Yes
SqueezeNet(ONNX) Yes Yes Yes Yes Yes
MobileNet v2(ONNX) Yes Yes Yes Yes Yes
ResNet50 v1(ONNX) Yes Yes Yes Yes Yes
ResNet50 v2(ONNX) Yes Yes Yes Yes Yes
Inception v2(ONNX) Yes #1130 Yes Yes Yes
DenseNet 121(ONNX) Yes #1130 #841 Yes Yes
SqueezeNet(OpenVINO) Yes #866 #841 Yes Yes
MobileNet v1(OpenVINO) Yes Yes Yes Yes Yes
MobileNet v2(OpenVINO) Yes Yes Yes Yes Yes
ResNet50 v1(OpenVINO) Yes Yes Yes Yes Yes
DenseNet 121(OpenVINO) Yes #1130 #841 Yes Yes
Inception v2(OpenVINO) Yes Yes Yes Yes Yes
Inception v4(OpenVINO) Yes Yes Yes Yes Yes

Person/Object Detection

Person/Object Detection clDNN DNNL DirectML WASM WebGL
SSD MobileNet v1(TFLite) Yes Yes Yes Yes Yes
SSD MobileNet v1 Quant(TFLite) #74 #74 #74 Yes #74
SSD MobileNet v2(TFLite) Yes Yes Yes Yes Yes
SSD MobileNet v2 Quant(TFLite) #74 #74 #74 Yes #74
SSDLite MobileNet v2(TFLite) Yes Yes Yes Yes Yes
Tiny Yolo v2 COCO(TFLite) #629 #630 #1130 #842 Yes Yes
Tiny Yolo v2 VOC(TFLite) #629 #630 #1130 #842 Yes Yes

Semantic Segmentation

Semantic Segmentation clDNN DNNL DirectML WASM WebGL
DeepLab  224 Yes #461 Yes Yes Yes
DeepLab  224 Atrous Yes #461 Yes Yes Yes
DeepLab  257 Yes #461 #837 Yes Yes
DeepLab  257 Atrous Yes #461 #837 Yes Yes
DeepLab  321 Yes #461 #837 Yes Yes
DeepLab  321 Atrous Yes #461 #837 Yes Yes
DeepLab  513 Yes #461 #837 Yes Yes
DeepLab  513 Atrous Yes #461 #837 Yes Yes

Skeleton Detection

Skeleton Detection clDNN DNNL DirectML WASM WebGL
PoseNet Yes Yes Yes Yes Yes

Face Recognition

Face Recognition clDNN DNNL DirectML WASM WebGL
SSD MobileNet v1 Face(TFLite) + FaceNet(OpenVINO) #639 #1130 #843 Yes Yes
SSD MobileNet v2 Face(TFLite) + FaceNet(OpenVINO) #639 #1130 #843 Yes Yes
SSDLite MobileNet v2 Face(TFLite) + FaceNet(OpenVINO) #639 #1130 #843 Yes Yes
Tiny Yolo v2 Face(TFLite) + FaceNet(OpenVINO) #629 #1130 #842 Yes Yes
SSD MobileNet v1 Face(TFLite) + Face Reidentification(OpenVINO) Yes #1130 Yes Yes Yes
SSD MobileNet v2 Face(TFLite) + Face Reidentification(OpenVINO) Yes #1130 Yes Yes Yes
SSDLite MobileNet v2 Face(TFLite) + Face Reidentification(OpenVINO) Yes #1130 Yes Yes Yes
Tiny Yolo v2 Face(TFLite) + Face Reidentification(OpenVINO) #629 #1130 #842 Yes Yes

Facial Landmark Detection

Facial Landmark Detection clDNN DNNL DirectML WASM WebGL
SSD MobileNet v1(TFLite) #800 Yes Yes Yes Yes
SSD MobileNet v2(TFLite) #800 Yes Yes Yes Yes
SSDLite MobileNet v2(TFLite) #800 Yes Yes Yes Yes
Tiny Yolo v2(TFLite) #629 #630 #1130 #842 Yes Yes

Super Resolution

Super Resolution clDNN DNNL DirectML WASM WebGL
SRGAN 96x4 #639 #640 #843 Yes Yes
SRGAN 128x4 #639 #640 #843 Yes Yes

Emotion Analysis

Emotion Analysis clDNN DNNL DirectML WASM WebGL
SSD MobileNet v1(TFLite) #629 #541 #835 Yes Yes
SSD MobileNet v2(TFLite) #629 #541 #835 Yes Yes
SSDLite MobileNet v2(TFLite) #629 #541 #835 Yes Yes
Tiny Yolo v2(TFLite) #629 #630 #1130 #842 Yes Yes

Speech Commands

Speech Commands clDNN DNNL DirectML WASM WebGL
KWS CNN(TFLite) #936 #935 Yes Yes Yes

Linux:

Image Classification

Image Classification clDNN DNNL IE-clDNN IE-MKLDNN WASM WebGL
MobileNet v1(TFLite) Yes Yes Yes Yes Yes Yes
MobileNet v1 Quant(TFLite) #74 #74 #851 #74 #851 #74 Yes #74
MobileNet v2(TFLite) Yes Yes Yes Yes Yes Yes
MobileNet v2 Quant(TFLite) #74 #74 #851 #74 #851 #74 Yes #74
SqueezeNet(TFLite) Yes Yes Yes Yes Yes Yes
Inception v3(TFLite) Yes Yes Yes Yes Yes Yes
Inception v3 Quant(TFLite) #74 #74 #851 #74 #851 #74 Yes #74
Inception v4(TFLite) Yes Yes #750 #861 Yes Yes
Inception v4 Quant(TFLite) #74 #74 #851 #74 #851 #74 Yes #74
Inception Resnet v2(TFLite) Yes Yes #750 #861 Yes Yes
SqueezeNet(ONNX) Yes Yes Yes Yes Yes Yes
MobileNet v2(ONNX) Yes Yes Yes Yes Yes Yes
ResNet50 v1(ONNX) Yes Yes #750 #861 Yes Yes
ResNet50 v2(ONNX) Yes Yes #750 #861 Yes Yes
Inception v2(ONNX) Yes #1130 #751 #725 Yes Yes
DenseNet 121(ONNX) Yes #1130 #726 #726 Yes Yes
SqueezeNet(OpenVINO) Yes #866 Yes Yes Yes Yes
MobileNet v1(OpenVINO) Yes Yes Yes Yes Yes Yes
MobileNet v2(OpenVINO) Yes Yes Yes Yes Yes Yes
ResNet50 v1(OpenVINO) Yes Yes #750 #861 Yes Yes
DenseNet 121(OpenVINO) Yes #1130 #751 #725 Yes Yes
Inception v2(OpenVINO) Yes Yes #750 Yes Yes Yes
Inception v4(OpenVINO) Yes Yes #750 #861 Yes Yes

Person/Object Detection

Person/Object Detection clDNN DNNL IE-clDNN IE-MKLDNN WASM WebGL
SSD MobileNet v1(TFLite) Yes Yes Yes Yes Yes Yes
SSD MobileNet v1 Quant(TFLite) #74 #74 #851 #74 #851 #74 Yes #74
SSD MobileNet v2(TFLite) Yes Yes Yes Yes Yes Yes
SSD MobileNet v2 Quant(TFLite) #74 #74 #851 #74 #851 #74 Yes #74
SSDLite MobileNet v2(TFLite) Yes Yes Yes Yes Yes Yes
Tiny Yolo v2 COCO(TFLite) #629 #630 #1130 #751 #725 Yes Yes
Tiny Yolo v2 VOC(TFLite) #629 #630 #1130 #751 #725 Yes Yes

Semantic Segmentation

Semantic Segmentation clDNN DNNL IE-clDNN IE-MKLDNN WASM WebGL
DeepLab  224 Yes #461 #754 #704 Yes Yes
DeepLab  224 Atrous Yes #461 #754 #704 Yes Yes
DeepLab  257 Yes #461 #754 #704 Yes Yes
DeepLab  257 Atrous Yes #461 #754 #704 Yes Yes
DeepLab  321 Yes #461 #754 #704 Yes Yes
DeepLab  321 Atrous Yes #461 #754 #704 Yes Yes
DeepLab  513 Yes #461 #754 #704 Yes Yes
DeepLab  513 Atrous Yes #461 #754 #704 Yes Yes

Skeleton Detection

Skeleton Detection clDNN DNNL IE-clDNN IE-MKLDNN WASM WebGL
PoseNet Yes Yes Yes Yes Yes Yes

Face Recognition

Face Recognition clDNN DNNL IE-clDNN IE-MKLDNN WASM WebGL
SSD MobileNet v1 Face(TFLite) + FaceNet(OpenVINO) #639 #1130 #751 #725 Yes Yes
SSD MobileNet v2 Face(TFLite) + FaceNet(OpenVINO) #639 #1130 #751 #725 Yes Yes
SSDLite MobileNet v2 Face(TFLite) + FaceNet(OpenVINO) #639 #1130 #751 #725 Yes Yes
Tiny Yolo v2 Face(TFLite) + FaceNet(OpenVINO) #629 #1130 #751 #725 Yes Yes
SSD MobileNet v1 Face(TFLite) + Face Reidentification(OpenVINO) Yes #1130 #751 #725 Yes Yes
SSD MobileNet v2 Face(TFLite) + Face Reidentification(OpenVINO) Yes #1130 #751 #725 Yes Yes
SSDLite MobileNet v2 Face(TFLite) + Face Reidentification(OpenVINO) Yes #1130 #751 #725 Yes Yes
Tiny Yolo v2 Face(TFLite) + Face Reidentification(OpenVINO) #629 #1130 #751 #725 Yes Yes

Facial Landmark Detection

Facial Landmark Detection clDNN DNNL IE-clDNN IE-MKLDNN WASM WebGL
SSD MobileNet v1(TFLite) #800 Yes #750 #727 Yes Yes
SSD MobileNet v2(TFLite) #800 Yes #750 #727 Yes Yes
SSDLite MobileNet v2(TFLite) #800 Yes #750 #727 Yes Yes
Tiny Yolo v2(TFLite) #629 #630 #1130 #751 #725 Yes Yes

Super Resolution

Super Resolution clDNN DNNL IE-clDNN IE-MKLDNN WASM WebGL
SRGAN 96x4 #639 #640 #782 #783 Yes Yes
SRGAN 128x4 #639 #640 #782 #783 Yes Yes

Emotion Analysis

Emotion Analysis clDNN DNNL IE-clDNN IE-MKLDNN WASM WebGL
SSD MobileNet v1(TFLite) #629 #541 #782 #783 Yes Yes
SSD MobileNet v2(TFLite) #629 #541 #782 #783 Yes Yes
SSDLite MobileNet v2(TFLite) #629 #541 #782 #783 Yes Yes
Tiny Yolo v2(TFLite) #629 #630 #1130 #751 #725 Yes Yes

Speech Commands

Speech Commands clDNN DNNL IE-clDNN IE-MKLDNN WASM WebGL
KWS CNN(TFLite) #936 #935 #937 #937 Yes Yes

macOS:

Image Classification

Image Classification MPS BNNS DNNL WASM WebGL
MobileNet v1(TFLite) Yes #368 Yes Yes Yes
MobileNet v1 Quant(TFLite) #74 #730 #74 Yes #74
MobileNet v2(TFLite) Yes #368 Yes Yes Yes
MobileNet v2 Quant(TFLite) #74 #730 #74 Yes #74
SqueezeNet(TFLite) Yes Yes Yes Yes Yes
Inception v3(TFLite) Yes Yes Yes Yes Yes
Inception v3 Quant(TFLite) #74 #730 #74 Yes #74
Inception v4(TFLite) Yes Yes Yes Yes Yes
Inception v4 Quant(TFLite) #74 #730 #74 Yes #74
Inception Resnet v2(TFLite) Yes Yes Yes Yes Yes
SqueezeNet(ONNX) Yes Yes Yes Yes Yes
MobileNet v2(ONNX) Yes #368 Yes Yes Yes
ResNet50 v1(ONNX) Yes Yes Yes Yes Yes
ResNet50 v2(ONNX) Yes Yes Yes Yes Yes
Inception v2(ONNX) Yes #1000 #1130 Yes Yes
DenseNet 121(ONNX) Yes #1000 #1130 Yes Yes
SqueezeNet(OpenVINO) Yes Yes #866 Yes Yes
MobileNet v1(OpenVINO) Yes #368 Yes Yes Yes
MobileNet v2(OpenVINO) Yes #368 Yes Yes Yes
ResNet50 v1(OpenVINO) Yes Yes Yes Yes Yes
DenseNet 121(OpenVINO) Yes #1000 #1130 Yes Yes
Inception v2(OpenVINO) Yes Yes Yes Yes Yes
Inception v4(OpenVINO) Yes Yes Yes Yes Yes

Person/Object Detection

Person/Object Detection MPS BNNS DNNL WASM WebGL
SSD MobileNet v1(TFLite) Yes #368 Yes Yes Yes
SSD MobileNet v1 Quant(TFLite) #74 #730 #74 Yes #74
SSD MobileNet v2(TFLite) Yes #368 Yes Yes Yes
SSD MobileNet v2 Quant(TFLite) #74 #730 #74 Yes #74
SSDLite MobileNet v2(TFLite) Yes #368 Yes Yes Yes
Tiny Yolo v2 COCO(TFLite) #627 #628 #630 #1130 Yes Yes
Tiny Yolo v2 VOC(TFLite) #627 #628 #630 #1130 Yes Yes

Semantic Segmentation

Semantic Segmentation MPS BNNS DNNL WASM WebGL
DeepLab  224 #1087 #368 #461 Yes Yes
DeepLab  224 Atrous #1087 #368 #461 Yes Yes
DeepLab  257 #447 #368 #461 Yes Yes
DeepLab  257 Atrous #447 #368 #461 Yes Yes
DeepLab  321 #447 #368 #461 Yes Yes
DeepLab  321 Atrous #447 #368 #461 Yes Yes
DeepLab  513 #447 #368 #461 Yes Yes
DeepLab  513 Atrous #447 #368 #461 Yes Yes

Skeleton Detection

Skeleton Detection MPS BNNS DNNL WASM WebGL
PoseNet Yes #368 Yes Yes Yes

Face Recognition

Face Recognition MPS BNNS DNNL WASM WebGL
SSD MobileNet v1 Face(TFLite) + FaceNet(OpenVINO) #637 #368 #1130 Yes Yes
SSD MobileNet v2 Face(TFLite) + FaceNet(OpenVINO) #637 #368 #1130 Yes Yes
SSDLite MobileNet v2 Face(TFLite) + FaceNet(OpenVINO) #637 #368 #1130 Yes Yes
Tiny Yolo v2 Face(TFLite) + FaceNet(OpenVINO) #627 #628 #1130 Yes Yes
SSD MobileNet v1 Face(TFLite) + Face Reidentification(OpenVINO) #1123 #368 #1130 Yes Yes
SSD MobileNet v2 Face(TFLite) + Face Reidentification(OpenVINO) Yes #368 #1130 Yes Yes
SSDLite MobileNet v2 Face(TFLite) + Face Reidentification(OpenVINO) Yes #368 #1130 Yes Yes
Tiny Yolo v2 Face(TFLite) + Face Reidentification(OpenVINO) #627 #628 #1130 Yes Yes

Facial Landmark Detection

Facial Landmark Detection MPS BNNS DNNL WASM WebGL
SSD MobileNet v1(TFLite) #969 #368 Yes Yes Yes
SSD MobileNet v2(TFLite) #969 #368 Yes Yes Yes
SSDLite MobileNet v2(TFLite) #969 #368 Yes Yes Yes
Tiny Yolo v2(TFLite) #627 #628 #630 #1130 Yes Yes

Super Resolution

Super Resolution MPS BNNS DNNL WASM WebGL
SRGAN 96x4 #637 #638 #640 Yes Yes
SRGAN 128x4 #637 #638 #640 Yes Yes

Emotion Analysis

Emotion Analysis MPS BNNS DNNL WASM WebGL
SSD MobileNet v1(TFLite) #627 #368 #541 Yes Yes
SSD MobileNet v2(TFLite) #627 #368 #541 Yes Yes
SSDLite MobileNet v2(TFLite) #627 #368 #541 Yes Yes
Tiny Yolo v2(TFLite) #627 #628 #630 #1130 Yes Yes

Speech Commands

Speech Commands MPS BNNS DNNL WASM WebGL
KWS CNN(TFLite) Yes #941 #935 Yes Yes

Android:

Image Classification

Image Classification NNAPI WASM WebGL
MobileNet v1(TFLite) Yes Yes Yes
MobileNet v1 Quant(TFLite) Yes Yes #74
MobileNet v2(TFLite) Yes Yes Yes
MobileNet v2 Quant(TFLite) Yes Yes #74
SqueezeNet(TFLite) Yes Yes Yes
Inception v3(TFLite) Yes Yes Yes
Inception v3 Quant(TFLite) Yes Yes #74
Inception v4(TFLite) Yes Yes Yes
Inception v4 Quant(TFLite) Yes Yes #74
Inception Resnet v2(TFLite) Yes Yes Yes
SqueezeNet(ONNX) Yes Yes Yes
MobileNet v2(ONNX) Yes Yes Yes
ResNet50 v1(ONNX) Yes Yes Yes
ResNet50 v2(ONNX) Yes Yes Yes
Inception v2(ONNX) Yes Yes Yes
DenseNet 121(ONNX) Yes Yes Yes
SqueezeNet(OpenVINO) Yes Yes Yes
MobileNet v1(OpenVINO) Yes Yes Yes
MobileNet v2(OpenVINO) Yes Yes Yes
ResNet50 v1(OpenVINO) Yes Yes Yes
DenseNet 121(OpenVINO) Yes Yes Yes
Inception v2(OpenVINO) Yes Yes Yes
Inception v4(OpenVINO) Yes Yes Yes

Person/Object Detection

Person/Object Detection NNAPI WASM WebGL
SSD MobileNet v1(TFLite) Yes Yes Yes
SSD MobileNet v1 Quant(TFLite) Yes Yes #74
SSD MobileNet v2(TFLite) Yes Yes Yes
SSD MobileNet v2 Quant(TFLite) Yes Yes #74
SSDLite MobileNet v2(TFLite) Yes Yes Yes
Tiny Yolo v2 COCO(TFLite) available on Android 10(MAXIMUM) Yes Yes
Tiny Yolo v2 VOC(TFLite) available on Android 10(MAXIMUM) Yes Yes

Semantic Segmentation

Semantic Segmentation NNAPI WASM WebGL
DeepLab  224 available on Android 10(ARGMAX) Yes Yes
DeepLab  224 Atrous #415 Yes Yes
DeepLab  257 available on Android 10(ARGMAX) Yes Yes
DeepLab  257 Atrous #415 Yes Yes
DeepLab  321 available on Android 10(ARGMAX) Yes Yes
DeepLab  321 Atrous #415 Yes Yes
DeepLab  513 available on Android 10(ARGMAX) Yes Yes
DeepLab  513 Atrous #415 Yes Yes

Skeleton Detection

Skeleton Detection NNAPI WASM WebGL
PoseNet(without atrous) Yes Yes Yes

Face Recognition

Face Recognition NNAPI WASM WebGL
SSD MobileNet v1 Face(TFLite) + FaceNet(OpenVINO) Yes Yes Yes
SSD MobileNet v2 Face(TFLite) + FaceNet(OpenVINO) Yes Yes Yes
SSDLite MobileNet v2 Face(TFLite) + FaceNet(OpenVINO) Yes Yes Yes
Tiny Yolo v2 Face(TFLite) + FaceNet(OpenVINO) available on Android 10(MAXIMUM) Yes Yes
SSD MobileNet v1 Face(TFLite) + Face Reidentification(OpenVINO) available on Android 10(PRELU) Yes Yes
SSD MobileNet v2 Face(TFLite) + Face Reidentification(OpenVINO) available on Android 10(PRELU) Yes Yes
SSDLite MobileNet v2 Face(TFLite) + Face Reidentification(OpenVINO) available on Android 10(PRELU) Yes Yes
Tiny Yolo v2 Face(TFLite) + Face Reidentification(OpenVINO) available on Android 10(PRELU) Yes Yes

Facial Landmark Detection

Facial Landmark Detection NNAPI WASM WebGL
SSD MobileNet v1(TFLite) Yes Yes Yes
SSD MobileNet v2(TFLite) Yes Yes Yes
SSDLite MobileNet v2(TFLite) Yes Yes Yes
Tiny Yolo v2(TFLite) available on Android 10(MAXIMUM) Yes Yes

Super Resolution

Super Resolution NNAPI WASM WebGL
SRGAN 96x4 Yes Yes Yes
SRGAN 128x4 Yes #441 Yes

Emotion Analysis

Emotion Analysis NNAPI WASM WebGL
SSD MobileNet v1(TFLite) available on Android 10(MAXIMUM) Yes Yes
SSD MobileNet v2(TFLite) available on Android 10(MAXIMUM) Yes Yes
SSDLite MobileNet v2(TFLite) available on Android 10(MAXIMUM) Yes Yes
Tiny Yolo v2(TFLite) available on Android 10(MAXIMUM) Yes Yes

Speech Commands

Speech Commands NNAPI WASM WebGL
KWS CNN(TFLite) Yes Yes Yes

Notes for Android:

  • [1]: The large size model may not work on Android WASM due to #441, restarting the browser or rebooting the device may resolve this issue.
  • [2]: Android NNAPI only supports PoseNet without atrous.

Clone this wiki locally