MLOps Knowledge
Less than 1 minute
MLOps Knowledge
MLOps
Gitlab CI/CD
Android Benchamrk APK Link
Follow ablove link step
- Install currect version APK to your Device
adb install -r -d -g android_aarch64_benchmark_model.apk
- Put the test model into the Devcie
adb push your_model.tflite /data/local/tmp
- Run benchmark APK
adb shell am start -S -n org.tensorflow.lite.benchmark/.BenchmarkModelActivity --es args '"--graph=/data/local/tmp/your_model.tflite --num_threads=4"'
- Turn logcat
In my case, if you wait for almost 20 seconds, you will see the following log in the logcat.
10:04:31.319 2638-2638 tflite org.tensorflow.lite.benchmark I count=50 first=392063 curr=392613 min=390939 max=416049 avg=392865 std=3443
10:04:31.319 2638-2638 tflite org.tensorflow.lite.benchmark I Inference timings in us: Init: 164025, First inference: 394833, Warmup (avg): 394149, Inference (avg): 392865
10:04:31.319 2638-2638 tflite org.tensorflow.lite.benchmark I Note: as the benchmark tool itself affects memory footprint, the following is only APPROXIMATE to the actual memory footprint of the model at runtime. Take the information at your discretion.
10:04:31.319 2638-2638 tflite org.tensorflow.lite.benchmark I Memory footprint delta from the start of the tool (MB): init=65.1562 overall=66.5391