cm3588-npu-inference.py
Script Python que usa la biblioteca RKNN para realizar inferencia en la NPU de 6 TOPS.
Hardware: CM3588 con NPU habilitada. Instale rknn-toolkit2 y rknn-rt. Convierta el modelo ONNX/TensorFlow a .rknn con rknn-toolkit2. Ejecute con python3 inference.py. Requiere dependencias OpenCV y NumPy.
cm3588-npu-inference.py
import numpy as np
import cv2
from rknn.api import RKNN
# Initialize RKNN
rknn = RKNN()
print('--> Loading model')
ret = rknn.load_rknn('model.rknn')
if ret != 0:
print('Failed to load rknn model')
exit(ret)
print('--> Building model')
ret = rknn.build(do_quantization=False)
if ret != 0:
print('Failed to build model')
exit(ret)
print('--> Initializing runtime')
ret = rknn.init_runtime()
if ret != 0:
print('Failed to init runtime')
exit(ret)
# Preprocess input
img = cv2.imread('input.jpg')
img = cv2.resize(img, (640, 640))
img = np.expand_dims(img, 0)
# Inference
outputs = rknn.inference(inputs=[img])
print('Inference done. Output shape:', outputs[0].shape)
rknn.release()