Model Prediction

1. CLI Usage

Currently, CLI only supports USB cameras. For CSI cameras, users can directly modify the Python code above to use ncnn models.

xxxxxxxxxx
cd /home/sunrise/ultralytics/ultralytics/data/yahboom_data/orange_data/runs/detect/train/weights
yolo predict model='best_ncnn_model' source=0 save=False show   # For multiple cameras, change the number after source

2. Python Usage

Using Python to call USB and CSI cameras to recognize oranges.

2.1. USB Camera

Use the best_ncnn_model to predict camera feed.

xxxxxxxxxx
cd /home/sunrise/ultralytics/ultralytics/yahboom_demo_26

Run the code: Click on the preview window, press the q key to terminate the program!

xxxxxxxxxx
python3 06.orange_camera_usb.py

Preview

yolo recognition output video location: /home/sunrise/ultralytics/ultralytics/output/

Sample code:

xxxxxxxxxx
import cv2
from ultralytics import YOLO
​
# Load the YOLO model
# model = YOLO("/home/sunrise/ultralytics/ultralytics/data/yahboom_data/orange_data/runs/detect/train/weights/best.pt")
model = YOLO("/home/sunrise/ultralytics/ultralytics/data/yahboom_data/orange_data/runs/detect/train/weights/best_ncnn_model")
​
# Open the cammera
cap = cv2.VideoCapture(0)
cap.set(6, cv2.VideoWriter.fourcc('M', 'J', 'P', 'G'))
cap.set(cv2.CAP_PROP_FRAME_WIDTH, 640)
cap.set(cv2.CAP_PROP_FRAME_HEIGHT, 480)
​
# Get the video frame size and frame rate
frame_width = int(cap.get(cv2.CAP_PROP_FRAME_WIDTH))
frame_height = int(cap.get(cv2.CAP_PROP_FRAME_HEIGHT))
fps = int(cap.get(cv2.CAP_PROP_FPS))
​
# Define the codec and create a VideoWriter object to output the processed video
output_path = "/home/sunrise/ultralytics/ultralytics/output/06.orange_camera_usb.mp4"
fourcc = cv2.VideoWriter_fourcc(*'mp4v')  # You can use 'XVID' or 'mp4v' depending on your platform
out = cv2.VideoWriter(output_path, fourcc, fps, (frame_width, frame_height))
​
# Loop through the video frames
while cap.isOpened():
    # Read a frame from the video
    success, frame = cap.read()
​
    if success:
        # Run YOLO inference on the frame
        results = model(frame)
​
        # Visualize the results on the frame
        annotated_frame = results[0].plot()
​
        # Write the annotated frame to the output video file
        out.write(annotated_frame)
​
​
        # Display the annotated frame
        cv2.imshow("YOLO Inference", cv2.resize(annotated_frame, (640, 480)))
​
        # Break the loop if 'q' is pressed
        if cv2.waitKey(1) & 0xFF == ord("q"):
            break
    else:
        # Break the loop if the end of the video is reached
        break
# Release the video capture and writer objects, and close the display window
cap.release()
out.release()
cv2.destroyAllWindows()
​

2.2. CSI Camera

Use the best_ncnn_model to predict camera feed.

xxxxxxxxxx
cd /home/sunrise/ultralytics/ultralytics/yahboom_demo_26

Run the code: Click on the preview window, press the q key to terminate the program!

xxxxxxxxxx
python3 06.orange_camera_csi.py

Preview

yolo recognition output video location: /home/sunrise/ultralytics/ultralytics/output/

Sample code:

​x
import cv2
from sunrisecamera2 import sunrisecamera2
​
from ultralytics import YOLO
​
# Initialize the sunrisecamera2
sunrisecam2 = sunrisecamera2()
sunrisecam2.preview_configuration.main.size = (640, 480)
sunrisecam2.preview_configuration.main.format = "RGB888"
sunrisecam2.preview_configuration.align()
sunrisecam2.configure("preview")
sunrisecam2.start()
​
# Load the YOLO model
# model = YOLO("/home/sunrise/ultralytics/ultralytics/data/yahboom_data/orange_data/runs/detect/train/weights/best.pt")
model = YOLO("/home/sunrise/ultralytics/ultralytics/data/yahboom_data/orange_data/runs/detect/train/weights/best_ncnn_model")
​
# Set up video output
output_path = "/home/sunrise/ultralytics/ultralytics/output/06.orange_camera_csi.mp4"
fourcc = cv2.VideoWriter_fourcc(*'mp4v')
out = cv2.VideoWriter(output_path, fourcc, 30, (640, 480))
​
# Loop through the video frames
while True:
    # Capture frame-by-frame
    frame = sunrisecam2.capture_array()
​
    # Run YOLO11 inference on the frame
    results = model(frame)
​
    # Visualize the results on the frame
    annotated_frame = results[0].plot()
​
    # Write the frame to the video file
    out.write(annotated_frame)
​
    # Display the resulting frame
    cv2.imshow("Camera", annotated_frame)
​
    # Break the loop if 'q' is pressed
    if cv2.waitKey(1) == ord("q"):
        break
​
# Release resources and close windows
sunrisecam2.close()
out.release()
cv2.destroyAllWindows()
​