Welcome to DOFBOT-Ultra repository
11. Text Large Model + YOLOv26 + Intelligent Garbage Classification
Text Large Model + YOLOv26 + Intelligent Garbage Classification
Please ensure that the web control program backend process is not running in the background. To close it, refer to the [Get Started Quickly - 2. Access the Terminal] section in [Disable the Auto-Start Web Control Backend Process]. After closing, please restart DofbotUltra!!!
The web control program backend process must be closed before starting this function.
1. Function Description
After the program starts, give a natural language command related to garbage classification to the large model. The large model will first understand whether the user wants to "sort a certain type of garbage", "keep a certain type of garbage", or "clean up all garbage on the table", then plan corresponding action steps, and finally control the robotic arm combined with YOLOv26 recognition results to sort the garbage label tag blocks on the table.
The "garbage" in this section is not real garbage, but wood blocks with garbage labels. The YOLO model is responsible for identifying the garbage category labels on the wood blocks, and the robotic arm then completes the gripping and placement according to the large model's plan.
This section supports the following three common types of tasks:
Sort a single type of garbage: e.g., "Sort toxic waste"
Keep a certain type of garbage: e.g., "Sort all garbage except recyclable waste"
Sort all garbage on the table: e.g., "Clean up the garbage on the table"
2. Startup
Enter the Docker container and input the following command: