k230 gaze direction

k230 and MSPM0 communication

1. Experimental Prerequisites

This tutorial uses the MSPMG3507 development board, and the corresponding routine path is [14.export\MSPM0-K230\07_k230_eye_gaze].

K230 needs to run the [14.export\CanmvIDE-K230\07.eye_gaze.py] program to start the experiment. It is recommended to download it as an offline program.

Things you need:

Windows computer MSPMG3507 development board K230 visual module (including TF card with image burned in) Two type-C data cables Connection cable

2. Experimental wiring

3. Main code explanation

void Pto_Data_Parse(uint8_t *data_buf, uint8_t num)
{
    uint8_t pto_head = data_buf[0];
    uint8_t pto_tail = data_buf[num-1];
    if (!(pto_head == PTO_HEAD && pto_tail == PTO_TAIL))
    {
        sprintf(print_buf, "pto error:pto_head=0x%02x , pto_tail=0x%02x\n", pto_head, pto_tail);
        uart0_send_string(print_buf);
        return;
    }
    uint8_t data_index = 1;
    uint8_t field_index[PTO_BUF_LEN_MAX] = {0};
    int i = 0;
    int values[PTO_BUF_LEN_MAX] = {0};
    for (i = 1; i < num-1; i++)
    {
        if (data_buf[i] == ',')
        {
            data_buf[i] = 0;
            field_index[data_index] = i;
            data_index++;
        }
    }
    
    for (i = 0; i < data_index; i++)
    {
        values[i] = Pto_Char_To_Int((char*)data_buf+field_index[i]+1);
    }
    
    uint8_t pto_len = values[0];
    
    if (pto_len != num)
    {
        sprintf(print_buf, "pto_len error:%d , data_len:%d\n", pto_len, num);
        uart0_send_string(print_buf);
        return;
    }
    uint8_t pto_id = values[1];
    if (pto_id != PTO_FUNC_ID)
    {
        sprintf(print_buf, "pto_id error:%d, func_id:%d\n", pto_id, PTO_FUNC_ID);
        uart0_send_string(print_buf);
        return;
    }
    int x0 = values[2];
    int y0 = values[3];
    int x1 = values[4];
    int y1 = values[5];
    sprintf(print_buf, "eye:x0:%d, y0:%d, x1:%d, y1:%d\n", x0, y0, x1, y1);
    uart0_send_string(print_buf);
}

The above functions are for parsing K230 data. Only when they meet specific protocols can the corresponding data be parsed.

in

• x0: is the horizontal coordinate of the eye starting point
• y0: is the vertical coordinate of the eye starting point
• x1: is the horizontal coordinate of the gaze direction
• y1: is the vertical coordinate of the gaze direction

4. Experimental Phenomenon

1. After connecting the cables, the k230 visual module runs offline. After K230 is connected to Canmv IDE, open the corresponding program, click [Save open script to CanMV board (as main.py)] on the toolbar, and then restart K230.

2. The hex file generated by the MSPM0 burning routine.

3. The serial port assistant is set to the interface shown in the figure

   

4. When the K230 camera recognizes a face, the serial port assistant will print out the information transmitted from K230 to MSPM0.

in

• x0: is the horizontal coordinate of the eye starting point

• y0: is the vertical coordinate of the eye starting point

• x1: is the horizontal coordinate of the gaze direction

• y1: is the vertical coordinate of the gaze direction

  As shown in the figure below