# 3. Remote Desktop Installation and Connection

## 3.1 VNC Installation and Connection

### 3.1.1 Preparation

* **Hardware**

Prepare a computer. If you are using desktop computer, wireless network card is required.The network card should support 5G band.

*  **Install VNC**

VNC is a graphical remote desktop control software. Through connecting your computer to the WiFi generated by Raspberry Pi, you can control Raspberry Pi. Installation of VNC is as below.

(1) Double-click the installation program "**VNC-Viewer-6.17.731-Windows**" in the same directory as this section. Select the installation language as "**English**" and lick "**OK**".

<img class="common_img" src="../_static/media/6.remote_tool_installation_and_connection/1.1/image1.png" />

(2) Click "**Next**".

<img class="common_img" src="../_static/media/6.remote_tool_installation_and_connection/1.1/image2.png" />

(3) Tick **"I accept the terms in the License Agreement"**. Then click **"Next"**.

<img class="common_img" src="../_static/media/6.remote_tool_installation_and_connection/1.1/image3.png" />

(4) Remain default location where the software is installed. Click **"Next"** to proceed next interface. Then directly click **"Install"**.

<img class="common_img" src="../_static/media/6.remote_tool_installation_and_connection/1.1/image4.png"  />

(5) When the installation completes, click **"Finish"**.

<img class="common_img" src="../_static/media/6.remote_tool_installation_and_connection/1.1/image5.png" />

(6) Click <img src="../_static/media/6.remote_tool_installation_and_connection/1.1/image6.png" style="width:45px;" /> to open VNC.

* **Start Robot**

Start Robot When LED1 on expansion board starts flickering and buzzer emits one beep, robot boots up successfully.

### 3.1.2 Connect to Robot

(1) After turning Robot on successfully, the default mode is AP direct connection mode. Robot generates a WiFi starting with HW. Connect your computer to this WiFi.

<img class="common_img" src="../_static/media/6.remote_tool_installation_and_connection/1.1/image7.png"  />

(2) Input password. The password is **"hiwonder"**.

<img class="common_img" src="../_static/media/6.remote_tool_installation_and_connection/1.1/image8.png"   />

<img class="common_img" src="../_static/media/6.remote_tool_installation_and_connection/1.1/image9.png"   />

(3) After connection, open VNC Viewer. Input the default IP address of Raspberry Pi, **192.168.149.1**, and then press Enter. If you receive security warning, select **"Continue"**.

<img class="common_img" src="../_static/media/6.remote_tool_installation_and_connection/1.1/image10.png"  />

(4) Input username and password. **(Username: pi  Password: raspberrypi)**. Click **"OK"** to enter Raspberry Pi desktop.

<img class="common_img" src="../_static/media/6.remote_tool_installation_and_connection/1.1/image11.png"  />

(5) The desktop is as pictured. If black screen occurs or only cursor leaves on the screen, restart Raspberry Pi.

<img class="common_img" src="../_static/media/6.remote_tool_installation_and_connection/1.1/image12.png"  />

### 3.1.3 Introduction to Desktop

The desktop is as pictured after connecting Robot through VNC successfully.

<img class="common_img" src="../_static/media/6.remote_tool_installation_and_connection/1.1/image13.png"  />

The following table demonstrates common functions:

<table  class="docutils-nobg" border="1">
<colgroup>
<col  />
<col  />
</colgroup>
<tbody>
<tr>
<td >Icon</td>
<td >Function</td>
</tr>
<tr>
<td ><img src="../_static/media/6.remote_tool_installation_and_connection/1.1/image14.png"   /></td>
<td ><p>Application menu. Click to select different applications.</p>
<p><img src="../_static/media/6.remote_tool_installation_and_connection/1.1/image15.png"  /></p></td>
</tr>
<tr>
<td ><img src="../_static/media/6.remote_tool_installation_and_connection/1.1/image16.png"   /></td>
<td >Browser.</td>
</tr>
<tr>
<td ><img src="../_static/media/6.remote_tool_installation_and_connection/1.1/image17.png"   /></td>
<td >File manager.</td>
</tr>
<tr>
<td ><img src="../_static/media/6.remote_tool_installation_and_connection/1.1/image18.png"   /></td>
<td >LX terminal. Click to input command line in the opened interface.</td>
</tr>
<tr>
<td ><img src="../_static/media/6.remote_tool_installation_and_connection/1.1/image19.png"   /></td>
<td >Trash. You can find the files deleted here.</td>
</tr>
<tr>
<td ><img src="../_static/media/6.remote_tool_installation_and_connection/1.1/image20.png"   /></td>
<td >PC software. You can adjust pan tilt and adjust color threshold on it.</td>
</tr>
<tr>
<td ><img src="../_static/media/6.remote_tool_installation_and_connection/1.1/image21.png"   /></td>
<td >Full screen or exit full screen.。</td>
</tr>
<tr>
<td ><img src="../_static/media/6.remote_tool_installation_and_connection/1.1/image22.png"   /></td>
<td >Exit full screen.</td>
</tr>
<tr>
<td ><img src="../_static/media/6.remote_tool_installation_and_connection/1.1/image23.png"   /></td>
<td ><p>Shut down, reboot and logout</p>
<p><img src="../_static/media/6.remote_tool_installation_and_connection/1.1/image24.png"  /></p></td>
</tr>
</tbody>
</table>

## 3.2 System Content

### 3.2.1 Desktop Layout

After connecting to VNC, the system desktop is as pictured:

<img class="common_img" src="../_static/media/6.remote_tool_installation_and_connection/2.1/image1.png"  />

(1) Double-click this icon <img src="../_static/media/6.remote_tool_installation_and_connection/2.1/image2.png" style="width:60px"  /> and click Execution.

This tool is used to adjust color threshold parameters and debug the pan-tilt servo.

<img class="common_img" src="../_static/media/6.remote_tool_installation_and_connection/2.1/image4.png"  />

(2) Click **"**Connect**"** to display the real-time image transmitted by the current camera. Then you can click "**Disconnect**" to close the camera.

<img class="common_img" src="../_static/media/6.remote_tool_installation_and_connection/2.1/image5.png"  />

(3) The tool interface can be divided into three parts as follows:

| **No.** | **Name**                                 | **Function**                                                 |
| ------- | ---------------------------------------- | ------------------------------------------------------------ |
| ①       | Camera feedback area                     | Used to display the transmitted image, with the processed image on the left and the original image on the right. |
| ②       | Adjust color threshold parameters button | Used for adjusting color thresholds, selecting the colors to be adjusted for recognition, adding or removing color categories, and saving the effects. |
| ③       | Servo control area                       | Used to adjust the initial position of the sixth servo of the pan-tilt and save the modified values. |

You can go to "[**Quick User Experience\2.3 Adjust Color Threshold**](https://docs.hiwonder.com/projects/uHandPi/en/latest/docs/2.quick_user_experience.html#adjust-color-threshold)" to learn the specific usage method of tool and the color threshold parameter.

### 3.2.2 Program Structure Instruction

(1) Press **"Ctrl+Alt+T"** to open the command line terminal. And input **"ls"** command to list all the current files. Take following contents as example.

<img class="common_img" src="../_static/media/6.remote_tool_installation_and_connection/2.1/image6.png"  />

| Content          | Function                                                     |
| ---------------- | ------------------------------------------------------------ |
| hiwonder-toolbox | WiFi management tool                                         |
| uhandpi          | Program source code for all game modes and associated functions. |
| uhandpi_software | Color threshold debugging tool and palm-sized PC.            |

(2) Next, enter the game and program source content. Then input the following command.

```bash
cd uhandpi/
```

(3) After that, input **"tree-L1"** command. List all folders and files in the directory in the form of a tree diagram. We mainly need to understand several directories indicated by the red box in the diagram.

<img class="common_img" src="../_static/media/6.remote_tool_installation_and_connection/2.1/image8.png"  />

| **Content/File**       | **Instruction**                                        |
| ---------------------- | ------------------------------------------------------ |
| action_groups          | Action group files storage path                        |
| action_groups          | Expansion board related routine                        |
| camera_calibration_sdk | Camera underlying file and calibration files           |
| common_sdk             | Underlying driver library                              |
| common.txt             | Detect and game command                                |
| config                 | Color threshold and servo deviation configuration file |
| mjpg_server.py         | Video stream program                                   |
| rpc_server.py          | Rpc communication service program                      |
| uHandPi.py             | APP service starting file                              |

(4) Input the command below, and open the directory containing the AI vision game program directly through the tree diagram.

```bash
tree -l 1 functions
```

<img class="common_img"  src="../_static/media/6.remote_tool_installation_and_connection/2.1/image9.png"  />

| **Content/File**        | **Instruction**                               |
| ----------------------- | --------------------------------------------- |
| color_classification.py | Color sorting program                         |
| color_tracking.py       | Color tracking program                        |
| face_detection.py       | Face detection program                        |
| gesture_recognition.py  | Gesture recognition program                   |
| remote_control.py       | APP remote control image transmission program |
| rock_paper_scissors.py  | Rock-scissors-paper program                   |
| running.py              | APP calling program                           |