opencv

All posts tagged opencv

Animabot Rev3 – Software – Raspberry Pi

Posted by Emmanuel Sichet on 28/10/2020
Posted in: Animabot Rev3, Software. Tagged: , , , , . Leave a comment

Been a while this the last update, I let aside the development of the Kinematic to work a bit on the Raspberry Pi. So far I could install everything I needed and tested one of the main feature of the robot: Face recognition and tracking.

I used the standard OpenCV library for face tracking and recognition (haar cascade). This work very well, I’m able to recognize different faces and track the x,y position regarding the center of the camera’s image. I also discovered the ArUco markers for augmented reality, I’m planning to use them for the docking station and some other features like cube toy for Animabot.

The framerate is not as high as expected but this will do for the moment. The next step is to transmit all relevant information to the motherboard via SPI to make Animabot act accordingly. Let’s see how it goes 😀

Simple Head Tracking with OpenCV

Posted by Emmanuel Sichet on 28/02/2017
Posted in: Image Processing. Tagged: , , , , . 1 Comment

Hi,

I’m currently working a bit on Animabot’s software (Raspberry Pi side). I developed a small application for the Head Tracking which will be used on the robot. The application is developed in Python and using TkInter for the GUI. The software is using the standard Face Detection from OpenCV.

The program checks for face to detect, then provide the Head center position regarding the center of the video. It also sends the position trough UART is order to link the Pi to another board if needed (in my case, to the STM32F4). Or through socket if you want to use the info internally in the Pi. The output coordinates are filtered to have a more accurate position and also to avoid having values changing every 100ms…

The interface also allows to change the detection settings (video cropping, Face HitBox size, etc..) These parameters are directly in the GUI so it is easy to find the right settings. I will maybe add a save/load feature for the parameters later if needed. But for now you can tune these parameters in real-time, then change their default values in the code.

The output coordinates (on UART and socket) as the following format : <%+0.3d|%+0.3d>. This means, that from the above screenshot, the output value is : <+034|-021>

This application is based on Python 2.7 and OpenCV 3. To use it you need to install the following packages : PIL, tkinter, PySerial and numpy. For now I’m working on windows, so I didn’t tried it on the Pi yet… this means I can’t help you for packages installation… However, I suggest you to install PIP to install packages, this would be much easier. Do not forget to place haarcascade_frontalface_default.xml in the same folder as the Python file.

Of course I will not use this application for the Pi as it would be too heavy to process smoothly, I will make a lighter version without GUI and without video feedback and only focus on the algorithm and UART output.

Below you can find the application’s code. Please be indulgent as I’m still learning Python… I’m sure it can be greatly improved (if you have corrections/suggestions, please tell me 😉 ) but at least it is as clear as possible and working quite fine ! Normally the code contains enough comments to understand it if you know how to program. But if you have questions, do not hesitate to ask me !

>>>  Source code available here <<<