Image based object localization for robotic tasks

OData support
Dr. Kiss Bálint
Department of Control Engineering and Information Technology

Technology has seen a real growth these last years in all different domains, and with the robotization, many problems were solved in diverse thematics such as mechanic, mechatronic, electronic, automatization and informatics, it contributed for the development of the human society along several years, and with the communication protocols between modules, many different domains can now be synchronized and assembled to work together (mobile application development, image processing and robot controlling) having this potential many possibilities rise, in this report a development of an automated system is going to be discussed from the mobile application development, image processing and robot programming.

The research content of this report is mainly about how robots can substitute the human in a given task for many reasons, a robot is a machine that accomplishes tasks in the environment where it evolves, provided by perception, decision and action capabilities that make him act in an autonomous way in its environment, we can differentiate two groups of robots, the fixed robots and the mobile robots.

In our work we will concentrate on the fixed robots, they are used in the industry due to their capacity in manipulation of objects. They substitute the human in the difficult tasks, repetitive or risky.

We are going to focus on the service sector and how can we integrate the robots to do such tasks. Conference organizers and reception services seek the possibility to employ robots that can replace partly or entirely hostesses. One task which is believed to be easily robotized is the distribution of badges to participants of a conference.

The task is to design and realize a prototype system providing such a functionality at the laboratory of the Department of Control Engineering and Information Technology. Badges are stored for distribution in racks and their positions must be precisely identified for smooth operations.

Different components will be defined such us controlling a robotic arm, acquiring and processing of depth images, application developing, database handling and 3D modeling and printing of a rack that will hold badges and a gripper that will catch them.

In this report we are going to see an overview about the project about the idea of hosting, phase decomposition of the project and some descriptions about the phases we are going to define the parts that are going to constitute our system and develop the automated system that is going to solve the host task.


Please sign in to download the files of this thesis.