Dissertation - Toolbox of automatic visual inspection solutions

The files cannot be stored in the repository, because of the signed confidentiality agreement. To serve this unique and exclusive repository to demonstrate the project that was developed during my dissertation.

PROJECT:

The objective of this work is to develop a toolbox of configurable solutions, through a graphical interface appropriate to the problem, so that they can be applied to similar problems. This dissertation focuses on the detection of four specific problems, namely, the detection of fiducial markers, the detection of pins, the detection of the geometric center and verification of the positioning of pointers and the detection of the absence or defective positioning of screws.

The methods proposed for each of the problems were based on the operators provided by the Halcon software (from MVTec) and validated on different objects. Then the interactive graphical interfaces were developed using the Qt framework and written in C++14. All the developed methods proved to be efficient, being able to correctly detect the objects the solutions can be applied to different objects with similar properties.

The developed application focuses on the definition of micro-operations and the execution engine. It is the combination of the interactive mode of the application, with the parameterizable toolbox, that enables the user configure the solutions.

OBJECTIVES:

  • Detection and recognition of different fiducial markers to, for example, help locate other electronic components inserted in plates;
  • Detection of pins correctly positioned on plugs;
  • Detection of the geometric center of objects for the placement of pointers and respective verification of their correct positioning;
  • Detection of the absence or defective positioning of screws;
  • The solutions developed will also be configurable, so that they can be applied to other problems with different properties.

RESULTS:

Video of an example - video with the execution of the two interfaces implemented and an example of a solution configuration for a given problem, in this case, for the detection of circular fiducials. Summary: first an image is selected that will serve as a reference for future new test images, and then an appropriate solution to the problem is loaded. By selecting the Settings option, the user will have control over the solution configuration, in the so-called micro-operations. At each step it is possible to adjust its parameters and, before proceeding to the next micro-operation, check its effect unlimited times. When the configuration of the solution is finished, it is transferred to the execution engine (main interface). The "new" solution will be applied to different test images where it will be possible to view the detections made, as well as additional information about the detections made, for example, number of detections and computation times.

  • Detection of different circular fiducial markers:

1

  • Detection of different cross fiducial markers:

2

  • Detection of correctly positioned pins:

3

4

  • Detection of the geometric center and checking the positioning of pointers:

5

  • Detection of the absence or defective positioning of screws:

6