AP22685781 – Development of a manipulator control system using computer vision to increase flexibility and automate processes

Purpose: The purpose of this work is to study and analyze the designs and operating principles of motion control systems for manipulators using computer vision technologies and artificial intelligence for logistical operations. The work also provides an overview of modern object recognition methods and video surveillance systems that can improve the performance of manipulators.

Relevance: In modern conditions of industrial development and digital transformation of the economy, automation of production and logistics processes is of particular importance. Robotic systems, in particular manipulators, are widely used to perform operations of loading, sorting and moving objects. However, their effectiveness is largely limited by their lack of adaptability and dependence on the operator. Most modern manipulators operate according to predefined algorithms and do not have a sufficient level of intelligence to analyze the changing environment in real time. One of the promising areas for improving the efficiency of robotic systems is the integration of computer vision technologies and machine learning methods into the manipulator control loop. This research is particularly relevant in conditions where production processes are often characterized by difficult operating conditions, including limited visibility, handling bulky and dangerous goods, as well as the need to adapt to various technological scenarios. Thus, the development of a manipulator control system using computer vision is an urgent scientific and technical task aimed at creating flexible, adaptive and autonomous robotic solutions capable of increasing productivity, reducing costs and improving working conditions.

Scientific supervisor: Ph.D., Rakhmetova Perizat

Expected and achieved results: Modern methods of object recognition have been studied, which can improve the performance of a manipulator using a video surveillance system. The mechanical design of the manipulator is designed. The article has been published in peer-reviewed foreign and (or) domestic publications recommended by the COC NVO.

• At least 2 (two) articles will be published in journals ranked within the top three quartiles by impact factor in the Web of Science database or having a CiteScore percentile of at least 50 in the Scopus database.
• At least 3 (three) articles and/or review papers will be published in peer-reviewed international and/or national journals recommended by CQASE.
• A patent will be obtained from the Kazakhstan patent office.

List of publications with links to them

1. П. М.Рахметова, Л. А. Курмангалиева, Н.С. Сембаев, М. М. Жамуратова, Ж.С. Бигалиева. Разработка конструкции манипулятора и алгоритмов компьютерного зрения для управления движением и распознавания // Научный журнал «Наука и техника Казахстана» - 2025 - №2 - С. 172 – 186. https://doi.org/10.48081/KKLG8361
2. П.М. Рахметова, Д.Д. Даулетия, А.Н. Ешмухаметов. Разработка и исследование системы обнаружения и контроля внутритрубных дефектов. Вестник Университета Шакарима. Технические науки № 4(20) 2025: 117-123. https://doi.org/10.53360/2788-7995-2025-4(20)-14
3. Койбагаров М.К., Исабеков Ж.Н., Курмангалиева Л.А., Байтурганова В.К., Рахметова П.М. Разработка системы предиктивного обслуживания на основе машинного обучения. Вестник Университета Шакарима. Серия технические науки. 2025;(2(18)):121-128. https://doi.org/10.53360/2788-7995-2025-2(18)-14
4. Rakhmetova, P., Issabekov, Z., Zhamuratova, M., & Baiturganova, V. (2024). Моделирование систем компьютерного зрения с искусственным интеллектом. Вестник КазАТК, 134(5), 393–402. https://doi.org/10.52167/1609-1817-2024-134-5-393-402
5. P. Rakhmetova, A. Bektilevov, L. Kurmangalieva, B. Bekbossynova and B. Shingissov, "Experimental Investigation of Computer Vision Architectures for Object Detection in Mobile Robotics," 2025 6th International Conference on Communications, Information, Electronic and Energy Systems (CIEES), Ruse, Bulgaria, 2025, pp. 1-4, doi: 10.1109/CIEES66347.2025.11300112. https://ieeexplore.ieee.org/document/11300112/references#references
6. Патент на Полезную модель «Система управления манипулятором мобильного робота». Охранный документ №10165 от 23.10.2024г. МПК B25J9/00 (2006.01) H01L27/00 (2006.01). Бюллетень №6 от 07.02.2025г. https://gosreestr.kazpatent.kz/Utilitymodel/Details?docNumber=410087