Deep Learning-Based Stair Segmentation and Behavioral Cloning for Autonomous Stair Climbing

Abstract

Mobile robots are widely used in the surveillance industry, for military and industrial applications. In order to carry out surveillance tasks like urban search and rescue operations, the ability to traverse stairs is of immense significance. This paper presents a deep learning based approach for semantic segmentation of stairs, behavioral cloning for star alignment, and a novel mechanical design for an autonomous stair climbing robot. The main objective is to solve the problem of locomotion over staircases with the proposed implementation. Alignment of a robot with stairs in an image is a traditional problem, and the most recent approaches are centred around hand-crafted texture-based Gabor filters and stair detection techniques. However, we could arrive at a more scalable and robust pipeline for alignment schemes. The proposed deep learning technique eliminates the need for manual tuning of parameters of the edge detector, the Hough accumulator, and PID constants. The empirical results and architecture of the stair alignment pipeline are demonstrated in this paper.

Publication
International Journal of Semantic Computing

Qualitative results

Stair segmentation

We use a U-Net model for segmenting the stairs in the RGBD image input.

Stair alignment

We use behavior cloning to learn a model that predicts actions (turn left/right, move forwards/backwards) per time step to align the TurtleBot2 with the stairs, given a segmented image of the stairs.

Quantitative results