Video-Based Content Recognition of Bank Cards with Mobile Devices

H. Chena,*, S. Yea,**, A. Kurilovichb,***, R. Bohushb,****, and S. Ablameykoc,d,*****

a Zhejiang Shuren University, Shuren St. 8, Hangzhou, 310015 China

b Polotsk State University, ul. Blokhina 29, Novopolotsk, 211440 Belarus

c Belarusian State University, pr. Nezavisimosti 4, Minsk, 220030 Belarus

d United Institute of Informatics Problems, National Academy of Sciences of Belarus, ul. Surganova 6, Minsk, 220012 Belarus

Correspondence to: *e-mail:
Correspondence to: **e-mail:
Correspondence to: ***e-mail:
Correspondence to: ****e-mail:
Correspondence to: *****e-mail:

Received 8 October, 2019

Abstract—In this paper, we propose an algorithm for detection and recognition of all information fields at the bank card front side based on video sequences. The algorithm is intended for use on mobile devices. This algorithm consists of the following basic steps: detection of the card boundaries in a frame, segmenting the information fields, improving the quality of segments, localizing the boundaries of symbols, and recognizing blocks of symbols. We also conduct a series of experiments. Experimental results show that our algorithm can achieve higher detection rates of 88% for all information fields and 92.5% for the bank card number and expiration date. The processing time per frame at different resolutions for each step by using iPhone 7 is presented. The experimental results confirm the efficiency of the proposed approach.

DOI: 10.1134/S036176882006002X