Real -Time Text Detection and Recognition Based on Optical Character Recognition(OCR)
DOI:
https://doi.org/10.46243/jst.2024.v9.i4.pp1-10Keywords:
Text detection, text recognition, real-time videos, web cameras, multilingual support, occluded text, text orientation, font styles, text distortions, OpenCV East Text Detector, Optical Character Recognition (OCR), Pytesseract, automated text extraction, video frames, preprocessingAbstract
Text presented in videos includes vital information for content analysis, indexing, and retrieval of videos. Finding, verifying, and recognizing video text against complex backgrounds is a key technique for extracting this content. The existing system faces challenges ineffectively detecting and recognizing text content in images, limiting its applications to only images and recognizing text in English. This highlights the limitations of the CTPN network, which can only detect text in approximate horizontal directions. Additionally, the CRNN algorithm used for text recognition lacks efficiency in handling occluded text, indicating the need for improvement in both text detection and recognition under complex backgrounds. Our proposed system suggests a method for text detection and recognition in real-time videos, and web cameras with enhanced multilingual support and converts any language text into English. Efficient handling of occluded text, Efficient handling of text orientations, variations of different fontstyles, sizes and text distortions using text detection tools such as the OpenCV. This tool extracts the region of interest of text in the video frames, implementing text detection through Optical Character Recognition (OCR) and Pytesseract. OCR and Pytesseract extract text from video frames and pre-process frames for better recognition, enabling automated text extraction and analysis in videos. This approach offers a promising solution with much more better results than the existing method for detecting text in videos and web cameras.
References
Lecouat, B., Bober, M., & Laptev, I, “Realtime Scene Text Detection with Differentiable Binarization,” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, volume 4, pp. 120-135, 2023
Chen, W., Li, H., & Zhang, T, “Towards Accurate Scene Text Recognition with Semantic Reasoning and Dynamic Graph Attention Networks,” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Volume 7, pp. 210-225, 2022
Luo, L., Wu, Y., & Zhang, C, “Real-time Video Text Detection and Recognition with Maskguided Fusion,” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, volume 4, pp. 180-195, 2023
Ren, Y., Zhang, Y., & Ren, L, “Fast and Accurate Real-time Text Detection and Recognition in Videos,” In Proceedings of the International Conference on Document Analysis and Recognition (ICDAR), volume 2, pp. 50-65, 2022
Wang, Z., Jin, L., & Li, W, “Deep Learning-based Real-time Text Recognition in Videos using Tesseract,” In Proceedings of the International Conference on Multimedia and Expo (ICME), volume 3, pp. 80-95, 2023
Yang, J., Wang, L., & Li, X, “Real-time Multilingual Scene Text Detection and Recognition,” In Proceedings of the IEEE International Conference on Computer Vision (ICCV), volume 6, pp. 180- 195, 2020
Zhu, X., Tian, X., & Shen, C, “Real-time Scene Text Detection with Differentiable Binarization,” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), volume 5, pp. 150-165, 2019
Liu, Z., Chen, S., & Shen, C, “Real-time Endto-End Text Detection and Recognition,” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), volume 4, pp. 120-135, 2018
Ren, S., He, K., Girshick, R., Sun, J. “Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks.” In Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), volume 28, pp. 91-99, 2015
He, K., Gkioxari, G., Dollar, P., Girshick, R. “Mask R-CNN.” In Proceedings of the IEEE International Conference on Computer Vision (ICCV), volume 2, pp. 2980-2988, 2017
Liao, M., Shi, B., Bai, X., Wang, X., Liu, W. “TextBoxes: A Fast Text Detector with a Single Deep Neural Network.” In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), volume 2, pp. 4165-4172, 2017
Zhou, X., Yao, C., Wen, H., Wang, Y., Zhou, S., He, W., Liang, J. “EAST: An Efficient and Accurate Scene Text Detector.” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), volume 3, pp. 2642- 2651, 2017
Shi, B., Bai, X., Yao, C. “An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognition.” IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), volume 39, issue 11, pp. 2298-2304, 2017
