PaperlayerView exact revision on arXiv

Source-linked AI summary

A Cloud-Based Hybrid Model for Real-Time Detection of BRTA-Approved Licence Plates Using YOLO Tiny and Haar Cascade

Debashis Kar Suvra, Tahsina Farah Sanam

arXiv:2609.06507v1cs.CV

TL;DR

Bengali BRTA license plate detection is difficult because localized scripts and changing real-world conditions challenge conventional systems. The paper combines YOLO Tiny v4, Haar-Cascade, dynamic retraining, and a public dataset, reporting 94% precision, 93% recall, and a 93% F1 score.

  • Problem

    Bengali license plate recognition lacks robust publicly available datasets and systems that handle lighting variation, motion blur, occlusion, and changing conditions.

    Source: §I · pp. 1–2

  • Method

    The paper combines YOLO Tiny v4 vehicle detection, Haar-Cascade plate localization, dynamic retraining, and a custom dataset of BRTA-compliant plates.

    Source: §I · p. 1, A. Data Collection & Dataset Development · p. 2

  • Results

    94% precision, 93% recall, and a 93% F1 score were achieved by the hybrid model.

    Source: §V · p. 5

  • Takeaways & Limitations

    The framework provides a resource-conscious Bengali license plate detection approach for varied environmental conditions and supports further non-Latin script recognition research.

    Source: §V · p. 6

Abstract

from arXiv · show

Accurate vehicle license plate detection is essential for applications such as intelligent transportation systems, toll collection, parking management, and law enforcement. In Bangladesh, this task presents distinct challenges due to the complexity of localized license plates and environmental factors like lighting, occlusion, motion blur, and obstructions such as dirt or mud. These challenges often render conventional methods ineffective. This paper introduces a novel hybrid approach, combining the YOLO Tiny deep learning model with the Haar-Cascade classifier, for enhanced detection and localization of Bengali license plates. A key innovation of our system is the integration of a dynamic retraining pipeline, which allows the model to adapt to evolving real-world conditions. This retraining mechanism significantly boosts performance in low-confidence scenarios by continuously improving the model's accuracy as new data is encountered. Additionally, a publicly accessible dataset of BRTA-compliant license plates, captured under diverse and challenging conditions, has been developed to support this approach. Experimental results demonstrate that our approach not only achieves superior detection accuracy and computational efficiency over conventional models but also ensures consistent performance in resource-constrained environments, particularly in Bangladesh.

I. INTRODUCTION

Bengali BRTA plates challenge conventional recognition because localized scripts, varied designs, and real-world conditions reduce detection reliability. The paper proposes a hybrid YOLO Tiny v4–Haar-Cascade system with dynamic retraining and contributes a public dataset for these conditions.

  • Bengali script, distinct plate designs, lighting variation, occlusion, motion blur, and vehicle diversity make conventional license plate recognition inaccurate.Source: §I · pp. 1–2
  • The proposed method combines YOLO Tiny v4 for efficient vehicle detection with Haar-Cascade for precise plate localization inside vehicle bounding boxes.Source: §I · p. 1
  • Dynamic retraining uses low-confidence detections to adapt the model to new conditions and maintain accuracy in rapidly changing environments.Source: §I · pp. 1–2
  • Existing research lacks publicly accessible Bengali license plate datasets and adaptive systems that continuously learn from changing conditions.Source: §I · pp. 1–2
  • The study introduces a public Bengali license plate dataset captured under varied real-world conditions to support future localized-script recognition research.Source: §I · p. 2

II. LITERATURE REVIEW

The literature traces a transition from traditional Haar-cascade and HOG methods to CNN-based detection, while positioning computer vision and cloud computing as foundations for scalable visual analysis.

  • Traditional Haar cascades and HOG established early object detection, but limitations in complex scenes and multiple classes encouraged CNN-based approaches.Source: §II · p. 2
  • Computer vision uses algorithms to extract and analyze visual features from images and videos, supporting applications such as surveillance, medical imaging, and robotics.Source: §II · p. 2
  • Cloud computing provides on-demand scalable resources that can support computationally demanding computer vision applications without maintaining local infrastructure.Source: §II · p. 2

III. PROPOSED METHODOLOGY

The methodology combines transfer learning, YOLOv4-tiny vehicle detection, Haar-Cascade plate localization, and real-time video analysis. Its custom dataset uses varied capture conditions and vehicle types to support robustness.

  • The system uses transfer learning with YOLOv4-tiny for vehicle detection and Haar-Cascade for Bengali license plate localization.Source: §III · p. 2

A. Data Collection & Dataset Development

B. YOLOv4 tiny for Vehicle Detection

YOLOv4-tiny performs real-time vehicle detection by predicting bounding boxes, confidence scores, and class probabilities for each grid cell. Postprocessing removes detections below a confidence threshold.

C. Haar-Cascade for License Plate Localization

The Haar-Cascade classifier localizes BRTA-aligned license plates using learned Haar-like features, weights, and thresholds to distinguish positive plate regions from negative samples.

D. Fine Tuning, Transfer learning & Hybrid Approach

The system fine-tunes YOLOv4-Tiny for Bengali license plates while retaining pretrained feature-extraction layers, then combines it with Haar-Cascade localization.

1) Efficiency Strategies:

The efficiency strategy concentrates license-plate processing on vehicle regions of interest after initial vehicle detection, reducing computation on distant or irrelevant objects.

2) Cascade Approach and Elimination of Irrelevant Regions:

The cascade processes video frames sequentially: YOLOv4 detects vehicles, then Haar-Cascade localizes plates within detected vehicle regions in a cloud-hosted real-time setup.

IV. EXPERIMENTAL STUDY

The experimental study evaluates the hybrid license-plate detection system using real-world BRTA-compliant Bengali plate data, standardized video processing, and both local and cloud-based real-time testing. Evaluation covers recognition metrics and streaming performance under constrained deployment conditions.

  • The evaluation measures precision, recall, F1 score, accuracy, and frames per second on BRTA-compliant Bengali plates captured under real-world conditions.Source: §IV · p. 4
  • Experiments were conducted on an AMD Ryzen 3 2200G system with 16GB RAM to prioritize accessible real-time inference.Source: A. Experimental Setup · p. 4
  • Test videos were standardized to 464x464 pixels before processing in local and cloud-based environments.Source: A. Experimental Setup · p. 5
  • Live RTSP footage from a Dahua IMOU CRUISER SE+4MP camera was used for hybrid-model testing with confidence and suppression thresholds.Source: A. Experimental Setup · p. 5
  • License plates were localized with Haar Cascade using a 1.05 scaling factor, five minimum neighbors, and a minimum size of 60x80 pixels.Source: A. Experimental Setup · p. 5

1) Data Augmentation Techniques:

The study examines how augmentation and selective transfer learning affect the hybrid model under lighting variation and occlusion. Results are assessed across recognition quality and processing speed, with Figure 3 comparing augmented and non-augmented models.

Data Augmentation Techniques

V. CONCLUSION

The conclusion presents a YOLO Tiny v4 and Haar-Cascade hybrid for BRTA-compliant Bengali license plates, supported by dynamic retraining and augmentation. Reported results indicate strong recognition performance and practical relevance for resource-constrained real-time deployment.

  • 94% precision, 93% recall, and 93% F1 score were achieved for BRTA-compliant Bengali license-plate detection and recognition.Source: §V · p. 5
  • The system combines YOLO Tiny v4 vehicle detection with Haar-Cascade license-plate localization and a dynamic retraining pipeline.Source: §V · p. 5
  • Dynamic range enhancement strengthened resilience to lighting variations and occlusions, while the public dataset supports further non-Latin script research.Source: §V · p. 6
  • The hybrid framework is presented as improving accuracy and computational efficiency for regions such as Bangladesh.Source: §V · p. 6

Related papers

Loading 2609.06507v1…