Source-linked AI summary
TTPLA: An Aerial-Image Dataset for Detection and Segmentation of Transmission Towers and Power Lines
Rabab Abdelfattah, Xiaofeng Wang, Song Wang
TL;DR
Aerial TT/PL detection and segmentation is challenging because power lines are thin and can resemble their backgrounds, while towers and scene conditions vary. The paper introduces TTPLA, a pixel-wise annotated aerial dataset, and evaluates a Yolact baseline, reporting low average scores for bounding boxes and masks. The dataset supports instance segmentation, and the baseline highlights challenges in crowded scenes.
Problem
Aerial TT/PL imagery presents thin, background-similar power lines and varied tower structures, complicating precise scene understanding for UAV inspection and flight safety.
Source: §1 · pp. 1–2Method
The paper releases TTPLA, a public aerial dataset with pixel-wise TT/PL annotations, and evaluates a Yolact instance-segmentation baseline.
Source: §1 · pp. 2–3Results
22.96% for bounding boxes and 15.72% for masks are the best average scores reported for the Yolact baseline, which the authors describe as low in general.
Source: §1 · p. 2Takeaways & Limitations
TTPLA is presented as the first public TT/PL image dataset focused on instance segmentation, with COCO-format annotations that can be integrated with other datasets.
Source: §1 · p. 3In crowded scenes, NMS threshold changes trade false positives against missed or suppressed overlapping objects, so threshold adjustment is not a perfect solution.
Source: §4.3 · p. 14
Abstract
from arXiv · showhide
Accurate detection and segmentation of transmission towers~(TTs) and power lines~(PLs) from aerial images plays a key role in protecting power-grid security and low-altitude UAV safety. Meanwhile, aerial images of TTs and PLs pose a number of new challenges to the computer vision researchers who work on object detection and segmentation -- PLs are long and thin, and may show similar color as the background; TTs can be of various shapes and most likely made up of line structures of various sparsity; The background scene, lighting, and object sizes can vary significantly from one image to another. In this paper we collect and release a new TT/PL Aerial-image (TTPLA) dataset, consisting of 1,100 images with the resolution of 3,840$\times$2,160 pixels, as well as manually labeled 8,987 instances of TTs and PLs. We develop novel policies for collecting, annotating, and labeling the images in TTPLA. Different from other relevant datasets, TTPLA supports evaluation of instance segmentation, besides detection and semantic segmentation. To build a baseline for detection and segmentation tasks on TTPLA, we report the performance of several state-of-the-art deep learning models on our dataset. TTPLA dataset is publicly available at https://github.com/r3ab/ttpla_dataset
1 Introduction
UAV imagery offers a flexible, lower-cost alternative for power-grid inspection, but detecting towers and power lines is difficult because of their varied structures, thin appearance, and complex scenes. TTPLA provides aerial imagery with instance-level annotations and a baseline whose reported scores are low in general.
1 Introduction
- UAV-based power-grid inspection needs precise, real-time scene understanding for localization, recognition, tracking, monitoring, inspection, and flight safety.UAV inspection is described as lower-cost, more mobile, and more flexible than traditional inspection methods.Source: §1 · p. 1
- Detection is complicated by background-color similarity, tower–line scale and class imbalance, crowded or overlapping lines, and varied object structures and shapes.Each tower is linked to at least 3–4 and up to 10 power lines; power lines are long and thin, while towers vary in shape and line-structure sparsity.Source: §1 · p. 2
- Existing TT/PL datasets support image-level or semantic annotations, while instance segmentation can distinguish same-class objects and provide masks for individual instances.The paper identifies close, occluded, and overlapping power lines as a setting where instance-level distinctions are useful.Source: §1 · p. 2
- 22.96% for bounding boxes and 15.72% for masks are the best average scores reported for the Yolact baseline, and are low in general.The baseline was evaluated with ResNet-50 and ResNet-101 backbones at three image resolutions.Source: §1 · p. 2
- TTPLA contributes a public aerial-image dataset, novel collection and labeling policies, pixel-wise instance annotations, and a baseline evaluation.The dataset includes TTs and PLs across different views, times, locations, backgrounds, and tower structures; annotations are provided in COCO format.Source: §1 · p. 3
2 Related Work
Related datasets span towers, power lines, and combined imagery, but vary in availability, resolution, annotation, and whether images are cropped. The review identifies a general lack of TT/PL training datasets, partly due to the difficulty of collecting UAV imagery near power grids.
2 Related Work
- The review describes a continuing lack of TT/PL training datasets, citing the difficulty of collecting images, especially when UAVs fly close to power grids.It surveys datasets on towers, power lines, and insulators.Source: §2 · p. 3
2.1 Datasets Based on TTs Images Only
- TT-only datasets include reduced-resolution aerial images with bounding-box labels and damage datasets, while several reviewed datasets are not publicly available.One dataset contains 3,200 images at 64×128 pixels; another has 28,674 images annotated with bounding boxes at 6,048×4,032 pixels.Source: §2.1 · p. 4
2.2 Datasets Based on PLs Images Only
- PL-only datasets include image-level or pixel-level labels, cropped UAV scenes, and synthetic wires; the reviewed synthetic datasets are not public.Manual cropping can remove realistic backgrounds and may not reflect real-time UAV operations, where objects can appear anywhere in an image.Source: §2.2 · pp. 4–5
2.3 Datasets Based on Both TTs and PLs Images
- ImageNet includes TT/PL labels, but most images are not aerial and lack top and side views, with simpler backgrounds than the UAV setting considered.The review notes 1,290 annotated images with TT and PL labels.Source: §2.3 · p. 5
3 TTPLA Dataset Properties
TTPLA’s preparation combines aerial-video sampling with policies for diverse views, object-aware labeling, and pixel-level instance annotation. Its statistics show an imbalance in instance counts across classes but comparable pixel coverage for towers and power lines.
3.1 Aerial Videos Collection and Images Preparation
- TTPLA draws from 80 UAV videos recorded at 3,840 × 2,160 and samples frames before manual inspection to remove redundancy and retain clear, complete tower views.Frames are sampled once every 15 frames, with more frequent sampling available for augmentation.Source: §3.1 · p. 6, §3.2 · p. 8
3.2 TTPLA Dataset Policy
- Recording policies vary tower viewpoints, zoom, time, and weather, while including noisy backgrounds, similar line-background colors, and lines partly hidden by trees.Front, top, and side views are included to support tower detection across viewing angles.Source: §3.2 · p. 6, Figure 3 · p. 7
- Expert annotators use polygons to label each tower and power-line instance at pixel level, enabling instances to be distinguished rather than assigning one class label to all matching pixels.Three expert annotators label images, with each image assigned to one annotator.Source: §3.2 · p. 8
- Tower labels group structures by lattice type or pole material rather than shape, since partial views can make tower shapes hard to distinguish; difficult-to-recognize instances are marked void and excluded from evaluation.The labels include tower-lattice, tower-tucohy, and tower-wooden, alongside cable for power lines.Source: §3.2 · pp. 8–9
3.3 Dataset Statistics
- Power-line instances greatly outnumber tower instances, yet towers and power lines occupy comparable pixel area; 659 images contain 1–6 instances and 241 contain 11–56.The authors attribute the instance imbalance to towers connecting to 2–10 power lines and include images with multiple towers to increase tower instances.Source: §3.3 · p. 10
4 Evaluation
The evaluation defines box and mask average precision and a weighted multi-loss objective, then examines baseline false positives from class confusion, incomplete masks, and NMS in crowded scenes.
4.1 Metrics
- Average precision is evaluated for bounding boxes and instance masks, using IoU thresholds above 50% and averages across thresholds from 50% to 95%.AP50 and AP75 use the respective 50% and 75% overlap values.Source: §4.1 · pp. 10–11
- Fig. 6 plots images against instances per image for all instances and for cable, tower-lattice, tower-tucohy, and tower-wooden classes.Source: Figure 6 · p. 11
4.2 Loss Function
- The baseline training objective sums localization, classification, and mask losses, weighted by 1, 1.5, and 6.125, with ground-truth box area normalizing mask loss.The number of boxes matching ground truth is also used in the loss formulation.Source: §4.2 · p. 11
- Classification uses softmax confidence scores, localization uses Smooth L1 box-offset loss, and mask prediction uses pixel-level binary cross-entropy.Source: §4.2 · pp. 11–12
4.3 Baseline experiment results
- Up to 1.3% of test-set images show classification falseness, including confusion between small tower-tucohy towers and PLs.The authors suggest color and shape similarity as one possible explanation.Source: §4.3 · pp. 12–13, Figure 7 · p. 12
- Segmentation falseness includes incomplete masks and split detections; PLs only 1–3 pixels wide are especially difficult for Yolact to cover fully.The account also notes that a PL may be represented by one bounding box and mask that misses much of its length.Source: §4.3 · p. 13, Figure 9 · p. 13
- 48.9%, 36.8%, 17.9%, and 2.5% of bounding-box pairs overlap at thresholds 0.3, 0.5, 0.75, and 0.95, respectively; NMS trades false positives against missed true objects.The overlap figures concern bounding boxes of different instances in TTPLA.Source: §4.3 · p. 14, Table 4 · p. 14
- The analysis highlights challenges in processing real-time UAV images and identifies opportunities for dataset-related improvement.Source: §4.3 · p. 14
5 Conclusion
TTPLA is a public dataset for combined transmission-tower and power-line instance segmentation, built from varied aerial images with pixel-wise annotations. The paper also establishes a baseline using a state-of-the-art model, different backbones, and multiple image sizes.
- TTPLA contains 1,100 aerial images at 3,840×2,160 resolution and up to 8,987 instances, with pixel-wise annotations for instance segmentation.The dataset focuses on combined transmission towers and power lines.Source: §5 · p. 14
- The authors propose collection, annotation, and labeling policies to capture variation in view angles, scales, backgrounds, lighting, and zoom levels.Source: §5 · p. 14
- The paper establishes a baseline on TTPLA using a state-of-the-art learning model, different backbones, and varied image sizes.The authors present TTPLA as a challenge for computer vision research in detection, classification, and instance segmentation.Source: §5 · p. 14