Connecting the Past and the Present : Histogram Layers for Texture Analysis

Abstract:

Feature engineering often plays a vital role in the fields of computer vision and machine learning. A few common examples of engineered features include histogram of oriented gradients (HOG) , local binary patterns (LBP), and edge histogram descriptors (EHD). Features such as pixel gradient directions and magnitudes for HOG, encoded pixel differences for LBP, and edge orientations for EHD are aggregated through histograms in order to extract texture information. However, the process of designing handcrafted features can be difficult and time-consuming. Artificial neural networks (ANNs) such as convolutional neural networks (CNNs) have performed well in various applications such as facial recognition, semantic segmentation, object detection and image classification with features learned by the network. In this work, a new histogram layer is proposed to learn histogram features and maximize the performance of ANNs for texture analysis. Current approaches using ANNs, particularly CNNs, or handcrafted features do not perform well for some texture applications due to inherent problems within texture datasets (e.g., high intrinsic dimensionality, large intra-class variations) and limitations in methods that use handcrafted and/or deep learning features. CNNs, as currently constructed, cannot directly model statistical texture information in the data; and statistical texture serves a powerful descriptor that can be used in several applications. The proposed histogram layer can
estimate bin centers and widths through the backpropagation of errors to aggregate the statistical texture features from the data while also maintaining spatial information. Two aspects of texture analysis, classification and segmentation, are explored in this work. The improved performance of each network with the addition of the histogram layer demonstrates the potential for the use of this new element within ANNs.

Links:

Citation:

J. Peeples, "Connecting the Past and the Present : Histogram Layers for Texture Analysis," Ph.D Thesis, Gainesville, FL, 2022.
@phdthesis{Peeples2022Thesis,
author = {Joshua Peeples},
title = {Connecting the Past and the Present : Histogram Layers for Texture Analysis},
school = {Univ. of Florida},
year = {2022},
address = {Gainesville, FL},
}