Deep Learning in Time-Frequency Domain for Document Layout Analysis

Felipe Grijalva, Erick Santos, Byron Acuna, Juan Carlos Rodriguez, Julio Cesar Larco

Producción científica: Contribución a una revistaArtículorevisión exhaustiva

2 Citas (Scopus)


Document layout analysis plays an important role in the area of Document Understanding. It is responsible for identifying and classifying the different components of digital documents. Currently, there is no universal algorithm that fits all types of digital documents. This work presents a novel approach for identifying tables, figures, isolated equations and text regions in scientific papers using deep learning and computer vision techniques. Our proposed approach is a three-stage system: (i) obtaining the spectrograms of the horizontal and vertical intensity histograms of segmented regions of interest; (ii) labeling segmented regions of interest into text, table, and figures using a deep convolutional neural network classifier; and (iii) identifying isolated equations in text regions using Bag of Visual Words (BOVW) with Zernike moments. We built a new dataset composed of 11007 papers to perform the experiments, using two common segmentation metrics to evaluate our model: (1) Adjusted Rand Index (ARI) and (2) Variation of Information (VI). The proposed document layout analysis system reached an overall accuracy of 96.2685%, outperforming prior art with a less computational cost.

Idioma originalInglés
Páginas (desde-hasta)151254-151265
Número de páginas12
PublicaciónIEEE Access
EstadoPublicada - 2021
Publicado de forma externa


Profundice en los temas de investigación de 'Deep Learning in Time-Frequency Domain for Document Layout Analysis'. En conjunto forman una huella única.

Citar esto