Beyond the Ground Truth: Alternative Quality Measures of Document Binarizations.: Alternative quality measures of document binarizations

Arie Shaus; Barak Sober; Eli Turkel; Eli Piasetzky

Beyond the Ground Truth: Alternative Quality Measures of Document Binarizations. Alternative quality measures of document binarizations

Arie Shaus, Barak Sober, Eli Turkel, Eli Piasetzky

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

5 Scopus citations

Abstract

This article discusses the quality assessment of binary images. The customary, ground truth based methodology, used in the literature is shown to be problematic due to its subjective nature. Several previously suggested alternatives are surveyed and are also found to be inadequate in certain scenarios. A new approach, quantifying the adherence of a binarization to its document image is proposed and tested using six different measures of accuracy. The measures are evaluated experimentally based on datasets from DIBCO and H-DIBCO competitions, with respect to different kinds of binarization degradations.

Original language	English
Title of host publication	Proceedings of the 15th International Conference on Frontiers in Handwriting Recognition
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	495 - 500
Number of pages	6
ISBN (Electronic)	9781509009817
State	Published - 2016
Event	15th International Conference on Frontiers in Handwriting Recognition, ICFHR 2016 - Shenzhen, China Duration: 23 Oct 2016 → 26 Oct 2016

Publication series

Name	2016 15th International Conference on Frontiers in Handwriting Recognition (ICFHR), Frontiers in Handwriting Recognition (ICFHR), 2016 15th International Conference on, ICFHR

Conference

Conference	15th International Conference on Frontiers in Handwriting Recognition, ICFHR 2016
Country/Territory	China
City	Shenzhen
Period	23/10/16 → 26/10/16

Bibliographical note

Funding Information:
The research reported here received initial funding from the Israel Science Foundation - F.I.R.S.T. (Bikura) Individual Grant no. 644/08, as well as the Israel Science Foundation Grant no. 1457/13. The research was also funded the European Research Council under the European Community's Seventh Framework Programme (FP7/2007-2013)/ERC grant agreement no. 229418, and by an Early Israel grant (New Horizons project), Tel Aviv University.

Publisher Copyright:
© 2016 IEEE.

Keywords

Computing and Processing
Extraterrestrial measurements
Sociology
Statistics
Quality assessment
Gray-scale
Manuals
quality measure
ground truth
binarization
evaluation

Access to Document

https://search.ebscohost.com/login.aspx?direct=true&AuthType=ip,shib&db=edseee&AN=edseee.7814113&site=eds-live&scope=site&custid=s5122861&authtype=shib

Cite this

Shaus, A., Sober, B., Turkel, E., & Piasetzky, E. (2016). Beyond the Ground Truth: Alternative Quality Measures of Document Binarizations. Alternative quality measures of document binarizations. In Proceedings of the 15th International Conference on Frontiers in Handwriting Recognition (pp. 495 - 500). Article 7814113 (2016 15th International Conference on Frontiers in Handwriting Recognition (ICFHR), Frontiers in Handwriting Recognition (ICFHR), 2016 15th International Conference on, ICFHR). Institute of Electrical and Electronics Engineers Inc.. https://search.ebscohost.com/login.aspx?direct=true&AuthType=ip,shib&db=edseee&AN=edseee.7814113&site=eds-live&scope=site&custid=s5122861&authtype=shib

Shaus, Arie ; Sober, Barak ; Turkel, Eli et al. / Beyond the Ground Truth: Alternative Quality Measures of Document Binarizations. Alternative quality measures of document binarizations. Proceedings of the 15th International Conference on Frontiers in Handwriting Recognition. Institute of Electrical and Electronics Engineers Inc., 2016. pp. 495 - 500 (2016 15th International Conference on Frontiers in Handwriting Recognition (ICFHR), Frontiers in Handwriting Recognition (ICFHR), 2016 15th International Conference on, ICFHR).

@inproceedings{c776b892d7574d88a07544d20aaad11b,

title = "Beyond the Ground Truth: Alternative Quality Measures of Document Binarizations.: Alternative quality measures of document binarizations",

abstract = "This article discusses the quality assessment of binary images. The customary, ground truth based methodology, used in the literature is shown to be problematic due to its subjective nature. Several previously suggested alternatives are surveyed and are also found to be inadequate in certain scenarios. A new approach, quantifying the adherence of a binarization to its document image is proposed and tested using six different measures of accuracy. The measures are evaluated experimentally based on datasets from DIBCO and H-DIBCO competitions, with respect to different kinds of binarization degradations.",

keywords = "Computing and Processing, Extraterrestrial measurements, Sociology, Statistics, Quality assessment, Gray-scale, Manuals, quality measure, ground truth, binarization, evaluation",

author = "Arie Shaus and Barak Sober and Eli Turkel and Eli Piasetzky",

note = "Publisher Copyright: {\textcopyright} 2016 IEEE.; 15th International Conference on Frontiers in Handwriting Recognition, ICFHR 2016 ; Conference date: 23-10-2016 Through 26-10-2016",

year = "2016",

language = "אנגלית",

series = "2016 15th International Conference on Frontiers in Handwriting Recognition (ICFHR), Frontiers in Handwriting Recognition (ICFHR), 2016 15th International Conference on, ICFHR",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "495 -- 500",

booktitle = "Proceedings of the 15th International Conference on Frontiers in Handwriting Recognition",

address = "ארצות הברית",

}

Shaus, A, Sober, B, Turkel, E & Piasetzky, E 2016, Beyond the Ground Truth: Alternative Quality Measures of Document Binarizations. Alternative quality measures of document binarizations. in Proceedings of the 15th International Conference on Frontiers in Handwriting Recognition., 7814113, 2016 15th International Conference on Frontiers in Handwriting Recognition (ICFHR), Frontiers in Handwriting Recognition (ICFHR), 2016 15th International Conference on, ICFHR, Institute of Electrical and Electronics Engineers Inc., pp. 495 - 500, 15th International Conference on Frontiers in Handwriting Recognition, ICFHR 2016, Shenzhen, China, 23/10/16. <https://search.ebscohost.com/login.aspx?direct=true&AuthType=ip,shib&db=edseee&AN=edseee.7814113&site=eds-live&scope=site&custid=s5122861&authtype=shib>

Beyond the Ground Truth: Alternative Quality Measures of Document Binarizations. Alternative quality measures of document binarizations. / Shaus, Arie; Sober, Barak; Turkel, Eli et al.
Proceedings of the 15th International Conference on Frontiers in Handwriting Recognition. Institute of Electrical and Electronics Engineers Inc., 2016. p. 495 - 500 7814113 (2016 15th International Conference on Frontiers in Handwriting Recognition (ICFHR), Frontiers in Handwriting Recognition (ICFHR), 2016 15th International Conference on, ICFHR).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Beyond the Ground Truth: Alternative Quality Measures of Document Binarizations.

T2 - 15th International Conference on Frontiers in Handwriting Recognition, ICFHR 2016

AU - Shaus, Arie

AU - Sober, Barak

AU - Turkel, Eli

AU - Piasetzky, Eli

PY - 2016

Y1 - 2016

N2 - This article discusses the quality assessment of binary images. The customary, ground truth based methodology, used in the literature is shown to be problematic due to its subjective nature. Several previously suggested alternatives are surveyed and are also found to be inadequate in certain scenarios. A new approach, quantifying the adherence of a binarization to its document image is proposed and tested using six different measures of accuracy. The measures are evaluated experimentally based on datasets from DIBCO and H-DIBCO competitions, with respect to different kinds of binarization degradations.

AB - This article discusses the quality assessment of binary images. The customary, ground truth based methodology, used in the literature is shown to be problematic due to its subjective nature. Several previously suggested alternatives are surveyed and are also found to be inadequate in certain scenarios. A new approach, quantifying the adherence of a binarization to its document image is proposed and tested using six different measures of accuracy. The measures are evaluated experimentally based on datasets from DIBCO and H-DIBCO competitions, with respect to different kinds of binarization degradations.

KW - Computing and Processing

KW - Extraterrestrial measurements

KW - Sociology

KW - Statistics

KW - Quality assessment

KW - Gray-scale

KW - Manuals

KW - quality measure

KW - ground truth

KW - binarization

KW - evaluation

UR - http://www.scopus.com/inward/record.url?scp=85012871603&partnerID=8YFLogxK

M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???

T3 - 2016 15th International Conference on Frontiers in Handwriting Recognition (ICFHR), Frontiers in Handwriting Recognition (ICFHR), 2016 15th International Conference on, ICFHR

SP - 495

EP - 500

BT - Proceedings of the 15th International Conference on Frontiers in Handwriting Recognition

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 23 October 2016 through 26 October 2016

ER -

Shaus A, Sober B, Turkel E, Piasetzky E. Beyond the Ground Truth: Alternative Quality Measures of Document Binarizations. Alternative quality measures of document binarizations. In Proceedings of the 15th International Conference on Frontiers in Handwriting Recognition. Institute of Electrical and Electronics Engineers Inc. 2016. p. 495 - 500. 7814113. (2016 15th International Conference on Frontiers in Handwriting Recognition (ICFHR), Frontiers in Handwriting Recognition (ICFHR), 2016 15th International Conference on, ICFHR).