Hostname: page-component-6bf8c574d5-n2sc8 Total loading time: 0 Render date: 2025-03-05T19:24:05.341Z Has data issue: false hasContentIssue false
  • English
  • Français

An Entropy Approach to the Scaling of Ordinal Categorical Data

Published online by Cambridge University Press:  01 January 2025

T. R. Jefferson ,
J. H. May  and
N. Ravi
T. R. Jefferson
Affiliation:
A. B. Freeman School of Business, Tulane University
J. H. May*
Affiliation:
Joseph M. Katz Graduate School of Business, University of Pittsburgh
N. Ravi
Affiliation:
Bell Laboratories
*
Requests for reprints should be sent to Jerrold H. May, The Katz Graduate School of Business, University of Pittsburgh, 214 Mervis Hall, Roberto Clemente Drive, Pittsburgh, PA 15260.
Get access Rights & Permissions [Opens in a new window]

Abstract

This paper studies the problem of scaling ordinal categorical data observed over two or more sets of categories measuring a single characteristic. Scaling is obtained by solving a constrained entropy model which finds the most probable values of the scales given the data. A Kullback-Leibler statistic is generated which operationalizes a measure for the strength of consistency among the sets of categories. A variety of data of two and three sets of categories are analyzed using the entropy approach.

Keywords

ordinal categorical dataentropyminimum discrimination informationscalingconvex programming
Type
Original Paper
Information
Psychometrika , Volume 54 , Issue 2 , June 1989 , pp. 203 - 215
Copyright
Copyright © 1989 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

This research was partially supported by the Air Force Office of Scientific Research under grant AFOSR 83-0234. The support by the Air Force through grant AFOSR-83-0234 is gratefully acknowledged. The comments of the editor and referees have been most helpful in improving the paper, and in bringing several additional references to our attention.

References

Barlow, R. E., Bartholomew, D. J., Bremner, J.M., Brunk, H.D. (1972). Statistical inference under order restrictions: The theory and application of isotonic regression, New York: Wiley.Google Scholar
Bazaraa, M. S., Shetty, C. M. (1979). Nonlinear programming theory and methods, New York: Wiley.Google Scholar
Bishop, Y. M., Fienberg, S. E., Holland, P. W. (1975). Discrete multivariate analysis, Cambridge, MA: The MIT Press.Google Scholar
Bock, R. D. (1960). Methods and applications of optimal scaling, Chapel Hill: University of North Carolina, Psychometric Laboratory.Google Scholar
Bradley, R. A., Katti, S. K., Coons, I. J. (1962). Optimal scaling for ordered categories. Psychometrika, 27, 355–374.CrossRefGoogle Scholar
Dantzig, G. B. (1963). Linear programming and extensions, Princeton, NJ: Princeton University Press.Google Scholar
Duffin, R. J., Peterson, E. L., Zener, C. (1967). Geometric programming—Theory and application, New York: John Wiley & Sons.Google Scholar
Fienberg, S. E. (1980). The analysis of cross-classified categorical data, Cambridge, MA: The MIT Press.Google Scholar
Fischer, G. H. (1981). On the existence and uniqueness of maximum-likelihood estimates in the Rasch Model. Psychometrika, 46, 59–77.CrossRefGoogle Scholar
Fletcher, R. (1980). Practical Methods of Optimization (Vol. I & II), New York: John Wiley & Sons.Google Scholar
Gokhale, D. V., Kullback, S. (1978). The information in contingency tables, Basel: Marcel Dekker.Google Scholar
goodman, L. A. (1979). Simple models for the analysis of association in corss-classification having ordered categories. Journal of the American Statistical Association, 74, 537–552.CrossRefGoogle Scholar
Greenacre, M. J. (1984). Review of Shizuhiko Nishisato, Analysis of categorical data: Dual scaling and its applications. Journal of Amercian Statistical Association, 79(388), 953–954.CrossRefGoogle Scholar
Haverman, S. J. (1974). The analysis of frequency data, Chicago: University of Chicago Press.Google Scholar
Jaynes, E. T. (1957). Information and Statistical Mechanics. Physics Review, 106, 620–630.CrossRefGoogle Scholar
Kimeldorf, G., May, J. H., Sampson, A. R. (1982). Concordant and discordent monotone correlations and their evaluation by nonlinear optimization. In Zanakis, S. H., Rustagi, J. S. (Eds.), Optimization in statistics (pp. 117–130). Amsterdam: North Holland.Google Scholar
Kullback, S., Leibler, R. A. (1951). On Information and sufficiency. Annals of Mathematical Statistics, 22, 70–86.CrossRefGoogle Scholar
Lazarsfeld, P. F. (1959). Latent structureanalysis. In Koch, S. (Eds.), Psychology: A study of science, volume 3, New York: McGrqaw-Hill.Google Scholar
Lord, F. M. (1952). A theory of test scores. Psychometrika Monograph No. 7, 17 (4, Pt. 2).Google Scholar
May, J. H., Sampson, A. R. (1984). Merging Moody's and S&P joint bond ratings, Pittsburgh: University of Pittsburgh, Graduate School of Business.Google Scholar
Murtagh, B. A., Saunders, M. A. (1978). Large scale linearly constrained optimization. Mathematical Programming, 14, 41–72.CrossRefGoogle Scholar
Nishisato, S. (1978). Optimal scaling of paired comparison rank-order data: An alternative to Guttman's formulation. Psychometrika, 43, 263–271.CrossRefGoogle Scholar
Nishisato, S. (1980). Analysis of categorical data: Dual scaling and its applications, Toronto: University of Toronto Press.CrossRefGoogle Scholar
Nishisato, S. (1984). Forced classification: A simple application of a quantification method. Psychometrika, 49, 25–36.CrossRefGoogle Scholar
Nishisato, S., Arri, P. S. (1975). Nonlinear programming approach to optimal scaling of partially ordered categories. Psychometrika, 40, 525–548.CrossRefGoogle Scholar
Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scroes. Psycholmetrica Monograph No. 17, 34(4, Pt. 2).Google Scholar
Tanaka, Y. (1979). Optimal scaling for arbitrarily ordered categories. Annals of the Institute for Statistical Mathematics, 31, 115–124.CrossRefGoogle Scholar
Tanaka, Y., Kodake, K. (1980). Computational aspects of optimal scalings for ordered categories. Behaviormetrika, 7, 35–46.CrossRefGoogle Scholar
Teunisjen, T. J. J. M. (1985). Binary programming and test design. Psychometrika, 50, 411–420.Google Scholar
Torgerson, W. S. (1958). Theory and methods of scaling, New York: Wiley.Google Scholar