"This brings us to the question of how the subtest scores are to be combined. Although there is some variation from test to test, the formal basis for test combination is a statistical procedure called factor analysis. Suppose that an intelligence test consists of K subtests. (To continue the analogy to the decathlon, K is usually 10 or 12.) A person's scores on the subtests can be represented by a K-dimensional vector. The collective scores of all people in the group can be thought of as a swarm of points in a K-dimensional space. Factor analysis attempts to reduce the K-dimensional space to a smaller P-dimensional space, where P is less than K and the axes defining the dimensions are orthogonal, or at right angles to one another. Unless the scores of two of the original tests are perfectly correlated, this always entails some loss of accuracy. The loss can be measured, so we can determine how much of the variation in the original K-space lies along a particular dimension in the reduced P-space.
To get an intuitive idea of factor analysis, imagine buying a hot dog with pimientos embedded in it. The hot dog is a three-dimensional object, so it takes three dimensions to specify the exact location of each pimiento. However, you can locate a pimiento reasonably accurately by saying where it is along the long axis of the dog. In factor-analytic terms the pimientos are the data from each person, and the three dimensions of the hot dog represent the individual tests. The long axis of the hot dog would be the first factor to be extracted and would capture most of the variation between pimiento locations. If we apply factor analysis to test scores, instead of hot dogs, the first factor accounts for most of the variation between people just as the length of the hot dog accounts for most of the positioning of the pimientos. But instead of saying "length of hot dog," we say "general intelligence."
There are two objections to this argument. One is that when the data are reduced from the K-dimensional to the P-dimensional space, the orientation of the orthogonal dimensions in the P-dimensional space is arbitrary. To see this, consider the hot-dog example again. Although locating pimientos can be reduced from a problem in three dimensions to a problem in one dimension, the one dimension does not have to point exactly along the long axis of the hot dog. It could be rotated to any angle at all, excepting at a right angle to the long axis, and the pimientos could still be located with equal accuracy.
This fact led one critic of the idea of general intelligence, Stephen Jay Gould (1983) to argue that factor analysis is not an appropriate way of defining the variables underlying test scores, because one solution is statistically as a good as another. Gould was wrong. There are statistical methods (which were well known to specialists at the time) that make it possible to compare the goodness of fit of one factor-analytic solution to another. When these methods are applied, investigators virtually always find a highly reliable first factor. The case for general intelligence, the unitary IQ score, is far from trivial. However, there are alternative explanations for the data, based on the idea that there are different types of intelligence, even when one restricts oneself to the notion that intelligence is what the tests measure. To understand what they are, we need to delve into factor analysis a bit more.
Suppose that the statistical variation in the data can be reduced from K dimensions (the original test space) to P orthogonal dimensions. This is only possible if the K original tests are positively correlated, which they virtually always are. In this case there will also be a solution in M dimensions, where P is less than M is less than K, in which some of the M dimensions are not orthogonal to each other. (In psychological terms, if two abilities are statistically unrelated to each other, the dimensions representing them will be orthogonal.) Now, suppose that you had some theoretical reason to believe that the data from the original K tests had been generated by two or more underlying mental factors that were statistically related to each other. Returning to the athletic example, you might want to argue that decathlon scores were determined by the strength and speed of the athletes, and that there is a statistical relationship between strength and speed. Reasoning such as this is called specifying a factor structure for the underlying abilities. Gould claimed that psychometricians could not distinguish between alternative factor structures. Today they can.
During the 1970s the Swedish psychometrician Karl Jreskog developed a statistical technique for evaluating the fit of a multivariate data to an arbitrary, a priori specified factor structure. This made it possible to compare two proposals about the structure of intelligence to data, to see which theory best fit the facts. The new methods have been applied to a number of new data sets (notably Gustafsson 1984) and have become standard in evaluating models of intelligence. In a related, highly technical but very important volume, John Carroll (1993) used somewhat different methods to reanalyze a great many important data sets that have been collected over the past 60 years. The results of these independent analyses were quite consistent. Skipping over some details, human intellectual competence appears to divide along three dimensions. Following Raymond Cattell (1971) and John Horn (1985), I shall refer to these dimensions as fluid intelligence (Gf), crystallized intelligence (Gc), and visual-spatial reasoning (Gv). Cattell and Horn describe them as follows:
Fluid intelligence is the ability to develop techniques for solving problems that are new and unusual, from the perspective of the problem solver.
Crystallized intelligence is the ability to bring previously acquired, often culturally defined, problem-solving methods to bear on the current problem. Note that this implies both that the problem solver knows the methods and recognizes that they are relevant in the current situation.
Visual-spatial reasoning is a somewhat specialized ability to use visual images and visual relationships in problem solving?for instance, to construct in your mind a picture of the sort of mental space that I described above in discussing factor-analytic studies. Interestingly, visual-spatial reasoning appears to be an important part of understanding mathematics."
To get an intuitive idea of factor analysis, imagine buying a hot dog with pimientos embedded in it. The hot dog is a three-dimensional object, so it takes three dimensions to specify the exact location of each pimiento. However, you can locate a pimiento reasonably accurately by saying where it is along the long axis of the dog. In factor-analytic terms the pimientos are the data from each person, and the three dimensions of the hot dog represent the individual tests. The long axis of the hot dog would be the first factor to be extracted and would capture most of the variation between pimiento locations. If we apply factor analysis to test scores, instead of hot dogs, the first factor accounts for most of the variation between people just as the length of the hot dog accounts for most of the positioning of the pimientos. But instead of saying "length of hot dog," we say "general intelligence."
There are two objections to this argument. One is that when the data are reduced from the K-dimensional to the P-dimensional space, the orientation of the orthogonal dimensions in the P-dimensional space is arbitrary. To see this, consider the hot-dog example again. Although locating pimientos can be reduced from a problem in three dimensions to a problem in one dimension, the one dimension does not have to point exactly along the long axis of the hot dog. It could be rotated to any angle at all, excepting at a right angle to the long axis, and the pimientos could still be located with equal accuracy.
This fact led one critic of the idea of general intelligence, Stephen Jay Gould (1983) to argue that factor analysis is not an appropriate way of defining the variables underlying test scores, because one solution is statistically as a good as another. Gould was wrong. There are statistical methods (which were well known to specialists at the time) that make it possible to compare the goodness of fit of one factor-analytic solution to another. When these methods are applied, investigators virtually always find a highly reliable first factor. The case for general intelligence, the unitary IQ score, is far from trivial. However, there are alternative explanations for the data, based on the idea that there are different types of intelligence, even when one restricts oneself to the notion that intelligence is what the tests measure. To understand what they are, we need to delve into factor analysis a bit more.
Suppose that the statistical variation in the data can be reduced from K dimensions (the original test space) to P orthogonal dimensions. This is only possible if the K original tests are positively correlated, which they virtually always are. In this case there will also be a solution in M dimensions, where P is less than M is less than K, in which some of the M dimensions are not orthogonal to each other. (In psychological terms, if two abilities are statistically unrelated to each other, the dimensions representing them will be orthogonal.) Now, suppose that you had some theoretical reason to believe that the data from the original K tests had been generated by two or more underlying mental factors that were statistically related to each other. Returning to the athletic example, you might want to argue that decathlon scores were determined by the strength and speed of the athletes, and that there is a statistical relationship between strength and speed. Reasoning such as this is called specifying a factor structure for the underlying abilities. Gould claimed that psychometricians could not distinguish between alternative factor structures. Today they can.
During the 1970s the Swedish psychometrician Karl Jreskog developed a statistical technique for evaluating the fit of a multivariate data to an arbitrary, a priori specified factor structure. This made it possible to compare two proposals about the structure of intelligence to data, to see which theory best fit the facts. The new methods have been applied to a number of new data sets (notably Gustafsson 1984) and have become standard in evaluating models of intelligence. In a related, highly technical but very important volume, John Carroll (1993) used somewhat different methods to reanalyze a great many important data sets that have been collected over the past 60 years. The results of these independent analyses were quite consistent. Skipping over some details, human intellectual competence appears to divide along three dimensions. Following Raymond Cattell (1971) and John Horn (1985), I shall refer to these dimensions as fluid intelligence (Gf), crystallized intelligence (Gc), and visual-spatial reasoning (Gv). Cattell and Horn describe them as follows:
Fluid intelligence is the ability to develop techniques for solving problems that are new and unusual, from the perspective of the problem solver.
Crystallized intelligence is the ability to bring previously acquired, often culturally defined, problem-solving methods to bear on the current problem. Note that this implies both that the problem solver knows the methods and recognizes that they are relevant in the current situation.
Visual-spatial reasoning is a somewhat specialized ability to use visual images and visual relationships in problem solving?for instance, to construct in your mind a picture of the sort of mental space that I described above in discussing factor-analytic studies. Interestingly, visual-spatial reasoning appears to be an important part of understanding mathematics."