button-home.gif (2711 bytes)

NormMaker

button-articles.gif (2719 bytes)
button-infodesk.gif (2779 bytes) button-techsupport.gif (2812 bytes)
button-news.gif (2848 bytes) button-visitors.gif (2745 bytes)
button-products.gif (2752 bytes) buttons-globaldealers.gif (2847 bytes)

Significantly enhance the interpretation and credibility of assessment results.

Benchmark group performance.

Login to the NormMaker Norm Generator


Quickly and effortlessly create norms for psychometric tests and instruments used in selection, assessment, personal and group development. Full norm tables allow you to evaluate performance using stanines, stens, percentile distribution, or standard scores. Quality control of your instrument is provided for by descriptive statistics, reliability coefficients and indications of the characteristics of the distribution. You can also view your data by graphing the distribution profile, including the position of stanines.

 

FEATURESwpe6.jpg (13334 bytes)

  • NormMaker can use data in Ascii, DBase and even frequency table form to allow users to enter test or questionnaire results easily or process existing scores stored in almost any format.

  • Attractive and easily readable output for norm tables can be viewed on screen, immediately printed, or saved to disk for future reference.

  • Reliability coefficients and other statistics for the test or questionnaire are provided with each norm table.

  • Graph your data showing the overall distribution of scores, scores distributed by stanine, or the top and bottom third of the distribution.

  • A comprehensive manual covering the use of NormMaker and an in-depth discussion of the concept and use of norms is supplied with the program.

EXPLAINING THE CONCEPT OF NORMS

The completion of a test or questionnaire results in a raw score reflecting how the person has accomplished the task. However, knowing a raw score does not tell a great deal about the person's actual performance on the test or questionnaire. In order to evaluate performance, we need a standard against which we can compare. In this way we are able to evaluate the person's performance relative to a group who we are interested in. Norms provide us with such a context. For example, if a person has obtained a raw score of 90 out of 100 for a test of some kind, we may initially think this performance is very good. However, if we compare this score to other people we are interested in and find that they score 95 or higher, it means that the performance of the person we are looking at is in fact low relative to the norm.

Further, using raw scores, we cannot identify how a person has performed across a range of tests or questionnaires unless we can get a standard which can be applied to all the tests. Using norms to evaluate performance, we may find that somebody performs strongly using language skills, but is relatively weak in computational skills. Norms therefore provide a frame of reference with which to view a candidate's performance.

Norms are constructed from a set of scores of candidates that are representative of the population you are measuring or comparing against. A candidate's scores can then be directly compared with the norm group, and the relative performance of the candidate can be identified by how the candidate falls in the distribution of scores on the norm table. In this way one can tell whether a candidate is anything from very poor or low, to average, to exceptional on an ability or characteristic.

Lets have a look at some examples of how norms can be used:

i. When assessing a bursary candidate for his or her suitability for university, it is useful to know how the person compares against students who have been successful at that level. By comparing the performance of the candidate on a number of psychometric tests against the norm group of successful students, you can evaluate the likely success of the candidate in obtaining the qualification.

ii. In a selection exercise within an organisation you want an overall profile of how good the candidates are on a range of measures. These may include psychometric tests and questionnaires. Use of a norm table composed of all internal personnel provides a profile of the performance of all candidates on the same criteria, and shows the relative strengths and weaknesses of individuals as well as how they compare to the standard in the company.

iii. As part of a development scheme for personnel, a company may offer an assertiveness course. Candidates complete a questionnaire on assertiveness and compare their scores with those of a norm composed of a representative sample of the general population. They can then see exactly how assertive they are relative to the next person.

iv. Use is made of an imported questionnaire as part of an organisation's management training program. The questionnaire measures conflict styles. Using norms generated from the scores of South African managers, the trainees can compare their own profiles with the norm and begin to adapt their behaviour where necessary.

Measurements taken on large groups of people will generally create a distribution which takes the approximate form of a normal bell shaped curve. For example, if we have a look at the shoe size of the adult male population, it will fall in a range of scores from very small to very large, with the majority of people somewhere in the middle.  

The normal curve is characterised by a concentration of observations in the middle and as the distance from the central point increases on either side, the incidence of people is reduced. By plotting the distribution above, we can see where any particular shoe size will be located on the normal distribution. These distributions also exist for other measures such as height, weight, and even blood pressure. Similar principles can be established for psychometric tests and questionnaires which are measuring a particular ability or trait. Using the information of a distribution we can make assessments and even predictions about outcomes. For instance, shoe makers will cater for the central tendency of sizes by making a large number of shoes between sizes seven and nine. Few shoes will be made smaller and larger than this, because the market is relatively smaller. In the case of psychometric measurements, we can locate a person's performance on the distribution curve and it will tell us whether he or she scored very well, average, or low on the quality relative to the distribution of the sample.

Norms therefore provide the following benefits:

! They provide a real life criterion through which we can establish a standard.

! They describe the quality of an individual's performance by comparing his or her score with the distribution of people similar to him or her.

! They allow us to compare the performance of an individual on two or more instruments or measures because they represent standard scales of measurement.

Tests and other instruments vary in difficulty and they seldom consist of the same number of items. Norms overcome these difficulties by providing a standardised way of viewing performance. No matter how tests may vary in length or difficulty, we can compare the person's performance against a common standard using norms. Further, we may want to compare people to a variety of different groups. So, for example, we can have a range of norms for a test varying from matriculants, through Technicon graduates, to University graduates. We can also develop norms for cultural groups where we know the instruments we are using are influenced by cultural factors. Separate norms may provide an unbiased way of assessing people on the same instrument and compensating for cultural bias in the instrument.

 The process utilised in NormMaker smooths and normalises the distribution of a set of scores to provide a norm table. The norm table can then be used to locate the raw score, and identify where the person falls in the distribution. The norm tables that are produced by NormMaker provide three ways in which we can view the distribution. These are:

! Standard Scores

! Percentile Ranks

! Stanines

3.1.1 Standard Scores

Standard scores are normalised raw scores with a mean of 50 and a standard deviation of 10. In calculating the Standard scores the raw scores are normalised using Hasting's transformation (see Hasting, 1955, p.192). In addition, the distribution is smoothed to eliminate spurious scores. These standard scores provide the basis for the calculation of other representations of distribution such as stanines.

3.1.2 Percentile Rank

The percentile rank associated with a raw score is a popular way of describing a candidates performance relative to the norm group. The percentile rank tells us that the raw score in question is higher than or equal to that percentage of scores in the norm group. For example, a percentile rank of 76 on an assertiveness questionnaire would mean that the raw score the person obtained shows that he or she is as or more assertive (as measured by the questionnaire) than 76% of the candidates comprising the norm group.

3.1.3 Stanines

The most widely used measure of distribution of results for psychometric tests and questionnaires are stanines. They are derived from standard scores and have a mean of 5 and a standard deviation of 1,96. Stanines are a convenient way of dividing up a normal distribution into a nine point scale. The stanine scale is particularly useful in that it eliminates the over interpretation of small spurious differences in scores between candidates. We can show the way stanines reflect the distribution in the following way:

 

Stanine

Proportion of Sample

Interpretation

1

In the lowest 0-4% of the sample. Very low or very poor.

2

Better than 4-11% of the sample. Low or poor.

3

Better than 11-23% of the sample. Well below average.

4

Better than 23-40% of the sample. Below average.

5

In the middle 20% of the sample. Average.

6

Better than 60-77% of the sample. Above average.

7

Better than 77-89% of the sample. High or good

8

Better than 89-96% of the sample. Very high or very good

9

In the top 96-100% of the sample. Exceptional