Attribute Agreement is a method of Measurement Systems Analysis applied to subjective classifications by people. Examples of subjective classifications include: telephone help line appraisal on a 1-5 rating scale; inspection of product as "pass" or "fail"; food and drink tasting results; hotel comfort rating.
These quality measures are subjective and several (human) assessors can be compared using Attribute Agreement Analysis. If assessors mostly agree, we can be confident that we have a useful measure. If assessors mostly disagree, the rating usefulness is limited. Attribute Agreement Analysis is used to assess the consistency of subjective classifications by examining the ratings within appraisers and between appraisers. If a standard is available (not always the case) then accuracy can also be assessed