How should annoyance responses from individuals receiving a similar aircraft noise exposure be combined, in order to measure 'community annoyance'? Schultz's metric, the percentage of people who express 'High annoyance', is widely used. Estimates of average annoyance, which take into account all the surveyed responses, can be constructed either from Category Ratings (using differences) or from Magnitude Estimates (via ratios). An illustrative measurement theory-based analysis of empirical data gives an example where the Schultz metric and Magnitude Estimates show a better agreement than Category Ratings. If Magnitude Estimates were to be well-established, then this would enable proper statistical comparisons between studies using ANAS and ICBEN scales.