Science Explorer Back to mapMap

Reliability and Agreement in Measurement

Reliability and Agreement in Measurement is a research topic within Statistics, Probability and Uncertainty. Science Explorer counts 6.3k research works in it since 1950. 10.4% of them reached the world's top 10% most cited for their field and year.

This cluster of papers focuses on the assessment and measurement of inter-rater reliability in scientific studies, particularly emphasizing the use of the kappa statistic and other agreement measures. It addresses methodological issues, statistical methods for reliability analysis, and the validity and reliability of data in various fields.

  • Inter-Rater Reliability
  • Kappa Statistic
  • Agreement Measures
  • Observer Agreement
  • Statistical Methods
  • Reliability Analysis
  • Interrater Agreement
  • Measurement of Agreement
  • Methodological Issues
  • Validity and Reliability
Research works
6.3k
fractional, since 1950
In the world top 10%
656
per year above
Top-10% rate
10.4%
share of its works in the world top 10%
Growth, 2018-21 → 2022-25
+12%
the tick is no change
Largest producer
United States
35% of the 10 largest, 2022-now
Reliability and Agreement in Measurement

Which countries lead Reliability and Agreement in Measurement research?

By volume, the United States and China publish the most (298 and 107 works in 2022-now).

By volume, 2022-now

  1. 1 United States 298 works
  2. 2 China 107 works
  3. 3 United Kingdom 77 works
  4. 4 Türkiye 57 works
  5. 5 Germany 57 works
  6. 6 India 56 works
  7. 7 Brazil 55 works
  8. 8 Canada 45 works
  9. 9 Spain 44 works
  10. 10 Italy 43 works

How concentrated that is

The same countries as shares of everything the list above accounts for. A node where two countries do two thirds of the work and one spread evenly across twelve read alike as a ranking and not at all alike here.

United States: 35.5%China: 12.8%United Kingdom: 9.2%Türkiye: 6.8%6 others listed: 35.7%35%largest
United States298 · 35.5%China107 · 12.8%United Kingdom77 · 9.2%Türkiye57 · 6.8%6 others listed300 · 35.7%

Shares of the rows listed above, not of the whole node.

Which institutions lead Reliability and Agreement in Measurement research?

By volume in 2022-now, University of North Carolina at Chapel Hill publishes the most Reliability and Agreement in Measurement research, followed by Harvard University and Mayo Clinic.

Who are the leading researchers in Reliability and Agreement in Measurement?

The most-cited researchers publishing on Reliability and Agreement in Measurement include David Moher, Douglas G. Altman and George Davey Smith.

  1. 1 David Moher Canada 898k citations
  2. 2 Douglas G. Altman United Kingdom 862k citations
  3. 3 George Davey Smith United Kingdom 435k citations
  4. 4 Julian P. T. Higgins United Kingdom 390k citations
  5. 5 Hermann Brenner Germany 343k citations
  6. 6 Cyrus Cooper United Kingdom 342k citations
  7. 7 Matthias Egger Switzerland 326k citations
  8. 8 John P. A. Ioannidis United States 317k citations
  9. 9 Gordon Henry Guyatt Canada 315k citations
  10. 10 Elie A. Akl Canada 313k citations

Ranked by citations received across their whole record, among researchers with at least three works on this topic.

What are the most cited papers in Reliability and Agreement in Measurement?

The most cited paper in Reliability and Agreement in Measurement is "STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT" (J Martin Bland, DouglasG. Altman, 1986), with 48,188 citations. Next come "A Coefficient of Agreement for Nominal Scales" (42,415) and "A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research" (29,409).

Most cited papers
#PaperReleasedCitations
1 STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT J Martin Bland, DouglasG. Altman · The Lancet Feb 1986 48,188
2 A Coefficient of Agreement for Nominal Scales Jacob Cohen · Educational and Psychological Measurement Apr 1960 42,415
3 A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research Terry K. K. Koo, Mae Y. Li · Journal of Chiropractic Medicine Open access Apr 2016 29,409
4 The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for Reporting Observational Studies Erik B von Elm, Douglas G. Altman, Matthias Egger et al. · PLoS Medicine Open access 10 Oct 2007 22,347
5 Meta-analysis of Observational Studies in Epidemiology A Proposal for Reporting Donna Fox Stroup · JAMA Review 19 Apr 2000 20,943
All 92 most cited papers, with filters and sorting

Where is Reliability and Agreement in Measurement research done?

The largest centres of Reliability and Agreement in Measurement research in 2022-now are London (United Kingdom), New York (United States), Tokyo (Japan) and Beijing (China).

Largest cities, 2022-now

  1. 1 LondonUnited Kingdom 23 works
  2. 2 New YorkUnited States 15 works
  3. 3 TokyoJapan 14 works
  4. 4 BeijingChina 12 works
  5. 5 SeoulSouth Korea 12 works
  6. 6 MadridSpain 12 works
  7. 7 IstanbulTürkiye 11 works
  8. 8 BostonUnited States 11 works
  9. 9 AmsterdamNetherlands 11 works
  10. 10 São PauloBrazil 10 works
See Reliability and Agreement in Measurement on the map

Where is the best place to study Reliability and Agreement in Measurement?

Among universities, judged by research, University of North Carolina at Chapel Hill score highest, combining excellence, specialisation, size, growth and international reach. Research strength is one signal when choosing where to study; it does not measure teaching.

Excellenceshare of its work in the world top 10%, 2022-now and all time averaged
40%
Specialisationhow much of its work is in this field, counted up to 10× the world share
10%
Sizeits output in this field, on a log scale
30%
Growthoutput growth, counted from -20% to +20%
10%
Internationalshare of its work with a co-author abroad
10%
Each slider sets a weight; the share it gets of the score is beside it.
#UniversityScoreTop 10%SpecialisationWorksGrowth
1University of North Carolina at Chapel HillUnited States 9.23.0%4.7×10 +16.6%

Universities only. The score blends excellence (40%), size (30%), specialisation (10%), growth (10%), international reach (10%), 2022-now; growth compares 2018-21 with 2022-25 and counts up to +20%, since a jump from a small base is mostly noise.

Every institution in Reliability and Agreement in Measurement, country by country

Is Reliability and Agreement in Measurement research growing?

Output in 2022-2025 was 12% higher than in 2018-2021, peaking in 2026. The fastest-growing topics are Reliability and Agreement in Measurement.

still counting19801990200020102020
grewheldshrank

The same series as a ribbon: one cell per year, darker for more. The line above answers how much; this answers when.

Its share of all research

Growing output can still be a shrinking share: all of science grows. This is Reliability and Agreement in Measurement as a percentage of every work published that year, 0.0042% in 2024.

still counting0.0050%0.010%Reliability and Agreement in Measurement0.0056% in 202519801990200020102020

Fractional works of Reliability and Agreement in Measurement over all fractional works that year. How the balance of science has shifted.

How much of it reaches the world top 10%

Year by year.

still counting5%10%15%Reliability and Agreement in Measurement10.8% in 2025200020102020

Of each year's works in it, the share that reached the world's 10% most cited for their field and year. A field is the world for its own topics, so there is no other line to hold it against.

Which topics inside it are moving

Growth and decline on one axis around a shared zero. Two lists side by side hide the thing that matters: whether the growth dwarfs the decline, or the other way round.

Discussion

Ask a question or share a note about Reliability and Agreement in Measurement. Posts are plain text and can be reported.