Science Explorer Back to mapMap
Discussion
Topic · Information Systems

Web Data Mining and Analysis

Web Data Mining and Analysis is a research topic within Information Systems. Science Explorer counts 30k research works in it since 1950. 10.0% of them reached the world's top 10% most cited for their field and year.

This cluster of papers focuses on techniques and technologies for extracting structured data from web pages, including web crawling, automatic wrapper generation, page segmentation, and mining data records. It also covers topics related to the hidden web, information retrieval, and content adaptation for different devices.

  • Web Data Extraction
  • Web Crawling
  • Information Retrieval
  • Structured Data
  • Automatic Wrapper Generation
  • Hidden Web
  • Page Segmentation
  • Data Records Mining
  • Deep Web
  • Content Adaptation
Research works
30k
fractional, since 1950
In the world top 10%
2.9k
per year above
Top-10% rate
10.0%
share of its works in the world top 10%
Growth, 2018-21 → 2022-25
-7%
the tick is no change
Largest producer
China
47% of the 10 largest, 2022-now
Web Data Mining and Analysis

Which countries lead Web Data Mining and Analysis research?

By volume, China and India publish the most (1.2k and 468 works in 2022-now).

By volume, 2022-now

  1. 1 China 1.2k works
  2. 2 India 468 works
  3. 3 United States 383 works
  4. 4 Germany 110 works
  5. 5 Japan 92 works
  6. 6 Indonesia 85 works
  7. 7 United Kingdom 72 works
  8. 8 Canada 63 works
  9. 9 France 59 works
  10. 10 Italy 55 works

How concentrated that is

The same countries as shares of everything the list above accounts for. A node where two countries do two thirds of the work and one spread evenly across twelve read alike as a ranking and not at all alike here.

China: 46.8%India: 17.9%United States: 14.7%Germany: 4.2%6 others listed: 16.3%47%largest
China1,223 · 46.8%India468 · 17.9%United States383 · 14.7%Germany110 · 4.2%6 others listed427 · 16.3%

Shares of the rows listed above, not of the whole node.

Which institutions lead Web Data Mining and Analysis research?

By volume in 2022-now, Chinese Academy of Sciences publishes the most Web Data Mining and Analysis research, followed by National University of Defense Technology and Centre National de la Recherche Scientifique.

By volume, 2022-now

  1. 1 Chinese Academy of SciencesChina 45 works
  2. 2 National University of Defense TechnologyChina 25 works
  3. 3 Centre National de la Recherche ScientifiqueFrance 16 works
  4. 4 Beijing University of Posts and TelecommunicationsChina 16 works
  5. 5 Peking UniversityChina 15 works
  6. 6 Amrita Vishwa VidyapeethamIndia 14 works
  7. 7 Tsinghua UniversityChina 14 works
  8. 8 Microsoft (United States)United States 13 works
  9. 9 State Grid Corporation of China (China)China 13 works
  10. 10 University of Chinese Academy of SciencesChina 12 works

Who are the leading researchers in Web Data Mining and Analysis?

The most-cited researchers publishing on Web Data Mining and Analysis include Xiangyu Zhang, Xiaogang Wang and Li Fei-Fei.

  1. 1 Xiangyu Zhang 327k citations
  2. 2 Xiaogang Wang China 260k citations
  3. 3 Li Fei-Fei United States 225k citations
  4. 4 Kai You Wang China 224k citations
  5. 5 Lei Jiang China 214k citations
  6. 6 Christopher D. Manning United States 179k citations

Ranked by citations received across their whole record, among researchers with at least three works on this topic.

What are the most cited papers in Web Data Mining and Analysis?

The most cited paper in Web Data Mining and Analysis is "The anatomy of a large-scale hypertextual Web search engine" (Sergey Brin, Lawrence M. Page, 1998), with 16,170 citations. Next come "Authoritative sources in a hyperlinked environment" (9,110) and "An algorithm for suffix stripping" (8,165).

Most cited papers
#PaperReleasedCitations
1 The anatomy of a large-scale hypertextual Web search engine Sergey Brin, Lawrence M. Page · Computer Networks and ISDN Systems Apr 1998 16,170
2 Authoritative sources in a hyperlinked environment Jon Kleinberg · Journal of the ACM Open access Sep 1999 9,110
3 An algorithm for suffix stripping Martin Porter · Data Technologies and Applications Mar 1980 8,165
4 Mining and summarizing customer reviews Minqing Hu, Bing Liu Conference paper 22 Aug 2004 7,770
5 Probabilistic topic models David M. Blei · Communications of the ACM 23 Mar 2012 5,645
All 99 most cited papers, with filters and sorting

Where is Web Data Mining and Analysis research done?

The largest centres of Web Data Mining and Analysis research in 2022-now are Beijing (China), Shanghai (China), Nanjing (China) and Wuhan (China). Among places with at least 20 works in it, it is an unusually large share of all research in Coimbatore.

Largest cities, 2022-now

  1. 1 BeijingChina 281 works
  2. 2 ShanghaiChina 69 works
  3. 3 NanjingChina 62 works
  4. 4 WuhanChina 61 works
  5. 5 HangzhouChina 44 works
  6. 6 GuangzhouChina 42 works
  7. 7 Xi'anChina 39 works
  8. 8 ChangshaChina 39 works
  9. 9 ChengduChina 39 works
  10. 10 TokyoJapan 37 works

Where it is the local speciality

  1. CoimbatoreIN · 26.1 works4.3×
← less than its size predicts1×more →

Location quotient: how much more of its research is in Web Data Mining and Analysis than the world average.

See Web Data Mining and Analysis on the map

Where is the best place to study Web Data Mining and Analysis?

Among universities, judged by research, Peking University, Zhejiang University and University of Illinois Urbana-Champaign score highest, combining excellence, specialisation, size, growth and international reach. Research strength is one signal when choosing where to study; it does not measure teaching.

0%20%40%mean 19.03%fractional works in this field (log) →share of work in the world top 10% →Zhejiang UniversityPeking UniversityAmrita Vishwa Vidyap…University of Illino…
above the meannear itbelow it

One dot per university in the first ten of the table below, at the default weights. The upper left is the interesting corner: small places doing unusually strong work.

Excellenceshare of its work in the world top 10%, 2022-now and all time averaged
40%
Specialisationhow much of its work is in this field, counted up to 10× the world share
10%
Sizeits output in this field, on a log scale
30%
Growthoutput growth, counted from -20% to +20%
10%
Internationalshare of its work with a co-author abroad
10%
Each slider sets a weight; the share it gets of the score is beside it.
#UniversityScoreTop 10%SpecialisationWorksGrowth
1Peking UniversityChina 59.825.1%2.4×15 +2.9%
2Zhejiang UniversityChina 59.033.2%1.3×11 +11.5%
3University of Illinois Urbana-ChampaignUnited States 58.414.8%3.5×9 +16.4%
4Amrita Vishwa VidyapeethamIndia 57.516.6%8.7×14 +12.1%
5Renmin University of ChinaChina 56.919.8%11.2×11 +108.7%
6National University of Defense TechnologyChina 56.17.5%10.4×25 +24.6%
7Tsinghua UniversityChina 55.027.4%1.9×14 -28.8%
8Nanyang Technological UniversitySingapore 53.418.5%3.3×8 +71.7%
9Hunan University of Science and TechnologyChina 52.611.5%21.7×10 +69.1%
10Southeast UniversityChina 50.415.9%2.5×11 +70.5%

Universities only. The score blends excellence (40%), size (30%), specialisation (10%), growth (10%), international reach (10%), 2022-now; growth compares 2018-21 with 2022-25 and counts up to +20%, since a jump from a small base is mostly noise.

Every institution in Web Data Mining and Analysis, country by country

Is Web Data Mining and Analysis research growing?

Output in 2022-2025 was 7% lower than in 2018-2021, peaking in 2011.

still counting19801990200020102020
grewheldshrank

The same series as a ribbon: one cell per year, darker for more. The line above answers how much; this answers when.

Its share of all research

Growing output can still be a shrinking share: all of science grows. This is Web Data Mining and Analysis as a percentage of every work published that year, 0.019% in 2024.

still counting0.025%0.050%0.075%Web Data Mining and Analysis0.016% in 202519801990200020102020

Fractional works of Web Data Mining and Analysis over all fractional works that year. How the balance of science has shifted.

How much of it reaches the world top 10%

Year by year.

still counting5%10%15%Web Data Mining and Analysis9.9% in 2025200020102020

Of each year's works in it, the share that reached the world's 10% most cited for their field and year. A field is the world for its own topics, so there is no other line to hold it against.

Which topics inside it are moving

Growth and decline on one axis around a shared zero. Two lists side by side hide the thing that matters: whether the growth dwarfs the decline, or the other way round.

Discussion

Ask a question or share a note about Web Data Mining and Analysis. Posts are plain text and can be reported.