WebQuality2014 WWW 2014
The 4th Joint WICOW/AIRWeb Workshop on Web Quality
Seoul, Korea. April 7, 2014


The Web and social media are growing both in size and complexity, as well as playing an increasing role in our lives. Finding relevant, timely and trustworthy content in a sea of seemingly irrelevant chatter remains a challenging research issue. On one hand, this workshop deals with the more blatant and malicious attempts that deteriorate web quality such as spam, plagiarism, or various forms of abuse and ways to prevent them or neutralize their impact on users' experience. On the other hand, it will also provide a venue for exchanging ideas on quantifying and modeling issues of content quality, credibility and author reputation.

The objective of the workshop is to provide the research communities working on web quality topics with a survey of current problems and potential solutions. It presents an opportunity for close interaction between researchers and practitioners who may be focused on isolated sub-areas. We also want to gather crucial feedback for the academic community from participants representing major industry players on how web content quality research can contribute to practice.

Themes and Topics

The main themes of the workshop are that of evaluating web information credibility, and identifying and combating qualitatively extreme content (and related behavior), such as spam. These themes encompass a large set of often-related topics and subtopics, as listed below.

Assessing the credibility of content and people on the web and social media.

    Uncovering distorted and biased content
  • Detecting disagreement and conflicting opinions
  • Detecting disputed or controversial claims
  • Uncovering distorted or biased, inaccurate or false information
  • Uncovering common misconceptions and false beliefs
  • Search models and applications for finding factually correct information on the Web
  • Comparing authorized vs. unauthorized information (e.g. news article vs. readers' comments)
  • Comparing and evaluating online reviews, product or service testimonials
    Measuring quality of web content
  • Information quality and credibility of web search results, on social media sites, of online mass-media and news, and on the Web in general
  • Estimation of information age, provenance, validity, coverage, and completeness or depth
  • Formation, change, and evolution of opinions
  • Sociological and psychological aspects of information credibility estimation
  • Users studies of information credibility evaluation
    Modeling author identity, trust, and reputation
  • Estimating authors' and publishers' reputation
  • Evaluating authors' qualifications and credentials
  • Transparent ranking/reputation systems
  • Author intent detection
  • Capturing personal traits and sentiment
  • Modeling author identity, authorship attribution, and writing style
  • Systems for managing author identity on the Web
  • Revealing hidden associations between authors, commenters, reviewers, etc.
    Role of groups and communities
  • Role of groups, communities, and invisible colleges in the formation of opinions on the Web
  • Social-network-based credibility evaluation
  • Analysis of information dissemination on the Web
  • Common cognitive or social biases in user behavior (e.g., herd behavior)
  • Credibility in collaborative environments (e.g., on Wikipedia)
    Multimedia content credibility
  • Detecting deceptive manipulation or distortion of images and multimedia
  • Hiding content in images
  • Detecting incorrect labels or captions of images on the Web
  • Detecting mismatches between online images and the represented real objects
  • Credibility of online maps

Fighting spam, abuse, and plagiarism on the Web and social media

    Reducing web spam
  • Detecting various types of search engine spam (e.g., link spam, content spam, or cloaking)
  • Uncovering social network spam (e.g., serial sharing and lobbying) and spam in online media (e.g., blog, forum, wiki spam, or tag spam)
  • Identifying review and rating spam
  • Characterizing trends in spamming techniques
    Reducing abuses of electronic messaging systems
  • Detecting e-mail spam
  • Detecting spit (spam over internet telephony) and spim (spam over instant messenger)
    Detecting abuses in internet advertising
  • Click fraud detection
  • Measuring information credibility in online advertising and monetization
    Uncovering plagiarism and multiple-identity issues
  • Detecting plagiarism in general, and in web communities, social networks, and cross-language environments in particular
  • Identifying near-duplicate and versioned content of all kinds (e.g., text, software, image, music, or video)
  • High-similarity retrieval technologies (e.g., fingerprinting and similarity hashing)
    Promoting cooperative behavior in social networks
  • Monitoring vandalism, trolling, and stalking
  • Detecting fake friendship requests with spam intentions
  • Creating incentives for good behavior in social networks
  • User studies of misuse of the Web
    Security issues with online communication
  • Detecting phishing and identity theft
  • Flagging malware (e.g., viruses and spyware)
  • Web forensics

Other adversarial issues

  • Modeling and anticipating responses of adversaries to counter-measures
  • New web infringements
  • Web content filtering
  • Bypassing censorship on the Web
  • Blocking online advertisements
  • Reverse engineering of ranking algorithms
  • Stealth crawling

Paper Submission

We invite two kinds of submissions: full (up to 6 pages) and short (up to 4 pages) papers. Submissions must be original and have not been submitted for publication elsewhere. They must:

  • be written in English;
  • contain author names, affiliations, and email addresses;
  • be formatted according to the ACM SIG Proceedings template (http://www.acm.org/sigs/publications/proceedings-templates) with a font size no smaller than 9pt;
  • be in PDF (make sure that the PDF can be viewed on any platform), and formatted for US Letter size;
  • occupy no more than six pages for full papers and four pages for short papers, including the abstract, references, and appendices.

Submissions should be sent via the submission website. All submited papers will be evaluated by at least three different reviewers. The accepted papers will be published in ACM Digital Library.

    Important Dates
  • Paper submission deadline: Jan 7, 2014 Jan 14, 2014 (23:59 Hawaii Standard Time)
  • Notification of acceptance: Feb 4, 2014
  • Camera ready copy deadline: Feb 12, 2014 (hard deadline)
  • Workshop date: April 7, 2014


[9:00 - 10:30] Text Content Quality Session:

  • "Learning Conflict Resolution Strategies for Cross-Language Wikipedia Data Fusion" [slides] [paper]
    Volha Bryl and Christian Bizer
  • "Incredible: Is (Almost) All Web Content Trustworthy? Analysis of psychological factors" [paper]
    Maria Rafalak, Katarzyna Abramczuk and Adam Wierzbicki
  • "Predicting Webpage Credibility using Linguistic Features" [paper]
    Aleksander Wawer, Radoslaw Nielek and Adam Wierzbicki

[10:30 - 11:00] ** Coffee Break **

[11:00 - 12:30] Keynote Talk:

  • Title: "The Web Science of Web Quality"
    Speaker: Wendy Hall (University of Southampton)

[12:30 - 14:00] ** Lunch Break **

[14:00 - 15:00} Multimedia Content Quality Session:

  • "Identifying Fraudulently Promoted Online Videos" [slides] [paper]
    Vlad Bulakh, Minaxi Gupta and Christopher Dunn
  • "Quality Evaluation of Social Tags according to Web Resource Types" [slides] [paper]
    Lei Li and Chengzhi Zhang

Keynote Talk

Title: "The Web Science of Web Quality"

Speaker: Wendy Hall (University of Southampton)

Short bio: Wendy Hall, DBE, FRS, FREng is Professor of Computer Science at the University of Southampton, UK, and is Dean of the Faculty of Physical Science and Engineering. She was Head of the School of Electronics and Computer Science (ECS) from 2002 to 2007. One of the first computer scientists to undertake serious research in multimedia and hypermedia, she has been at its forefront ever since. The influence of her work has been significant in many areas including digital libraries, the development of the Semantic Web, and the emerging research discipline of Web Science. Her current research includes applications of the Semantic Web and exploring the interface between the life sciences and the physical sciences. She is Managing Director of the Web Science Trust In addition to playing a prominent role in the development of her subject, she also helps shape science and engineering policy and education. Through her leadership roles on national and international bodies, she has shattered many glass ceilings, readily deploying her position on numerous national and international bodies to promote the role of women in SET, and acting as an important role model for others. She became a Dame Commander of the British Empire in the 2009 UK New Year's Honours list, and was elected a Fellow of the Royal Society in June 2009. She was elected President of the Association for Computing Machinery (ACM) in July 2008, and was the first person from outside North America to hold this position. Until July 2008, she was Senior Vice President of the Royal Academy of Engineering, was a member of the UK Prime Minister's Council for Science and Technology, and was a founder member of the Scientific Council of the European Research Council. She was President of the British Computer Society (2003-4) and an EPSRC Senior Research Fellow from 1996 to 2002.


Adam Jatowt (Kyoto University)
Carlos Castillo (Qatar Computing Research Institute)
James Caverlee (Texas A&M University)
Katsumi Tanaka (Kyoto University)

PC Members: (to be extended)
Ching-man Au Yeung (Huawei Noah's Ark Lab)
Andras Benczur (Hungarian Academy of Sciences)
Brian Davison (Lehigh University)
Andrew Flanagin (University of California, Santa Barbara)
Zoltan Gyongyi (Google Research)
Kyumin Lee (Utah State University)
Pranam Kolari (Walmart Labs)
Miriam Metzger (University of California, Santa Barbara)
Meenali Rungta (Google)
Shazia Sadiq (University of Queensland)
David Siklosi (Hungarian Academy of Sciences)
Mozhgan Tavakolifard (Norwegian University of Science and Technology)
De Wang (Georgia Institute of Technology)
Steve Webb (Georgia Institute of Technology)


Emailadam [at] dl [dot] kuis [dot] kyoto-u [dot] ac [dot] jp