Panagiotis G. Ipeirotis

Panagiotis  G. Ipeirotis

Joined Stern 2004

Leonard N. Stern School of Business
Kaufman Management Center
44 West Fourth Street, 8-84
New York, NY 10012

Personal website
Personal blog
Follow on Twitter

View/Download C.V.


Panos Ipeirotis is a Professor and George A. Kellner Faculty Fellow at the Department of Technology, Operations, and Statistics at the Leonard N. Stern School of Business of New York University. His research focuses in the areas of crowdsourcing, machine learning, web data management, and social media analytics. He is widely regarded as the world's leading expert in building human-machine loop systems, that integrate human and machine intelligence to generate outcomes that are better than what humans alone or machines alone can achieve. He has also received more than ten “Best Paper” awards and nominations, and a CAREER award from the National Science Foundation. For his contributions in the field of social media, user-generated content, and crowdsourcing, he received the 2015 Lagrange Prize in Complex Systems.

Research Interests

  • Crowdsourcing
  • Data quality
  • Data Science
  • Economics and Text, Web and Data Mining

Courses Taught

  • Dealing with Data
  • Information Systems Technical Research Seminar
  • Information Technology in Business and Society
  • Introduction to Programming and Data Science
  • Projects in Programming and Data Science
  • Search and the New Economy

Academic Background

PhD, Computer Science, 2004
Columbia University

MSc, Computer Science, 2001
Columbia University

BSc, Computer Engineering & Informatics, 1999
University of Patras, Greece

Awards & Appointments

Lagrange Prize 2015
Best Paper Award for years 2011-2014, Management Science, ISS/INFORMS 2014
Best Paper Award, WWW 2011 2011
Best Paper Runner Up Award, KDD 2008 2008
Best Paper Award, SIGMOD 2006 2006

Selected Publications

J Wang, PG Ipeirotis, F Provost (2017)
Cost-Effective Quality Assurance in Crowd Labeling
Information Systems Research 28 (1), 137-158

J Attenberg, P Ipeirotis, F Provost (2015)
Beat the Machine: Challenging Humans to Find a Predictive Model’s “Unknown Unknowns”
ACM Journal on Data and Information Quality 6 (1), 2015

M Kokkodis, PG Ipeirotis (2015)
Reputation transferability in online labor markets
Management Science 62 (6), 1687-1706

PG Ipeirotis, E Gabrilovich (2014)
Quizz: targeted crowdsourcing with a billion (potential) users
Proceedings of the 23rd international conference on World wide web (WWW 2014)

A Ghose, P Ipeirotis, B Li (2012)
Designing ranking systems for hotels on travel search engines by mining user-generated and crowd-sourced content
Marketing Science 31 (3), 493-520

A Ghose, PG Ipeirotis (2011)
Estimating the helpfulness and economic impact of product reviews: Mining text and reviewer characteristics
IEEE Transactions on Knowledge and Data Engineering 23 (10), 1498-1512

G. Paolacci, J. Chandler, P. Ipeirotis (2010)
Running Experiments on Amazon Mechanical Turk
Judgment and Decision Making, Vol. 5, No. 5, August 2010

VS Sheng, F Provost, PG Ipeirotis (2008)
Get another label? Improving data quality and data mining using multiple, noisy labelers
Proceeding of the 14th ACM SIGKDD Conference (KDD 2008)

PG Ipeirotis, E Agichtein, P Jain, L Gravano (2007)
Towards a query optimizer for text-centric tasks
ACM Transactions on Database Systems (TODS) 32 (4), 21

N Archak, A Ghose, P Ipeirotis (2007)
Deriving the pricing power of product features by mining consumer reviews
Management Science 57 (8), 1485-1509

Areas of Expertise


  • Amazon
  • Google
  • Microsoft


  • Information Technology
  • Internet & Computers
  • Technology

Technology, Operations & Statistics

  • Artificial Intelligence
  • Database Management
  • E-commerce
  • Web Search