Panagiotis G. Ipeirotis
Associate Professor of Information, Operations, and Management Sciences, Stern School of Business, New York University

Information Systems Group
Department of Information, Operations,
and Management Sciences
Leonard N. Stern School of Business
New York University
44 West 4th Street, Suite 8-84
New York, NY 10012-1126, USA
Phone: +1 (212) 998-0803
Fax: +1 (212) 995-4228

Short Bio

Panos Ipeirotis is an Associate Professor and George A. Kellner Faculty Fellow at the Department of Information, Operations, and Management Sciences at Leonard N. Stern School of Business of New York University. His recent research interests focus on crowdsourcing and on mining user-generated content on the Internet. He received his Ph.D. degree in Computer Science from Columbia University in 2004. He has received four “Best Paper” awards (IEEE ICDE 2005, ACM SIGMOD 2006, WWW 2011, ICIS 2012), two “Best Paper Runner Up” awards (JCDL 2002, ACM KDD 2008), and is also a recipient of a CAREER award from the National Science Foundation and of several other grants.

Education

Professional Employment

Teaching Experience

Awards and Grants

Publications, Papers, Demos etc

Working papers

  1. Jun 2013
    Unrefereed

    Quality-Based Pricing for Crowdsourced Workers Jing Wang, Panagiotis G. Ipeirotis, and Foster Provost NYU-CBA Working Paper CBA-13-06

  2. Dec 2010
    Unrefereed

    Modeling Dependency in Prediction Markets Nikolay Archak and Panagiotis G. Ipeirotis NYU Center for Digital Economy Research Working Paper No. CEDER-10-05

  3. Mar 2010
    Unrefereed

    Demographics of Mechanical Turk Panagiotis G. Ipeirotis NYU Center for Digital Economy Research Working Paper CeDER-10-01

  4. Mar 2009
    Unrefereed

    The Dimensions of Reputation in Electronic Markets Anindya Ghose, Panagiotis G. Ipeirotis, and Arun Sundararajan NYU Center for Digital Economy Research Working Paper No. CeDER-06-02

Journals

  1. Mar 2014
    Refereed

    Examining the Impact of Ranking on Consumer Behavior and Search Engine Revenue Anindya Ghose, Panagiotis G. Ipeirotis, and Beibei Li Management Science

  2. Mar 2014
    Refereed

    Repeated Labeling Using Multiple Noisy Labelers Panagiotis G. Ipeirotis, Foster Provost, Victor S. Sheng, and Jing Wang Data Mining and Knowledge Discovery, March 2014, Volume 28, Issue 2, pp 402-441

  3. Feb 2014
    Refereed

    Facilitating Document Annotation using Content and Querying Value Eduardo J. Ruiz, Vagelis Hristidis, and Panagiotis G. Ipeirotis IEEE Transactions on Knowledge and Data Engineering (TKDE)

  4. May 2012
    Refereed

    Designing Ranking Systems for Hotels on Travel Search Engines by Mining User-Generated and Crowd-Sourced Content Anindya Ghose, Panagiotis G. Ipeirotis, and Beibei Li Marketing Science, Vol. 31, No. 3, May/June 2012

  5. Feb 2012
    Refereed

    Answering General Time-Sensitive Queries Wisam Dakka, Luis Gravano, and Panagiotis G. Ipeirotis IEEE Transactions on Knowledge and Data Engineering (TKDE), Vol. 24, No. 2, February 2012

  6. Oct 2011
    Refereed

    Relevance-Based Retrieval on Hidden-Web Text Databases without Ranking Support Vagelis Hristidis, Yuheng Hu, and Panagiotis G. Ipeirotis IEEE Transactions on Knowledge and Data Engineering (TKDE), Vol. 23, No. 10, October 2011

  7. Oct 2011
    Refereed

    Estimating the Helpfulness and Economic Impact of Product Reviews: Mining Text and Reviewer Characteristics Anindya Ghose and Panagiotis G. Ipeirotis IEEE Transactions on Knowledge and Data Engineering (TKDE), Vol. 23, No. 10, October 2011

  8. Aug 2011
    Refereed

    Deriving the Pricing Power of Product Features by Mining Consumer Reviews Nikolay Archak, Anindya Ghose, and Panagiotis G. Ipeirotis Management Science, Vol. 57, No 8, August 2011

  9. Dec 2010
    Refereed

    Analyzing the Amazon Mechanical Turk Marketplace Panagiotis G. Ipeirotis ACM XRDS (Crossroads), Vol. 17, No 2, Winter 2010

  10. Aug 2010
    Refereed

    Running Experiments on Amazon Mechanical Turk Gabriele Paolacci, Jesse Chandler, and Panagiotis G. Ipeirotis Judgment and Decision Making, Vol. 5, No. 5, August 2010

  11. Apr 2009
    Refereed

    A Quality-Aware Optimizer for Information Extraction Alpa Jain and Panagiotis G. Ipeirotis ACM Transactions on Database Systems (TODS), Vol. 34, No. 1, April 2009

  12. Mar 2009
    Refereed

    The EconoMining Project at NYU: Studying the Economic Value of User-Generated Content on the Internet Anindya Ghose and Panagiotis G. Ipeirotis Journal of Revenue and Pricing Management, Vol. 8, No 2-3, March 2009

  13. Dec 2008
    Invited

    Building Query Optimizers for Information Extraction: The SQoUT Project Alpa Jain, Panagiotis G. Ipeirotis, and Luis Gravano SIGMOD Record, Special Issue on "Managing Information Extraction," Vol. 37, No. 4, December 2008

  14. Mar 2008
    Invited

    Classification-Aware Hidden-Web Text Database Selection Panagiotis G. Ipeirotis and Luis Gravano ACM Transactions on Information Systems (TOIS), Vol. 26, No. 2, March 2008

  15. Nov 2007
    Refereed

    Towards a Query Optimizer for Text-Centric Tasks Panagiotis G. Ipeirotis, Eugene Agichtein, Pranay Jain, and Luis Gravano ACM Transactions on Database Systems (TODS), Vol. 32, No. 4, November 2007

  16. Aug 2007
    Refereed

    Modeling and Managing Changes in Text Databases Panagiotis G. Ipeirotis, Alexandros Ntoulas, Junghoo Cho, and Luis Gravano ACM Transactions on Database Systems (TODS), Vol. 32, No. 3, August 2007

  17. Jan 2007
    Refereed

    Duplicate Record Detection: A Survey Ahmed K. Elmagarmid, Panagiotis G. Ipeirotis, and Vassilios S. Verykios IEEE Transactions on Knowledge and Data Engineering (TKDE), Vol. 19, No. 1, January 2007

  18. Jan 2003
    Refereed

    QProber: A System for Automatic Classification of Hidden-Web Databases Luis Gravano, Panagiotis G. Ipeirotis, and Mehran Sahami ACM Transactions on Information Systems (TOIS), Vol. 21, No. 1, January 2003

  19. Mar 2002
    Invited

    Query- vs. Crawling-Based Classification of Searchable Web Databases Luis Gravano, Panagiotis G. Ipeirotis, and Mehran Sahami IEEE Data Engineering Bulletin, Vol. 25, No. 1, March 2002

  20. Dec 2001
    Invited

    Using q-grams in a DBMS for Approximate String Processing Luis Gravano, Panagiotis G. Ipeirotis, Hosagrahar Visvesvaraya Jagadish, Nick Koudas, Shanmugauelayut Muthukrishnan, Lauri Pietarinen, and Divesh Srivastava IEEE Data Engineering Bulletin, Vol. 24, No. 4, December 2001

Conferences

  1. Jun 2014
    Refereed

    Efficient Filtering on Hidden Document Streams Eduardo Ruiz, Vagelis Hristidis, and Panagiotis G. Ipeirotis 8th International AAAI Conference on Weblogs and Social Media (ICWSM 2014) 64/279 = 23% accepted

  2. Jun 2014
    Unrefereed

    Composing and Analyzing Crowdsourcing Workflows Panagiotis G. Ipeirotis, Greg Little, and Thomas W. Malone Collective Intelligence 2014

  3. Apr 2014
    Refereed

    Quizz: Targeted Crowdsourcing with a Billion (Potential) Users Panos Ipeirotis and Evgeniy Gabrilovich 23rd International World Wide Web Conference (WWW 2014) 84/650=12.9% accepted

  4. Feb 2014
    Refereed

    Trust, but Verify: Predicting Contribution Quality for Knowledge Base Construction and Curation Chun How Tan, Eugene Agichtein, Evgeniy Gabrilovich, and Panos Ipeirotis Seventh ACM Conference on Web Search and Data Mining (WSDM 2014) 64/356 = 18% accepted

  5. Feb 2013
    Refereed

    Have you Done Anything Like That? Predicting Performance Using Inter-category Reputation Marios Kokkodis and Panagiotis G. Ipeirotis Sixth International Conference on Web Search and Data Mining (WSDM 2013) 73/387=19% accepted

  6. Dec 2012
    Refereed

    Bonus, Disclosure, and Choice: What Motivates the Creation of High-Quality Paid Reviews? Jing Wang, Anindya Ghose, and Panagiotis G., Ipeirotis Thirty Third International Conference on Information Systems (ICIS 2012)

  7. Dec 2012
    Refereed

    Search Less, Find More? Examining Limited Consumer Search with Social Media and Product Search Engines Anindya Ghose, Panagiotis G. Ipeirotis, and Beibei Li Thirty Third International Conference on Information Systems (ICIS 2012) Best Theme Paper Award

  8. Dec 2011
    Refereed

    Content and Context: Identifying the Impact of Qualitative Information on Consumer Choice Sinan Aral, Panagiotis G. Ipeirotis, and Sean Taylor Proceedings of the International Conference on Information Systems (ICIS), 2011

  9. Mar 2011
    Refereed

    Towards a Theory Model for Product Search Beibei Li, Anindya Ghose, and Panagiotis G. Ipeirotis Proceedings of the 20th International World-Wide Web Conference (WWW), 2011 81/658=12% accepted; Best Paper Award

  10. Mar 2010
    Refereed

    Ranked Queries Over Sources with Boolean Query Interfaces without Ranking Support Vagelis Hristidis, Yuheng Hu, and Panagiotis G. Ipeirotis Proceedings of the 25th IEEE International Conference on Data Engineering (ICDE), 2010 ~20% accepted

  11. Jan 2010
    Refereed

    Designing Ranking Systems for Hotels on Travel Search Engines to Enhance User Experience Anindya Ghose, Panagiotis G. Ipeirotis, and Beibei Li Proceedings of the International Conference on Information Systems (ICIS), 2010

  12. Jul 2009
    Refereed

    Modeling Volatility in Prediction Markets Nikolay Archak and Panagiotis G. Ipeirotis Proceedings for the 10th ACM Conference on Electronic Commerce (EC), 2009 40/158 = 25% accepted

  13. Mar 2009
    Refereed

    Join Optimization of Information Extraction Output: Quality Matters! Alpa Jain, Panagiotis G. Ipeirotis, An-Hai Doan, and Luis Gravano Proceedings of the 25th IEEE International Conference on Data Engineering (ICDE), 2009 93/554 = 16.7% accepted

  14. Feb 2009
    Refereed

    Query by Document Yin Yang, Nilesh Bansal, Wisam Dakka, Panagiotis G. Ipeirotis, Nick Koudas, and Dimitris Papadias Proceedings of the Second ACM International Conference on Web Search and Data Mining (WSDM), 2009 29/170 = 17% accepted

  15. Aug 2008
    Refereed

    Get Another Label? Improving Data Quality and Data Mining Using Multiple, Noisy Labelers Victor S. Sheng, Foster Provost, and Panagiotis G. Ipeirotis Proceedings of the Fourteenth ACM International Conference on Knowledge Discovery and Data Mining (KDD), 2008 50/~500 < 10% accepted; Best Paper Award Runner Up

  16. Apr 2008
    Refereed

    Automatic Extraction of Useful Facet Hierarchies from Text Databases Wisam Dakka and Panagiotis G. Ipeirotis Proceedings of the 24th IEEE International Conference on Data Engineering (ICDE), 2008 75/617 = 12.1% accepted

  17. Aug 2007
    Refereed

    Designing Novel Review Ranking Systems: Predicting Usefulness and Impact of Reviews Anindya Ghose and Panagiotis G. Ipeirotis Proceedings of the Ninth International Conference on Electronic Commerce (ICEC), 2007

  18. Aug 2007
    Refereed

    Show me the Money! Deriving the Pricing Power of Product Features by Mining Consumer Reviews Nikolay Archak, Anindya Ghose, and Panagiotis G. Ipeirotis Proceedings of the Thirteenth ACM International Conference on Knowledge Discovery and Data Mining (KDD), 2007 ~100/513 < 20% accepted

  19. Jun 2007
    Refereed

    Opinion Mining Using Econometrics: A Case Study on Reputation Systems Anindya Ghose, Panagiotis G. Ipeirotis, and Arun Sundararajan Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics (ACL), 2007 132/588 = 22% accepted

  20. Jun 2006
    Refereed

    To Search or to Crawl? Towards a Query Optimizer for Text-Centric Tasks Panagiotis G. Ipeirotis, Eugene Agichtein, Pranay Jain, and Luis Gravano Proceedings of the 2006 ACM International Conference on Management of Data (SIGMOD), 2006 58/446=13% accepted; Best Paper Award

  21. Oct 2005
    Refereed

    Automatic Construction of Multifaceted Browsing Interfaces Wisam Dakka, Panagiotis G. Ipeirotis, and Kenneth R. Wood Proceedings of the 2005 ACM International Conference on Information and Knowledge Management (CIKM), 2005 76/425 = 18% accepted

  22. Apr 2005
    Refereed

    Modeling and Managing Content Changes in Text Databases Panagiotis G. Ipeirotis, Alexandros Ntoulas, Junghoo Cho, and Luis Gravano Proceedings of the 21st IEEE International Conference on Data Engineering (ICDE), 2005 67/521 = 13% accepted; Best Paper Award

  23. Jun 2004
    Refereed

    When one Sample is not Enough: Improving Text Database Selection Using Shrinkage Panagiotis G. Ipeirotis and Luis Gravano Proceedings of the 2004 ACM International Conference on Management of Data (SIGMOD), 2004 69/431 = 16% accepted

  24. May 2003
    Refereed

    Text Joins in an RDBMS for Web Data Integration Luis Gravano, Panagiotis G. Ipeirotis, Nick Koudas, and Divesh Srivastava Proceedings of the 12th International World-Wide Web Conference (WWW), 2003 13% accepted, more than 600 submissions

  25. Mar 2003
    Refereed

    Text Joins for Data Cleansing and Integration in an RDBMS Luis Gravano, Panagiotis G. Ipeirotis, Nick Koudas, and Divesh Srivastava Proceedings of the 19th IEEE International Conference on Data Engineering (ICDE), 2003

  26. Aug 2002
    Refereed

    Distributed Search over the Hidden-Web: Hierarchical Database Sampling and Selection Panagiotis G. Ipeirotis and Luis Gravano Proceedings of the 28th International Conference on Very Large Databases (VLDB), 2002 69/432 = 16% accepted

  27. Jul 2002
    Refereed

    Extending SDARTS: Extracting Metadata from Web Databases and Interfacing with the Open Archives Initiative Panagiotis G. Ipeirotis, Tom Barry, and Luis Gravano Proceedings of the Second ACM+IEEE Joint Conference on Digital Libraries (JCDL), 2002 33% accepted

  28. Sep 2001
    Refereed

    Approximate String Joins in a Database (Almost) for Free Luis Gravano, Panagiotis G. Ipeirotis, Hosagrahar Visvesvaraya Jagadish, Nick Koudas, Shanmugauelayut Muthukrishnan, and Divesh Srivastava Proceedings of the 27th International Conference on Very Large Databases (VLDB), 2001 59/339 = 17% accepted

  29. Jun 2001
    Refereed

    SDLIP + STARTS = SDARTS. A Protocol and Toolkit for Metasearching Noah Green, Panagiotis G. Ipeirotis, and Luis Gravano Proceedings of the First ACM+IEEE Joint Conference on Digital Libraries (JCDL), 2001

  30. May 2001
    Refereed

    Probe, Count, and Classify: Categorizing Hidden-Web Databases Panagiotis G. Ipeirotis, Luis Gravano, and Mehran Sahami Proceedings of the 2001 ACM International Conference on Management of Data (SIGMOD), 2001 15% accepted

Workshops

  1. Dec 2011
    Refereed

    Examining the Impact of Search Engine Ranking and Personalization on Consumer Behavior: Combining Bayesian Modeling with Randomized Field Experiments Anindya Ghose, Panagiotis G. Ipeirotis, and Beibei Li Proceedings of the Workshop on Information Systems and Economics (WISE), 2011

  2. Aug 2011
    Refereed

    What’s the Right Price? Pricing Tasks for Finishing on Time Siamak Faridani, Björn Hartmann, and Panagiotis G. Ipeirotis Proceedings of the 3rd Human Computation Workshop (HCOMP), 2011 16/52=30% accepted

  3. Aug 2011
    Refereed

    Beat the Machine: Challenging Workers to Find the Unknown Unknowns Josh Attenberg, Panagiotis G. Ipeirotis, and Foster Provost Proceedings of the 3rd Human Computation Workshop (HCOMP), 2011 16/52=30% accepted

  4. May 2011
    Refereed

    The Need for Standardization in Crowdsourcing Panagiotis G. Ipeirotis and John J. Horton Proceedings of the Workshop on Crowdsourcing and Human Computation at CHI, 2011

  5. Mar 2011
    Refereed

    A Demo Search Engine for Products Beibei Li, Anindya Ghose, and Panagiotis G. Ipeirotis Proceedings of the 20th International World-Wide Web Conference (WWW), 2011

  6. Feb 2011
    Refereed

    Estimating the Completion Time of Crowdsourced Tasks Using Survival Analysis Models Jing Wang, Siamak Faridani, and Panagiotis G. Ipeirotis Proceedings of the Workshop on Crowdsourcing for Search and Data Mining (WSDM11-CSDM), 2011

  7. Jan 2011
    Unrefereed

    Managing Crowdsourcing Workers Jing Wang, Panagiotis G. Ipeirotis, and Foster Provost Winter Conference on Business Intelligence, 2011

  8. Jul 2010
    Refereed

    Quality Management on Amazon Mechanical Turk Panagiotis G. Ipeirotis, Foster Provost, and Jing Wang Proceedings of the Second Human Computation Workshop (HCOMP), 2010

  9. Sep 2009
    Refereed

    Cramer’s Rule: How Information Content Moves Markets Sinan Aral, Panagiotis G. Ipeirotis, and Sean J. Taylor Proceedings of the 20th Workshop on Information Systems and Economics (WISE), 2009

  10. Sep 2009
    Refereed

    The Economic Impact of User-Generated Content on the Internet: Combining Text Mining with Demand Estimation in the Hotel Industry Anindya Ghose, Panagiotis G. Ipeirotis, and Beibei Li Proceedings of the 20th Workshop on Information Systems and Economics (WISE), 2009

  11. Oct 2008
    Refereed

    Answering General Time Sensitive Queries Wisam Dakka, Luis Gravano, and Panagiotis G. Ipeirotis Proceedings of the 2008 ACM CIKM International Conference on Information and Knowledge Management (CIKM), 2008

  12. Jun 2008
    Refereed

    Stay Elsewhere? Improving Local Search for Hotels Using Econometric Modeling and Image Classification Beibei Li, Anindya Ghose, and Panagiotis G. Ipeirotis Proceedings of the Sixth International Workshop on the Web and Databases (WebDB), 2008 14/30 = 46% accepted

  13. Jan 2008
    Refereed

    Detecting Important Events Using Prediction Markets, Text Mining, and Volatility Modeling George Tziralis and Panagiotis G. Ipeirotis Proceedings of the Third Workshop on Prediction Markets, 2008

  14. Jan 2008
    Refereed

    The Impact of Information Disclosure on Stock Market Returns: The Sarbanes-Oxley Act and the Role of Media as an Information Intermediary Karthik Balakrishnan, Anindya Ghose, and Panagiotis G. Ipeirotis Proceedings of the Seventh Workshop on the Economics of Information Security (WEIS), 2008

  15. Apr 2007
    Refereed

    Faceted Browsing over Large Databases of Text-Annotated Objects Wisam Dakka, Panagiotis G. Ipeirotis, and Kenneth R. Wood Proceedings of the 23rd IEEE International Conference on Data Engineering, Demonstrations (ICDE), 2007 28/73 = 38% accepted

  16. Aug 2006
    Refereed

    Automatic Discovery of Useful Facet Terms Wisam Dakka, Rishabh Dayal, and Panagiotis G. Ipeirotis Proceedings of the ACM SIGIR 2006 Workshop on Faceted Search, 2006

  17. Jan 2006
    Refereed

    Designing Ranking Systems for Consumer Reviews: The Impact of Review Subjectivity on Product Sales and Review Quality Anindya Ghose and Panagiotis G. Ipeirotis Proceedings of the 2006 Workshop on Information Technology and Systems (WITS), 2006 36/105 = 35% accepted

  18. Aug 2005
    Refereed

    Reputation Premiums in Electronic Peer-to-Peer Markets: Analyzing Textual Feedback and Network Structure Anindya Ghose, Panagiotis G. Ipeirotis, and Arun Sundararajan Proceedings of the ACM SIGCOMM 2005 Third Workshop on Economics of Peer-to-Peer Systems, (P2PEcon), 2005

  19. Jun 2003
    Refereed

    Modeling Query-Based Access to Text Databases Eugene Agichtein, Panagiotis G. Ipeirotis, and Luis Gravano Proceedings of the Sixth ACM SIGMOD International Workshop on the Web and Databases (WebDB), 2003 25% accepted

  20. Jun 2001
    Refereed

    PERSIVAL Demo: Categorizing Hidden-Web Resources Panagiotis G. Ipeirotis, Luis Gravano, and Mehran Sahami Proceedings of the First ACM+IEEE Joint Conference on Digital Libraries (JCDL), 2001

  21. May 2000
    Refereed

    Automatic Classification of Text Databases through Query Probing Panagiotis G. Ipeirotis, Luis Gravano, and Mehran Sahami Proceedings of the Third International Workshop on the Web and Databases, (WebDB), 2000 29% accepted

Misc publications

  1. Mar 2011
    Invited Misc Presentation

    The Computer is the New Sewing Machine: Benefits and Perils of Crowdsourcing Praveen Paritosh, Panagiotis G. Ipeirotis, Matt Cooper, and Siddharth Suri Panel at the 20th International World-Wide Web Conference (WWW), 2011

  2. Mar 2011
    Refereed Misc Presentation

    Managing Crowdsourced Human Computation: A Tutorial Panagiotis G. Ipeirotis and Praveen K. Paritosh Tutorial at the 20th International World-Wide Web Conference (WWW), 2011

  3. Dec 2010
    Misc Presentation

    System, Method, Software Arrangement and Computer-Accessible Medium for Incorporating Qualitative and Quantitative Information into an Economic Model US Patent 7,848,979

  4. Mar 2010
    Refereed Misc Presentation

    Improving Product Search with Economic Theory Beibei Li, Panagiotis G. Ipeirotis, and Anindya Ghose Proceedings of the Workshops of 2010 IEEE 26th International Conference on Data Engineering (ICDE), 2010

  5. Jan 2009
    Invited Misc Presentation

    Searching Digital Libraries Panagiotis G. Ipeirotis Encyclopedia of Database Systems, Part 19, Springer, 2009

  6. Jan 2009
    Invited Misc Presentation

    Taxonomy Design for Faceted Search Wisam Dakka , Panagiotis G. Ipeirotis, and Giovanni Maria Sacco The Information Retrieval Series, Vol. 25, 175-213, Springer, 2009

  7. Jan 2004
    Unrefereed Misc Presentation

    Classifying and Searching Hidden-Web Text Databases Panagiotis G. Ipeirotis Ph.D. Dissertation, Columbia University (advisor: L. Gravano), September 2004

Service