Biography:Panos Ipeirotis

From HandWiki
Short description: American computer scientist


Panagiotis G. Ipeirotis
Παναγιώτης Ηπειρώτης
Born (1976-05-03) May 3, 1976 (age 50)[1]
Serres, Greece[2]
CitizenshipGreek, American
AwardsLagrange Prize (2015)[3]
ACM SIGKDD Test of Time Award (2020)[4]
Academic background
Alma materUniversity of Patras (BSc)
Columbia University (MSc, PhD)
ThesisClassifying and Searching Hidden-Web Text Databases (2004)
Doctoral advisorLuis Gravano
Academic work
DisciplineComputer science
InstitutionsNew York University Stern School of Business
Main interestsCrowdsourcing; human computation; Data quality; Text mining
Websitewww.stern.nyu.edu/faculty/bio/panagiotis-ipeirotis

Panagiotis G. Ipeirotis (also known as Panos Ipeirotis; born May 3, 1976, in Serres, Greece) is a Greek-American computer scientist and the Merchants' Council Professor of Technology and Business at the New York University Stern School of Business.[5][6] His research focuses on data mining, crowdsourcing, human computation, and the economics of online information systems.[7]

Ipeirotis received the Lagrange Prize in Complex Systems (2015)[3] and the ACM SIGKDD Test of Time Award (2020).[4] His research on Amazon Mechanical Turk underpinned the Pew Research Center's 2016 methodology for estimating the platform's size and has informed reporting on crowdsourced labor in outlets including The New York Times and The Economist.[8][9][10]

In addition to his academic career, Ipeirotis co-founded the AI consulting firm Detectica in 2015, which was acquired by Compass, Inc. in 2019.[11] He has also held research positions at Google (2013–2014) and at Meta's Reality Labs division (2024–2025).[5]

Early life

Ipeirotis was born on May 3, 1976, in Serres, Greece.[2] In 1994, he won a Gold Medal at the 8th National Greek Competition in Chemistry.[12] Later that year, he represented Greece at the 26th International Chemistry Olympiad in Oslo, Norway.[13]

Education

Ipeirotis earned his Diploma in Computer Engineering and Informatics (CEID) from the University of Patras in 1999.[5] He pursued graduate studies at Columbia University under the supervision of Luis Gravano, receiving his M.Sc. in 2001, M.Phil. in 2003, and Ph.D. in Computer Science in 2004.[5]

Academic career

Ipeirotis began his academic career as a graduate research assistant at Columbia University (1999–2004). In 2004, he joined the Department of Information, Operations, and Management Sciences at the New York University Stern School of Business as an Assistant Professor. He was promoted to Associate Professor in 2010 and Full Professor in 2016. He holds a courtesy appointment at the Courant Institute of Mathematical Sciences[14] and is an associated faculty member at the NYU Center for Data Science.[15]

Ipeirotis has served as Program Co-Chair for the 13th ACM Conference on Electronic Commerce in 2012,[16] as Technical Program Co-Chair for The Web Conference 2018 (WWW 2018),[17] and as an Area Chair for the AAAI Conference on Artificial Intelligence in 2021 and 2023.[18][19] He co-organized the Human Computation Workshop series from its founding edition in 2009 (co-located with SIGKDD) through 2012,[20][21][22][23] and served as General Co-Chair of the AAAI Conference on Human Computation and Crowdsourcing (HCOMP) in 2015, after the series had grown into a stand-alone AAAI conference.[24] He has served on the editorial boards of Management Science, IEEE Transactions on Knowledge and Data Engineering, the INFORMS Journal on Computing, and the ACM Journal of Data and Information Quality,[25] and was a founding co-Editor-in-Chief of the journal Collective Intelligence, launched in 2022 as a collaboration between SAGE Publications, the Association for Computing Machinery, and Nesta.[26][27]

Ipeirotis has been the subject of media profiles in business and Greek-language outlets. Bloomberg Businessweek profiled him in 2011, describing his work on technology that combines human and machine intelligence,[28] and again in 2013, in a feature that called him the "data dude" of business analytics.[29] A 2014 Kathimerini interview discussed his career and conditions in Greek higher education.[30]

Academic lineage and doctoral students

Ipeirotis's doctoral advisor Luis Gravano was himself a student of Hector Garcia-Molina at Stanford. According to the Mathematics Genealogy Project, Ipeirotis has advised seven doctoral students at NYU and Columbia.[31]

His doctoral students include Beibei Li (now at Carnegie Mellon University's Heinz College) and Marios Kokkodis, both of whom subsequently received INFORMS Information Systems Society early-career awards — the Sandra A. Slaughter Early Career Award in 2019[32] and the Gordon B. Davis Young Scholar Award in 2020.[33] Former postdoctoral researcher Djellel Difallah is Assistant Professor at New York University Abu Dhabi.[34]

Research

Ipeirotis's research spans text mining, crowdsourcing, and the economics of online information systems. His work has been published in venues such as Management Science, Information Systems Research, and IEEE Transactions on Knowledge and Data Engineering.[5]

Text mining and web databases

Ipeirotis's doctoral research at Columbia University, supervised by Luis Gravano, addressed the problem of accessing text databases on the deep web — content behind search interfaces that conventional web crawlers cannot index. An early 2001 paper introduced a query-probing method for categorizing hidden-web databases by topic without retrieving any documents,[35] which the thesis later generalized into the QProber system using machine learning classifiers to derive the probing queries.[36] In parallel, Ipeirotis contributed to research on data integration: a 2001 paper at the International Conference on Very Large Data Bases (VLDB), co-authored with Gravano, H. V. Jagadish, Nick Koudas, S. Muthukrishnan, and Divesh Srivastava, showed how approximate string joins — matching slightly different versions of the same entity across databases — could be implemented entirely within standard relational database systems, without specialized indexes.[37]

Building on this foundation, Ipeirotis published two award-winning papers on modeling and querying text databases. A 2005 study applied survival analysis techniques to model how the content of 152 web databases changed over a 52-week period, winning the Best Paper Award at the 21st IEEE International Conference on Data Engineering.[38] His 2006 paper "To Search or to Crawl?" presented a cost-based framework for choosing between querying and crawling text databases when executing information extraction tasks, and won the Best Paper Award at ACM SIGMOD.[39] In 2007, Ipeirotis received a National Science Foundation CAREER Award for the project "Towards a Text-Centric Database Management System," which funded research on query optimization for information extraction and on the economic analysis of textual content.[40]

Ipeirotis's subsequent research extended in two directions: crowdsourcing quality management, addressing the challenge of obtaining reliable labeled data from non-expert workers; and a collaboration with Anindya Ghose that used economic signals such as prices and sales as implicit indicators of textual content quality, an approach they termed "EconoMining."[7]

Crowdsourcing and human computation

Ipeirotis's 2010 paper "Running Experiments on Amazon Mechanical Turk,"[41] co-authored with Gabriele Paolacci and Jesse Chandler, provided methodological guidance for using the platform — commonly abbreviated MTurk — in behavioral research.

A 2010 study by Ipeirotis estimated that approximately 40% of tasks posted by new requesters on MTurk involved spam or low-quality content, drawing media coverage.[42][43][44][45]

His 2010 demographic analysis of the MTurk workforce provided early data on worker motivations, geographic distribution, and income levels, and has been cited by researchers studying crowdsourcing platforms.[46][47] A follow-up study with former postdoctoral researcher Djellel Difallah and Elena Filatova, presented at the ACM International Conference on Web Search and Data Mining in 2018, tracked changes in the MTurk workforce over an eight-year period.[48] Media outlets have continued to draw on this body of work as concerns about the human labor underlying machine learning training data have grown, including coverage in Wired and The New York Times on automated responses on MTurk[49][50] and a 2026 Marketplace interview in which Ipeirotis discussed CAPTCHA completion and other routine online interactions as unrecognized AI-training-data labor.[51]

This line of work also led to the development of quality management techniques for crowdsourcing. The 2008 paper "Get Another Label?," co-authored with Foster Provost and Victor S. Sheng, addressed the problem that training machine learning classifiers on labels from non-expert workers degrades model accuracy when those labels are noisy. The paper studied whether repeated labeling of uncertain items could improve classifier performance under noisy labels, and proposed selective repeated-labeling strategies for crowdsourced annotation. It received the Best Paper Runner-Up Award at the 2008 ACM SIGKDD Conference on Knowledge Discovery and Data Mining[52] and the SIGKDD Test of Time Award in 2020.[4]

ProPublica drew on Ipeirotis's research and blog posts in publishing its "Guide to Mechanical Turk" for investigative reporters, citing his work on data quality through multiple worker verification.[53]

To support this research, Ipeirotis developed "MTurk Tracker," a set of tracking tools for the MTurk platform. The first tool tracked workforce demographics using capture-recapture techniques to estimate the size and composition of the workforce in near real-time. The second tool periodically downloaded all tasks posted on the platform, enabling analysis of the crowdsourcing marketplace's size and activity. The Pew Research Center's 2016 report "Research in the Crowdsourcing Age" drew on data from the task tracker, explicitly crediting "the online tool mturk-tracker, which is run by Dr. Panagiotis G. Ipeirotis."[8][54]

During a 2013–2014 sabbatical at Google, Ipeirotis worked on crowdsourcing methods for improving the Google Knowledge Graph. He co-developed "Quizz," a gamified system that presented data collection as trivia quizzes targeted by domain expertise, using calibration questions with known answers to assess user reliability in real-time.[55][56] In a related paper with Chun How Tan, Eugene Agichtein, and Evgeniy Gabrilovich, Ipeirotis examined methods for predicting contribution quality in knowledge-base construction and curation.[57]

Ipeirotis also applied crowdsourcing methods to building training data for computer vision systems. With Pietro Perona and Serge Belongie — co-recipients with Ipeirotis of a 2012 Google Focused Research Award — he co-authored a 2015 paper at the IEEE Conference on Computer Vision and Pattern Recognition describing the construction of a large-scale dataset for fine-grained bird species recognition using citizen-scientist labels.[58]

In a 2015 article in the ACM Journal on Data and Information Quality, co-authored with Josh Attenberg and Foster Provost, Ipeirotis introduced "Beat the Machine," a framework in which crowdworkers were rewarded for finding examples that a trained classifier predicted incorrectly. The approach was proposed as a method for surfacing the "unknown unknowns" — systematic blind spots — of machine learning models.[59]

Data quality and record linkage

Ipeirotis has published research on duplicate record detection and data quality. The 2007 survey "Duplicate Record Detection: A Survey," co-authored with Ahmed Elmagarmid and Vassilios Verykios, appeared in IEEE Transactions on Knowledge and Data Engineering and reviewed record linkage techniques across the database, statistics, and machine learning literatures.[60]

Online reputation and user-generated content

As part of the EconoMining project, Ipeirotis and Anindya Ghose quantified the pricing power derived from textual content in product reviews; the work was discussed in the Financial Times.[61][62] A related 2011 study found that the quality of spelling and grammar in product reviews affects perceived helpfulness and product sales.[63] The finding was discussed in Forbes, Harvard Business Review, and Slate.[64][65][66]

With Anindya Ghose and doctoral student Beibei Li, Ipeirotis developed text-mining and econometric methods for ranking products and hotels on online platforms. A 2011 paper introduced a theoretical model for product search that combined consumer review text with product characteristics to rank items by their predicted economic utility, receiving the Best Paper Award at the 20th International World Wide Web Conference.[67][68] A 2012 study in Marketing Science extended the framework to hotel ranking on travel search engines, combining mining of online reviews with crowdsourced ratings of hotel attributes.[69] A 2014 study in Management Science analyzed how the ordering of search results affects consumer click-through and platform revenue.[70]

Online labor markets

With doctoral student Marios Kokkodis, Ipeirotis studied reputation systems and hiring dynamics in online labor markets such as oDesk (now Upwork). A 2015 study at the ACM International Conference on Web Search and Data Mining modeled employer hiring decisions using features such as worker reputation, prior experience, and bid characteristics.[71] Their work on reputation transferability modeled how a freelancer's performance ratings in one task category can predict outcomes in another, analyzing over one million transactions; it was published in Management Science in 2016.[72] A subsequent study applied reinforcement learning to recommend career paths to freelancers based on dynamic market demand, finding that the framework could increase both marketplace revenue and worker wages.[73] They also developed recommender systems for matching job applicants to employers on freelancing platforms.[74]

Applied research and industry

Early industry work (2009–2014)

Beginning in 2009, Ipeirotis served as an early advisor to Integral Ad Science (originally AdSafe Media), contributing to the development of machine learning systems for detecting inappropriate web content and advertising fraud.[75] In 2011, working with AdSafe engineers, he identified a click fraud scheme that used hidden iframes to generate fraudulent ad impressions, which he termed "traffic laundering."[76] The investigation, which MIT Technology Review headlined as "A Web Scam That Makes $500,000 a Month," was also reported by The Wall Street Journal and led to an FBI referral.[77][76]

In 2011, Ipeirotis co-founded Tagasauris, a media annotation startup where he served as Chief Scientist until 2013.[29] The company combined crowdsourcing with semantic graph technology to tag photo archives. The system identified approximately two dozen previously unidentified photographs from the 1973 filming of "American Graffiti" in the Magnum Photos archive, by having crowdworkers tag individuals and using machine learning to link them via shared film appearances.[78][79]

He also served as Academic-in-Residence at Upwork (then oDesk) in 2012 and as a Visiting Scientist at Google from 2013 to 2014.[5]

Policy research and World Bank

In 2015, Ipeirotis collaborated with the World Bank on a report titled "The Global Opportunity in Online Outsourcing," which examined the potential of digital labor markets to provide employment pathways in developing nations.[80] Drawing on his empirical research from Mechanical Turk and oDesk, the report estimated the online outsourcing market would grow to $15–25 billion by 2020 and identified barriers preventing workers in the Global South from accessing these jobs, including lack of reliable internet infrastructure and the "reputation cold start" problem. The report has been cited in subsequent policy work by the RAND Corporation on online outsourcing as a youth-employment pathway in Indonesia.[81]

Detectica and Compass (2015–2022)

In 2015, Ipeirotis co-founded Detectica with Foster Provost and Josh Attenberg, offering AI strategy consulting and machine learning solutions for business applications.[82] The company developed AI-driven compliance monitoring systems for financial institutions.[82]

Detectica was acquired by Compass, Inc. in November 2019.[11] At Compass, the Detectica team developed "Likely to Sell," a predictive analytics system that identifies properties likely to enter the market; Compass discussed the system as a revenue contributor on its 2022 and 2023 earnings calls.[83][84]

Meta Reality Labs (2024–2025)

From 2024 to 2025, Ipeirotis was a visiting researcher at Meta's Reality Labs division, working on machine learning deployment for wearable devices.[5][85]

Public engagement and pedagogy

Since 2008, Ipeirotis has maintained the blog "A Computer Scientist in a Business School,"[86] which has served as the original venue for several posts that subsequently drew independent media coverage, including his 2011 commentary on academic integrity and his 2025 description of an AI-driven oral examination format.

Academic integrity debates

In July 2011, Ipeirotis published a post on his blog, titled "Why I will never pursue cheating again," describing his experience using Turnitin software to detect that about 20 percent of the students in his roughly 100-person "Information Technology in Business and Society" course had plagiarized.[86][87] The post criticized the administrative burden placed on faculty who enforce academic integrity policies and drew coverage in higher-education media, including Inside Higher Ed and The Chronicle of Higher Education.[87][88] Ipeirotis temporarily removed the post following concerns raised about whether quoted student communications could implicate the Family Educational Rights and Privacy Act (FERPA).[88]

Business Insider reported that Ipeirotis said his student evaluations declined after the plagiarism cases, contributing to a reduced annual raise;[89] NYU Stern vice dean Ingo Walter responded that faculty are not penalized for enforcing academic integrity and that student evaluations from such cases are excluded from review.[87] The incident prompted discussion about academic integrity enforcement, faculty incentives, and student privacy,[87][88] and was subsequently cited in Nature in a 2012 commentary on plagiarism detection in academia.[90]

Security vulnerability discovery

In April 2012, Ipeirotis discovered a vulnerability in Google Spreadsheets that he termed a "Denial of Money" attack. While running a crowdsourcing experiment that required image classification, he uploaded 25,000 image URLs (hosted on his Amazon S3 bucket) into a Google Spreadsheet. Google's Feedfetcher bot repeatedly re-downloaded all images from his S3 bucket every time the spreadsheet was processed, generating a high volume of outgoing bandwidth. Ipeirotis reported receiving an Amazon Web Services bill of $1,177.76—approximately ten times his normal monthly rate.[91]

Coverage of the incident described it as illustrating a potential attack vector: a malicious actor could create a Google Sheet with thousands of links to a victim's large files, causing Google's servers to repeatedly request the files and resulting in either financial damage or a denial of service. The discovery was covered in technology publications including Wired and The Economist.[92][91][93][94] Amazon subsequently forgave the charges, and Google investigated the behavior.[91]

AI-powered assessment

In December 2025, Ipeirotis developed an AI-driven oral examination system using ElevenLabs voice agents to address concerns about students submitting written assignments produced with generative AI tools. The system, which cost approximately $0.42 per student to administer, used a voice AI agent to call students and ask personalized questions about their submitted work.[95][96] An Associated Press feature in April 2026 reported on the approach as part of broader coverage of U.S. colleges adopting oral examinations in response to generative AI, quoting Ipeirotis on his rationale: "I don't trust written assignments anymore to be the result of actual thinking."[97]

Awards and honors

  • 2020: ACM SIGKDD Test of Time Award for Research (with Foster Provost and Victor S. Sheng). The Test of Time Award honors papers from approximately ten years prior that have had lasting impact on the field of knowledge discovery and data mining. The award recognized their 2008 paper "Get Another Label? Improving Data Quality and Data Mining Using Multiple, Noisy Labelers" "for their approach to selective acquisition of multiple labels."[4]
  • 2018: Named in a 2018 feature in the Greek newspaper Kathimerini as one of "45 under 45" Greek scientists — researchers born after 1974 whose publications, per the newspaper's accompanying methodology, ranked among the most-cited in their fields.[98][99]
  • 2015: Lagrange Prize in Complex Systems (shared with Jure Leskovec), awarded by the CRT Foundation and ISI Foundation. The prize citation recognized Ipeirotis's "pioneering work in the field of crowdsourcing and human computation" and research "[combining] economic, social psychology and automatic text analysis methods to quantify the economic value of the content generated by users on the Internet."[3][100]
  • 2014: Best Paper Award, Second AAAI Conference on Human Computation and Crowdsourcing (HCOMP), for "STEP: A Scalable Testing and Evaluation Platform".[101][102]
  • 2014: INFORMS Information Systems Society (ISS) Best Paper Award (Management Science), for "Deriving the Pricing Power of Product Features by Mining Consumer Reviews" (2011).[103]
  • 2012: Google Focused Research Award ($1.5 million), with Serge Belongie and Pietro Perona.[104]
  • 2011: Best Paper Award, 20th International World Wide Web Conference (WWW 2011), for "Towards a Theory Model for Product Search".[67]
  • 2008: Best Paper Runner-Up Award, 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2008), for "Get Another Label? Improving Data Quality and Data Mining Using Multiple, Noisy Labelers" (with Foster Provost and Victor S. Sheng).[52]
  • 2007: National Science Foundation CAREER Award, "Towards a Text-Centric Database Management System."[40]
  • 2006: Best Paper Award, ACM International Conference on Management of Data (SIGMOD 2006) — "To Search or to Crawl? Towards a Query Optimizer for Text-Centric Tasks".[39]
  • 2005: Best Paper Award, 21st IEEE International Conference on Data Engineering (ICDE 2005), for "Modeling and Managing Content Changes in Text Databases".[38]

Selected publications

  • Sheng, Victor S.; Provost, Foster; Ipeirotis, Panagiotis G. (2008). "Get another label? Improving data quality and data mining using multiple, noisy labelers". Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. doi:10.1145/1401890.1401965.  (KDD Test of Time Award, 2020)
  • Paolacci, Gabriele; Chandler, Jesse; Ipeirotis, Panagiotis G. (2010). "Running experiments on Amazon Mechanical Turk". Judgment and Decision Making 5 (5): 411–419. doi:10.1017/S1930297500002205. 
  • Ghose, Anindya; Ipeirotis, Panagiotis G. (2011). "Estimating the helpfulness and economic impact of product reviews: Mining text and reviewer characteristics". IEEE Transactions on Knowledge and Data Engineering 23 (10): 1498–1512. doi:10.1109/TKDE.2010.188. 
  • Archak, Nikolay; Ghose, Anindya; Ipeirotis, Panagiotis G. (2011). "Deriving the pricing power of product features by mining consumer reviews". Management Science 57 (8): 1485–1509. doi:10.1287/mnsc.1110.1370. 
  • Elmagarmid, Ahmed K.; Ipeirotis, Panagiotis G.; Verykios, Vassilios S. (2007). "Duplicate record detection: A survey". IEEE Transactions on Knowledge and Data Engineering 19 (1): 1–16. doi:10.1109/TKDE.2007.250581. 

References

  1. ↑ "Panagiotis G. Ipeirotis". https://orcid.org/0000-0002-2966-7402. 
  2. ↑ 2.0 2.1 "Πάνος Ηπειρώτης: Ο Σερραίος καθηγητής που διαπρέπει στη Νέα Υόρκη" (in el). Aveserres.gr. 2025-04-11. https://aveserres.gr/panos-ipeirotis-o-serraios-kathigitis-poy-diaprepei-sti-nea-yorki-scholiazei-tin-trechoysa-katastasi-stin-ameriki-kai-stis-chrimatagores/. 
  3. ↑ 3.0 3.1 3.2 "Press Release: Lagrange Prize 2015". 2015-10-06. http://www.isi.it/press-release-a-panos-ipeirotis-e-jure-leskovec-il-premio-lagrange-fondazione-crt-2015/. 
  4. ↑ 4.0 4.1 4.2 4.3 "2020 SIGKDD Test of Time Award Winners". https://kdd.org/awards/view/2020-sigkdd-test-of-time-award-winners. 
  5. ↑ 5.0 5.1 5.2 5.3 5.4 5.5 5.6 "NYU Stern - Panagiotis Ipeirotis - Merchants' Council Professor of Technology, Operations, and Statistics" (in en). https://www.stern.nyu.edu/faculty/bio/panagiotis-ipeirotis. 
  6. ↑ "TOPS | Full-time Faculty - NYU Stern". https://www.stern.nyu.edu/experience-stern/about/departments-centers-initiatives/academic-departments/tops/faculty-staff/full-time-faculty. 
  7. ↑ 7.0 7.1 Ghose, Anindya; Ipeirotis, Panagiotis (2009). "The EconoMining project at NYU: Studying the economic value of user-generated content on the internet". Journal of Revenue and Pricing Management 8 (2–3): 241–246. doi:10.1057/rpm.2008.56. 
  8. ↑ 8.0 8.1 "Methodology: Mechanical Turk". 2016-07-11. https://www.pewresearch.org/internet/2016/07/11/mechanical-turk-methodology/. 
  9. ↑ Segal, David (2011-05-22). "A Rave, a Pan, or Just a Fake?". The New York Times. https://www.nytimes.com/2011/05/22/your-money/22haggler.html. 
  10. ↑ "Turks of the World, Unite!". The Economist. 2011-05-24. https://www.economist.com/blogs/babbage/2011/05/repetitive_tasks. 
  11. ↑ 11.0 11.1 "Real-Estate Brokerage Compass Buys AI Startup Detectica". The Wall Street Journal. 2019-11-19. https://www.wsj.com/articles/real-estate-brokerage-compass-buys-ai-startup-detectica-11574159402. 
  12. ↑ "8η Ολυμπιάδα Χημείας" (in el). Χημικά Χρονικά (Chemical Chronicles) 56 (8): 233. 1994. http://jupiter.chem.uoa.gr/thanost/XX/XX_56_8_1994.pdf. Retrieved 2026-02-02. 
  13. ↑ "26th IChO 1994 Results". http://www.icho-official.org/results/results.php?id=26&year=1994. 
  14. ↑ "Faculty". https://cims.nyu.edu/dynamic/people/faculty/. 
  15. ↑ "Associated Faculty". https://cds.nyu.edu/associated-faculty/. 
  16. ↑ "13th ACM Conference on Electronic Commerce". https://www.sigecom.org/ec12/chairs.html. 
  17. ↑ "Research Tracks CFP – TheWebConf 2018". https://archives.iw3c2.org/www2018/call-for-papers/research-tracks-cfp/. 
  18. ↑ "AAAI-21 Area Chairs". https://aaai.org/conference/aaai/aaai-21/aaai-21-area-chairs/. 
  19. ↑ "AAAI-23 Area Chairs". https://aaai.org/conference/aaai/aaai-23/aaai-23-area-chairs/. 
  20. ↑ "Organizing Committee – First Human Computation Workshop (HComp 2009)". https://www.humancomputation.com/2009/Submit_a_Paper.html. 
  21. ↑ "Organizers – Second Human Computation Workshop (HComp 2010)". https://www.humancomputation.com/2010/org.html. 
  22. ↑ "Organizers – Third Human Computation Workshop (HCOMP 2011)". https://www.humancomputation.com/2011/About_the_Workshop.html. 
  23. ↑ "Organizers – Fourth Human Computation Workshop (HCOMP 2012)". https://www.humancomputation.com/2012/About_the_Workshop.html. 
  24. ↑ "HCOMP 2015: Organizers". https://www.humancomputation.com/2015/index.html. 
  25. ↑ "Long Biographical Note". https://ipeirotis.org/bio/. 
  26. ↑ "Editorial Board". SAGE Publications. https://journals.sagepub.com/editorial-board/CIN. 
  27. ↑ "SAGE, Association for Computing Machinery Announce Collective Intelligence, New Open Access Journal in Collaboration with Nesta". 2020-08-18. https://www.acm.org/media-center/2020/august/collective-intelligence-new-journal. 
  28. ↑ Weise, Karen (2011-11-10). "Humans Plus Computers Equals Better Crowdsourcing" (in en). Bloomberg Businessweek. http://www.businessweek.com:80/magazine/humans-plus-computers-equals-better-crowdsourcing-11102011.html. 
  29. ↑ 29.0 29.1 "The Data Dude: NYU Stern's Panos Ipeirotis". Bloomberg Businessweek. 2013-01-24. https://www.bloomberg.com/news/articles/2013-01-24/the-data-dude-nyu-stern-s-panos-ipeirotis. 
  30. ↑ "Παναγιώτης Ηπειρώτης: «Θαυμάζω όσους παράγουν έργο στα πανεπιστήμια με τις συνθήκες που επικρατούν»" (in el). Kathimerini. 2014-07-21. https://www.kathimerini.gr/opinion/interviews/777025/panagiotis-ipeirotis-thaymazo-osoys-paragoyn-ergo-sta-panepistimia-me-tis-synthikes-poy-epikratoyn/. 
  31. ↑ "Panagiotis Ipeirotis - Mathematics Genealogy Project". https://www.genealogy.math.ndsu.nodak.edu/id.php?id=85858. 
  32. ↑ "ISS Sandra A. Slaughter Early Career Award". https://www.informs.org/Recognizing-Excellence/Community-Prizes/Information-Systems-Society/ISS-Sandra-A.-Slaughter-Early-Career-Award. 
  33. ↑ "ISS Gordon B. Davis Young Scholar Award". https://www.informs.org/Recognizing-Excellence/Community-Prizes/Information-Systems-Society/ISS-Gordon-B.-Davis-Young-Scholar-Award. 
  34. ↑ "Djellel Difallah". https://nyuad.nyu.edu/en/academics/divisions/science/faculty/djellel-difallah.html. 
  35. ↑ Ipeirotis, Panagiotis G.; Gravano, Luis; Sahami, Mehran (2001). "Probe, count, and classify: categorizing hidden web databases". Proceedings of the 2001 ACM SIGMOD International Conference on Management of Data. ACM. pp. 67–78. doi:10.1145/375663.375671. 
  36. ↑ Gravano, Luis; Ipeirotis, Panagiotis G.; Sahami, Mehran (2003). "QProber: A System for Automatic Classification of Hidden-Web Databases". ACM Transactions on Information Systems 21 (1): 1–41. doi:10.1145/635484.635485. 
  37. ↑ Gravano, Luis; Ipeirotis, Panagiotis G.; Jagadish, H. V.; Koudas, Nick; Muthukrishnan, S.; Srivastava, Divesh (2001). "Approximate string joins in a database (almost) for free". Proceedings of the 27th International Conference on Very Large Data Bases. Morgan Kaufmann. pp. 491–500. 
  38. ↑ 38.0 38.1 "ICDE 2005 Best Paper Awards". https://web.archive.org/web/20050410134051/http://icde2005.is.tsukuba.ac.jp/best-papers.html. 
  39. ↑ 39.0 39.1 "SIGMOD Best Paper Award". https://sigmod.org/sigmod-awards/sigmod-best-paper-award/. 
  40. ↑ 40.0 40.1 "Award Search: Award #0643846 – CAREER: Towards a Text-Centric Database Management System". https://www.nsf.gov/awardsearch/show-award?AWD_ID=0643846. 
  41. ↑ Paolacci, Gabriele; Chandler, Jesse; Ipeirotis, Panagiotis G. (2010). "Running experiments on Amazon Mechanical Turk" (in en). Judgment and Decision Making 5 (5): 411–419. doi:10.1017/S1930297500002205. ISSN 1930-2975. https://www.cambridge.org/core/journals/judgment-and-decision-making/article/running-experiments-on-amazon-mechanical-turk/BBD787F3B4DDB61119CBB215927CA39E. 
  42. ↑ Walsh, Bryan (2011-01-31). "On Crowdsourcing: Pennies for Your Thoughts". TIME. http://content.time.com/time/magazine/article/0,9171,2043450,00.html. 
  43. ↑ Mims, Christopher. "How Mechanical Turk is Broken". MIT Technology Review. http://www.technologyreview.com:80/blog/mimssbits/26193/. 
  44. ↑ "40% Of Amazon's Mechanical Turk Is Spam" (in en-US). Business Insider. 2010-12-17. https://www.businessinsider.com/40-of-amazons-mechanical-turk-is-spam-2010-12. 
  45. ↑ Rosenwald, Michael S. (2011-01-30). "How you and Google are losing the battle against spam in search results" (in en-US). The Washington Post. ISSN 0190-8286. http://www.washingtonpost.com/wp-dyn/content/article/2011/01/28/AR2011012807515.html. 
  46. ↑ Ipeirotis, Panagiotis G. (2010). "Demographics of Mechanical Turk". NYU Stern School of Business. https://archive.nyu.edu/handle/2451/29585. 
  47. ↑ Fort, Karën; Adda, Gilles; Cohen, K. Bretonnel (2011). "Amazon Mechanical Turk: Gold Mine or Coal Mine?". Computational Linguistics (MIT Press) 37 (2): 413–420. doi:10.1162/COLI_a_00057. 
  48. ↑ Difallah, Djellel; Filatova, Elena; Ipeirotis, Panos (2018). "Demographics and Dynamics of Mechanical Turk Workers". Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining. ACM. pp. 135–143. doi:10.1145/3159652.3159661. 
  49. ↑ Dreyfuss, Emily (2018-08-17). "A Bot Panic Hits Amazon Mechanical Turk". Wired. https://www.wired.com/story/amazon-mechanical-turk-bot-panic/. 
  50. ↑ Newman, Andy (2019-11-15). "I Found Work on an Amazon Website. I Made 97 Cents an Hour.". The New York Times. https://www.nytimes.com/interactive/2019/11/15/nyregion/amazon-mechanical-turk.html. 
  51. ↑ Ben-Achour, Sabri (2026-05-11). "You may be helping train AI and not even know it". Marketplace. https://www.marketplace.org/story/2026/05/11/you-may-be-helping-train-ai-and-not-even-know-it. 
  52. ↑ 52.0 52.1 "2008 SIGKDD Best Paper Award". https://kdd.org/awards/view/2008-sigkdd-best-paper-award. 
  53. ↑ "ProPublica's Guide to Mechanical Turk". ProPublica. 2010. https://www.propublica.org/article/propublicas-guide-to-mechanical-turk. 
  54. ↑ "The size of the Mechanical Turk marketplace". 2016-07-11. https://www.pewresearch.org/internet/2016/07/11/the-size-of-the-mechanical-turk-marketplace/. 
  55. ↑ Ipeirotis, Panagiotis G.; Gabrilovich, Evgeniy (2014). "Quizz: targeted crowdsourcing with a billion (potential) users". Proceedings of the 23rd International Conference on World Wide Web. ACM. pp. 143–154. doi:10.1145/2566486.2567988. https://dl.acm.org/doi/10.1145/2566486.2567988. 
  56. ↑ Slawski, Bill (2014-08-25). "Good Bye Knowledge Graph, Hello Google Knowledge Vault?". https://gofishdigital.com/blog/good-bye-knowledge-graph-hello-google-knowledge-vault/. 
  57. ↑ Tan, Chun How; Agichtein, Eugene; Ipeirotis, Panos; Gabrilovich, Evgeniy (2014). "Trust, but verify: predicting contribution quality for knowledge base construction and curation". Proceedings of the Seventh ACM International Conference on Web Search and Data Mining. ACM. pp. 553–562. doi:10.1145/2736277.2741681. https://dl.acm.org/doi/10.1145/2736277.2741681. 
  58. ↑ Van Horn, Grant; Branson, Steve; Farrell, Ryan; Haber, Scott; Barry, Jessie; Ipeirotis, Panos; Perona, Pietro; Belongie, Serge (2015). "Building a bird recognition app and large scale dataset with citizen scientists: The fine print in fine-grained dataset collection". Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE. pp. 595–603. doi:10.1109/CVPR.2015.7298658. 
  59. ↑ Attenberg, Josh; Ipeirotis, Panagiotis G.; Provost, Foster (2015). "Beat the Machine: Challenging Humans to Find a Predictive Model's "Unknown Unknowns"". ACM Journal on Data and Information Quality 6 (1): 1–17. doi:10.1145/2700832. 
  60. ↑ Elmagarmid, Ahmed K.; Ipeirotis, Panagiotis G.; Verykios, Vassilios S. (2007). "Duplicate Record Detection: A Survey". IEEE Transactions on Knowledge and Data Engineering 19 (1): 1–16. doi:10.1109/TKDE.2007.250581. ISSN 1558-2191. https://ieeexplore.ieee.org/document/4016511/. 
  61. ↑ Archak, Nikolay; Ghose, Anindya; Ipeirotis, Panagiotis G. (2011). "Deriving the Pricing Power of Product Features by Mining Consumer Reviews". Management Science 57 (8): 1485–1509. doi:10.1287/mnsc.1110.1370. ISSN 0025-1909. https://www.jstor.org/stable/25835793. 
  62. ↑ "Something for the Weekend". Financial Times. 2011-10-28. https://www.ft.com/content/8de49ff4-ff17-11e0-9b2f-00144feabdc0. 
  63. ↑ Ghose, Anindya; Ipeirotis, Panagiotis G. (2011). "Estimating the Helpfulness and Economic Impact of Product Reviews: Mining Text and Reviewer Characteristics". IEEE Transactions on Knowledge and Data Engineering 23 (10): 1498–1512. doi:10.1109/TKDE.2010.188. ISSN 1558-2191. https://ieeexplore.ieee.org/abstract/document/5590249/. 
  64. ↑ Savitz, Eric (2011-06-08). "Zapos, Zappoz, or Zappos: Why Typos Are Good For Your Brand" (in en-US). Forbes. http://blogs.forbes.com:80/ciocentral/2011/06/08/zapos-zappoz-or-zappos-why-typos-are-good-for-your-brand/. 
  65. ↑ "The Value of Teaching Your Customers How to Spell" (in en). 2011-05-26. http://blogs.hbr.org/fox/2011/05/the-value-of-teaching-your-cus.html. 
  66. ↑ Agger, Michael (2011-05-10). "Awsum Shoes!" (in en-US). Slate. ISSN 1091-2339. https://slate.com/technology/2011/05/awsum-shoes-is-it-ethical-to-fix-grammatical-and-spelling-errors-in-reviews.html. 
  67. ↑ 67.0 67.1 "The Twentieth International WWW Conference (WWW 2011) – Best Paper Award". https://archives.iw3c2.org/www2011/. 
  68. ↑ Li, Beibei; Ghose, Anindya; Ipeirotis, Panagiotis G. (2011). "Towards a theory model for product search". Proceedings of the 20th International Conference on World Wide Web. ACM. pp. 327–336. doi:10.1145/1963405.1963453. 
  69. ↑ Ghose, Anindya; Ipeirotis, Panagiotis G.; Li, Beibei (2012). "Designing Ranking Systems for Hotels on Travel Search Engines by Mining User-Generated and Crowdsourced Content". Marketing Science 31 (3): 493–520. doi:10.1287/mksc.1110.0700. 
  70. ↑ Ghose, Anindya; Ipeirotis, Panagiotis G.; Li, Beibei (2014). "Examining the Impact of Ranking on Consumer Behavior and Search Engine Revenue". Management Science 60 (7): 1632–1654. doi:10.1287/mnsc.2013.1828. 
  71. ↑ Kokkodis, Marios; Papadimitriou, Panagiotis; Ipeirotis, Panagiotis G. (2015). "Hiring Behavior Models for Online Labor Markets". Proceedings of the Eighth ACM International Conference on Web Search and Data Mining. ACM. pp. 223–232. doi:10.1145/2684822.2685299. 
  72. ↑ Kokkodis, Marios; Ipeirotis, Panagiotis G. (2016). "Reputation Transferability in Online Labor Markets". Management Science 62 (6): 1687–1706. doi:10.1287/mnsc.2015.2217. 
  73. ↑ Kokkodis, Marios; Ipeirotis, Panagiotis G. (2021). "Demand-Aware Career Path Recommendations: A Reinforcement Learning Approach". Management Science 67 (7): 4362–4383. doi:10.1287/mnsc.2020.3727. 
  74. ↑ Kokkodis, Marios; Ipeirotis, Panagiotis G. (2023). "The Good, the Bad, and the Unhirable: Recommending Job Applicants in Online Labor Markets". Management Science 69 (11): 6969–6987. doi:10.1287/mnsc.2023.4690. 
  75. ↑ "About Us". https://detectica.com/about-us/. "Panos served as an early advisor of Integral Ad Science." 
  76. ↑ 76.0 76.1 Mims, Christopher (2011-03-21). "A Web Scam That Makes $500,000 a Month". MIT Technology Review. https://www.technologyreview.com/2011/03/21/196240/a-web-scam-that-makes-500000-a-month/. 
  77. ↑ "Off Screen, Porn Sites Trick Advertisers". The Wall Street Journal. 2011-03-18. https://www.wsj.com/articles/SB10001424052748704893604576200383793893712. 
  78. ↑ "Hidden Treasure: Lost Photos From the Set of American Graffiti". Wired. 2011-07-01. https://www.wired.com/2011/07/lost-photos-american-graffiti/. 
  79. ↑ Mims, Christopher (2011-06-20). "How Six Degrees of Kevin Bacon Unearthed Lost Photos From American Graffiti". MIT Technology Review. https://www.technologyreview.com/2011/06/20/193958/how-six-degrees-of-kevin-bacon-unearthed-lost-photos-from-american-graffiti/. 
  80. ↑ "The Global Opportunity in Online Outsourcing". 2015. https://openknowledge.worldbank.org/handle/10986/22284. 
  81. ↑ "Online Outsourcing: Prospects for Increasing Youth Employment and Reducing Poverty in Indonesia". https://www.rand.org/pubs/perspectives/PE271.html. 
  82. ↑ 82.0 82.1 "Detectica - Enabling organizations to adopt effective AI strategies". Techweek. 2019-12-19. https://techweek.com/detectica-organizations-ai-strategies/. 
  83. ↑ "Compass, Inc. (COMP) Q4 2021 Earnings Call Transcript". 2022-02-17. https://www.fool.com/earnings/call-transcripts/2022/02/17/compass-inc-comp-q4-2021-earnings-call-transcript/. "In 2021, $151 million gross commission revenue was from listings that the likely to sell tool recommended to our agents before the listing was created. We expect this number to exceed $400 million in 2022." 
  84. ↑ "Compass, Inc. (COMP) Q1 2023 Earnings Call Transcript". 2023-05-09. https://www.fool.com/earnings/call-transcripts/2023/05/09/compass-comp-q1-2023-earnings-call-transcript/. "Since launching in 2020, we have handed out millions of recommendations that be attributed more than $100 million of annual incremental revenue to these recommendations over each of the last two years." 
  85. ↑ "CCI Seminar Series 2024-25: Panos Ipeirotis". https://cci.mit.edu/cci-seminar-series-2024-25/. 
  86. ↑ 86.0 86.1 "A Computer Scientist in a Business School". https://www.behind-the-enemy-lines.com/. 
  87. ↑ 87.0 87.1 87.2 87.3 Jaschik, Scott (2011-07-22). "Who Is Punished for Plagiarism?". Inside Higher Ed. https://www.insidehighered.com/news/2011/07/22/who-punished-plagiarism. 
  88. ↑ 88.0 88.1 88.2 Parry, Marc (2011-07-21). "NYU Prof Vows Never to Probe Cheating Again—and Faces a Backlash". The Chronicle of Higher Education. https://www.chronicle.com/blogs/wiredcampus/nyu-prof-vows-never-to-probe-cheating-again%E2%80%94and-faces-a-backlash. 
  89. ↑ "NYU Professor Catches 20% of His Students Cheating, And He's The One Who Pays For It". Business Insider. 2011-07-20. https://www.businessinsider.com/nyu-professor-class-cheating-2011-7. 
  90. ↑ "Science publishing: How to stop plagiarism". Nature 481 (7378): 21–23. 2012-01-04. doi:10.1038/481021a. https://www.nature.com/articles/481021a. Retrieved 2026-02-04. 
  91. ↑ 91.0 91.1 91.2 McMillan, Robert (2012-04-27). "Oops! Amazon Web Services Customer Unleashes 'Denial of Money' Attack – on Himself". Wired. https://www.wired.com/2012/04/aws-bill-in-minutes/. 
  92. ↑ "Twice shy, once bitten". The Economist. 2012-05-28. https://www.economist.com/babbage/2012/05/28/twice-shy-once-bitten. 
  93. ↑ Bort, Julie (2012-04-30). "An Amazon Customer Accidentally Ran Up A $1,200 Bill In Just 10 Minutes". Business Insider. https://www.businessinsider.com/panos-ipeirotis-1200-crowdsource-experiment-2012-4. 
  94. ↑ "Accidentally invented – Dos attack using Google Spreadsheets". 2012-04-28. https://thehackernews.com/2012/04/accidentally-invented-dos-attack-using.html. 
  95. ↑ ""An NYU professor who hates that students' work reads like McKinsey memos held AI oral exams to 'fight fire with fire'"". Business Insider. 2026-01-05. https://www.businessinsider.com/nyu-professor-ai-oral-exam-mckinsey-memo-business-school-2026-1. 
  96. ↑ Bastian, Matthias (2026-01-06). "NYU professor fights AI cheating with AI-powered oral exams that cost 42 cents per student". The Decoder. https://the-decoder.com/nyu-professor-fights-ai-cheating-with-ai-powered-oral-exams-that-cost-42-cents-per-student/. 
  97. ↑ Gecker, Jocelyn (2026-04-22). "Perfect homework, blank stares: Why colleges are turning to oral exams to combat AI". Associated Press. https://apnews.com/article/college-oral-exam-ai-chatgpt-77954a19f5304bfc6e76dc92d4bef3ad. 
  98. ↑ "Έλληνες στην κορυφή της επιστήμης" (in el). Kathimerini. 2018. https://www.kathimerini.gr/society/987304/ellines-stin-koryfi-tis-epistimis/. 
  99. ↑ "Professor Panos Ipeirotis is Recognized as One of '45 Under 45' Greek Scientists Producing Highest-Impact Publications". https://www.stern.nyu.edu/experience-stern/news-events/professor-panos-ipeirotis-recognized-one-45-under-45-greek-scientists-producing-highest-impact. 
  100. ↑ "Research Highlight: Panos Ipeirotis - 2015 CRT Foundation Lagrange Prize". https://www.stern.nyu.edu/experience-stern/faculty-research/panos-ipeirotis-lagrange-prize. 
  101. ↑ "Past Meetings". https://www.humancomputation.com/past%20meetings.html. 
  102. ↑ Christoforaki, Maria; Ipeirotis, Panagiotis (2014-11-05). "STEP: A Scalable Testing and Evaluation Platform". Proceedings of the AAAI Conference on Human Computation and Crowdsourcing. 2. AAAI. https://aaai.org/papers/00041-13159-step-a-scalable-testing-and-evaluation-platform/. 
  103. ↑ "Management Science—2014 Best Paper Awards". Management Science (INFORMS). 2015-01-15. doi:10.1287/mnsc.2014.2122. https://pubsonline.informs.org/doi/10.1287/mnsc.2014.2122. Retrieved 2025-12-22. 
  104. ↑ "$1.5 Million Google Research Grant Awarded to Professor Panos Ipeirotis & Colleagues". 2013-02-22. https://www.stern.nyu.edu/experience-stern/faculty-research/ipeirotis-google-grant. 



Retrieved from "https://handwiki.org/wiki/index.php?title=Biography:Panos_Ipeirotis&oldid=4407685"