Biography:Panos Ipeirotis
Panagiotis G. Ipeirotis | |
|---|---|
Παναγιώτης Ηπειρώτης | |
| Born | May 3, 1976[1] Serres, Greece[2] |
| Citizenship | Greek, American |
| Awards | Lagrange Prize (2015)[3] ACM SIGKDD Test of Time Award (2020)[4] |
| Academic background | |
| Alma mater | University of Patras (BSc) Columbia University (MSc, PhD) |
| Thesis | Classifying and Searching Hidden-Web Text Databases (2004) |
| Doctoral advisor | Luis Gravano |
| Academic work | |
| Discipline | Computer science |
| Institutions | New York University Stern School of Business |
| Main interests | Crowdsourcing; human computation; Data quality; Text mining |
| Website | behind-the-enemy-lines |
Panagiotis G. Ipeirotis (also known as Panos Ipeirotis; born May 3, 1976, in Serres, Greece) is a Greek-American computer scientist and the Merchants' Council Professor of Technology and Business at the New York University Stern School of Business.[5][6] His research focuses on data mining, crowdsourcing, human computation, and the economics of online information systems.[7]
Ipeirotis received the Lagrange Prize in Complex Systems (2015)[3] and the ACM SIGKDD Test of Time Award (2020).[4] His research on Amazon Mechanical Turk and crowdsourcing quality management has been discussed in publications including The New York Times, The Economist, and Bloomberg Businessweek.[8][9][10]
In addition to his academic career, Ipeirotis co-founded the AI consulting firm Detectica in 2015, which was acquired by Compass, Inc. in 2019.[11] He has also held research positions at Google (2013–2014), where he conducted research on crowdsourcing methods to improve the Google Knowledge Graph,[12][13] and at Meta's Reality Labs division (2024–2025), where he worked on machine learning deployment for wearable devices.[5][14] Ipeirotis also authors the blog "A Computer Scientist in a Business School," which has been cited in media coverage.[15][16]
Early life
Ipeirotis was born on May 3, 1976, in Serres, Greece.[2] In 1994, he won a Gold Medal at the 8th National Greek Competition in Chemistry.[17] Later that year, he represented Greece at the 26th International Chemistry Olympiad in Oslo, Norway.[18]
Education
Ipeirotis earned his Diploma in Computer Engineering and Informatics (CEID) from the University of Patras in 1999.[5] He pursued graduate studies at Columbia University under the supervision of Luis Gravano, receiving his M.Sc. in 2001, M.Phil. in 2003, and Ph.D. in Computer Science in 2004.[5]
Academic career
Ipeirotis began his academic career as a graduate research assistant at Columbia University (1999–2004). In 2004, he joined the Department of Information, Operations, and Management Sciences at the New York University Stern School of Business as an Assistant Professor. He was promoted to Associate Professor in 2010 and Full Professor in 2016. He holds a courtesy appointment at the Courant Institute of Mathematical Sciences[19] and is an associated faculty member at the NYU Center for Data Science.[20]
Ipeirotis has served as Program Co-Chair for the 13th ACM Conference on Electronic Commerce in 2012,[21] as General Co-Chair of the AAAI Conference on Human Computation and Crowdsourcing (HCOMP) in 2015,[22] and as Technical Program Co-Chair for The Web Conference 2018 (WWW 2018).[23] He has served on the editorial boards of Management Science and IEEE Transactions on Knowledge and Data Engineering, and was a founding co-Editor-in-Chief of the journal Collective Intelligence launched in 2022 as a collaboration between SAGE Publications, the Association for Computing Machinery, and Nesta.[24][25]
His research has been discussed in publications such as The New York Times,[8][26] The Economist,[9] Bloomberg Businessweek,[10] The Wall Street Journal,[27] Financial Times,[28] MIT Technology Review,[29] and TIME.[30][31][32] In 2013, Bloomberg Businessweek profiled him as the "data dude" of business analytics.[33] He has also been profiled in Greek media, including a 2014 interview with Kathimerini discussing Greek higher education and his career.[34]
Academic lineage and doctoral students
Ipeirotis completed his PhD at Columbia University under the supervision of Luis Gravano, himself a student of Hector Garcia-Molina at Stanford. According to the Mathematics Genealogy Project, Ipeirotis has advised seven doctoral students at NYU and Columbia.[35]
His former students include Beibei Li, now a professor at Carnegie Mellon University's Heinz College and recipient of the 2019 INFORMS ISS Sandra A. Slaughter Early Career Award,[36] and Marios Kokkodis, recipient of the 2020 INFORMS ISS Gordon B. Davis Young Scholar Award.[37] Former postdoctoral researcher Djellel Difallah is now Assistant Professor and Program Head at New York University Abu Dhabi and previously served as a Research Scientist at the Wikimedia Foundation.[38]
Research
Ipeirotis's work explores the intersection of computer science and economics, an approach he and collaborators have termed "EconoMining." His research has been published in venues such as Management Science, Information Systems Research, and IEEE Transactions on Knowledge and Data Engineering.[5]
Crowdsourcing and human computation
Ipeirotis has published research on Amazon Mechanical Turk (MTurk). His 2010 paper "Running Experiments on Amazon Mechanical Turk,"[39] co-authored with Gabriele Paolacci and Jesse Chandler, provided methodological guidance for using crowdsourcing platforms in behavioral research.
In 2010, his studies revealing that approximately 40% of tasks posted by new requesters on MTurk involved spam or low-quality content received media coverage.[30][29][32][31] His 2010 demographic analysis of the MTurk workforce provided early data on worker motivations, geographic distribution, and income levels, and has been cited by researchers studying crowdsourcing platforms.[40][41] In 2018 and 2019, media outlets continued to cite Ipeirotis's research on MTurk data quality as concerns about automated responses on the platform grew.[42][26] This line of work led to the development of quality management techniques for crowdsourcing, including the "Get Another Label" framework for improving data quality using multiple noisy labelers, which received the SIGKDD Test of Time Award in 2020.[4]
His research on crowdsourcing best practices also influenced journalism; ProPublica published a "Guide to Mechanical Turk" for investigative reporters that drew on Ipeirotis's research and blog posts, citing his work on data quality through multiple worker verification.[43]
To support this research, Ipeirotis developed "MTurk Tracker," a set of tracking tools for the MTurk platform. The first tool tracked workforce demographics using capture-recapture techniques to estimate the size and composition of the workforce in near real-time. The second tool periodically downloaded all tasks posted on the platform, enabling analysis of the crowdsourcing marketplace's size and activity; Amazon eventually blocked this tracker. The Pew Research Center's 2016 report "Research in the Crowdsourcing Age" drew on data from the task tracker, explicitly crediting "the online tool mturk-tracker, which is run by Dr. Panagiotis G. Ipeirotis."[44][45]
During a 2013–2014 sabbatical at Google, Ipeirotis co-developed "Quizz," a gamified crowdsourcing system for improving the Google Knowledge Graph. The system presented data collection as trivia quizzes targeted by domain expertise, using calibration questions with known answers to assess user reliability in real-time.[12][46]
Data quality and record linkage
Ipeirotis has published research on duplicate record detection and data quality. His 2007 survey "Duplicate Record Detection: A Survey" in IEEE Transactions on Knowledge and Data Engineering, co-authored with Ahmed Elmagarmid and Vassilios Verykios, has been cited in the database research community.[47]
Online reputation and user-generated content
His collaborative work with Anindya Ghose on the economic value of textual content in product reviews quantified the pricing power derived from user-generated content.[48] A related 2011 study demonstrated that the quality of spelling and grammar in product reviews significantly affects perceived helpfulness and product sales.[49] This finding was discussed in Forbes, Harvard Business Review, Slate, and Freakonomics.[50][51][52][53]
Applied research and industry
Early industry work (2009–2014)
Beginning in 2009, Ipeirotis served as an early advisor to Integral Ad Science (originally AdSafe Media), contributing to the development of machine learning systems for detecting inappropriate web content and advertising fraud.[54] In 2011, working with AdSafe engineers, he uncovered a click fraud scheme that used hidden iframes to generate fraudulent ad impressions, which he termed "traffic laundering."[55] The investigation, which estimated the scheme generated hundreds of thousands of dollars monthly, was reported by The Wall Street Journal and MIT Technology Review and led to an FBI referral.[27][55]
In 2011, Ipeirotis co-founded Tagasauris, a media annotation startup where he served as Chief Scientist until 2013.[33] The company combined crowdsourcing with semantic graph technology to tag photo archives. A notable accomplishment was the discovery of approximately two dozen "lost" photographs from the 1973 filming of "American Graffiti" in the Magnum Photos archive; the system identified the photos by using crowdworkers to tag individuals and machine learning to connect them via shared film appearances.[56][57]
He also served as Academic-in-Residence at Upwork (then oDesk) in 2012 and as a Visiting Scientist at Google from 2013 to 2014.[5]
Policy research and World Bank
In 2015, Ipeirotis collaborated with the World Bank on a report titled "The Global Opportunity in Online Outsourcing," which examined the potential of digital labor markets to provide employment pathways in developing nations.[58] Drawing on his empirical research from Mechanical Turk and oDesk, the report estimated the online outsourcing market would grow to $15–25 billion by 2020 and identified barriers preventing workers in the Global South from accessing these jobs, including lack of reliable internet infrastructure and the "reputation cold start" problem. The report has been cited in subsequent policy frameworks by the International Labour Organization and the RAND Corporation.[59]
Detectica and Compass (2015–2022)
In 2015, Ipeirotis co-founded Detectica with Foster Provost and Josh Attenberg, offering AI strategy consulting and machine learning solutions for business applications.[60] The company developed AI-driven compliance monitoring systems for financial institutions. Prior to founding Detectica, the team had designed and built the founding data science architecture for Integral Ad Science.[60]
Detectica was acquired by Compass, Inc. in November 2019.[11] At Compass, the Detectica team developed "Likely to Sell," a predictive analytics system that identifies properties likely to enter the market; the company cited the tool as a significant revenue contributor in earnings calls.[61][62]
Public engagement and pedagogy
Academic integrity debates
In July 2011, Ipeirotis published a blog post titled "Why I will never pursue cheating again," describing his experience using Turnitin software to detect that about 20 percent of the students in his roughly 100-person "Information Technology in Business and Society" course had plagiarized.[63] The post criticized the administrative burden placed on faculty who enforce academic integrity policies and went viral.[64] Ipeirotis temporarily removed the post after a complaint alleged potential violations of the Family Educational Rights and Privacy Act (FERPA) due to included student communications.[64] Business Insider reported that Ipeirotis said his student evaluations declined after the plagiarism cases, costing him part of his annual raise;[65] NYU Stern vice dean Ingo Walter responded that faculty are not penalized for enforcing academic integrity and that student evaluations from such cases are excluded from review.[63] The incident prompted discussion about academic integrity enforcement, faculty incentives, and student privacy.[63][64] The case was subsequently cited in Nature in a 2012 commentary on plagiarism detection in academia.[66]
Security vulnerability discovery
In April 2012, Ipeirotis accidentally discovered a vulnerability in Google Spreadsheets that he termed a "Denial of Money" attack. While running a crowdsourcing experiment that required image classification, he uploaded 25,000 image URLs (hosted on his Amazon S3 bucket) into a Google Spreadsheet. Google's Feedfetcher bot aggressively re-downloaded all images from his S3 bucket every time the spreadsheet was processed, generating massive outgoing bandwidth. Ipeirotis reported receiving an Amazon Web Services bill of $1,177.76—approximately ten times his normal monthly rate.[67]
The incident highlighted a novel attack vector: a malicious actor could create a Google Sheet with thousands of links to a victim's large files, causing Google's servers to repeatedly request the files, resulting in either financial damage or a denial of service. The discovery was covered in technology publications including Wired and The Economist.[68][67][69][70] Amazon subsequently forgave the charges, and Google investigated the behavior.[67]
AI-powered assessment
In December 2025, Ipeirotis developed an AI-driven oral examination system using ElevenLabs voice agents to address concerns about students using generative AI tools to submit assignments while lacking deeper understanding. The system, which cost approximately $0.42 per student to administer, used a voice AI agent to call students and ask personalized questions about their submitted work.[71][72]
Awards and honors
- 2020: ACM SIGKDD Test of Time Award for Research (with Foster Provost and Victor S. Sheng). The Test of Time Award honors papers from approximately ten years prior that have had lasting impact on the field of knowledge discovery and data mining. The award recognized their 2008 paper "Get Another Label? Improving Data Quality and Data Mining Using Multiple, Noisy Labelers" "for their approach to selective acquisition of multiple labels."[4]
- 2018: Selected as one of "45 under 45" Greek scientists producing the highest-impact publications worldwide by the Greek newspaper Kathimerini. The recognition identified researchers born after 1974 whose work ranks in the top 0.1% globally by citations.[73][74]
- 2015: Lagrange Prize in Complex Systems (shared with Jure Leskovec), awarded by the CRT Foundation and ISI Foundation. The prize recognized Ipeirotis's "pioneering work in the field of crowdsourcing and human computation" and research "[combining] economic, social psychology and automatic text analysis methods to quantify the economic value of the content generated by users on the Internet."[3][75]
- 2014: Best Paper Award, Second AAAI Conference on Human Computation and Crowdsourcing (HCOMP), for "STEP: A Scalable Testing and Evaluation Platform".[76][77]
- 2014: INFORMS Information Systems Society (ISS) Best Paper Award (Management Science), for "Deriving the Pricing Power of Product Features by Mining Consumer Reviews" (2011).[78]
- 2012: Google Focused Research Award ($1.5 million), with Serge Belongie and Pietro Perona.[79]
- 2011: Best Paper Award, 20th International World Wide Web Conference (WWW 2011), for "Towards a Theory Model for Product Search".[80]
- 2007: National Science Foundation CAREER Award (Grant IIS-0643846), "Towards a Text-Centric Database Management System."[81]
- 2006: Best Paper Award, ACM International Conference on Management of Data (SIGMOD 2006) — "To Search or to Crawl? Towards a Query Optimizer for Text-Centric Tasks".[82]
- 2005: Best Paper Award, 21st IEEE International Conference on Data Engineering (ICDE 2005), for "Modeling and Managing Content Changes in Text Databases".[83]
Selected publications
- Sheng, Victor S.; Provost, Foster; Ipeirotis, Panagiotis G. (2008). "Get another label? Improving data quality and data mining using multiple, noisy labelers". Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. doi:10.1145/1401890.1401965. (KDD Test of Time Award, 2020)
- Paolacci, Gabriele; Chandler, Jesse; Ipeirotis, Panagiotis G. (2010). "Running experiments on Amazon Mechanical Turk". Judgment and Decision Making 5 (5): 411–419. doi:10.1017/S1930297500002205.
- Ghose, Anindya; Ipeirotis, Panagiotis G. (2011). "Estimating the helpfulness and economic impact of product reviews: Mining text and reviewer characteristics". IEEE Transactions on Knowledge and Data Engineering 23 (10): 1498–1512. doi:10.1109/TKDE.2010.188.
- Archak, Nikolay; Ghose, Anindya; Ipeirotis, Panagiotis G. (2011). "Deriving the pricing power of product features by mining consumer reviews". Management Science 57 (8): 1485–1509. doi:10.1287/mnsc.1110.1370.
- Elmagarmid, Ahmed K.; Ipeirotis, Panagiotis G.; Verykios, Vassilios S. (2007). "Duplicate record detection: A survey". IEEE Transactions on Knowledge and Data Engineering 19 (1): 1–16. doi:10.1109/TKDE.2007.250581.
References
- ↑ "Panagiotis G. Ipeirotis". https://orcid.org/0000-0002-2966-7402.
- ↑ 2.0 2.1 "Πάνος Ηπειρώτης: Ο Σερραίος καθηγητής που διαπρέπει στη Νέα Υόρκη" (in el). Aveserres.gr. 2025-04-11. https://aveserres.gr/panos-ipeirotis-o-serraios-kathigitis-poy-diaprepei-sti-nea-yorki-scholiazei-tin-trechoysa-katastasi-stin-ameriki-kai-stis-chrimatagores/.
- ↑ 3.0 3.1 3.2 "Press Release: Lagrange Prize 2015". 2015-10-06. http://www.isi.it/press-release-a-panos-ipeirotis-e-jure-leskovec-il-premio-lagrange-fondazione-crt-2015/.
- ↑ 4.0 4.1 4.2 4.3 "2020 SIGKDD Test of Time Award Winners". https://kdd.org/awards/view/2020-sigkdd-test-of-time-award-winners.
- ↑ 5.0 5.1 5.2 5.3 5.4 5.5 "NYU Stern - Panagiotis Ipeirotis - Merchants' Council Professor of Technology, Operations, and Statistics" (in en). https://www.stern.nyu.edu/faculty/bio/panagiotis-ipeirotis.
- ↑ "TOPS | Full-time Faculty - NYU Stern". https://www.stern.nyu.edu/experience-stern/about/departments-centers-initiatives/academic-departments/tops/faculty-staff/full-time-faculty.
- ↑ Ghose, Anindya; Ipeirotis, Panagiotis (2009). "The EconoMining project at NYU: Studying the economic value of user-generated content on the internet". Journal of Revenue and Pricing Management 8 (2–3): 241–246. doi:10.1057/rpm.2008.56.
- ↑ 8.0 8.1 Segal, David (2011-05-22). "A Rave, a Pan, or Just a Fake?". The New York Times. https://www.nytimes.com/2011/05/22/your-money/22haggler.html.
- ↑ 9.0 9.1 "Turks of the World, Unite!". The Economist. 2011-05-24. https://www.economist.com/blogs/babbage/2011/05/repetitive_tasks.
- ↑ 10.0 10.1 Weise, Karen (2011-11-10). "Humans Plus Computers Equals Better Crowdsourcing" (in en). Bloomberg Businessweek. http://www.businessweek.com:80/magazine/humans-plus-computers-equals-better-crowdsourcing-11102011.html.
- ↑ 11.0 11.1 "Real-Estate Brokerage Compass Buys AI Startup Detectica". The Wall Street Journal. 2019-11-19. https://www.wsj.com/articles/real-estate-brokerage-compass-buys-ai-startup-detectica-11574159402.
- ↑ 12.0 12.1 Ipeirotis, Panagiotis G.; Gabrilovich, Evgeniy (2014). "Quizz: targeted crowdsourcing with a billion (potential) users". Proceedings of the 23rd International Conference on World Wide Web. ACM. pp. 143–154. doi:10.1145/2566486.2567988. https://dl.acm.org/doi/10.1145/2566486.2567988.
- ↑ Tan, Chun How; Agichtein, Eugene; Ipeirotis, Panos; Gabrilovich, Evgeniy (2014). "Trust, but verify: predicting contribution quality for knowledge base construction and curation". Proceedings of the Seventh ACM International Conference on Web Search and Data Mining. ACM. pp. 553–562. doi:10.1145/2736277.2741681. https://dl.acm.org/doi/10.1145/2736277.2741681.
- ↑ "CCI Seminar Series 2024-25: Panos Ipeirotis". https://cci.mit.edu/cci-seminar-series-2024-25/.
- ↑ "A Computer Scientist in a Business School". https://www.behind-the-enemy-lines.com/.
- ↑ Agger, Michael (2011-05-10). "Awsum Shoes!" (in en-US). Slate. ISSN 1091-2339. https://slate.com/technology/2011/05/awsum-shoes-is-it-ethical-to-fix-grammatical-and-spelling-errors-in-reviews.html.
- ↑ "8η Ολυμπιάδα Χημείας" (in el). Χημικά Χρονικά (Chemical Chronicles) 56 (8): 233. 1994. http://jupiter.chem.uoa.gr/thanost/XX/XX_56_8_1994.pdf. Retrieved 2026-02-02.
- ↑ "26th IChO 1994 Results". http://www.icho-official.org/results/results.php?id=26&year=1994.
- ↑ "Faculty". https://cims.nyu.edu/dynamic/people/faculty/.
- ↑ "Associated Faculty". https://cds.nyu.edu/associated-faculty/.
- ↑ "13th ACM Conference on Electronic Commerce". https://www.sigecom.org/ec12/chairs.html.
- ↑ "HCOMP 2015: Organizers". https://www.humancomputation.com/2015/index.html.
- ↑ "Research Tracks CFP – TheWebConf 2018". https://archives.iw3c2.org/www2018/call-for-papers/research-tracks-cfp/.
- ↑ "Editorial Board". SAGE Publications. https://journals.sagepub.com/editorial-board/CIN.
- ↑ "SAGE, Association for Computing Machinery Announce Collective Intelligence, New Open Access Journal in Collaboration with Nesta". 2020-08-18. https://www.acm.org/media-center/2020/august/collective-intelligence-new-journal.
- ↑ 26.0 26.1 Newman, Andy (2019-11-15). "I Found Work on an Amazon Website. I Made 97 Cents an Hour.". The New York Times. https://www.nytimes.com/interactive/2019/11/15/nyregion/amazon-mechanical-turk.html.
- ↑ 27.0 27.1 "Off Screen, Porn Sites Trick Advertisers". The Wall Street Journal. 2011-03-18. https://www.wsj.com/articles/SB10001424052748704893604576200383793893712.
- ↑ "Something for the Weekend". Financial Times. 2011-10-28. https://www.ft.com/content/8de49ff4-ff17-11e0-9b2f-00144feabdc0.
- ↑ 29.0 29.1 Mims, Christopher. "How Mechanical Turk is Broken". MIT Technology Review. http://www.technologyreview.com:80/blog/mimssbits/26193/.
- ↑ 30.0 30.1 Walsh, Bryan (2011-01-31). "On Crowdsourcing: Pennies for Your Thoughts". TIME. http://content.time.com/time/magazine/article/0,9171,2043450,00.html.
- ↑ 31.0 31.1 Rosenwald, Michael S. (2011-01-30). "How you and Google are losing the battle against spam in search results" (in en-US). The Washington Post. ISSN 0190-8286. http://www.washingtonpost.com/wp-dyn/content/article/2011/01/28/AR2011012807515.html.
- ↑ 32.0 32.1 "40% Of Amazon's Mechanical Turk Is Spam" (in en-US). Business Insider. 2010-12-17. https://www.businessinsider.com/40-of-amazons-mechanical-turk-is-spam-2010-12.
- ↑ 33.0 33.1 "The Data Dude: NYU Stern's Panos Ipeirotis". Bloomberg Businessweek. 2013-01-24. https://www.bloomberg.com/news/articles/2013-01-24/the-data-dude-nyu-stern-s-panos-ipeirotis.
- ↑ "Παναγιώτης Ηπειρώτης: «Θαυμάζω όσους παράγουν έργο στα πανεπιστήμια με τις συνθήκες που επικρατούν»" (in el). Kathimerini. 2014-07-21. https://www.kathimerini.gr/opinion/interviews/777025/panagiotis-ipeirotis-thaymazo-osoys-paragoyn-ergo-sta-panepistimia-me-tis-synthikes-poy-epikratoyn/.
- ↑ "Panagiotis Ipeirotis - Mathematics Genealogy Project". https://www.genealogy.math.ndsu.nodak.edu/id.php?id=85858.
- ↑ "ISS Sandra A. Slaughter Early Career Award". https://www.informs.org/Recognizing-Excellence/Community-Prizes/Information-Systems-Society/ISS-Sandra-A.-Slaughter-Early-Career-Award.
- ↑ "ISS Gordon B. Davis Young Scholar Award". https://www.informs.org/Recognizing-Excellence/Community-Prizes/Information-Systems-Society/ISS-Gordon-B.-Davis-Young-Scholar-Award.
- ↑ "Djellel Difallah". https://nyuad.nyu.edu/en/academics/divisions/science/faculty/djellel-difallah.html.
- ↑ Paolacci, Gabriele; Chandler, Jesse; Ipeirotis, Panagiotis G. (2010). "Running experiments on Amazon Mechanical Turk" (in en). Judgment and Decision Making 5 (5): 411–419. doi:10.1017/S1930297500002205. ISSN 1930-2975. https://www.cambridge.org/core/journals/judgment-and-decision-making/article/running-experiments-on-amazon-mechanical-turk/BBD787F3B4DDB61119CBB215927CA39E.
- ↑ Ipeirotis, Panagiotis G. (2010). "Demographics of Mechanical Turk". NYU Stern School of Business. https://archive.nyu.edu/handle/2451/29585.
- ↑ Fort, Karën; Adda, Gilles; Cohen, K. Bretonnel (2011). "Amazon Mechanical Turk: Gold Mine or Coal Mine?". Computational Linguistics (MIT Press) 37 (2): 413–420. doi:10.1162/COLI_a_00057.
- ↑ Dreyfuss, Emily (2018-08-17). "A Bot Panic Hits Amazon Mechanical Turk". Wired. https://www.wired.com/story/amazon-mechanical-turk-bot-panic/.
- ↑ "ProPublica's Guide to Mechanical Turk". ProPublica. 2010. https://www.propublica.org/article/propublicas-guide-to-mechanical-turk.
- ↑ "Methodology: Mechanical Turk". 2016-07-11. https://www.pewresearch.org/internet/2016/07/11/mechanical-turk-methodology/.
- ↑ "The size of the Mechanical Turk marketplace". 2016-07-11. https://www.pewresearch.org/internet/2016/07/11/the-size-of-the-mechanical-turk-marketplace/.
- ↑ Slawski, Bill (2014-08-25). "Good Bye Knowledge Graph, Hello Google Knowledge Vault?". https://gofishdigital.com/blog/good-bye-knowledge-graph-hello-google-knowledge-vault/.
- ↑ Elmagarmid, Ahmed K.; Ipeirotis, Panagiotis G.; Verykios, Vassilios S. (2007). "Duplicate Record Detection: A Survey". IEEE Transactions on Knowledge and Data Engineering 19 (1): 1–16. doi:10.1109/TKDE.2007.250581. ISSN 1558-2191. https://ieeexplore.ieee.org/document/4016511/.
- ↑ Archak, Nikolay; Ghose, Anindya; Ipeirotis, Panagiotis G. (2011). "Deriving the Pricing Power of Product Features by Mining Consumer Reviews". Management Science 57 (8): 1485–1509. doi:10.1287/mnsc.1110.1370. ISSN 0025-1909. https://www.jstor.org/stable/25835793.
- ↑ Ghose, Anindya; Ipeirotis, Panagiotis G. (2011). "Estimating the Helpfulness and Economic Impact of Product Reviews: Mining Text and Reviewer Characteristics". IEEE Transactions on Knowledge and Data Engineering 23 (10): 1498–1512. doi:10.1109/TKDE.2010.188. ISSN 1558-2191. https://ieeexplore.ieee.org/abstract/document/5590249/.
- ↑ Savitz, Eric (2011-06-08). "Zapos, Zappoz, or Zappos: Why Typos Are Good For Your Brand" (in en-US). Forbes. http://blogs.forbes.com:80/ciocentral/2011/06/08/zapos-zappoz-or-zappos-why-typos-are-good-for-your-brand/.
- ↑ "The Value of Teaching Your Customers How to Spell" (in en). 2011-05-26. http://blogs.hbr.org/fox/2011/05/the-value-of-teaching-your-cus.html.
- ↑ Agger, Michael (2011-05-10). "Awsum Shoes!" (in en-US). Slate. ISSN 1091-2339. https://slate.com/technology/2011/05/awsum-shoes-is-it-ethical-to-fix-grammatical-and-spelling-errors-in-reviews.html.
- ↑ "Does Reviewer Quality Matter?". 2011-04-12. https://freakonomics.com/2011/04/does-reviewer-quality-matter/.
- ↑ "About Us". https://detectica.com/about-us/. "Panos served as an early advisor of Integral Ad Science."
- ↑ 55.0 55.1 Mims, Christopher (2011-03-21). "A Web Scam That Makes $500,000 a Month". MIT Technology Review. https://www.technologyreview.com/2011/03/21/196240/a-web-scam-that-makes-500000-a-month/.
- ↑ "Hidden Treasure: Lost Photos From the Set of American Graffiti". Wired. 2011-07-01. https://www.wired.com/2011/07/lost-photos-american-graffiti/.
- ↑ Mims, Christopher (2011-06-20). "How Six Degrees of Kevin Bacon Unearthed Lost Photos From American Graffiti". MIT Technology Review. https://www.technologyreview.com/2011/06/20/193958/how-six-degrees-of-kevin-bacon-unearthed-lost-photos-from-american-graffiti/.
- ↑ "The Global Opportunity in Online Outsourcing". 2015. https://openknowledge.worldbank.org/handle/10986/22284.
- ↑ "Online Outsourcing: Prospects for Increasing Youth Employment and Reducing Poverty in Indonesia". https://www.rand.org/pubs/perspectives/PE271.html.
- ↑ 60.0 60.1 "Detectica - Enabling organizations to adopt effective AI strategies". Techweek. 2019-12-19. https://techweek.com/detectica-organizations-ai-strategies/.
- ↑ "Compass, Inc. (COMP) Q4 2021 Earnings Call Transcript". 2022-02-17. https://www.fool.com/earnings/call-transcripts/2022/02/17/compass-inc-comp-q4-2021-earnings-call-transcript/. "In 2021, $151 million gross commission revenue was from listings that the likely to sell tool recommended to our agents before the listing was created. We expect this number to exceed $400 million in 2022."
- ↑ "Compass, Inc. (COMP) Q1 2023 Earnings Call Transcript". 2023-05-09. https://www.fool.com/earnings/call-transcripts/2023/05/09/compass-comp-q1-2023-earnings-call-transcript/. "Since launching in 2020, we have handed out millions of recommendations that be attributed more than $100 million of annual incremental revenue to these recommendations over each of the last two years."
- ↑ 63.0 63.1 63.2 Jaschik, Scott (2011-07-22). "Who Is Punished for Plagiarism?". Inside Higher Ed. https://www.insidehighered.com/news/2011/07/22/who-punished-plagiarism.
- ↑ 64.0 64.1 64.2 Parry, Marc (2011-07-21). "NYU Prof Vows Never to Probe Cheating Again—and Faces a Backlash". The Chronicle of Higher Education. https://www.chronicle.com/blogs/wiredcampus/nyu-prof-vows-never-to-probe-cheating-again%E2%80%94and-faces-a-backlash.
- ↑ "NYU Professor Catches 20% of His Students Cheating, And He's The One Who Pays For It". Business Insider. 2011-07-20. https://www.businessinsider.com/nyu-professor-class-cheating-2011-7.
- ↑ "Science publishing: How to stop plagiarism". Nature 481 (7378): 21–23. 2012-01-04. doi:10.1038/481021a. https://www.nature.com/articles/481021a. Retrieved 2026-02-04.
- ↑ 67.0 67.1 67.2 McMillan, Robert (2012-04-27). "Oops! Amazon Web Services Customer Unleashes 'Denial of Money' Attack – on Himself". Wired. https://www.wired.com/2012/04/aws-bill-in-minutes/.
- ↑ "Twice shy, once bitten". The Economist. 2012-05-28. https://www.economist.com/babbage/2012/05/28/twice-shy-once-bitten.
- ↑ Bort, Julie (2012-04-30). "An Amazon Customer Accidentally Ran Up A $1,200 Bill In Just 10 Minutes". Business Insider. https://www.businessinsider.com/panos-ipeirotis-1200-crowdsource-experiment-2012-4.
- ↑ "Accidentally invented – Dos attack using Google Spreadsheets". 2012-04-28. https://thehackernews.com/2012/04/accidentally-invented-dos-attack-using.html.
- ↑ ""An NYU professor who hates that students' work reads like McKinsey memos held AI oral exams to 'fight fire with fire'"". Business Insider. 2026-01-05. https://www.businessinsider.com/nyu-professor-ai-oral-exam-mckinsey-memo-business-school-2026-1.
- ↑ Bastian, Matthias (2026-01-06). "NYU professor fights AI cheating with AI-powered oral exams that cost 42 cents per student". The Decoder. https://the-decoder.com/nyu-professor-fights-ai-cheating-with-ai-powered-oral-exams-that-cost-42-cents-per-student/.
- ↑ "Έλληνες στην κορυφή της επιστήμης" (in el). Kathimerini. 2018. https://www.kathimerini.gr/society/987304/ellines-stin-koryfi-tis-epistimis/.
- ↑ "Professor Panos Ipeirotis is Recognized as One of '45 Under 45' Greek Scientists Producing Highest-Impact Publications". https://www.stern.nyu.edu/experience-stern/news-events/professor-panos-ipeirotis-recognized-one-45-under-45-greek-scientists-producing-highest-impact.
- ↑ "Research Highlight: Panos Ipeirotis - 2015 CRT Foundation Lagrange Prize". https://www.stern.nyu.edu/experience-stern/faculty-research/panos-ipeirotis-lagrange-prize.
- ↑ "Past Meetings". https://www.humancomputation.com/past%20meetings.html.
- ↑ Christoforaki, Maria; Ipeirotis, Panagiotis (2014-11-05). "STEP: A Scalable Testing and Evaluation Platform". Proceedings of the AAAI Conference on Human Computation and Crowdsourcing. 2. AAAI. https://aaai.org/papers/00041-13159-step-a-scalable-testing-and-evaluation-platform/.
- ↑ "Management Science—2014 Best Paper Awards". Management Science (INFORMS). 2015-01-15. doi:10.1287/mnsc.2014.2122. https://pubsonline.informs.org/doi/10.1287/mnsc.2014.2122. Retrieved 2025-12-22.
- ↑ "$1.5 Million Google Research Grant Awarded to Professor Panos Ipeirotis & Colleagues". 2013-02-22. https://www.stern.nyu.edu/experience-stern/faculty-research/ipeirotis-google-grant.
- ↑ "The Twentieth International WWW Conference (WWW 2011) – Best Paper Award". https://archives.iw3c2.org/www2011/.
- ↑ "Award Search: Award #0643846 – CAREER: Towards a Text-Centric Database Management System". https://www.nsf.gov/awardsearch/show-award?AWD_ID=0643846.
- ↑ "SIGMOD Best Paper Award". https://sigmod.org/sigmod-awards/sigmod-best-paper-award/.
- ↑ "ICDE 2005 Best Paper Awards". https://web.archive.org/web/20050410134051/http://icde2005.is.tsukuba.ac.jp/best-papers.html.
External links
