Measurement dysfunction

From HandWiki

Measurement dysfunction describes a situation or behavior where actual data metrics, statistics and especially their meaning (or communicated meaning), can become problematic due to misuse.[1][2][3] Specifically, in areas such as Human Resources (Performance measurements[4]), Technology (Safety[5]), Finance or Health,[5] measurement dysfunctionality are critical, as it can lead to negative outcomes, wrong predictions or forecasts.

Practices to avoid:[6][3]

  • Reward of wrong behavior (also persons who manipulate[7])
  • Measuring the wrong things[8]
  • Measuring either not enough or too much
  • Cheating or data manipulation (intentional or unintentional due to wrong calculation models, systematic errors, human errors, etc.)

On eliminating dysfunctional measurement:[9]

  • Establish, and monitor the move to and adherence to ‘policies’ for good, functional measurement
  • Support technical correctness
  • Periodically evaluate the information need and value delivered by measurements

Trivia

"What gets measured gets manipulated."[10][11]

See also

References

  1. ↑ "Presentations and Papers". http://www.osel.co.uk/presentations.htm. 
  2. ↑ Austin, Robert D. (1996). Measuring and managing performance in organizations. Tom DeMarco, Timothy R. Lister. New York: Dorset House Publishing. ISBN 0-932633-36-6. OCLC 34798037. https://www.worldcat.org/oclc/34798037. 
  3. ↑ 3.0 3.1 "Measurement Dysfunction". https://proactsafety.com/blog-posts/measurement-dysfunction. 
  4. ↑ "Measurement Madness: Recognizing and Avoiding the Pitfalls of Performance Measurement | Wiley" (in en-us). https://www.wiley.com/en-us/Measurement+Madness%3A+Recognizing+and+Avoiding+the+Pitfalls+of+Performance+Measurement-p-9781119970705. 
  5. ↑ 5.0 5.1 Vincent, Charles, Dr (2013). The measurement and monitoring of safety : drawing together academic evidence and practical experience to produce a framework for safety measurement and monitoring. Susan Burnett, Jane Carthey. London. ISBN 978-1-906461-44-7. OCLC 861644942. https://www.worldcat.org/oclc/861644942. 
  6. ↑ "When Measurement Goes Bad" (in en). https://www.amanet.org//articles/when-measurement-goes-bad/. 
  7. ↑ "How to Spot and Stop Manipulators" (in en-US). http://www.psychologytoday.com/blog/communication-success/201406/how-spot-and-stop-manipulators. 
  8. ↑ Leonelli, Sabina (2020), Zalta, Edward N., ed., Scientific Research and Big Data (Summer 2020 ed.), Metaphysics Research Lab, Stanford University, https://plato.stanford.edu/archives/sum2020/entries/science-big-data/, retrieved 2021-02-22 
  9. ↑ Shelley, C. C. (October 2009). "eXtreme Measurement: recognizing, understanding and avoiding measurement dysfunction". Oxford Software Engineering. http://www.osel.co.uk/presentations/XMslides.pdf. 
  10. ↑ Dekker, Sidney (2017-10-19). "What gets measured, gets manipulated" (in en). The Safety Anarchist. Routledge. pp. 75–98. doi:10.4324/9780203733455-5. ISBN 978-0-203-73345-5. https://www.taylorfrancis.com/chapters/gets-measured-gets-manipulated-sidney-dekker/e/10.4324/9780203733455-5. 
  11. ↑ "Managing the Unmanageable: More Rules of Thumb". https://www.managingtheunmanageable.net/morerulesofthumb.html. 



Retrieved from "https://handwiki.org/wiki/index.php?title=Measurement_dysfunction&oldid=3383222"