Engineering:DxOMark

From HandWiki
Short description: Camera and smartphone benchmarking website
DXOMARK
DXOMARK logo.svg
Logo
Type of site
Professional benchmarking ratings for digital camera systems, camera lenses, photography equipment, and smartphone camera systems
Available inEnglish, Chinese
Headquarters92100 Boulogne-Billancourt, Paris, France [1]
Area servedWorldwide
OwnerDXOMARK Image Labs SAS
EditorLars Rehm (editor-in-chief)
Key peopleFréderic Guichard (CEO) Marie Frécénon (CFO)
Industryphotography
ProductsSmartphone and digital camera ratings
ServicesConsulting, scientific benchmarking
Websitewww.dxomark.com
CommercialYes
RegistrationNone
Launched2008; 16 years ago (2008)[2]
Current statusActive
Content licence
Copyright

DXOMARK is a commercial website described as "an independent benchmark that scientifically assesses smartphones, lenses and cameras".[2][3] Founded in 2008, DxOMark was originally owned by DxO Labs,[4] a France engineering and consulting company, which is headquartered in Boulogne-Billancourt, Paris, France.[1][4][2][5] DXOMARK Image Labs was separated from DxO Labs in September 2017, and was later re-branded to DXOMARK in 2019.[6][7] DXOMARK is now a wholly independent privately-owned company.[6]

DXOMARK scores are used in many independent news publications and specialist media sites.[2]

DXOMARK rating systems

The score(s) awarded by DXOMARK are based upon a comprehensive and highly-documented, but commercially secret methodology. An overall 'headline' (v) score is awarded, but that is based upon an aggregated overview of a number of other very specific and detailed test attributes, although the actual weighting of those individual attributes is unknown.[4] DXOMARK themselves stress that "the overall score is not a weighted sum of the sub-scores. It is a proprietary and confidential mapping of sub-scores into a combined score". DXOMARK also highlight that they consult directly with the equipment manufacturers, with the objective of helping them make better cameras.[4]

In respect of specific score figures, it is not clear what headroom or ceiling level is available to the DXOMARK scoring system.[4] Some early high performers might have suggested an upper limit of 100 points,[4] yet later high performers are awarded scores in excess of 100. It is also important to note that the DXOMARK score is not based on any averages.[4]

Camera sensor rating

The DXOMARK Sensor Score measures several important image quality metrics of the RAW image[8] captured by the camera's sensor.[9] The overall score is a confidential combination of three sub-scores:[9][10]

Another metric, the Perceptual MegaPixel (P-MPix), defined as 'the unit of a sharpness measurement', is used to rate the resolution a camera produces when paired to a particular lens.[11] DXOMARK claims that P-MPix is a more accurate and relevant value for photographers to consider than alternate measures of sharpness when evaluating camera and lens image quality.[11][12][13][14][15][unreliable source] As of December 2015, the Canon EF 300mm f/2.8L IS II USM lens mounted on a Canon EOS 5DS R has the highest measured P-MPix (45 P-MPix), followed by the Carl Zeiss APO Sonnar T* 2/135 ZE (41 P-MPix on Canon EOS 5DS R and 36 P-MPix on Nikon D800E).[16]

Camera lens rating

The DXOMARK Lens Score provides ratings for camera lenses, as tested using its proprietary tool-set in combination with various camera models.[8][10][17] As with the DxOMark Sensor Score, the DXOMARK Lens Score is an aggregation of five separate sub-scores; namely: sharpness, distortion, vignetting, transmission, and chromatic aberration.[17]

Smartphone camera rating

As smartphones began to overtake point-and-shoot cameras,[18] DXOMARK began testing smartphones and other mobile devices in 2011, and introduced DXOMARK Mobile[7] in 2012.[19][20][21] A major update was made in September 2017, adding tests designed to stress the capabilities of current-model smartphones, including those with dual lenses; such as lower-light shooting, telephoto zoom, depth effect, and bokeh.[5][19][20][22] In September 2019, the DXOMARK Mobile score was renamed DXOMARK Camera.[7][19][23]

DXOMARK Camera Overall Score is the headline number reported for each tested device, and consists of a proprietary combination of DXOMARK Camera Photo, and DXOMARK Camera Video category scores.

DXOMARK's Camera Photo score is a proprietary combination of nine category sub-scores:[23]

  • Exposure and contrast
  • Colour
  • Auto-focus
  • Texture
  • Noise
  • Artifacts
  • Night (enhanced from Flash, September 2019)[19][22][23][24]
  • Zoom[22]
  • Bokeh[22]
  • Wide (added September 2019)[19][23][24]
  • Preview (added October 2020)[25]

DXOMARK's Camera Video score includes six of the same sub-scores as DXOMARK's Mobile Photo score (Exposure, Colour, Auto-focus, Texture, Noise, and Artifacts), along with Stabilisation.

DXOMARK's tests are conducted by the company's technical staff under a variety of lighting conditions; ranging from low-light 1 Lux, to bright daylight outdoors.[22] Sub-scores are combined using a proprietary and confidential mapping into an overall score. Tests are also confined to default modes, except for Zoom and Bokeh, which has caused reviewers to be cautious when using them.[4]

Selfie-camera rating

On 22 January 2019, DXOMARK started to release the results of a new metric; testing the front-facing 'selfie' cameras on smartphones.[19][26][27] These new standalone DXOMARK Selfie tests are undertaken for both Photo and Video, though the 'headline' DXOMARK Selfie score will combine both.[27] For DXOMARK Selfie Photo, there are sub-scores for Exposure, Colour, Focus, Texture, Noise, Artifacts, Flash, and Bokeh. For DXOMARK Selfie Video, sub-scores include Exposure, Colour, Focus, Texture, Noise, Artifacts, and Stabilisation.[27]

Smartphone audio rating

On 10 October 2019, DXOMARK introduced a new Audio benchmark for smartphones.[28] Phones are tested for playback using their internal speakers, and for recording using their built-in microphones.[29] DXOMARK Audio tested categories include:[28][29]

  • Timbre (frequency response, treble/mid-range/bass, total balance, volume dependency)
  • Dynamics (attack, bass precision, punch, volume dependency)
  • Spatial (wideness, balance, distance, localisation)
  • Volume (maximum, minimum, user volume consistency)
  • Artifacts (noise, pumping, clipping, user artifacts, other artifacts)

For recording only:[28][29]

  • Background (directivity, noise profile, artifacts)

Smartphone display ratings

In October 2020, DXOMARK introduced a rating system for mobile device displays (screens). DXOMARK Display tests over 400 measurements, and more than 20 hours of laboratory evaluations and real-life scenarios. The result includes six sub-scores: Readability, Colour, Video, Motion, Touch, and Artifacts.[30]

Wireless speaker ratings

In November 2020, DXOMARK introduced a rating system, DXOMARK Sound, for wireless speakers, based on factors including both lab tests using sound-level meters and calibrated microphones, as well as 20 hours of perceptual assessment. Customized music clips, created by DXOMARK in collaboration with professional musicians and recording studios, include those in the styles of jazz, hip-hop, classical, pop, rock, Latin, electronic, and alternative genres.[31]

Battery ratings

DXOMARK started smartphone battery testing on 10 May 2021. DXOMARK's battery test protocol is based on 70 measurements and takes 150 hours to test.[32]

Comparison tool

Users of the DXOMARK website can select several devices of the same class, and have the website display a comparison of their test scores and graphical versions of the actual test data.[10][33]

Analyzer

Analyzer is a suite of software tools published by DXOMARK, that includes test targets and test equipment. It is used by camera companies, as well as press publications and websites;[34] to test sensors, lenses, and standalone cameras, as well as mobile devices with cameras. Testing can be performed on both RAW and JPEG images, as well as video. Analyzer is also the analysis engine behind dxomark.com[8][34][35] Results can be displayed either numerically or graphically.[36] Originally introduced by DxO Labs, Analyzer is now a product of DxOMark, which has been separated from DxO.[6][37]

Analyzer includes modules for testing optics, sensors, stabilisation, video, timing, and 3D features.[38]

Usage in industry

DXOMARK ratings are often used by the press to describe the image quality characteristics of their cameras and mobile devices.[4][39][40][41] High DXOMARK Camera ratings have also been featured as hallmarks of quality in vendor announcements[42] and marketing materials,[43] although reviewers are careful to note that the ratings only reflect image quality.[44][45][46] DXOMARK also provides consulting services to hardware manufacturers, related to image quality.[47][48]

See also

References

Citations
  1. ↑ 1.0 1.1 "Contact us". DxOMark. https://www.DxOMark.com/contact-us. 
  2. ↑ 2.0 2.1 2.2 2.3 "What is DxOMark?". DxOMark. https://www.DxOMark.com/about-us. 
  3. ↑ "Honor ranks #2 in the world of smartphone cameras – That's according to camera specialists DxOMark". Esquire Middle East – Hearst Communications, Inc.. 24 July 2019. https://www.EsquireME.com/content/37255-honor-ranks-2-in-the-world-of-smartphone-cameras. 
  4. ↑ 4.0 4.1 4.2 4.3 4.4 4.5 4.6 4.7 4.8 "What is a DXOMark score?" (in en-AU). PC World Australia – IDG Communications. 20 March 2018. https://www.pcworld.idg.com.au/article/634659/what-dxomark-score/. 
  5. ↑ 5.0 5.1 "DxOMark unveils expanded mobile benchmark suite". Smart Chimps. 12 September 2017. http://Smart-Chimps.co.uk/smart-news/dxomark-unveils-expanded-mobile-benchmark-suite/. 
  6. ↑ 6.0 6.1 6.2 "DxOMark splits from DxO Labs, is now an independent privately-owned company". Digital Photography Review. 8 January 2018. https://www.DPReview.com/news/3776732295/dxomark-splits-from-dxo-labs-is-now-an-independent-privately-owned-company. 
  7. ↑ 7.0 7.1 7.2 "DxOMark: Huawei Mate 30 Pro camera score will be announced today". Gearbest blog. 26 September 2019. https://www.gearbest.com/blog/tech-news/dxomark-huawei-mate-30-pro-camera-score-will-be-announced-today-8494. 
  8. ↑ 8.0 8.1 8.2 "Lens reviews explained". Digital Photography Review. 30 October 2012. https://www.DPReview.com/articles/3135549652/lens-reviews-explained/8. 
  9. ↑ 9.0 9.1 "Sensors Database – DxOMark". DxOMark. https://www.DxOMark.com/Cameras/. 
  10. ↑ 10.0 10.1 10.2 "A simple guide to the DXOMARK numbers". Daystar Visions. 2015. https://DaystarVisions.com/Docs/Tuts/DxOMark/. 
  11. ↑ 11.0 11.1 "DxOMark reviews > looking for new photo gear? DXOMARK's Perceptual Megapixel can help you". DxO Labs. 17 December 2012. https://www.DxOMark.com/index.php/Publications/DxOMark-Reviews/Looking-for-new-photo-gear-DxOMark-s-Perceptual-Megapixel-can-help-you. 
  12. ↑ "Perceptual Megapixel: lens sharpness boiled down to a single number". PetaPixel blog. 17 December 2012. https://PetaPixel.com/2012/12/17/perceptual-megapixel-mtf-charts-boiled-down-to-a-single-number/. 
  13. ↑ "DxOMark introduces the 'Perceptual Megapixel'". Tim Grey's blog – thoughts on photography, digital imaging, and travel. 6 January 2013. http://TimGrey.com/blog/2013/dxomark-introduces-the-perceptual-megapixel/. 
  14. ↑ "DxO Labs tries making sense of camera lens sharpness". CNET – CBS Interactive Inc. 17 December 2012. https://www.CNET.com/news/dxo-labs-tries-making-sense-of-camera-lens-sharpness/. 
  15. ↑ "DxOMark scores lens sharpness with Perceptual Megapixel". Photo.net Photography forums. 20 December 2012. https://www.Photo.net/discuss/threads/dxomark-scores-lens-sharpness-with-perceptual-megapixel.473326/. 
  16. ↑ "Lenses > Camera Lens Ratings > Optical Metric Scores > camera lens ratings by DXOMARK". DxO Labs. http://www.DxOMark.com/Lenses/Camera-Lens-Ratings/Optical-Metric-Scores. 
  17. ↑ 17.0 17.1 "Lenses Database – DXOMARK". DxOMark. https://www.DxOMark.com/Lenses/. 
  18. ↑ Daisuke Wakabayashi (30 July 2013). "The point-and-shoot camera faces its existential moment; as more users opt for smartphones, companies wonder what's next". The Wall Street Journal – Dow Jones & Company, Inc.. https://www.WSJ.com/news/articles/SB10001424127887324251504578580263719432252. 
  19. ↑ 19.0 19.1 19.2 19.3 19.4 19.5 "Introducing our new Wide and Night scores". DxOMark. 18 September 2019. https://www.DxOMark.com/introducing-our-new-wide-and-night-scores/. 
  20. ↑ 20.0 20.1 "DxOMark revamps its mobile testing for the phone cameras of 2017; new testing method will take into account dual cameras, selfie performance, and other recent trends.". Android Central – Future US, Inc.. 12 September 2017. https://www.AndroidCentral.com/dxomark-revamps-its-mobile-testing-phone-cameras-2017. 
  21. ↑ Lexy Savvides (10 October 2012). "Smartphones outperforming high-end compact cameras". CNET Australia – CBS Interactive.. http://www.CNET.com.au/smartphones-outperforming-high-end-compact-cameras-339341960.htm. 
  22. ↑ 22.0 22.1 22.2 22.3 22.4 "DxOMark adds bokeh and zoom to new smartphone camera scoring scale; DxOMark's testing protocol for scoring smartphone cameras adds zoom, bokeh". Digital Trends – Designtechnica Corporation.. 12 September 2017. https://www.DigitalTrends.com/mobile/dxomark-new-smartphone-scale/. 
  23. ↑ 23.0 23.1 23.2 23.3 Monckton, Paul (24 September 2019). "iPhone 11's best camera features now part of DxOMark tests". Forbes. https://www.forbes.com/sites/paulmonckton/2019/09/24/iphone-11s-best-camera-features-now-part-of-dxomark-tests/. 
  24. ↑ 24.0 24.1 "DxOMark adds Wide and Night scores to its tests, [Samsung Galaxy Note 10+ tops recalculated results"]. GSM Arena. 18 September 2019. https://www.GSMArena.com/dxomark_adds_wide_and_night_scores_to_its_tests_note_10_tops_recalculated_results-news-39240.php. 
  25. ↑ "DxOMark test shows superiority of Apple's cameras". Digital Information World. 22 October 2020. https://www.DigitalInformationWorld.com/2020/10/dxomark-test-shows-superiority-of.html. 
  26. ↑ "Here are the best selfie cameras on the market, according to DxOMark". Digital Trends – Designtechnica Corporation.. 22 January 2019. https://www.DigitalTrends.com/mobile/dxomark-adds-selfie-scores/. 
  27. ↑ 27.0 27.1 27.2 Monckton, Paul (22 January 2019). "How DxOMark's new test ranks selfie cameras". Forbes. https://www.forbes.com/sites/paulmonckton/2019/01/22/dxomark-selfie-introduced/. 
  28. ↑ 28.0 28.1 28.2 Lovejoy, Ben (10 October 2019). "DxOMark audio testing begins, with interesting results for iPhones - finds iPhone 11 Pro Max worse than iPhone XS Max". 9to5Mac blog. https://9to5mac.com/2019/10/10/dxomark-audio-testing/. 
  29. ↑ 29.0 29.1 29.2 Mehta, Ivan (10 October 2019). "DxOMark launches audio ranking to test recording and playback quality of phones". Plugged | The Next Web. https://TheNextWeb.com/plugged/2019/10/10/dxomark-launches-audio-ranking-to-test-recording-and-playback-quality-of-phones/. 
  30. ↑ "DXOMARK introduces new score for smartphone display and expands smartphone rear-camera testing". Markets Insider – Insider Inc. and finanzen.net GmbH. 21 October 2020. https://Markets.BusinessInsider.com/news/stocks/dxomark-introduces-new-score-for-smartphone-display-and-expands-smartphone-rear-camera-testing-1029707502. 
  31. ↑ "DXOMark announces new benchmark for the sound quality of wireless speakers". TechRadar – Future Publishing Limited. 4 November 2020. https://www.TechRadar.com/uk/news/dxomark-announces-new-benchmark-for-the-sound-quality-of-wireless-speakers. 
  32. ↑ "Introducing the DXOMARK Battery protocol" (in en-US). 2021-05-10. https://www.dxomark.com/introducing-the-dxomark-battery-protocol/. 
  33. ↑ "How do I use DxOMark?". Tony & Chelsea Northrup. https://Northrup.photo/gear-basics/faq/how-do-i-use-dxomark/. 
  34. ↑ 34.0 34.1 "Popular Photography: how we test". Popular Photography – Bonnier Corporation. 2 February 2013. http://www.PopPhoto.com/reviews. 
  35. ↑ "Publication Partagée" (in fr). Chasseur d’Images. http://www.ChassImages.com/minimags2/CI/CIPhotophones/index.html#/4/. 
  36. ↑ "How we test lenses". SLR Gear!. http://www.slrgear.com/articles/howwetest/howwetest.html. 
  37. ↑ "DxO Analyzer". DxOMark. https://corp.DxOMark.com/analyzer/. 
  38. ↑ "DxO Analyzer 5". Photography Blog. http://www.PhotographyBlog.com/news/dxo_analyzer_5/. 
  39. ↑ "HTC 10 gets the same DXOMark score as Galaxy S7". Android Central. 12 April 2016. http://www.AndroidCentral.com/htc-10-gets-same-dxomark-score-galaxy-s7. 
  40. ↑ "Leading camera lab report: Samsung Galaxy S7 Edge named new smartphone camera champion". Samsung Newsroom. 18 March 2016. https://news.Samsung.com/us/2016/03/18/leading-camera-lab-report-samsung-galaxy-s7-edge-named-new-smartphone-camera-champion/. 
  41. ↑ "How Google hopes its Pixel camera will win over iPhone fans". CNET. https://www.CNET.com/news/google-pixel-camera-design-lure-from-iphone/. 
  42. ↑ "8 times Google savagely burned Apple during the Pixel announcement". Mac World. http://www.MacWorld.com/article/3127734/ios/8-times-google-savagely-burned-apple-during-the-pixel-announcement.html#slide4. 
  43. ↑ "Google Pixel 2 and Pixel 2 XL". Verizon Wireless. https://www.VerizonWireless.com/wireless-devices/smartphones/google/. 
  44. ↑ Bagnell, Juan Carlos (4 October 2016). "Google Pixel: a great DxOMark score doesn't mean 'the best smartphone camera'". http://PocketNow.com/2016/10/04/google-pixel-a-great-dxomark-score. 
  45. ↑ "Who is hiding behind DxOMark scores?". Android PIT. https://www.AndroidPit.com/who-is-hiding-behind-dxomark-scores. 
  46. ↑ "Google's new Pixel 2 phone cameras are highly rated". Fortune. 4 October 2017. http://Fortune.com/2017/10/04/google-pixel-2-camera-dxomark-score/. 
  47. ↑ "DxOMark scores shouldn't be your definitive camera rating system". Android Authority. 9 October 2017. http://www.AndroidAuthority.com/dxomark-ranking-troublesome-805633/. 
  48. ↑ "A summary of MKBHD's explanation of DxOMark ratings". Resource. October 2017. http://ResourceMagOnline.com/2017/10/a-summary-of-mkbhds-explanation-of-dxomark-ratings/81499/. 
Further reading

External links



Retrieved from "https://handwiki.org/wiki/index.php?title=Engineering:DxOMark&oldid=3240913"