Pixel shift

From HandWiki
This very fine level of resolution was derived by merging four precursor images taken at sensor positions just one pixel apart.
Comparison of simple image (left) and image generated with pixel shift (right) (Click to enlarge)

Pixel shift is a method in digital cameras for producing a super resolution image. The method works by taking several images, after each such capture moving ("shifting") the sensor to a new position. In digital colour cameras that employ pixel shift, this avoids a major limitation inherent in using Bayer pattern for obtaining colour, and instead produces an image with increased colour resolution and, assuming a static subject or additional computational steps, an image free of colour moiré. Taking this idea further, sub-pixel shifting may increase the resolution of the final image beyond that suggested by the specified resolution of the image sensor.

Additionally, assuming that the various individual captures are taken at the same sensitivity, the final combined image will have less image noise than a single capture. This can be thought of as an averaging effect (for instance, in a pixel shift image composed of four individual frames with a classic Bayer pattern, every pixel in the final colour image is based on two measurements of the green channel).

An early pixel shift camera, the Kontron ProgRes 3012 digital camera, was used for the "Electronic Beowulf" project in the mid 1990s (https://www.uky.edu/~kiernan/welcome/1993.htm). The images were 3000x2000 pixels, 24 bit colour. Considered high resolution for the time.

List of cameras implementing pixel shift

All of the following cameras are fabricated with one imaging sensor, thus any kind of pixel shift requires a movement of the whole sensor.

Fujifilm

  • Fujifilm GFX50S II:
    contains a 51 Mpixel sensor. The Pixel Shift Multi-Shot mode shifts the imaging sensor by 0.5-pixel movements to obtain a sequence of 16 images that are subsequently merged into a 200 Mpixel image.[1]
  • Fujifilm GFX100:
    contains a 102 Mpixel sensor. A sequence of 16 pixel shifted images are merged into a 400 Mpixel image.[2]
  • Fujifilm GFX100S:
    contains a 102 Mpixel sensor. A sequence of 16 pixel shifted images are merged into a 400 Mpixel image[3]
  • Fujifilm GFX100IR:
    contains a 102 Mpixel sensor. A sequence of 16 pixel shifted images are merged into a 400 Mpixel image[4]
  • Fujifilm X-H2: contains a 40 Mpixel sensor. A sequence of 20 shifted images are merged into a 160 Mpixel image.[5]
  • Fujifilm X-T5: contains a 40 Mpixel sensor. A sequence of 20 shifted images are merged into a 160 Mpixel image.[6]

Olympus

  • Olympus OM-D E-M1 Mark II:
    contains a 20.4 Mpixel sensor. The High Res shot mode produces a 50 Mpixel image.[7]
  • Olympus OM-D E-M5 Mark II:
    contains a 16 Mpixel sensor. The High Res shot mode shifts the imaging sensor by 0.5-pixel movements to obtain a sequence of 8 images that are subsequently merged into a 40 Mpixel image.[8]
  • Olympus OM-D E-M5 Mark III:
    contains a 20.4 Mpixel sensor. The High Res shot mode shifts the imaging sensor by 0.5-pixel movements to obtain a sequence of 8 images that are subsequently merged into a 50 Mpixel image.[9]
  • Olympus OM-D E-M1X:
    contains a 20.4 Mpixel sensor. The camera sports two pixel shift mode: (a) the 80Mp Tripod mode produces an 80 Mpixel image, (b) the Handheld High Res shot mode produces a 50 Mpixel image.[10]
  • Olympus PEN-F:
    contains a 22 Mpixel sensor. The High Res Shot mode takes multiple images, continually shifting the position of the sensor in sub-pixel increments. Combining these images results in either a 50MP JPEG or an 80MP Raw file.[11]

OM System

  • OM System OM-1: contains a 20MPix sensor. The High Res Shot mode takes multiple images, and it can be used handheld or on a tripod. Handheld it will internally produce 50 Mpix files and 80 Mpix when mounted on a tripod.
  • OM System OM-5: contains a 20MPix sensor. The High Res Shot mode takes multiple images, and it can be used handheld or on a tripod. Handheld it will internally produce 50 Mpix files and 80 Mpix when mounted on a tripod.

Panasonic

  • Panasonic Lumix DC-G9:
    contains a 24.2 Mpixel sensor. The High Resolution Mode takes a sequence of 8 shots in quick succession between which the sensor is shifted by 0.5 pixel[12] for each image. These are subsequently merged into an 80 Mpixel image.[13]
  • Panasonic Lumix DC-S1:
    contains a 24.2 Mpixel sensor. The High Resolution Mode takes a sequence of shots in quick succession between which the sensor is shifted by a small amount. These are subsequently merged into a 96 Mpixel image.[14]
  • Panasonic Lumix DC-S1R:
    contains a 47.3 Mpixel sensor. The High Resolution Mode shifts the imaging sensor by a small increments to obtain a sequence of 8 images that are subsequently merged into a 187 Mpixel image.[15]
  • Panasonic Lumix DC-S1H
  • Panasonic Lumix DC-S5

Pentax

  • Pentax K-70:
    contains a 24.3 Mpixel sensor. The pixel shift mode takes a sequence of 4 shots between which the sensor is shifted by 1 pixel. These are subsequently merged into an image sporting 'all color data in each pixel to deliver super-high-resolution images'.[16]
  • Pentax KP:
    contains a 24.3 Mpixel sensor. The pixel shift mode takes a sequence of 4 shots between which the sensor is shifted by 1 pixel. These are subsequently merged into an image sporting 'high-resolution images with more accurate colours and much finer details'.[17]
  • Pentax K-3 II:
    contains a 24.3 Mpixel sensor. The pixel shift mode takes a sequence of 4 shots between which the sensor is shifted by 1 pixel. These are subsequently merged into an image sporting 'super-high-resolution images with far more truthful color reproduction and much finer details'.[18]
  • Pentax K-3 III:
    contains a 25.7 Mpixel sensor. The pixel shift mode takes a sequence of 4 shots between which the sensor is shifted by 1 pixel. These are subsequently merged into an image sporting 'a cancelling out of the Bayer pattern and removal of the need for sharpness-sapping demosaicing'.[19]
  • Pentax K-1:
    contains a 36.4 Mpixel sensor. The pixel shift mode takes a sequence of 4 shots between which the sensor is shifted by 1 pixel. These are subsequently merged into an image sporting 'improved detail and colour resolution'.[20]
  • Pentax K-1 II:
    contains a 36.4 Mpixel sensor. The camera sports two pixel shift mode: (a) a series of 4 tripod-stabilised images shifted by 1 pixel each are subsequently combined into a 47.3 Mpixel image, (b) a series of images taken in handheld mode are combined into a 47.3 Mpixel image that is, within limits, able to cope even with moving subjects.[21]

Sony

  • Sony α7R III:[22]
    contains a 42.4 Mpixel sensor. The pixel shift mode takes a sequence of 4 shots between which the sensor is shifted by 1 pixel. These are subsequently merged into a 42.4 Mpixel image with improved tonal resolution.[23]
  • Sony α7R IV:[24]
    contains a 61 Mpixel sensor. The camera has two pixel shift modes, (a) the first takes a sequence of 4 shots between which the sensor is shifted by 1 pixel. These are subsequently merged into a 61 Mpixel image with improved tonal resolution, (b) the other takes a sequence of 16 shots between which the sensor is shifted by 0.5 pixel. These are subsequently merged into a 240 Mpixel image with both enhanced detail and improved tonal resolution.[25]
  • Sony α1:[26]
    contains a 50 Mpixel sensor. The camera has two pixel shift modes, (a) the first takes a sequence of 4 shots between which the sensor is shifted by 1 pixel. These are subsequently merged into a 50 Mpixel image with improved tonal resolution, (b) the other takes a sequence of 16 shots between which the sensor is shifted by 0.5 pixel. These are subsequently merged into a 200 Mpixel image with both enhanced detail and improved tonal resolution.[27]

Hasselblad

  • Hasselblad H3DII:
    the model H3DII-39 sports a 39 Mpixel sensor, the model H3DII-50 a 50 Mpixel sensor. Both enable a pixel shift mode which takes a sequence of 4 shots between which the sensor is shifted by 1 pixel. These are subsequently merged into a single image.[28]
  • Hasselblad H4D series:
    the model H4D-200MS contains a 50 Mpixel sensor. The sensor sports 3 different pixel shift modes which take (a) a sequence of 6 shots taken at slight offsets, (b) a sequence of 4 shots between which the sensor is shifted by 1 pixel, (c) a sequence of 4 shots between which the sensor is shifted by 0.5 pixels. Images obtained by all three modes are subsequently merged into 200 Mpixel images.[29]
  • Hasselblad H5D series:
    both models H5D-50c MS and H5D-200c MS contain a 50 Mpixel sensor. This sensor sports 2 different pixel shift modes which take (a) a sequence of 6 shots with full and half pixel movements, (b) a sequence of 4 shots between which the sensor is shifted by exactly 1 pixel. Images obtained by both modes are subsequently merged into 200 Mpixel images.[30]
  • Hasselblad H6D-400c MS:
    the model H6D-400c contains a 100 Mpixel sensor. The camera provides two so called 'Multi-Shot modes', one that comprises a sequence of 4 shots, the other a total of 6 shots. Both involve moving the sensor by one pixel between shots to achieve real colour data for every pixel. The 6-shot Multi-Shot mode provides an additional two exposures, whereby the sensor is repositioned by 0.5 pixel horizontally and 0.5 pixel vertically. Four Multi-Shot images result in a 100 Mpixel image, a series of six Multi-Shot images is combined into a 400 Mpixel 16-bit TIFF image sporting a resolution of 23200 x 17400 pixels and sized at 2.4 GBytes.[31]

JVC

See also

References

  1. "The Fujifilm GFX 50S II is the least expensive medium-format digital camera ever, refer to chapter '"Pixel Shift Multi-Shot" function to capture and generate 200MP images free of false color'". dpreview. 2021-09-02. https://www.dpreview.com/news/9372460520/the-fujifilm-gfx-50s-ii-is-the-least-expensive-medium-format-digital-camera-ever. 
  2. "The Buyers guide to ... Which cameras have pixel shift?, refer to chapter 'Fujifilm GFX 100'". www.camerajabber.com. https://camerajabber.com/buyersguides/which-cameras-have-pixel-shift/. 
  3. "The Buyers guide to ... Which cameras have pixel shift?, refer to chapter 'Fujifilm GFX 100S'". www.camerajabber.com. https://camerajabber.com/buyersguides/which-cameras-have-pixel-shift/. 
  4. "Fujifilm Introduces GFX 100 IR for 100MP infrared imaging, refer to chapter 'Press release'". dpreview. 2020-11-25. https://www.dpreview.com/news/9281887406/fujifilm-introduces-fujifilm-gfx100-ir-for-100mp-infra-red-imaging. 
  5. "Fujifilm X-H2 initial review". https://www.dpreview.com/reviews/fujifilm-x-h2-initial-review. 
  6. "Fujifilm X-T5 initial review". https://www.dpreview.com/reviews/fujifilm-x-t5-initial-review. 
  7. "The Buyers guide to ... Which cameras have pixel shift?, refer to chapter 'Olympus OM-D E-M1 Mark II'". www.camerajabber.com. https://camerajabber.com/buyersguides/which-cameras-have-pixel-shift/. 
  8. "Olympus announces OM-D E-M5 II with 40MP high resolution mode". dpreview. 2015-02-05. https://www.dpreview.com/articles/9437515928/olympus-announces-om-d-e-m5-ii-with-40mp-high-resolution-mode. 
  9. "The Buyers guide to ... Which cameras have pixel shift?, refer to chapter 'Olympus OM-D E-M5 Mark III'". www.camerajabber.com. https://camerajabber.com/buyersguides/which-cameras-have-pixel-shift/. 
  10. "Olympus OM-D E-M1X Review, refer to chapter 'High Res Shot Mode'". www.camerajabber.com. 15 May 2019. https://camerajabber.com/olympus-om-d-e-m1x-review/. 
  11. "History Repeating: Olympus PEN-F Review, refer to chapter 'High Res Shot mode'". dpreview. 2016-02-24. https://www.dpreview.com/reviews/olympus-pen-f/9. 
  12. "Panasonic Lumix DC-G9 first impressions". dpreview. 2017-11-09. https://www.dpreview.com/reviews/panasonic-lumix-dc-g9-first-impressions?slide=5. 
  13. "The Buyers guide to ... Which cameras have pixel shift?, refer to chapter 'Panasonic Lumix DC-G9'". www.camerajabber.com. https://camerajabber.com/buyersguides/which-cameras-have-pixel-shift/. 
  14. "The Buyers guide to ... Which cameras have pixel shift?, refer to chapter 'Panasonic Lumix DC-S1'". www.camerajabber.com. https://camerajabber.com/buyersguides/which-cameras-have-pixel-shift/. 
  15. "The Buyers guide to ... Which cameras have pixel shift?, refer to chapter 'Panasonic Lumix DC-S1R'". www.camerajabber.com. https://camerajabber.com/buyersguides/which-cameras-have-pixel-shift/. 
  16. "Ricoh introduces weather-resistant Pentax K-70 with Hybrid AF and Pixel Shift, refer to chapter '5. PENTAX-original shake-reduction system featuring the Pixel Shift Resolution System'". dpreview. 2016-06-08. https://www.dpreview.com/news/2746194559/ricoh-introduces-weather-resistant-pentax-k-70-with-hybrid-af-and-pixel-shift. 
  17. "Pentax KP: price, specs, release date confirmed, refer to chapter 'Pentax KP Pixel Shift Resolution System'". www.camerajabber.com. 25 January 2017. https://camerajabber.com/pentax-kp-price-specs-release-date-confirmed/. 
  18. "PENTAX K-3 II - The new flagship model of the PENTAX K-series digital SLR cameras, refer to chapter '2. New-generation PENTAX-original shake reduction mechanism'". Pentax. https://news.ricoh-imaging.co.jp/rim_info2/2015/20150423_019143.html. 
  19. "Pentax K-3 Mark III initial review, refer to chapter 'Key specifications'". dpreview. https://www.dpreview.com/reviews/pentax-k-3-mark-iii-initial-review. 
  20. "Pentax K-1 Review - Image Quality, refer to chapter 'Pixel Shift'". dpreview. https://www.dpreview.com/reviews/pentax-k-1/8. 
  21. "The Buyers guide to ... Which cameras have pixel shift?, refer to chapter 'Pentax K-1 II'". www.camerajabber.com. https://camerajabber.com/buyersguides/which-cameras-have-pixel-shift/. 
  22. "Pixel-Shift-Multi-Aufnahme | SONY". https://support.d-imaging.sony.co.jp/support/ilc/psms/ilce7rm3/de/index.html. 
  23. "The Buyers guide to ... Which cameras have pixel shift?, refer to chapter 'Sony α7R III'". www.camerajabber.com. https://camerajabber.com/buyersguides/which-cameras-have-pixel-shift. 
  24. "Pixel-Shift-Multi-Aufnahme | SONY". https://support.d-imaging.sony.co.jp/support/ilc/psms/ilce7rm4/de/index.html. 
  25. "The Buyers guide to ... Which cameras have pixel shift?, refer to chapter 'Sony α7R IV'". www.camerajabber.com. https://camerajabber.com/buyersguides/which-cameras-have-pixel-shift. 
  26. "Pixel-Shift-Multi-Aufnahme | SONY". https://support.d-imaging.sony.co.jp/support/ilc/psms/ilce1/de/index.html. 
  27. "The Buyers guide to ... Which cameras have pixel shift?, refer to chapter 'Sony α1". www.camerajabber.com. https://camerajabber.com/buyersguides/which-cameras-have-pixel-shift. 
  28. "Hasselblad creates 50MP multi-shot full-color camera". dpreview. 2009-11-19. https://www.dpreview.com/articles/1998472460/hasselbladh3d50ms. 
  29. "Hasselblad H4D-200MS offers 200 megapixel multi-shot images". dpreview. 2011-05-26. https://www.dpreview.com/articles/3698399703/hasselbladms. 
  30. "Hasselblad unveils pixel-shifting 200MP H5D-200c MS". dpreview. 2014-08-22. https://www.dpreview.com/articles/4410648565/hasselblad-unveils-pixel-shifting-200mp-h5d-200c-ms. 
  31. "H6D-400C MULTI-SHOT". Hasselblad. 2021. https://www.hasselblad.com/h-system/h6d-400c-multi-shot/. 
  32. "JVC GZ-HD3 HD Camcorder flyer". https://www3.jvckenwood.com/english/press/2007/gz-hd3.pdf. 
  33. "JVC GZ-HD7 Press Release". https://www3.jvckenwood.com/english/press/2007/gz-hd3.pdf. 

Sources