SpringerLink
Log in

High dynamic range image reconstruction for multi-bit quanta image sensor

  • Published:
Optoelectronics Letters Aims and scope Submit manuscript

Abstract

An adaptive thresholds algorithm is proposed in this letter, which is used to determine the global optimal thresholds for multi-bit quanta image sensor (MB-QIS). Firstly, the senor model of MB-QIS is set up. Then global optimal thresholds theory is analyzed and a thresholds optimization algorithm based on the binary search is designed to determine the optimal global thresholds. Finally, the high dynamic range (HDR) images are reconstructed by the noniterative maximum likelihood estimation (MLE) image reconstruction method. The results of simulation prove that HDR imaging of MB-QIS is realized by the proposed method effectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. FOSSUM E R. What to do with sub-diffraction-limit (SDL) pixels?- a proposal for a gigapixel digital film sensor (DFS)[C]//IEEE Workshop on Charge-Coupled Devices and Advanced Image Sensors, 2005, Nagano, Japan. New York: IEEE, 2005: 214–217.

    Google Scholar 

  2. FOSSUM E R. The quanta image sensor (QIS): concepts and challenges[C]//Imaging Systems and Applications, July 10–14, 2011, Toronto, Canada. Washington: Optical Society of America, 2011: 10–14.

    Google Scholar 

  3. MASOODIAN S, MA J, STARKEY D, et al. A 1Mjot 1040fps 0.22e-rms stacked BSI quanta image sensor with cluster-parallel readout[C]//2017 International Image Sensor Workshop, May 30-June 2, 2017, Hiroshima, Japan. International Image Sensor Society, 2017: 230–233.

  4. FOSSUM E R. Modeling the performance of single-bit and multi-bit quanta image sensors[J]. IEEE journal of the electron devices society, 2013, 1(9): 166–174.

    Article  Google Scholar 

  5. FOSSUM E R. Multi-bit quanta image sen-sors[C]//2015 International Image Sensor Workshop, June 8–11, 2015, Vaals, The Netherlands. International Image Sensor Society, 2015: 292–295.

  6. YIN Z Y, WANG Y B M, FOSSUM E R. Low bit-depth ADCs for multi-bit quanta image sensors[J]. IEEE journal of solid-state circuits, 2021, 56(3): 950–960.

    Article  ADS  Google Scholar 

  7. YANG F, LU Y M, SBAIZ L, et al. Bits from photons: oversampled image acquisition using binary Poisson statistics[J]. IEEE transactions on image processing, 2012, 21(4): 1421–1436.

    Article  ADS  MathSciNet  Google Scholar 

  8. CHAN S H, ELGENDY O A, WANG X. Images from bits: non-iterative image reconstruction for quanta image sensors[J]. Sensors, 2016, 16(11): 1961–1982.

    Article  ADS  Google Scholar 

  9. ROJAS R A, LUO W Y, MURRAY V, et al. Learning optimal parameters for binary sensing image reconstruction algorithms[C]//2017 IEEE International Conference on Image Processing, September 17–20, 2017, Bei**g, China. New York: IEEE, 2017: 2791–2795.

    Google Scholar 

  10. CHOI J H, ELGENDY O A, CHAN S H. Image reconstruction for quanta image sensors using deep neural networks[C]//2018 IEEE International Conference on Acoustics, Speech and Signal Processing, April 15–20, 2018, Calgary, AB, Canada. New York: IEEE, 2018: 6543–6547.

    Google Scholar 

  11. CHAN S H, LU Y M. Efficient image reconstruction for gigapixel quantum image sensors[C]//Proceedings of the 2014 IEEE Global Conference on Signal and Information Processing, December 3–5, 2014, Atlanta, GA USA. New York: IEEE, 2014: 312–316.

    Google Scholar 

  12. WONG H T, LEUNG C S, HO D. Theoretical analysis and image reconstruction for multi-bit quanta image sensors[J]. Signal processing, 2021, 185: 108087.

    Article  Google Scholar 

  13. ELGENDY O A, CHAN S H. Optimal threshold design for quanta image sensor[J]. IEEE transactions on computational imaging, 2017, 4(1): 99–111.

    Article  MathSciNet  Google Scholar 

  14. GNANASAMBANDAM A, MA J, CHAN S H. HDR imaging with quanta image sensors: theoretical limits and optimal reconstruction[J]. IEEE transactions on computational imaging, 2020, 6: 1571–1585.

    Article  Google Scholar 

  15. GAO J, DU X X, NIE K M, et al. Analysis and elimination method of the non-fixed column noise for quantum image sensor[J]. IEEE sensor journal, 2020, 20(1): 318–327.

    Article  ADS  Google Scholar 

  16. MA J J, ZHANG D X, ELGENDY O A, et al. A 0.19e-rms read noise 16.7Mpixel stacked quanta image sensor with 1.1 µm-pitch backside illuminated pixels[J]. IEEE electron device letters, 2021, 42(6): 891–894.

    Article  ADS  Google Scholar 

  17. MA J J, ZHANG D X, ELGENDY O A, et al. A photon-counting 4Mpixel stacked BSI quanta image sensor with 0.3e-read noise and 100dB single-exposure dynamic range[C]//2021 Symposium on VLSI Technology, June 13–19, 2021, Kyoto, Japan. New York: IEEE, 2021.

    Google Scholar 

  18. LIU B W, XU J T. Modeling the photon counting and photoelectron counting characteristics of quanta image sensors[J]. Journal of semiconductors, 2021, 42(6): 062301.

    Article  Google Scholar 

  19. ZHAO T, GAO J, XU J T, et al. Optimized oversam-pling and readout circuit design for quanta image sen-sor[J]. Laser & optoelectronics progress, 2021, 58(24): 2403001. (in Chinese)

    Article  Google Scholar 

  20. FOSSUM E R. Analog read noise and quantizer threshold estimation from quanta image sensor bit density[J]. IEEE journal of the electron devices society, 2022, 10: 269–274.

    Article  Google Scholar 

  21. XU J T, ZHAO X Y, HAN L Q, et al. Effect of the transition points mismatch on quanta image sensors[J]. Sensors, 2018, 18(12): 4357–4370.

    Article  ADS  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Tian** Key Laboratory of Imaging and Sensing Microelectronic Technology, School of Microelectronics, Tian** University, Tian**, 300072, China

    **g Gao, Zongyao Shang & Kaiming Nie

  2. College of Intelligence and Computing, Tian** University, Tian**, 300072, China

    Tao Luo

Authors
  1. **g Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zongyao Shang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kaiming Nie
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Tao Luo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tao Luo.

Additional information

Statements and Declarations

The authors declare that there are no conflicts of interest related to this article.

This work has been supported by the National Key R&D Program of China (No.2019YFB2204300).

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gao, J., Shang, Z., Nie, K. et al. High dynamic range image reconstruction for multi-bit quanta image sensor. Optoelectron. Lett. 18, 553–558 (2022). https://doi.org/10.1007/s11801-022-2014-9

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11801-022-2014-9

Document code

Search

Navigation