References

(2022) ISET3d

Adelson EH (2001) On seeing stuff: The perception of materials by humans and machines. In: Human vision and electronic imaging VI. SPIE, pp 1–12

Adelson EH, Bergen JR (1991) The plenoptic function and the elements of early vision. In: Landy MS, Movshon JA (eds) Computational Models of Visual Processing. MIT Press, Cambridge, pp 3–20

Adelson EH, Wang JYA (1992) Single lens stereo with a plenoptic camera. IEEE Transactions on Pattern Analysis and Machine Intelligence 14:99–106

Airy GB (1835) On the diffraction of an object-glass with circular aperture. Transactions of the Cambridge Philosophical Society 5:283

Ayscough J (1755) A short account of the eye and nature of vision. Chiefly designed to illustrate the use and advantage of spectacles. ... By James Ayscough, optician. ... - The fourth edition. 1755

Backlund MP, Lew MD, Backer AS, et al (2012) Simultaneous, accurate measurement of the 3D position and orientation of single molecules. Proc Natl Acad Sci U S A 109:19087–19092

Banks MS, Sprague WW, Schmoll J, et al (2015) Why do animal eyes have pupils of different shapes? Sci Adv 1:e1500391

Barlow HB (1956) Retinal noise and absolute threshold. J Opt Soc Am 46:634–639

Bayer B (1976) Color imaging array. United States Patent, no. 3971065

Baylor DA (1987) Photoreceptor signals and vision. Proctor lecture. Investigative Ophthalmology and Visual Science 28:34–49

Betzig E, Patterson GH, Sougrat R, et al (2006) Imaging intracellular fluorescent proteins at nanometer resolution. Science 313:1642–1645

Bohndiek SE, Blue A, Clark AT, et al (2008) Comparison of methods for estimating the conversion gain of CMOS active pixel sensors. IEEE Sens J 8:1734–1744

Box GEP (1976) Science and Statistics. Journal of the American Statistical Association 71:791–799. https://doi.org/10.1080/01621459.1976.10480949

Boyle WS, Smith G (1971) Charge-coupled devices - a new approach to MIS device structures. IEEE Spectr 8:18–27

Boyle WS, Smith GE (1970) Charge coupled semiconductor devices. Bell Syst Tech J 49:587–593

Brindley GS (1970) Physiology of the Retina and Visual Pathway. Williams & Wilkins

Catrysse PB, Zhao N, Jin W, Fan S (2022) Subwavelength bayer RGB color routers with perfect optical efficiency. Nanophotonics 11:2381–2387

Catrysse P, Fan S (2023) Spectral routers for snapshot multispectral imaging. Appl Phys Lett

Cohen J (1964) Dependency of the spectral reflectance curves of the munsell color chips. Bull Psychon Soc 1:369–370

Cote RH (2006) Photoreceptor phosphodiesterase (PDE6): A G-protein-activated PDE regulating visual excitation in rod and cone photoreceptor cells. In: Cyclic nucleotide phosphodiesterases in health and disease. CRC Press, pp 165–193

Curcio CA, Sloan KR, Kalina RE, Hendrickson AE (1990) Human photoreceptor topography. Journal of Comparative Neurology 292:497–523

Da Vinci L (1970) The Notebooks of Leonardo Da Vinci. Dover, New York

Delbracio M, Kelly D, Brown MS, Milanfar P (2021) Mobile Computational Photography: A Tour. Annual review of vision science 7:571–604

DeMonasterio FM, Schein SJ, McCrane EP (1981) Staining of blue-sensitive cones of the macaque retina by a fluorescent dye. Science 213:1278–1281

DiCarlo JM, Wandell B (2000) Illuminant estimation: Beyond the bases. Color Imaging Conf 91–96

DiCarlo JM, Wandell BA (2003) Spectral estimation theory: Beyond linear but before Bayesian. Journal of the Optical Society of America A, Optics, Image Science, and Vision 20:1261–1270

Dickson R, Cubitt AB, Tsien R, Moerner W (1997) On/off blinking and switching behaviour of single molecules of green fluorescent protein. Nature 388:355–358

El Gamal A, Eltoukhy H (2005) CMOS image sensors. IEEE Circuits and Devices Magazine 21:6–20

Faraday M (1832) V. Experimental researches in electricity. Philos Trans R Soc Lond 122:125–162

Feynman RP, Leighton RB, Sands M (1963) The Feynman Lectures on Physics, Vol. I: Mainly Mechanics, Radiation, and Heat. Addison-Wesley, Boston

Fossum ER (1997) CMOS image sensors: Electronic camera-on-a-chip. IEEE Transactions on Electron Devices 44:1689–1698

Fossum ER (1993) Active pixel sensors: Are CCDs dinosaurs? In: Blouke MM (ed) Charge-coupled devices and solid state optical sensors III. SPIE, pp 2–14

Fossum ER (2023) The invention and development of CMOS image sensors: A camera in every pocket. In: Nathan A, Saha SK, Todi RM (eds) 75th anniversary of the transistor. Wiley Online Library, pp 281–291

Fossum ER, Hondongwa DB (2014) A review of the pinned photodiode for CCD and CMOS image sensors. IEEE J Electron Devices Soc 2:33–43

Fossum ER, Mendis S, Kemeny SE (1995) Active pixel sensor with intra-pixel charge transfer. US Patent

Fossum ER, Teranishi N, Theuwissen AJP (2024) Digital image sensor evolution and new frontiers. Annu Rev Vis Sci 10:171–198

Fowler B, El GA (1995) U.S. Patent no. 5,461,425. US Patent 5,461,425

Fröch JE, Chakravarthula P, Sun J, et al (2025) Beating spectral bandwidth limits for large aperture broadband nano-optics. Nat Commun 16:3025

Gershun A (1939) The Light Field. Journal of Mathematical Physics 18:51–151

Goodman JW (2022) Introduction to fourier optics, 4th edn. W.H. Freeman, New York, NY

Goodman JW, Wandell BA (1996) Image systems engineering at stanford. In: Proceedings of 3rd IEEE international conference on image processing. pp 435–438 vol.1

Goossens T, Lyu Z, Ko J, et al (2022) Ray-transfer functions for camera simulation of 3D scenes with hidden lens design. Optics Express 30:24031–24047

Grimaldi FM (1665) Physico-mathesis de lvmine, coloribvs, et iride, aliisque adnexis libri duo: Opvs posthvmvm

Han C-F, Chiou J-M, Lin J-F (2020) Deep trench isolation and inverted pyramid array structures used to enhance optical efficiency of photodiode in CMOS image sensor via simulations. Sensors (Basel) 20:3062

Hasinoff SW, Sharlet D, Geiss R, et al (2016) Burst photography for high dynamic range and low-light imaging on mobile cameras. ACM Trans Graph 35:1–12

Helmholtz H (1896) Physiological optics. Dover Publications, Inc., New York

Hernández-Andrés J, Romero J, Nieves JL, Lee RL Jr (2001) Color and spectral analysis of daylight in southern europe. J Opt Soc Am A Opt Image Sci Vis 18:1325–1335

Hertz H (1887a) Ueber sehr schnelle electrische schwingungen. Ann Phys 267:421–448

Hertz H (1887b) Ueber einen einfluss des ultravioletten lichtes auf die electrische entladung. Ann Phys 267:983–1000

Hirsch J, Miller WH (1987) Does cone positional disorder limit resolution? Journal of the Optical Society of America A 4:1481–1492

Hofer H, Carroll J, Neitz J, et al (2005) Organization of the human trichromatic cone mosaic. J Neurosci 25:9669–9679

Hofer HJ, Williams DR (2014) Color vision and the retinal mosaic. In: Chalupa LM, Werner JS (eds) The New Visual Neurosciences. MIT Press, Cambridge, MA, pp 469–483

Hullin MB, Hanika J, Heidrich W (2012) Polynomial optics: A construction kit for efficient ray-tracing of lens systems. Computer Graphics Forum 31:1375–1383

Huygens C (1690) Traité de la lumière où sont expliquées les causes de ce qui lui arrive dans la réflexion et dans la réfraction. Pierre van der Aa, Leiden

Hwang J-H, Kim Y (2023a) A numerical method of aligning the optical stacks for all pixels. Sensors (Basel) 23:702

Hwang J-H, Kim Y (2023b) Covered microlens structure for quad color filter array of CMOS image sensor. Curr Opt Photonics 7:485–495

Isaacson W (2008) Einstein: His life and universe. Simon; Schuster

Jenkins FA, White HE (1976) Fundamentals of optics, 4th edn. McGraw-Hill, New York, NY

Judd DB, MacAdam DL, Wyszecki G, et al (1964) Spectral distribution of typical daylight as a function of correlated color temperature. Journal of The Optical Society of America 54:1031

Kleinfelder S, Lim S, Liu X, El Gamal A (2001) A 10000 frames/s CMOS digital pixel sensor. IEEE J Solid-State Circuits 36:2049–2059

Kuhn J, Lodieu N, López RR, et al (2025) Creating ground-based telescopes for imaging interferometry: SELF and ELF. gxjzz 6:1

Lee AB, Mumford D, Huang J (2001) Occlusion models for natural images: A statistical study of a scale-invariant dead leaves model. Int J Comput Vis 41:35–59

Levoy M, Hanrahan P (1996) Light field rendering. Association for Computing Machinery, New York, NY, USA, pp 31–42

Maaten L, Postma E, Herik J (2008) Dimensionality reduction: A comparative review

Maloney LT (1986) Evaluation of linear models of surface spectral reflectance with small numbers of parameters. Journal of The Optical Society of America A 3:1673–1683

Mandel L (1959) Fluctuations of photon beams: The distribution of the photo-electrons. Proc Phys Soc 74:233–243

Massey SC (2006) Functional anatomy of the mammalian retina. In: Retina. Elsevier, pp 43–82

Maxwell JC (1872) On color vision. 75–83

Maxwell JC (1860) IV. On the theory of compound colours, and the relations of the colours of the spectrum. 150:57–84

Maxwell JC, Zaidi Q (1993) On the theory of compound colours, and the relations of the colours of the spectrum. Color Research and Application 18:270–287

Moerner WE, Kador L (1989) Optical detection and spectroscopy of single molecules in a solid. Phys Rev Lett 62:2535–2538

Monasterio FD de, McCrane E, Newlander J, Schein S (1985) Density profile of blue-sensitive cones along the horizontal meridian of macaque retina. Invest Ophthalmol Vis Sci 26:289–302

Ng R, Levoy M, Brédif M, et al (2005) Light field photography with a hand-held plenoptic camera. PhD thesis, Stanford university

Øersted HC (1820) Experiments on the effect of a current of electricity on the magnetic needle. Annals of Philosophy

Oike Y (2022) Evolution of image sensor architectures with stacked device technologies. IEEE Trans Electron Devices 69:2757–2765

Park BJ, Jung J, Moon C-R, et al (2007) Deep trench isolation for crosstalk suppression in active pixel sensors with 1.7 µm pixel pitch. Japanese Journal of Applied Physics 46:2454

Parkkinen JPS, Hallikainen J, Jaaskelainen T (1989) Characteristic spectra of munsell colors. J Opt Soc Am A, JOSAA 6:318–322

Pavani SRP, Piestun R (2008) Three dimensional tracking of fluorescent microparticles using a photon-limited double-helix response system. Opt Express 16:22048–22057

Pharr M, Jakob W, Humphreys G PBRT: Version 4

Pirenne MH (1951) Quantum physics of vision theoretical discussion. Prog Biophys Biophys Chem 2:193–223

Preece BL, Haefner DP (2022) 3D noise photon transfer curve. Appl Opt 61:6202–6212

Roorda A, Williams D (1999) The arrangement of the three cone classes in the living human eye. Nature 397:520–522

Rust MJ, Bates M, Zhuang X (2006) Sub-diffraction-limit imaging by stochastic optical reconstruction microscopy (STORM). Nat Methods 3:793–795

Schmid AC, Barla P, Doerschner K (2023) Material category of visual objects computed from specular image structure. Nat Hum Behav 7:1152–1169

Schmidt F, Hebart MN, Schmid AC, Fleming RW (2025) Core dimensions of human material perception. Proc Natl Acad Sci U S A 122:e2417202122

Serabyn E, Huby E, Matthews K, et al (2017) The w. M. Keck observatory infrared vortex coronagraph and a first image of hip 79124 b. Astron J 153:43

Shapiro AE (1989) Huygens’ traité de la lumière and newton’s opticks: Pursuing and eschewing hypotheses. Notes Rec R Soc Lond 43:223–247

Smith AM (1982) Ptolemy’s search for a law of refraction: A case-study in the classical methodology of “saving the appearances” and its limitations. Arch Hist Exact Sci 26:221–240

Stryer L (1986) Cyclic GMP cascade of vision. Annu Rev Neurosci 9:87–119

Thatte J, Lian T, Wandell B, Girod B (2017) Stacked omnistereo for virtual reality with six degrees of freedom. In: 2017 IEEE visual communications and image processing (VCIP). IEEE

Thibos LN (2020) Retinal image formation and sampling in a three-dimensional world. Annual review of vision science 6:469–489

Thibos LN, Hong X, Bradley A, Cheng X (2002) Statistical variation of aberration structure and image quality in a normal population of healthy eyes. Journal of the Optical Society of America A 19:2329–2348

Tominaga S, Nishi S, Ohtera R (2021) Measurement and estimation of spectral sensitivity functions for mobile phone cameras. Sensors (Basel, Switzerland) 21:4985

Tompsett M, Amelio G, Smith GE (1970) CHARGE COUPLED 8‐BIT SHIFT REGISTER. Applied Physics Letters 17:111–115

Tompsett MF (1978) Charge transfer imaging devices. US Patent

Torralba A, Freeman WT (2012) Accidental pinhole and pinspeck cameras: Revealing the scene outside the picture. In: 2012 IEEE conference on computer vision and pattern recognition. pp 374–381

Tournier A, Leverd F, Favennec L, et al (2011) R 5 pixel-to-pixel isolation by deep trench technology : Application to CMOS image sensor

Udoy MRI, Alam S, Islam MM, et al (2025) A review of digital pixel sensors. IEEE Access 13:8533–8551

von Helmholtz H (1925) Helmholtz’s treatise on physiological optics. Optical Society of America

Vrhel MJ, Gershon R, Iwan LS (1994) Measurement and analysis of object reflectance spectra. Color Research And Application 19:4–9

Wandell BA (1995) Foundations of vision: Behaviour, neuroscience, and computation. Sinauer Associates, Sunderland, MA

Wandell BA, Brainard D (2021) Principles and consequences of the initial visual encoding. In: F. Gregory Ashby HC, Dzhafarov EN (eds) New handbook of mathematical psychology

Wandell BA, El Gamal A, Girod B (2002) Common principles of image acquisition systems and biological vision. Proceedings of the IEEE 90:5–17

Wang F, Theuwissen A (2017) Linearity analysis of a CMOS image sensor. IS&T Int Symp Electron Imaging 29:84–90

Wikler KC, Rakic P (1990) Distribution of photoreceptor subtypes in the retina of diurnal and nocturnal primates. J Neurosci 10:3390–3401

Wood RW (1906) Fish-eye views, and vision under water. The London, Edinburgh, and Dublin Philosophical Magazine and Journal of Science 6, 12th series (LXVIII):159–161

Xian W, Božič A, Snavely N, Lassner C (2023) Neural lens modeling. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp 8435–8445

Young T (1804a) A reply to the animadversions of the Edinburgh reviewers, on some papers, published in the philosophical transactions. Savage and Easingwood

Young T (1804b) The Bakerian Lecture: Experiments and Calculations Relative to Physical Optics. Philosophical Transactions of the Royal Society of London 94:1–16. https://doi.org/10.1098/rstl.1804.0001