References
(2022) ISET3d
Adelson EH (2001) On seeing stuff: The perception of
materials by humans and machines. In: Human vision and electronic
imaging VI. SPIE, pp 1–12
Adelson EH, Bergen JR (1991) The plenoptic function and the elements of
early vision. In: Landy MS, Movshon JA (eds) Computational
Models of Visual Processing. MIT Press,
Cambridge, pp 3–20
Adelson EH, Wang JYA (1992) Single lens stereo with a plenoptic camera.
IEEE Transactions on Pattern Analysis and Machine Intelligence 14:99–106
Airy GB (1835) On the diffraction of an object-glass with circular
aperture. Transactions of the Cambridge Philosophical Society 5:283
Ayscough J (1755) A short account of the eye and nature of vision.
Chiefly designed to illustrate the use and advantage of spectacles. ...
By James Ayscough, optician. ... - The fourth edition. 1755
Backlund MP, Lew MD, Backer AS, et al (2012) Simultaneous, accurate
measurement of the 3D position and orientation of single
molecules. Proc Natl Acad Sci U S A 109:19087–19092
Banks MS, Sprague WW, Schmoll J, et al (2015) Why do animal eyes have
pupils of different shapes? Sci Adv 1:e1500391
Barlow HB (1956) Retinal noise and
absolute threshold. J Opt Soc Am 46:634–639
Bayer B (1976) Color imaging
array. United States Patent, no. 3971065
Baylor DA (1987) Photoreceptor signals
and vision. Proctor lecture. Investigative
Ophthalmology and Visual Science 28:34–49
Betzig E, Patterson GH, Sougrat R, et al (2006) Imaging intracellular
fluorescent proteins at nanometer resolution. Science 313:1642–1645
Bohndiek SE, Blue A, Clark AT, et al (2008) Comparison of methods
for estimating the conversion gain of CMOS active pixel
sensors. IEEE Sens J 8:1734–1744
Box GEP (1976) Science and Statistics. Journal of the
American Statistical Association 71:791–799. https://doi.org/10.1080/01621459.1976.10480949
Boyle WS, Smith G (1971) Charge-coupled
devices - a new approach to MIS device structures. IEEE
Spectr 8:18–27
Boyle WS, Smith GE (1970) Charge
coupled semiconductor devices. Bell Syst Tech J 49:587–593
Burkey BC, Chang W-C, Littlehale J, et al (1984) The pinned photodiode
for an interline-transfer CCD image sensor. In: 1984
international electron devices meeting. pp 28–31
Catrysse PB, Zhao N, Jin W, Fan S (2022) Subwavelength bayer
RGB color routers with perfect optical efficiency.
Nanophotonics 11:2381–2387
Catrysse P, Fan S (2023) Spectral routers for snapshot
multispectral imaging. Appl Phys Lett
Cohen J (1964) Dependency of the spectral reflectance curves of the
Munsell color chips. Psychonomic Science 1:369–370
Cote RH (2006) Photoreceptor
phosphodiesterase (PDE6): A
G-protein-activated PDE regulating visual
excitation in rod and cone photoreceptor cells. In: Cyclic
nucleotide phosphodiesterases in health and disease. CRC Press, pp
165–193
Curcio CA, Sloan KR, Kalina RE, Hendrickson AE (1990) Human
photoreceptor topography. Journal of Comparative Neurology 292:497–523
Da Vinci L (1970) The Notebooks of Leonardo Da
Vinci. Dover, New York
Delbracio M, Kelly D, Brown MS, Milanfar P (2021) Mobile
Computational Photography: A Tour. Annual
review of vision science 7:571–604
Deng J, Dong W, Socher R, et al (2009) Imagenet: A
large-scale hierarchical image database. 2009 IEEE conference
DiCarlo JM, Wandell B (2000) Illuminant
estimation: Beyond the bases. Color Imaging Conf 91–96
DiCarlo JM, Wandell BA (2003) Spectral estimation theory:
Beyond linear but before Bayesian. Journal of
the Optical Society of America A, Optics, Image Science, and Vision
20:1261–1270
Dickson R, Cubitt AB, Tsien R, Moerner W (1997) On/off blinking and switching
behaviour of single molecules of green fluorescent protein. Nature
388:355–358
El Gamal A, Eltoukhy H (2005) CMOS image sensors. IEEE
Circuits and Devices Magazine 21:6–20
Faraday M (1832) V.
Experimental researches in electricity. Philos Trans R Soc Lond
122:125–162
Feynman RP, Leighton RB, Sands M (1963) The feynman lectures on physics,
vol. I: Mainly mechanics, radiation, and heat.
Addison-Wesley, Reading, MA
Fossum ER (1997) CMOS image sensors:
Electronic camera-on-a-chip. IEEE Transactions on Electron
Devices 44:1689–1698
Fossum ER (1993) Active
pixel sensors: Are CCDs dinosaurs? In: Blouke MM (ed)
Charge-coupled devices and solid state optical sensors III. SPIE, pp
2–14
Fossum ER (2023) The invention and
development of CMOS image sensors: A camera in every
pocket. In: Nathan A, Saha SK, Todi RM (eds) 75th anniversary of the
transistor. Wiley Online Library, pp 281–291
Fossum ER, Hondongwa DB (2014) A review of the
pinned photodiode for CCD and CMOS image
sensors. IEEE J Electron Devices Soc 2:33–43
Fossum ER, Mendis S, Kemeny SE (1995) Active pixel
sensor with intra-pixel charge transfer. US Patent
Fossum ER, Teranishi N, Theuwissen AJP (2024) Digital
image sensor evolution and new frontiers. Annu Rev Vis Sci
10:171–198
Fowler B, El GA (1995) U.S.
Patent no. 5,461,425. US Patent 5,461,425
Fröch JE, Chakravarthula P, Sun J, et al (2025) Beating spectral
bandwidth limits for large aperture broadband nano-optics. Nat
Commun 16:3025
Geisler WS (2008) Visual
perception and the statistical properties of natural scenes. Annu
Rev Psychol 59:167–192
Gershun A (1939) The Light Field. Journal of Mathematical
Physics 18:51–151
Goodman JW (2022) Introduction to fourier optics, 4th edn. W.H. Freeman,
New York, NY
Goodman JW, Wandell BA (1996) Image systems
engineering at stanford. In: Proceedings of 3rd IEEE international
conference on image processing. pp 435–438 vol.1
Goossens T, Lyu Z, Ko J, et al (2022) Ray-transfer functions for camera
simulation of 3D scenes with hidden lens design. Optics
Express 30:24031–24047
Grimaldi FM (1665) Physico-mathesis de lvmine, coloribvs, et iride,
aliisque adnexis libri duo: Opvs posthvmvm
Guidash RM, Lee PPK, Lee T-H, et al (1997) A 0.6 μm
CMOS pinned photodiode color imager technology. In:
1997 international electron devices meeting (IEDM) technical digest. pp
927–929
Han C-F, Chiou J-M, Lin J-F (2020) Deep trench isolation and
inverted pyramid array structures used to enhance optical efficiency of
photodiode in CMOS image sensor via simulations.
Sensors (Basel) 20:3062
Hardeberg JY (2002) On the
spectral dimensionality of object colours. In: Conference on colour
in graphics, imaging, and vision. Society of Imaging Science;
Technology, pp 480–485
Hasinoff SW, Sharlet D, Geiss R, et al (2016) Burst photography for high
dynamic range and low-light imaging on mobile cameras. ACM Trans Graph
35:1–12
Helmholtz H (1896) Physiological optics. Dover Publications, Inc., New
York
Hernández-Andrés J, Romero J, Nieves JL, Lee RL Jr (2001) Color
and spectral analysis of daylight in southern europe. J Opt Soc Am A
Opt Image Sci Vis 18:1325–1335
Hertz H (1887a) Ueber sehr schnelle
electrische schwingungen. Ann Phys 267:421–448
Hertz H (1887b) Ueber einen einfluss
des ultravioletten lichtes auf die electrische entladung. Ann Phys
267:983–1000
Hirsch J, Miller WH (1987) Does cone positional disorder limit
resolution? Journal of the Optical Society of America A, Optics and
Image Science 4:1481–1492
Hofer H, Carroll J, Neitz J, et al (2005) Organization of
the human trichromatic cone mosaic. J Neurosci 25:9669–9679
Hofer HJ, Williams DR (2014) Color vision and the retinal mosaic. In:
Chalupa LM, Werner JS (eds) The New Visual Neurosciences.
MIT Press, Cambridge, MA, pp 469–483
Hullin MB, Hanika J, Heidrich W (2012) Polynomial optics: A
construction kit for efficient ray-tracing of lens systems. Computer
Graphics Forum 31:1375–1383
Huygens C (1690) Treatise on the lvmière: Where are
explained the causes of what happens to it in the Éflection
& in the Éfraction, and particularly in the
Éstrange Éfraction of Iceland
crystal. Pierre vander Aa
Hwang J-H, Kim Y (2023a) A
numerical method of aligning the optical stacks for all pixels.
Sensors (Basel) 23:702
Hwang J-H, Kim Y (2023b) Covered microlens
structure for quad color filter array of CMOS image
sensor. Curr Opt Photonics 7:485–495
Isaacson W (2008) Einstein: His life and universe. Simon; Schuster
Jenkins FA, White HE (1976) Fundamentals of optics, 4th edn.
McGraw-Hill, New York, NY
Judd DB, MacAdam DL, Wyszecki G, et al (1964) Spectral distribution of
typical daylight as a function of correlated color temperature. Journal
of The Optical Society of America 54:1031
Kleinfelder S, Lim S, Liu X, El Gamal A (2001) A 10000 frames/s
CMOS digital pixel sensor. IEEE J Solid-State Circuits
36:2049–2059
Kuhn J, Lodieu N, López RR, et al (2025) Creating ground-based
telescopes for imaging interferometry: SELF and
ELF. gxjzz 6:1
Lee AB, Mumford D, Huang J (2001) Occlusion models for
natural images: A statistical study of a scale-invariant dead leaves
model. Int J Comput Vis 41:35–59
Lee PPK, Gee RC, Guidash RM, et al (1995) An active pixel sensor
fabricated using CMOS/CCD process technology. In: IEEE
workshop on charge-coupled devices and advanced image sensors. pp
115–119
Lee PPK, Guidash RM, Lee T-H, Stevens EG (1997) Active pixel sensor
integrated with a pinned photodiode
Levoy M, Hanrahan P (1996) Light field rendering.
Association for Computing Machinery, New York, NY, USA, pp 31–42
Liang J, Williams DR, Miller DT (1997) Supernormal vision and
high-resolution retinal imaging through adaptive optics. Journal of the
Optical Society of America A, Optics, Image Science, and Vision
14:2884–2892
Liu Z, Kurokawa K, Zhang F, et al (2017) Imaging and quantifying
ganglion cells and other transparent neurons in the living human
retina. Proc Natl Acad Sci U S A 114:12803–12808
Maaten L, Postma E, Herik J (2008) Dimensionality
reduction: A comparative review
Maloney LT (1986) Evaluation of linear models of surface spectral
reflectance with small numbers of parameters. Journal of The Optical
Society of America A 3:1673–1683
Mandel L (1959) Fluctuations of
photon beams: The distribution of the photo-electrons. Proc Phys Soc
74:233–243
Marte ME, Kurokawa K, Jung H, et al (2024) Characterizing presumed
displaced retinal ganglion cells in the living human retina of healthy
and glaucomatous eyes. Invest Ophthalmol Vis Sci 65:20
Massey SC (2006) Functional anatomy of the mammalian retina. In: Retina.
Elsevier, pp 43–82
Maxwell JC (1860) IV. On the theory of
compound colours, and the relations of the colours of the spectrum.
150:57–84
Maxwell JC (1872) On color vision. 75–83
Maxwell JC, Zaidi Q (1993) On the theory of compound colours, and the
relations of the colours of the spectrum. Color Research and Application
18:270–287
Moerner WE, Kador L (1989) Optical detection
and spectroscopy of single molecules in a solid. Phys Rev Lett
62:2535–2538
Monasterio FM de, Schein SJ, McCrane EP (1981) Staining of
blue-sensitive cones of the macaque retina by a fluorescent dye. Science
213:1278–1281
Ng R, Levoy M, Brédif M, et al (2005) Light field photography with a
hand-held plenoptic camera. PhD thesis, Stanford university
Øersted HC (1820) Experiments on the effect of a current of electricity
on the magnetic needle. Annals of Philosophy
Oike Y (2022) Evolution
of image sensor architectures with stacked device technologies. IEEE
Trans Electron Devices 69:2757–2765
Park BJ, Jung J, Moon C-R, et al (2007) Deep trench isolation
for crosstalk suppression in active pixel sensors with 1.7 m pixel
pitch. Japanese Journal of Applied Physics 46:2454
Parkkinen JPS, Hallikainen J, Jaaskelainen T (1989) Characteristic
spectra of munsell colors. J Opt Soc Am A, JOSAA 6:318–322
Pavani SRP, Piestun R (2008) Three dimensional tracking
of fluorescent microparticles using a photon-limited double-helix
response system. Opt Express 16:22048–22057
Pharr M, Jakob W, Humphreys G PBRT: Version 4
Pirenne MH (1951) Quantum physics
of vision theoretical discussion. Prog Biophys Biophys Chem
2:193–223
Preece BL, Haefner DP (2022) 3D noise photon
transfer curve. Appl Opt 61:6202–6212
Roorda A (2011) Adaptive
optics for studying visual function: A comprehensive review. J Vis
11:
Roorda A, Duncan JL (2015) Adaptive
optics ophthalmoscopy. Annu Rev Vis Sci 1:19–50
Roorda A, Romero-Borja F, Donnelly W Iii, et al (2002) Adaptive optics scanning
laser ophthalmoscopy. Opt Express 10:405–412
Roorda A, Williams D (1999) The arrangement of the three cone
classes in the living human eye. Nature 397:520–522
Ruderman DL, Bialek W (1994) Statistics of
natural images: Scaling in the woods. Phys Rev Lett 73:814–817
Rushton WAH (1975) Visual pigments and color blindness. Scientific
American 232:64–74. https://doi.org/10.1038/scientificamerican0375-64
Rust MJ, Bates M, Zhuang X (2006) Sub-diffraction-limit imaging
by stochastic optical reconstruction microscopy
(STORM). Nat Methods 3:793–795
Schmid AC, Barla P, Doerschner K (2023) Material
category of visual objects computed from specular image structure.
Nat Hum Behav 7:1152–1169
Schmidt F, Hebart MN, Schmid AC, Fleming RW (2025) Core dimensions of
human material perception. Proc Natl Acad Sci U S A 122:e2417202122
Serabyn E, Huby E, Matthews K, et al (2017) The w.
M. Keck observatory infrared vortex coronagraph and a first
image of hip 79124 b. Astron J 153:43
Shapiro AE (1989) Huygens’ traité de la
lumière and newton’s opticks: Pursuing and eschewing hypotheses.
Notes Rec R Soc Lond 43:223–247
Simoncelli EP, Olshausen BA (2001) Natural image statistics and neural
representation. Annual Review of Neuroscience, Vol 34 24:1193–1216
Smith AM (1982) Ptolemy’s
search for a law of refraction: A case-study in the classical
methodology of “saving the appearances” and its
limitations. Arch Hist Exact Sci 26:221–240
Stryer L (1986) Cyclic
GMP cascade of vision. Annu Rev Neurosci 9:87–119
Teranishi N, Kohono A, Ishihara Y, et al (1982) No image lag photodiode
structure in the interline CCD image sensor. In: 1982
international electron devices meeting. pp 324–327
Thatte J, Lian T, Wandell BA, Girod B (2017) Stacked omnistereo
for virtual reality with six degrees of freedom. In: 2017 IEEE
visual communications and image processing (VCIP). IEEE
Thibos LN (2020) Retinal image formation and sampling in a
three-dimensional world. Annual review of vision science 6:469–489
Thibos LN, Hong X, Bradley A, Cheng X (2002) Statistical variation of
aberration structure and image quality in a normal population of healthy
eyes. Journal of the Optical Society of America A 19:2329–2348
Tominaga S, Nishi S, Ohtera R (2021) Measurement and estimation of
spectral sensitivity functions for mobile phone cameras. Sensors (Basel,
Switzerland) 21:4985
Tompsett M, Amelio G, Smith GE (1970) CHARGE
COUPLED 8-BIT SHIFT
REGISTER. Applied Physics Letters 17:111–115
Tompsett MF (1978) Charge transfer
imaging devices. US Patent
Torralba A, Freeman WT (2012) Accidental pinhole and pinspeck cameras:
Revealing the scene outside the picture. In: 2012
IEEE conference on computer vision and pattern recognition.
pp 374–381
Tournier A, Leverd F, Favennec L, et al (2011) R
5 pixel-to-pixel isolation by deep trench technology : Application to
CMOS image sensor
Tuten WS, Harmening WM, Sabesan R, et al (2017) Spatiochromatic
interactions between individual cone photoreceptors in the human retina.
Journal of Neuroscience 37:9498–9509
Udoy MRI, Alam S, Islam MM, et al (2025) A review of digital
pixel sensors. IEEE Access 13:8533–8551
von Helmholtz H (1925) Helmholtz’s treatise on physiological optics.
Optical Society of America
Vrhel MJ, Gershon R, Iwan LS (1994) Measurement and analysis of object
reflectance spectra. Color Research And Application 19:49
Wandell BA (1995) Foundations of vision: Behaviour,
neuroscience, and computation. Sinauer Associates, Sunderland, MA
Wandell BA, Brainard D (2021) Principles and consequences of the initial
visual encoding. In: F. Gregory Ashby HC, Dzhafarov EN (eds) New
handbook of mathematical psychology
Wandell BA, El Gamal A, Girod B (2002) Common principles of image
acquisition systems and biological vision. Proceedings of the IEEE
90:5–17
Wang F, Theuwissen A (2017) Linearity
analysis of a CMOS image sensor. IS&T Int Symp
Electron Imaging 29:84–90
Wikler KC, Rakic P (1990) Distribution
of photoreceptor subtypes in the retina of diurnal and nocturnal
primates. J Neurosci 10:3390–3401
Williams DR, Burns SA, Miller DT, Roorda A (2023) Evolution of adaptive
optics retinal imaging [Invited]. Biomedical Optics Express
14:1307–1338
Wood RW (1906) XXIII.
Fish-eye views, and vision under water. Lond Edinb Dublin Philos Mag
J Sci 12:159–162
Xian W, Božič A, Snavely N, Lassner C (2023) Neural
lens modeling. In: Proceedings of the IEEE/CVF conference on
computer vision and pattern recognition. pp 8435–8445
Young T (1804a) I. The Bakerian Lecture.
Experiments and calculations relative to physical optics.
94:1–16
Young T (1804b) A reply to the animadversions of the
Edinburgh reviewers, on some papers, published in the
philosophical transactions. Savage and Easingwood