How A Digital Camera Sensor Works?

Digital Imaging Basics

• photography has the magical capacity to preserve a moment in time. key to this is the image sensor at the heart of every digital camera.
• just as the retina in the human eye captures light and translates it into nerve impulses that the brain can interpret, the sensor captures light and converts it into an electrical signal that is then processed to form a digital image.
• with all types of sensors, the imaging process begins when light passes through the camera's lens and strikes the sensor.
• the sensor contains millions of light receptors or photosites, which convert the light energy into an electrical charge.
• the magnitude of the charge is proportional to the intensity of the light – the more light that hits a particular photosite, the stronger the electrical charge it produces.

the image sensor is one of the most important components of any machine vision camera.

while a sensor's function is to convert light into an electrical signal, not all sensors are built the same.

• however they are classified, the purpose of image sensors are the same; to convert incoming light (photons) into an electrical signal that can be viewed, analyzed, or stored.
• image sensors are a solid-state device and serve as one of the most important components inside a machine vision camera.
• the main purpose of this layout is to convert light into a digital signal which can then be analyzed to trigger some future action.

at its simplest, a camera sensor is a device that captures light, converting it into an electronic signal. this signal is then processed by the camera to create an image.

a camera sensor is a silicon-based chip that records light data captured through the lens. instead of using film to record an image, digital cameras use this sensor to convert data into a digital file.

Photosites And Electrical Signals

• each sensor consists of millions of light-sensitive pixels, or photosites, which are very small areas made up of a photosensitive material that converts incoming light into electrical signals.
• the number and size of the pixels on a camera’s sensor determine how much detail is captured when taking a photo.
• this data is then processed by the camera to create an image.

the solid-state image sensor chip contains pixels which are made up of light sensitive elements, micro lenses, and micro electrical components.

• in a camera system, the image sensor receives incident light (photons) that is focused through a lens or other optics.
• depending on whether the sensor is ccd or cmos, it will transfer information to the next stage as either a voltage or a digital signal.
• cmos sensors convert photons into electrons, then to a voltage, and then into a digital value using an on-chip analog to digital converter (adc).

an image sensor is a tiny piece of optical technology within a digital camera system. they receive photons or incident light that’s focused through the lens of a camera or other piece of optical equipment. in other words, the image sensor is the part of your camera that takes in light.

we understand that image sensors take in light from the camera’s lens. but what happens after that? once an image sensor registers incident light, it transfers the information to its next stage, either digital signal or voltage, depending on the sensor type in your camera.

• once it hits this next stage, your camera’s processor will read the voltage or digital signals as color.
• from there, all the data your image sensor initially gathered is converted into a high-resolution image.
• in other words, the image sensor collects the information necessary to create the pictures you love.

the lens projects an image onto the space behind the shutter, where a film camera would have the light-sensitive film. a digital camera has a ccd sensor there. each pixel of the sensor builds up an electrical charge proportional to how much light has hit it, then the camera reads out the voltage from each pixel to save the image.

Colour Capture

• in order to capture colours as well as brightness information, photosites are fitted with red, green and blue colour filters.
• this means some photosites record the intensity of red light, some the intensity of green, and some the intensity of blue.
• the electrical signals from all the photosites in the sensor are passed to the camera's image processor, which interprets all this information and determines the colour and brightness values of all the individual pixels (picture elements) that make up a digital image.

the pixels are colour-blind, just recording the intensity of light they receive. to get a colour image you put filters over each pixel so that some receive only the red light from the scene, some only green light and some only blue light.

• unlike film, digital sensors record light in monochrome.
• because of this, camera sensors use a color filter placed over each pixel which allows the sensor to display colors and accurately represent the scene.
• the color of each pixel is determined by the frequency of the light wave that passes through the filter.

for visible light sensors (not infrared, uv, or x-ray) there are two main types; color and mono. color sensors have an extra layer that sits below the micro lens, called a color filter, which absorbs undesired color wavelengths so that each pixel is sensitive to a specific color wavelength. for mono sensors, there is no color filter so each pixel is sensitive to all visible light wavelengths.

• for the color sensor example shown above right, the color filter array employed is a bayer filter pattern.
• this filter pattern uses a 50% green, 25% red and 25% blue array.
• while most color cameras use the bayer filter pattern, there are other filter patterns available that have different pattern arrangements and rgb breakdowns.
• for some sensors, especially sensors with smaller pixel sizes, additional micro lenses are used to help guide photons into the photodiode.

the most common type of colour filter mosaic in digital sensors, a bayer array. this is what makes it possible for the sensor to detect colour, not just light intensity. there are more photosites dedicated to green because the human eye happens to be more sensitive to green light than to blue or red.

CCD Sensors

• there are several different types of image sensor.
• digital photography arrived in the mid-1980s with the introduction of ccd (charge-coupled device) sensors.
• these sensors were the first to make it possible to capture images without the use of film, revolutionising photography.

ccd sensors are composed of an integrated grid of semiconductor capacitors capable of holding an electrical charge. when light reaches the sensor, these capacitors, acting as individual photosites, absorb the light and convert it into an electrical charge. the amount of charge at each photosite is directly proportional to the intensity of the light that strikes it.

in a ccd sensor, the charge from each photosite is transferred through the sensor's grid (hence the term charge-coupled) and read at one corner of the array, in the same way that water might be passed along a bucket brigade or human chain.

• this method ensures a high degree of image quality and uniformity because each pixel uses the same pathway to output its signal.
• however, this process is also more power-intensive than the process in cmos sensors.

ccd sensors (charged couple device) start and stop exposure for all pixels at the same time. this is known as global shutter. the ccd then tranfers this exposure charge to the horizontal shift register where it is then sent to the floating diffusion amplifier.

• global shutter
• low noise
• high dynamic range
• medium range frame rates
• subject to smearing

CMOS Sensors

unlike the ccd sensor, which transfers charges across the sensor to a single output node, a cmos sensor contains multiple transistors at each photosite, enabling the charge to be processed directly at the site. this has several implications.

• for a start, cmos sensors require less power, making them more energy efficient.
• they can also read off electrical charges at a much faster rate, which is crucial for shooting high-speed sequences.
• what's more, cmos sensors share the same basic structure as computer microprocessors, which allows for mass production at a lower cost while incorporating additional functions such as noise reduction and image processing right on the sensor.

cmos sensors are the industry standard today, as they work more efficiently than ccd, have better low-light performance, cost less, and work better for high-speed capture.

in the past, cmos sensors (complementary metal-oxide semiconductor) were only able to start and stop exposure one pixel row at a time, which is known as rolling shutter. this has changed over time, with many global shutter cmos sensors now available in the market.

• cmos sensors use smaller adcs for each pixel column allowing for higher frame rates than ccds.
• cmos sensors have undergone major improvements over the years making most modern cmos sensors equal or superior to ccds for image quality, image speed, and overall value.

• global shutter and rolling shutter models
• low to very low noise
• high to very high dynamic range
• very high frame rates
• no smearing

Sensor Classification

• sensors can be classified in several ways, such as by their structure type (ccd or cmos), chroma type (color or monochromatic), or shutter type (global or rolling shutter).
• additionally, they can be categorized based on resolution, frame rate, pixel size, and sensor format.
• understanding these terms is crucial for selecting the most suitable sensor for a given application.

cmos sensors are defined by their sizes. there are multiple sensor sizes, but the most popular are: full frame, aps-c, and micro four thirds.

image sensors come in different format types (also known as optical class, sensor size or type) and packages. resolution and pixel size will dictate the overall size of a sensor with larger sensors having either higher resolutions or larger pixel sizes than smaller sensors.

• knowing the sensor format is important for choosing a lens and optics for a camera.
• all lenses are designed for specific sensor formats and resolutions.
• note that sensor formats only describe the area of the sensor chip and not the entire sensor package.

it's clear that a sensor's megapixel count (whether it's total or effective pixels) isn't the whole story. the physical size of the sensor is an important factor.

Pixel Size And Sensitivity

pixel size is measured in micrometers (µm) and includes the entire area of both the photodiode and surrounding electronics. a cmos pixel consists of a photodiode, an amplifier, reset gate, transfer gate and floating diffusion. these elements however may not always be within each pixel as they can also be shared between pixels.

• typically a larger pixel size is better for increased light sensitivity because there is more area of the photodiode to receive light.
• if the sensor format stays the same but the resolution increases the pixel size must decrease.
• while this might decrease sensor sensitivity, improvements in pixel structure, noise reduction technology, and image processing have helped mitigate this.
• to get a more accurate understanding of sensor sensitivity it is best to refer to the sensor’s spectral response (quantum efficiency) as well as other sensor performance results.

if two sensors have the same total pixel count but one is physically larger than the other, then each photosite on the larger one must be bigger. this is sometimes included in camera specs as the "pixel pitch" – a 21mp aps-c camera might have a pixel pitch of about 4.22 microns while a 21mp full-frame camera might be 6.45 microns.

photosites act as "light buckets" and, in the same way that a wider bucket would capture more rainwater than a narrower bucket, a larger photosite captures more photons with relatively less random noise.

Shutter Types

an important function of the sensor is its shutter type. the two main electronic shutter types are global shutter and rolling shutter. these shutter types are different in their operation and final imaging results, especially when the camera or target is in motion.

• the diagram to the left shows the exposure timing of a global shutter sensor.
• all pixels begin and end exposure at the same time but readout still happens line by line.
• this timing produces non-distorted images without wobble or skewing.
• global shutter sensors are essential for imaging high speed moving objects.

• the diagram to the left shows the exposure timing of a rolling shutter sensor.
• exposure timing is different line by line with reset and readout happening at shifted times.
• this row by row exposure produces image distortion if either the target or camera are in motion.
• rolling shutter sensors offer excellent sensitivity for imaging static or slow moving objects.

one shortcoming of current cmos sensors is that, for technical reasons including data bandwidth, their data is read out sequentially rather than all at once. this results in issues such as "rolling shutter" distortion.

SPAD Sensors

• ccd and cmos sensors measure the intensity of light – in other words, how many photons reach the sensor within a specified time.
• spad (single photon avalanche diode) sensors work differently, using the "avalanche" effect in semiconductors.
• when a photon strikes the sensor, it generates an electron, which then triggers a chain reaction or "avalanche" of electron production.
• this cascading effect causes a large current to flow instantaneously, which is read out as a voltage signal in the form of a train of pulses corresponding to individual photons.

in a cmos sensor, the charge of a single electron is too small to be detected as an electrical signal, so the charge has to be accumulated over a certain period of time. by contrast, a spad sensor amplifies the charge by approximately one million times using a phenomenon called avalanche multiplication, which causes a large current to flow instantaneously, enabling the sensor to detect that a single photon has hit it.