We subjected the Fairphone 4 to our rigorous SBMARK Camera test suite to measure its performance in terms of photo, video and zoom quality from an end-user perspective. This article explains how the device performed in a variety of tests and different common use cases and aims to highlight the most important results of our tests with an extract of the acquired data.
Overview
Key Camera Specifications:
- Main: 48 MP 1/2 ″ sensor, 0.8 μm pixels, f / 1.6 aperture lens, AF, OIS
- Ultra-Wide: 48MP sensor, 1.6μm pixels, f / 2.2 aperture lens, AF
- Video: 4K at 30fps, 1080p at 30 / 60fps
Pros
- Low noise levels in bright light and indoors
- Good detail in bright light
- Accurate white balance
versus
- Underexposure
- Limited dynamic range
- Unnatural rendering of dark complexions (reddish tendency)
- Lack of detail in indoor images and in low light conditions
- Strong white balance in night flash shots
- No bokeh modes
- Narrower field of view on ultra-wide than many competitors
After the Fairphone 3, the Fairphone 4 is the latest version of the company’s sustainable smartphone and comes with an overall updated hardware, including the addition of an ultra-wide camera and a wider aperture on the main camera. Both camera modules use 48 MP 1/2 “image sensors.
Despite the technological upgrade, the Fairphone 4 does not come close to the category leaders Google Pixel 6 and Apple iPhone SE and occupies one of the lowest places in the SBMARK Camera ranking for high-end smartphones. When shooting still images, the camera produces accurate white balance and controls noise well in bright light and indoors. However, the Fairphone 4 is held back by frequent underexposure and a lack of image detail.
The Fairphone 4 does not come with a dedicated tele module and, as a result, the tele image quality leaves some room for improvement. On the plus side, the ultra-wide is capable of decent image results under the right conditions. However, the field of view is not as wide as in many competitors.
When recording video, the Fairphone offers the best results in bright light and static scenes. Under such conditions, the shots show pleasant colors, a neutral white balance, and an acceptable level of detail. Video stabilization is also quite effective. However, with moving subjects in the scene, autofocus instabilities, differences in sharpness between frames, and noise become noticeable, especially in low-light conditions.
Fairphone 4 camera scores
This chart compares the SBMARK photo, zoom and video scores between the tested device and the references. The average and maximum scores of the price segment are also indicated. The average and maximum scores for each price segment are calculated based on the SBMARK database of tested devices.
Test summary
About SBMARK Camera Tests: SBMARK camera assessments take place in labs and real-world situations using a wide variety of subjects. Scores are based on objective tests for which the results are calculated directly by the measurement software on the settings of our laboratory and on perceptual tests in which a sophisticated set of metrics allows a group of image experts to compare aspects of quality image that require human judgment. Testing a smartphone involves a team of engineers and technicians for about a week. The quality of photo, zoom and video is evaluated separately and then combined into an overall score for comparison between cameras from different devices. For more information on the SBMARK Camera protocol, click here. More details on the smartphone camera scores can be found here. The following section collects the key elements of SBMARK’s comprehensive testing and analysis. Comprehensive performance evaluations are available upon request. Contact us to find out how to receive a full report.
Photo
94
Honor Magic4 Ultimate
Honor Magic4 Ultimate
About SBMARK Camera Photo Tests
For scoring and analysis, SBMARK engineers capture and evaluate more than 2,600 test images in both controlled laboratory environments and natural outdoor, indoor and low-light scenes, using the camera’s default settings. The photographic protocol is designed to take into account the main use cases and is based on typical shooting scenarios, such as portraits, family photos and landscapes. Assessment is done by visually inspecting images Cons a natural scene reference and making objective measurements on graphical images captured in the lab under various lighting conditions from 1 to 1,000+ lux and color temperatures from 2,300K to 6,500K.
Fairphone 4 Photo vs High-End Scores
Photo tests analyze image quality attributes such as exposure, color, texture, and noise under various lighting conditions. Autofocus performance and the presence of artifacts on all images acquired under controlled laboratory conditions and in real-life images are also evaluated. All of these attributes have a significant impact on the final quality of the images captured with the tested device and can help understand the main strengths and weaknesses of the camera.
Exposure
57
Honor Magic4 Ultimate
Honor Magic4 Ultimate
Color
90
Apple iPhone 13 Pro Max
Apple iPhone 13 Pro Max
Exposure and color are the key attributes for technically good images. For exposure, the main attribute evaluated is the brightness of the main subject in various use cases such as landscape, portrait or still life. Other factors evaluated are contrast and dynamic range, eg. the ability to make details visible in both light and dark areas of the image. Repeatability is also important, as it demonstrates the camera’s ability to deliver the same rendering when shooting multiple images of the same scene.
For color, the image quality attributes analyzed are skin tone rendering, white balance, color shading, and repeatability. For the rendering of color and skin tone, we penalize unnatural colors but respect the manufacturer’s choice of the chromatic signature.
Fairphone 4: Underexposure, shadow clipping, slightly reddish skin tone
Google Pixel 6: precise exposure of the target
Oppo Reno6 Pro 5G: precise target exposure
Autofocus
81
Asus smartphone for Snapdragon insiders
Asus smartphone for Snapdragon insiders
Autofocus tests focus on focus accuracy, focus repeatability, shutter lag and depth of field. The shutter lag is the difference between the time the user presses the capture button and the time the image is actually taken. It includes focus speed and the ability of the device to capture images at the right moment, what is called “zero shutter lag” capability. While shallow depth of field can be nice for a single-subject portrait or close-up, it can also be a problem in some specific conditions such as group portraits; Both situations are tested. Focus accuracy is also evaluated in all real-life images taken, from infinity to close-up objects and in low light to outdoor conditions.
Autofocus irregularity and speed: 20Lux Δ4EV Tungsten Handheld
This graph shows edge sharpness versus shooting time measured at the AFHDR setting over a series of images. All photos were taken at 20 Lux with tungsten illuminant, 500 ms after blurring. In this scenario, the HDR charts are active and the difference between them and the DeadLeaves chart is Δ4EV. Edge sharpness is measured on the four edges of the Deadleaves and shutter speed is measured on the Universal Timer LED.
Structure
78
Xiaomi Mi 11
Xiaomi Mi 11
Texture tests analyze the level of detail and texture of subjects in images taken in the laboratory as well as in real-life scenarios. For natural shots, special attention is paid to the level of detail in the light and dark areas of the image. Objective measurements are performed on map images taken under various lighting conditions from 1 to 1000 lux and different types of dynamic range conditions. The charts used are the proprietary SBMARK (DMC) chart and the Dead Leaves chart.
DMC Detail retention metric versus lux levels for tripod and handheld conditions
This graph shows the evolution of the DMC detail retention score with the lux level, for two retention conditions. The DMC detail retention score is derived from an AI-based metric trained to evaluate texture and detail rendering on a selection of crops from our SBMARK chart.
Noise
73
Honor Magic4 Ultimate
Honor Magic4 Ultimate
Noise tests analyze various attributes of noise such as intensity, chromaticity, grain, texture on real life images and graphical images taken in the laboratory. For natural images, special attention is paid to noise on faces, landscapes, but also on dark areas and high dynamic range conditions. Noise on moving objects is also evaluated on natural images. Objective measurements are performed on graphical images taken under various conditions from 1 to 1000 lux and different types of dynamic range conditions. The graph used is the Dead Leaves graph and standardized measurement such as visual noise derived from ISO 15739.
Evolution of visual noise with lighting levels in handheld condition
This graph shows the evolution of the visual noise metric with the lux level under portable conditions. The visual noise metric is the average of the visual noise measurement across all Dead Leaves chart patches in the AFHDR setting. SBMARK visual noise measurement is derived from the ISO15739 standard.
Manufactured goods
68
Google Pixel 6
Google Pixel 6
Artifact evaluation examines lens shading, chromatic aberrations, geometric distortion, edge ring, halos, ghosting, quantization, unexpected color tone variations, among other types of possible unnatural effects on photos. The more serious and frequent the artifact, the greater the deduction of points on the score. The main artifacts observed and the corresponding point loss are listed below.
Main penalties for photographic artifacts
Preview
33
Apple iPhone 13 Pro Max
Apple iPhone 13 Pro Max
The preview tests analyze the image quality of the camera app image preview, with particular attention to the difference between capture and preview, especially with regards to dynamic range and application of the bokeh effect. The smoothness of exposure, color and focus adaptation are also evaluated when zooming from the minimum to the maximum available zoom factor. The preview frame rate is measured using the Universal Timer LED.
Fairphone 4 Preview: limited dynamic range, underexposure on faces
Fairphone 4 Capture: limited dynamic range, greater underexposure on faces
Enlarge
45
Honor Magic4 Ultimate
Honor Magic4 Ultimate
Learn about SBMARK camera zoom tests
SBMARK engineers capture and evaluate over 400 test images in controlled laboratory environments and in outdoor, indoor and natural scenes in low light conditions, using default camera settings and zooming in at various zoom factors, from ultra wide angle at ultra-long range zoom. Evaluation is done by visually inspecting images Cons a natural scene reference and making objective measurements of graphs captured in the lab under different conditions from 20 to 1000 lux and color temperatures from 2300K to 6500K.
Wide
30
Honor Magic4 Ultimate
Honor Magic4 Ultimate
These tests analyze the performance of the ultra-wide-angle camera at different focal lengths from 12mm to 20mm. All image quality attributes are evaluated, with particular attention to artifacts such as chromatic aberrations, lens softness and distortion. The images below are an excerpt of tested scenes.
Fairphone 4: precise target exposure, strong lack of detail, low noise
Google Pixel 6: precise target exposure, good detail, very light noise
Oppo Reno6 Pro 5G: precise target exposure, good detail, noise
Tele
55
Honor Magic4 Ultimate
Honor Magic4 Ultimate
All image quality attributes are evaluated at focal lengths from about 40mm to 300mm, with a focus on texture and detail. The score is derived from a series of objective measurements in the laboratory and from the perceptual analysis of real-life images.
DMC Detail retention metric versus lux levels for tripod and handheld conditions
This graph shows the evolution of the DMC detail retention zoom score with the lux level, for two retention conditions. The DMC detail retention score is derived from an AI-based metric trained to evaluate texture and detail rendering on a selection of crops from our SBMARK chart.
DMC Detail retention metric versus lux levels for tripod and handheld conditions
This graph shows the evolution of the DMC detail retention zoom score with the lux level, for two retention conditions. The DMC detail retention score is derived from an AI-based metric trained to evaluate texture and detail rendering on a selection of crops from our SBMARK chart.
DMC Detail retention metric versus lux levels for tripod and handheld conditions
This graph shows the evolution of the DMC detail retention zoom score with the lux level, for two retention conditions. The DMC detail retention score is derived from an AI-based metric trained to evaluate texture and detail rendering on a selection of crops from our SBMARK chart.
video
87
Apple iPhone 13 Pro Max
Apple iPhone 13 Pro Max
About SBMARK Camera Video Tests
SBMARK engineers capture and evaluate more than 2.5 hours of video in controlled laboratory environments and natural scenes in low light conditions, indoors and outdoors, using the camera’s default settings. The assessment consists of visually inspecting natural videos taken under various conditions and carrying out objective measurements on graphical videos recorded in the laboratory under different conditions from 1 to 1000 lux and color temperatures from 2300 to 6500 K.
Fairphone 4 video scores
Video tests analyze the same image quality attributes as still images, such as exposure, color, texture, or noise, as well as temporal aspects such as speed, exposure uniformity and stability, white balance, and autofocus transitions.
Exposure
85
Apple iPhone 13 Pro Max
Apple iPhone 13 Pro Max
Color
90
Honor Magic4 Ultimate
Honor Magic4 Ultimate
Exposure tests evaluate the brightness of the main subject and the dynamic range, eg. the ability to make details visible in both light and dark areas of the image. The stability and temporal adaptation of exposure are also analyzed.
Image quality color analysis examines color rendition, skin tone rendition, white balance, color shading, white balance stability and its adaptation when the light changes.
Fairphone 4: good exposure but slight wobble, strong differences in sharpness between frames, some slight exposure instability while walking, things get worse when running while recording
Google Pixel 6: precise and stable exposure, almost no difference in sharpness between frames barely visible when walking and barely visible when running, well-compensated camera shake
Oppo Reno6 Pro 5G: precise and stable exposure, few differences in sharpness between frames barely visible while walking and barely visible while running, some camera shake, especially when running
Structure
51
Oppo Reno6 Pro 5G (Snapdragon)
Oppo Reno6 Pro 5G (Snapdragon)
Texture tests analyze the level of detail and texture of real-life videos, as well as graphics videos recorded in the lab. Natural video recordings are evaluated visually, with particular attention to the level of detail in bright areas and dark areas. Objective measurements are performed on images of graphs taken under various conditions from 1 to 1000 lux. The charts used are the SBMARK (DMC) chart and the Dead Leaves chart.
DMC Detail retention metric versus lux levels
This graph shows the evolution of the DMC detail retention video score with the lux level in the video. The DMC detail retention score is derived from an AI-based metric trained to evaluate texture and detail rendering on a selection of crops from our SBMARK chart.
Noise
68
Apple iPhone 13 Pro Max
Apple iPhone 13 Pro Max
Noise tests analyze various noise attributes such as intensity, chromaticity, grain, texture, temporal aspects on real-life video recordings and graphing videos taken in the laboratory. Natural videos are evaluated visually, with a focus on noise in dark areas and high dynamic range conditions. Objective measurements are performed on card videos recorded under various conditions from 1 to 1000 lux. The graph used is the SBMARK visual noise graph.
Spatial evolution of visual noise with the level of illuminance
This graph shows the evolution of spatial visual noise with the level of lux. Spatial visual noise is measured on the visual noise graph in the video noise setting. SBMARK visual noise measurement is derived from the ISO15739 standard.
Time evolution of visual noise with the level of illuminance
This graph shows the evolution of temporal visual noise with the level of lux. Visual temporal noise is measured on the visual noise graph in the video noise setting.
Manufactured goods
71
Oppo Find X2 Pro
Oppo Find X2 Pro
Artifacts are evaluated with MTF and ring measurements on the SFR graph in the laboratory, as well as frame rate measurements using the Universal Timer LED. Natural videos are visually evaluated with particular attention to artifacts such as aliasing, quantization, locking, and toning, among others. The more severe and frequent the artifact, the greater the point deduction from the score. The main artifacts and the corresponding point loss are listed below.
Main penalties for video artifacts
Start a new Thread