Foveon: New CMOS sensor captures triple the data!
By
Michael R. Tomkins, The Imaging Resource
(Monday, February 11, 2002 - 18:35 EST)
Will Foveon's X3 CMOS imagers change the face of digital imaging as we know it?
Foveon Inc.,
a privately held company based in Santa Clara, California, founded by
electronics pioneer Dr. Carver Mead (who amongst other things devised a
gallium-arsenide transistor and laid down the original design rules for
etching microchips) has today made what we consider to be an extremely
significant announcement that has the potential to turn the world of
digital imaging on its head. The company has taken the wraps off its new X3 image sensor, a CMOS device which is capable of recording all three colors (red, green and blue) at every cell.
Current
digital camera designs use one of two main techniques: in the first, a
single CCD or CMOS sensor records only one color at each cell, and then
interpolates (read: makes an educated guess) the remaining color values
to produce the final color for each pixel in the digital image. The
other technique, much less commonly used since it adds significantly to
the cost of the camera, is to use a beam-splitting prism to direct light
of each color to three separate image sensors, each of which records
only one color. Other techniques do exist, such as moving an optical
refraction plate in front of the sensor to cause light to fall on
different cells, hence recording multiple color values and increasing
the data collected - but movement of the subject between separate
exposures renders the final results useless, so such techniques are of
no use for anything other than static scenes.
 | Foveon's X3 image sensor, demonstrating how light penetrates to the different layers of 'stacked' cells.
Click for a bigger picture!
|
Foveon's
new sensor works in a completely different way, as demonstrated in the
image above - using the natural properties of the silicon where light of
different wavelengths is absorbed at differing depths. The X3 sensor
essentially 'stacks' photo-detectors in three layers, so that for each
location on the sensor, all three colors are recorded. Foveon draws a
parallel to traditional color film, where each color is recorded in
stacked layers of emulsion to result in a final full-color image. In the
X3 sensor, this approach triples the data collected as compared to a
standard CCD or CMOS sensor of similar resolution, which by itself
should bring a significant boost in overall image quality. There are
numerous other advantages as well, though...
Traditional CCD
sensors use a manufacturing process that is unique, meaning that there
is a significant expense in creating a CCD fab to manufacture only CCD
chips - causing high costs to manufacturers (and eventually the
consumer) for CCD-based cameras. Since the X3 sensors use a CMOS
process, they should be able to be made using the same equipment and
techniques as many other types of computer chips, meaning that resources
can be shared with production of other items to help defray costs - and
this should result in savings to manufacturers of X3 cameras and to the
consumer. (As an example of how CMOS can save money, look no further
than Canon's EOS D30 digital camera, which has for some time been about
the lowest-priced option for a true digital SLR - thanks in part to its
use of a CMOS imager).
 | Foveon compares how film and the X3 sensor capture color.
Click for a bigger picture!
|
A
further benefit to the X3 chips over CCD sensors should be a reduction
in power consumption, with quoted power levels of 50mW during readout,
10mW in standby mode and 100μW in power-down mode. This could allow for
the final product - an X3 digital camera - to be smaller, lighter,
cheaper, or run longer than a similar product using a CCD sensor, thanks
to extended battery life, or smaller / cheaper batteries. Foveon also
claims that its design will offer "extremely low-noise readout and very
high dynamic range" - something which once again seems believable
considering the very clean images we've already seen from Canon's
proprietary CMOS sensors. If Foveon have done as good a job, chalk up
another potential benefit over the CCD cameras!
Another advantage
of the design is that since real color values are recorded for every
pixel, there is no need to interpolate data - which brings two bonuses.
Images should be able to be captured more quickly - just pass the data
to buffer memory and write it to flash, rather than having to first
spend time on complex mathematical operations to interpolate the missing
color values whilst trying to avoid artifacts and moire effects.
Secondly, there is a potential to further save on cost, since
manufacturers may be able to avoid using extra chips that are dedicated
to this interpolation process.
 | How traditional CCD or CMOS-based cameras record color information.
Click for a bigger picture!
|
 | How Foveon X3 CMOS-based cameras record color information.
Click for a bigger picture!
|
Not
only should images have better color, but there is the potential for
them to have better detail as well, again thanks to the lack of any
interpolation. Just how much of an improvement there is we'll wait with
interest to see once we get an X3-based camera in our labs to test, but
with triple the data the improvement should be very real. There should
also be a very significant lessening of problems like moire effects on
images - caused by fine detail that is too high-frequency for the sensor
to capture. With traditional CCD and CMOS cameras, this is exacerbated
by the way colors are spaced - and whilst techniques for reducing the
impact of the problem during interpolation do exist, they're not
foolproof.
The company also says that its sensor design allows
for some other features - such as what it calls 'VPS' (Variable Pixel
Size). Essentially, this allows multiple pixels to be combined together
for higher ISO images and faster frame rates, albeit at a lower final
resolution. This seems very similar to what Fuji is doing
with its pixel data coupling and pixel mixing technologies in its
proprietary third-generation SuperCCD imager, although it isn't clear
whether VPS is performed in-chip in the same manner as Fuji does.
Essentially though, VPS allows for cells of the same color to be linked
together in groups to either reduce the data that must be read-out
and/or manipulated (for higher frame rates) or to increase the total
light gathered for the final pixel value - effectively increasing ISO
sensitivity.
Foveon has initially announced two products based on
its X3 design; the F7 and F10 image sensors - part numbers F7-35X3-A25B
and F10-14X3-D08A respectively. The F7 is a 2304 x 1536 pixel (2268 x
1512 effective) chip that would be a 3.43 megapixel sensor in terms of
dimensions of the image alone, but actually records 10.29 megapixels of
color data. The F7 chip has an ISO rating of 100, a 3:2 aspect ratio, a
photo detector pitch of 9.12μm and an effective area of 20.7 x 13.8mm
(which would give a focal length multiplier of 1.74x as compared to 35mm
film). Foveon claims a resolution of 756lp/picture height, a
full-resolution frame rate of 2 frames per second, and a maximum rate of
25 fps using VPS at a resolution of 576 x 384 pixels. For the F7 chip,
VPS offers resolutions of 1152 x 768, 768 x 512 and 576 x 384 pixels for
still images, and video in the lowest resolution only. We do note one
oddity, in that the VPS resolutions are all neatly divisible into the
total resolution of the chip, not the effective resolution. We'd have
expected these resolutions to divide evenly into the effective
resolution if there were no interpolation going on, since the extra
pixels above the effective resolution are masked off for dark current
calibration, etc. We also note that Foveon doesn't state what packaging
the F7 chip uses.
The F10 meanwhile is a lower-resolution 1344 x
1024 pixel (1280 x 960 effective) chip that has an image resolution of
1.23 megapixels and gathers 3.69 megapixels of color data. It also has
an ISO rating of 100, but has a 4:3 aspect ratio and a photo detector
pitch of 5μm. It has an effective area of 6.4 x 4.8mm, which results in a
diagonal of exactly 8mm / 0.315" - unfortunately that doesn't translate
directly to a nice fraction (154129/489359ths anybody?) :) but it is
somewhat smaller than the 0.370"/9.4mm and 0.555"/14.1mm sensors used in
most consumer digital cameras. Foveon's speed rating for the chip is a
swift 10 frames per second at the maximum resolution, and over 30fps at
640 x 480 pixels using VPS. On the F10 chip, VPS combines pixels in
integer multiples (2, 3, etc.) It isn't clear what the lowest resolution
is for the chip when using VPS. The F1 chip comes in a CLCC 100 pin
package...
 | Foveon's F7 Reference Design Kit.
|
Also
announced alongside the F7 and F10 image sensors is the F7-RDK
Reference Design Kit, which consists of the higher-resolution F7 image
sensor coupled with an IEEE-1394 FireWire port, mechanical shutter, PC
Synch connector, 2mm stereo-jack remote shutter release port, Canon EOS
lens mount, 3/8-inch tripod socket, and composite video out
connectivity. An optional 1.8 inch LCD display is available, the unit is
compatible with Type-I and Type-II CompactFlash cards, features a
206MHz Intel StrongARM processor and 128MB of SDRAM, and can output
either NTSC or PAL composite video. The RDK serves as a platform for
development of digital camera designs based on the X3 image sensors, and
allows control of aperture and shutter speed, real-time full-frame
video preview, full resolution image capture, VPS image resizing, and
the ability to capture 4-second digital video streams. The F7-RDK can
output 48-bit S-RGB TIFF files, raw images, dark-frame subtracted
images, gray-balanced images and digital video.
A final
announcement is the FX3-SDK software development kit. Designed for
manufacturers to produce the software their cameras will run, as well as
software for the user's host PC to download and process images, the SDK
is based on C++ Object libraries. Supported camera hardware includes an
Intel StrongARM processor, CompactFlash media, a color LCD display, USB
or IEEE-1394 FireWire interfaces, and an I2C bus. Supported host
operating systems are Windows 98, 2000, XP and Me, or MacOS 9 or OSX.
Image formats supported include Foveon RAW, 24-bit or 48-bit TIFF, JPEG
and Embedded Color Profiles. The specific libraries can be found listed
on Foveon's site.
Foveon
notes in its press release that the first X3-based camera will be an
SLR called the SD-9 manufactured by Tokyo, Japan-based Sigma
corporation. The camera will be on display at the upcoming Photo
Marketing Association 2002 show which starts in a couple of weeks from
now, and should be shipping by May of this year. We'll have further
details on the SD-9 digital camera in a further news item to follow
shortly.
For those interested in image quality, three large sample images can be found
on the Foveon website. Note however that we don't know what hardware
captured the images, what conditions they were captured under nor how
they have been post-processed or retouched. None of the images match up
to the sizes available from either the F7 or F10 sensors or the
prototype X3 sensor, which was a square 2048 x 2048 pixel chip - so at
the very least all of the images have been resized and/or cropped. Also,
the 'Pool Table' image is taller than the maximum size available from
the higher-res F7 chip, so this image in particular definitely didn't
originate from one of the chips announced today. You can also find several small thumbnails
and 100% crops of shots from a prototype X3 camera using the larger
prototype chip from our friends at the Digital Photography Review -
there are no full-sized images here, but Phil's 240 x 240 pixel crops
are certainly interesting since they were taken by a third-party and not
Foveon themselves.
Foveon says that it intends to offer a range
of X3 products aimed at everything from professional SLR digital cameras
to low-cost consumer point'n'shoots. It will certainly be interesting
to see how well Foveon does with the X3 image sensor line-up - one
potential question-mark is how well the consumer will deal with
comparing (and understanding) megapixel ratings before they purchase a
digital camera. We'll now have three different numbers, none of which
are directly comparable - standard megapixel ratings from
color-interpolating cameras, Fuji's ratings for its proprietary
SuperCCD-based cameras, and now the ratings from the new X3-based
cameras. Thus far, the company seems to have taken the approach of
stating a rating such as "2MP x 3" to attempt to get the point across
that it captures more information than the other cameras - but will the
consumer understand what that means? If the company were to instead
publish megapixel numbers for the number of cells of color-data it
captures though, it may find itself dealing with an uproar from those
consumers who are better informed who might feel that they're
overstating their case, so perhaps adding "X 3" to the rating is the
safest approach.
There is also the question of whether the other
manufacturers of CCD and CMOS imagers will take this sitting down - or
will they have something up their sleeves? If another manufacturer finds
a way to market imagers which capture color values for every pixel,
then Foveon will have a much harder time marketing itself to
manufacturers of consumer digicams who've already built up a history of
purchasing imagers from the likes of Sony - or building their own, like
FujiFilm and Canon have done with certain models. You can be sure the
company is patenting its developments from every conceivable angle, but
we can't imagine the likes of Sony taking second-place to the X3 sensors
without a fight...
As usual with any new technology, we'll
reserve final judgement until we've had a chance to put an X3 camera
through our usual battery of tests... There are many questions that
won't be answered until that time, and it is possible that the new
design may bring new challenges of its own. Hopefully with plans for the
Sigma SD-9 digital camera to ship around May 2002, the answers will be
forthcoming soon. In the meantime, this is definitely one to watch - on
paper at least, X3 seems to have the potential to revolutionise imaging
in much the same way that the CCD sensor has done since its conception
around 30 years ago...
 | Foveon's F7 X3-type image sensor.
|
Source:
Foveon Inc.
|
Original Source Press Release:
| FOVEON INTRODUCES WORLD'S FIRST FULL-COLOR IMAGE SENSOR New Chip Is First To Work Like Film And Dramatically Improves Color Resolution
SANTA
CLARA, CA - (February 11, 2002) - Foveon Inc., a technology leader in
high quality digital photography has announced the introduction and
immediate availability of its new Foveon® X3? image sensor. The Foveon
X3 represents a true breakthrough in digital photography, bringing
significant advantages over all other CCD and CMOS image sensors. Foveon
X3 image sensors dramatically improve photographs from digital cameras
by capturing three times the color resolution of comparable image
sensors found in today's digital cameras. The use of Foveon X3 image
sensors will lead to digital cameras that are simpler to design for
manufacturers and that provide more image quality and performance value
to customers.
"The Foveon X3 represents the most significant
breakthrough in digital camera technology since the invention of CCDs
over 30 years ago. This new technology combines the immediacy and
excitement of the digital photography experience with the quality that
exceeds what consumers have previously come to expect only from film,"
says Jim Lau, Foveon's CEO.
In addition to increased color
resolution, the new technology integrates high-resolution still
photography with professional-quality full-motion video within a single
image sensor enabling a new class of dual mode still/video digital
cameras. "Current image sensor technology has not enabled digital
cameras to realize their full potential. We believe the breakthroughs of
the Foveon X3 technology will form the foundation of a new generation
of digital cameras in all classes.", continued Lau.
The Foveon X3
is the world's first color image sensor that captures red, green and
blue light at each pixel, resulting in brilliantly sharper images,
enhanced color, and freedom from unwanted "color rainbow" artifacts
common in photographs from today's digital cameras. Foveon X3 image
sensors detect color in a manner similar to that of color film. With
film, different colors of light penetrate to different layers of
photosensitive material, with each layer detecting a specific color.
Using a similar concept, Foveon X3 image sensors consist of three layers
of photo detectors embedded in silicon and are the first to detect
three colors at every pixel location. The name X3 comes from a unique
capability that the Foveon X3 technology brings - the ability to capture
three colors at each single pixel location.
The Foveon X3
technology is highly scalable and will be used in designs for small,
mid-range and large size image sensors. Foveon's first image sensors are
targeted for professional, advanced amateur and high-end
point-and-shoot camera users. Additional Foveon X3 image sensors are
being designed that are suitable for a wide range of cameras including
digital still/video cameras, PDA's, cell phones, security cameras, and
fingerprint-recognition systems.
Higher Quality Photographs, Smaller File Sizes
Today's
CCD and CMOS image sensors detect only one color of the three required
colors at each pixel and must mathematically estimate the remaining two
colors not detected. This limits the range and accuracy of the color
captured thereby increasing the possibility of unwanted color artifacts
in the photograph. By capturing three colors at every pixel instead of
just one, Foveon X3 based cameras have measured information for all
three colors. This results in high quality photographs with fewer
numbers of pixels because the pixels are based on real measurements.
Fewer pixels results in smaller file sizes allowing digital camera users
to send a higher quality photograph more quickly through e-mail. It
also means that more digital photos can be stored on a digital camera
storage card.
The first camera that will use the Foveon X3 chip
is the SD9 SLR digital camera made by Sigma Corporation. Photographs
from the SD9 can be enlarged up to 30 inches, exceeding the quality of
35 mm film. Sigma Corporation will demonstrate the SD9 camera at the
Photo Marketing Association convention, Booth # 1635 in Orlando, Florida
on Feb 24-27, 2002.
High-Quality, Low-Cost Solutions for Dual Mode Digital Cameras
In
addition to the breakthrough in color resolution, Foveon X3 image
sensors are the first to incorporate a capability known as Variable
Pixel Size (VPS). Foveon X3 full-color pixels can be grouped together to
create larger, full-color "super pixels" ushering in a new class of
dual capability still/video cameras. The size of the pixel groups is
variable and can be configured instantaneously on the camera. VPS
technology allows a Foveon X3 enabled digital camera to capture
high-resolution still photographs and full-motion video that offers
photo quality superior to 35 mm film, and video quality that rivals
high-end digital camcorders.
Parents for example, could use this
new type of camera to capture video of their child playing soccer.
Mid-way through video recording they could press a shutter button,
capture a high-resolution photograph and then seamlessly continue
recording video. Security applications could also benefit from this
high-quality dual-mode capture capability. Foveon X3 enabled airport
security cameras could record video for general surveillance and capture
high-resolution still photographs targeting suspected individuals or at
timed intervals.
"The photographic detail and color that can be
achieved with this technology is unsurpassed," said Lau. "Pixel for
pixel, Foveon X3 based digital cameras will deliver higher quality
images than any other image sensor."
About Foveon
Foveon, Inc.
was founded in 1997 by Dr. Carver Mead, a pioneer in solid-state
electronics and VLSI design. Foveon's mission is to develop innovative
products and technology that allow photographers to fully realize the
potential of digital photography. The company's recent accomplishments
include: the world's highest quality professional studio portrait
camera, the worlds first 16.8 million pixel CMOS image sensor and Foveon
X3, the worlds first full color image sensor. Foveon is a privately
held company. Investors include: National Semiconductor Inc., Synaptics
Inc. and New Enterprise Associates.
PERFORMANCE ADVANCES OF FOVEON X3 TECHNOLOGY - Image sensors with Foveon X3 technology are much less susceptible to digital artifacts and create sharper images.
Current
color image sensors (CCD and CMOS) contain just one layer of
monochromatic photo detectors, with one photo detector per pixel. To
capture color, the pixels in the image sensor are organized in a mosaic
pattern resembling a three-color checkerboard. As a result, each pixel
captures just one color-red, green or blue. The use of mosaic color
filters in image sensors has inherent drawbacks, no matter how many
pixels a mosaic-based image sensor might contain. Image sensors with
Foveon X3 technology produce accurate color every time because it
captures three colors at every pixel instead of one. - VPS: Video Performance and High Resolution in a single chip.
Foveon
X3 sensors come with a new feature known as Variable Pixel Size (VPS),
bringing the benefits of small and large pixels together into a single
image sensor. Smaller pixels offer higher resolution and sharper images
demanded by still photography. Larger pixels promote higher light
sensitivity that is needed for low light situations, faster auto focus
systems and video applications. The changing of pixel sizes can be
accomplished instantaneously and is only achieved with the full-color
capture of the Foveon X3 technology. - The only image sensors that capture color images by taking advantage of the natural color-separating properties of silicon.
Foveon
X3 image sensors are the world's first to use silicon as a color
filter. It is a well-known property of silicon that light of different
colors is absorbed at different depths in the silicon. Each Foveon X3
pixel consists of three photo detectors located at different depths
within the sensor to detect the absorption of the red, green and blue
light that has penetrated the silicon. Foveon is the first and only
company to use silicon color separation for designing color image
sensors for digital cameras. - Less Complex, Lower Cost.
Foveon
X3 image sensors will streamline the electronic designs of digital
cameras. Today's digital cameras use mosaic color filters and require
complex mathematical algorithms to estimate the red, green and blue
value of pixel, since only one color per pixel is being truly measured.
To accomplish this interpolation, dedicated processing hardware and
software are required inside the camera. Color interpolation adds cost
and complexity to a camera while increasing delays between clicking the
shutter button and capturing a picture, which can result in the
difference between capturing a great picture or missing an important
moment. By capturing all three colors at every pixel, Foveon X3-based
image sensors eliminate the need for costly, complex and error-prone
color interpolation. Foveon X3 enables improved image quality,
simplified camera designs and increased click-to-capture performance.
|
Powered by Coranto
|
