Photoshop Blog

December 7, 2015 /Lightroom /Photoshop /Tutorials /

DNG Pros, Cons and Myths

Martin Evening is an accomplished studio photographer and author based in London.  Martin’s book Photoshop for Photographers is in its 13th edition and his Adobe Photoshop Lightroom book has established itself as the encyclopedia on Lightroom.  As an expert on Photoshop and Lightroom, Martin routinely encounters questions from photographers on topics like raw file formats.  Below Martin tackles commonly asked questions and myths around Adobe’s openly documented DNG file format. I’d like to thank Martin for taking the time to explain this topic in such a clear format.

Without further ado, here’s Martin:

Is it wise to convert your raw files to the Adobe DNG format? If you are using Lightroom or Photoshop with Camera Raw, you have the option to convert your master files to DNG. In this article I want to focus on the benefits of converting, the reasons why converting to DNG may not always be ideal or necessary, as well as tackle some of the misinformation about DNG.

Why the need for the DNG format?

The DNG format was devised by Adobe in response to the growing number of undocumented raw camera file formats that are produced each time a new digital camera is introduced. The problem here is that these camera file formats are all proprietary to the camera manufacturer that specified them. To open such files you either need the camera manufacturer’s own raw processing software, or the ability to interpret the raw data using third-­party software, such as Capture One, Camera Raw or Lightroom.

DNG-logo

DNG as an archival format

Any of the 500­‐plus types of raw files that are currently supported by Camera Raw and Lightroom can be archived using DNG. Some cameras even give you the option to save your capture images as DNG (including the latest Android smartphones). The DNG format is open standard, which means the file format specification (based on the TIFF 6 file format) is made freely available to any third-party developer. A number of programs other than Lightroom and Photoshop are able to read from and write DNG files. This supports the case for DNG as an archive format that meets the criteria for long-term file preservation that will enable future generations to access and read the DNG raw data. This should hold true in the same way regular TIFF files look set to be readable for the foreseeable future.

You will notice that whenever you import files into Lightroom, you have the option to convert to DNG. You can also do this by making a selection of photos in the Library module and choosing Library > Convert Photos to DNG. The only proviso is that the photos you import or select are in a raw format Lightroom recognizes. For now, there is no imminent need to convert everything to DNG since undocumented raw formats can still widely be read. However, in the long term, there are legitimate concerns about the suitability of storing raw files using undocumented file formats. Major operating system updates have been known to make older operating systems, and the software that runs on them, obsolete within a matter of a few years.

Therefore, continued support for undocumented file formats is directly dependent on future support for those applications. It is likely Adobe will be around 10 years from now, but photographers should really be asking themselves “what will happen in 50 or 100 years’ time?”

Validating the raw data

The DNG format contains a checksum validation feature, which can be used to spot corrupted DNG files. This is a useful feature for archivists as it allows them to check on the condition of their archived files. 

DNG-validate

In Lightroom you can choose Validate DNG Files from the Library menu to check the integrity of your DNGs.

Faster performance

The DNG format allows you to enable Fast Load Data, which stores a standard-size preview in the DNG file. This enables faster loading when opening an image in Camera Raw or Lightroom. Having said that, Lightroom 6.3 now includes faster Camera Raw caching whereby the opening of proprietary raw files is now almost as fast as opening a DNG with Fast Load Data enabled. The DNG spec also enables image tiling, which can speed up file data read times when using multicore processors compared with reading a continuous compressed raw file, that can only be read using one processor core at a time.

In the Lightroom File Handling preferences you can enable Embed Fast Load Data when saving a DNG file.

In the Lightroom File Handling preferences you can enable Embed Fast Load Data when saving a DNG file.

Compact format

Raw files that have been converted to DNG tend to be smaller in size compared to the original raws. This is because the lossless compression method Adobe uses is generally more efficient compared to that implemented by most proprietary raw formats. In some instances the file size savings can be really dramatic.

If you compare the file size of the raw original with a converted DNG, the DNG file size will usually be smaller. 

If you compare the file size of the raw original with a converted DNG, the DNG file size will usually be smaller.

Photo merged composites

If you are using Camera Raw 9 or Lightroom 6, you can create Photo Merged panoramas or HDR images that are saved as DNGs. Because of this they can retain the raw characteristics of the source images.

An example of a Panorama Photo Merge image created in Lightroom and saved as a raw DNG. 

An example of a Panorama Photo Merge image created in Lightroom and saved as a raw DNG.

It is also worth pointing out that Camera Raw/Lightroom Photo Merge HDR are saved as compact, scene-referred 16-bit floating point TIFFs that can contain over 30 stops of image data. This is compared to HDR files that contain “baked” output-referred data that have to be saved as 32-bit TIFFs in order to store more than 30 stops of image data. Therefore Camera Raw/Lightroom HDR DNGs offer a more efficient workflow for HDR photography compared to other HDR-­‐processing methods.

An example of a Photo Merge HDR DNG created and processed in Lightroom from three bracketed exposure images.

An example of a Photo Merge HDR DNG created and processed in Lightroom from three bracketed exposure images.

Keep up-­to-­date without upgrading

Camera Raw gets updated several times each year to provide support for the latest cameras and lenses. These updates are now only available to customers who are using Photoshop CC (since Camera Raw 9.2/Lightroom 6.2, ongoing Camera Raw support has ceased for CS6 customers). However, CS6 users, as well as those running older versions of Photoshop (or earlier versions of Lightroom) can use the DNG Converter program to batch convert raw files shot with the latest cameras to DNG and thereby keep their old software up-to-date.

The DNG Converter program.

The DNG Converter program.

DNG Cons

The time it takes to convert to DNG

Converting to DNG does have its downsides, most notably, the added time it takes to convert raw files to DNG.

DNG compatibility with other programs

While Adobe programs work well with the DNG format, there are other programs that support DNG, which do not. This has led to problems for some photographers who have converted to DNG. These are fixable through proper implementation of the DNG spec, but nonetheless it can be a hindrance to some users who are working with other raw processing programs. If you convert to DNG you do certainly lose the ability to process DNG files using the manufacturer’s dedicated raw processing software, unless you choose to embed the original raw inside the DNG. However, this can double the file size because you will be storing two raw files in one container.

Backing up DNG metadata changes

If you save edit changes to the DNG files, this will slow down the backup process because the backup software will have to copy a complete DNG file instead of just the XMP sidecar files that otherwise accompany proprietary raw images. Personally, I believe it is better to let the Lightroom catalog file store the metadata edits rather than constantly overwrite the files referenced by the catalog. If you are in the habit of saving metadata edits to the files themselves as well, this is an important consideration, but you need to ask yourself, “In an emergency situation, where I might need to restore all my metadata edits, which is going to be the most up-to-date? The metadata that’s stored in the files, or the metadata that’s stored in the Lightroom catalog?”

Proprietary raw files that have been edited in Camera Raw or Lightroom have the metadata information stored in a compact XMP sidecar file. DNG files though incorporate the metadata information into the file header. 

Proprietary raw files that have been edited in Camera Raw or Lightroom have the metadata information stored in a compact XMP sidecar file. DNG files though incorporate the metadata information into the file header.

 

DNG Myths 

Converting to DNG changes the raw data

Whenever you open a raw image in Camera Raw/Lightroom the raw data is internally converted to the DNG format regardless of whether the file being read is a DNG file or not. In other words, DNG is the internal format for Camera Raw/Lightroom. If you can open an image normally using Camera Raw or Lightroom there will be no difference if you convert to DNG. It is true to say though that the raw data is converted in as much as the lossless compression used is different. The DNG format is based on the TIFF 6 spec, which is an industry standard file format.

The ability to read the raw data on a DNG is therefore only limited by the implementation of the DNG spec. When a DNG file is read correctly, the result will be identical to reading the proprietary raw format version the DNG was converted from.

DNG converts your files to an “Adobe Standard” color profile

When you import a raw file, Lightroom applies a camera profile setting as part of the import process. The same is true when you copy files to Bridge and open them in Camera Raw. The camera profile merely establishes the base settings ‘look’ for the imported files. By default, the camera profile is set to Adobe Standard. This applies a camera profile (created in-­‐house by Adobe) that is specific to the camera the photo was shot with. If you prefer the default profile to be different, such as Camera Standard (to match the camera JPEG previews) you can do so by setting this as the new default.

When you convert a proprietary raw file to the DNG format it preserves the colors of the original raw file in the native color space of the sensor. Converting to DNG does not actually convert the data to an Adobe Camera Profile. “Adobe Standard” is simply an option for the default color rendition when interpreting that raw color data in Lightroom of Camera Raw. The camera profile information is included in the DNG metadata so it can be read by Adobe Camera Raw or Lightroom. The Adobe Standard camera profile is meaningless to other DNG-compatible software programs and is therefore simply ignored by them.

The DNG conversion process converts the raw data to something that works best with Camera Raw and Lightroom, which means other programs, are unable to interpret the raw data.

Other DNG-compatible programs, such as Capture One are able to read DNG files, just as they are able to read any other recognized raw format. How the raw data may have been previously read and edited using Camera Raw or Lightroom will have no bearing on another program’s ability to read the same raw data. This is because each raw processing program will have its own unique way of demosaicing the raw data and will allow you to apply image adjustments using that program.

It is not a good idea to convert JPEG images to DNG

The DNG format was originally designed with raw files in mind, but you can also use it to archive JPEGs, and here’s why. While it is true that converting a JPEG to DNG does not turn it into a raw file, there are very good reasons for using DNG as a JPEG container format. Lightroom allows you to import and edit JPEG files (such as those shot using a smart phone) using the same slider controls as you use to process raw files. If you save the metadata to a JPEG file via Camera Raw or Lightroom, the Camera Raw settings are saved to the file’s metadata so these settings can be read externally if you edit the original or a copy of the original file. If you choose to export a JPEG from Lightroom, it is all too easy for the Camera Raw metadata to be omitted. If you choose to convert your JPEG files to DNG, the Lightroom-applied settings will always travel with the master image and allow another Camera Raw/Lightroom user access to the settings applied to the JPEG. At the same time, saving as a DNG file saves a Lightroom-adjusted preview, so when it’s viewed in any third-party, DNG-aware program, the correct preview is seen, even if it doesn’t have the same edit controls as Lightroom or Camera Raw.

—-

All photographs © Martin Evening. My thanks to Eric Chan and Tom Hogarty at Adobe for their assistance, researching this article.

Lightroom, Photoshop, Tutorials

Join the discussion

  • By Peter - 5:50 AM on December 8, 2015   Reply

    one thing that annoyes the hell out of me is that DNG´s are touched by lightroom even when they are actually not touched by me.

    let me expalin.

    i do automativ updates of my image database once a day.
    ony files that are changed are copied over to the backup drives.

    now i noticed that a lot of DNG files are copied again even when i did make no changes to them. no editing changes and no metadata chages (keywords etc).

    this happens when i SYNCHRONIZE a folder that contains DNG data.
    again nothing is changed on these files by me.
    synchronizing the folder they are in is enough to make lightroom write changes to them.

    this was also mentioned already on the adobe lightroom forum and thr adobe feedback forum.

    • By Martin Evening - 12:54 AM on December 9, 2015   Reply

      One possibility is this. In the preferences the automatically write changes into XMP is on. This automatically updates the XMP metadata in all catalog files, but only does this when it is possible to do so without affecting Lightroom performance. Therefore, if you have made changes to a lot of files the updates are immediately updated to the master catalog file, but the same metadata updates are not immediately updated to the master files’ metadata. It could be that Lightroom has a deferred list of files to backup the XMP metadata. Therefore, although you may not have touched those files in Lightroom on the day of backup, the metadata update may have been delayed because it is a background (do when Lightroom is idle) process. The auto update on a small number of photos should only be delayed by a few minutes. But if there were a lot of images? i.e. a mass update of the IPTC metadata to update the copyright notice say? Just a thought.

      • By Peter - 2:45 PM on December 9, 2015   Reply

        no, as i wrote THERE ARE NO CHANGES MADE TO THE FILES FOR MONTH.

        it´s also described in detail in the link i posted.

        it is NOT about delayed updates.

    • By jemelaih - 10:55 AM on December 16, 2015   Reply

      can you guys help me sing up because I can’t do it and I need help thank you

      • By jemeliah - 10:57 AM on December 16, 2015   Reply

        thank you guys can you guys help me to sing up and when you get this mail get back to me please

      • By jemeliah - 12:01 PM on December 16, 2015   Reply

        can you help me peter because I need help to sign up please and thank you

  • By Peter - 5:52 AM on December 8, 2015   Reply

    here is someone writing about this

    https://forums.adobe.com/thread/1266351?tstart=0

    ps: sorry for the typos… im on my phone.

  • By David Bullock - 7:23 AM on December 8, 2015   Reply

    Tom, Adobe don’t seem to facilitate the batch conversion of JPEG to DNG in the free Adobe DNG Converter. Why is that?

    • By David Bullock - 11:18 PM on January 5, 2016   Reply

      Or to put it another way, would Adobe consider permitting batch conversion of JPEG -> DNG in the free Adobe DNG Converter? It seems a no-brainer that doing so would likely assist to increase the adoption of DNG as a container format for JPEGs, as the above article advocates.

  • By Robin Orrow - 1:12 PM on December 9, 2015   Reply

    DNG files are not recognised as original files by most international competitions making submission invalid if the original capture has been converted to DNG and the raw file not kept.

    • By Martin Evening - 2:03 PM on December 10, 2015   Reply

      Hi Robin,
      That’s an interesting point. I haven’t come across this myself, but I can imagine it happening. I was recently commissioned to carry out a technical review of submissions for a big photo competition, but there was no such restriction. Photographers were simply requested to supply a raw file of any kind. In the case of DNGs one can use the DNG mode for the Metadata panel and check to see if the mosaic data is there or not. If yes, it’s a raw DNG. Some cameras also shoot DNG.

    • By Carolyn B - 7:23 AM on January 20, 2016   Reply

      That’s an interesting problem. The only suggestion then is to edit in the original RAW format and perhaps make a backup file in DNG format, and store it somewhere else, like you would put an original film negative in an archival sleeve in dark, dust-free folder.

      • By Conor Molloy - 8:18 AM on February 1, 2016   Reply

        This is a very real concern. Today, I was getting ready to submit my entry for the Wildlife Photographer of the Year competition. However, they specify that you need to be able to produce the original raw file native to the camera that took the image (in my case Canon .CR2). As my set up has converted all images to DNG on import to Lightroom and I did not tick the box called “embed original RAW file” – as it basically doubles the file size – it means I am unable to enter this competition. I think in future I need to stop copying to DNG.

  • By rafaya - 7:47 AM on December 10, 2015   Reply

    this format is 12 Bit or 14 Bit Raw?

    • By Martin Evening - 2:08 PM on December 10, 2015   Reply

      The format can contain whatever the bit depth the source image is in. If it is a dSLR with 14-bit capture, that is how the image is stored. With the ability to create HDR DNGs, the bit depth is 16-bit.

  • By Web Tasarım - 5:08 AM on December 12, 2015   Reply

    It was a very nice article, thank you.

  • By Malou - 8:32 AM on January 12, 2016   Reply

    Thanks for the article. I find the con about time a point but if your computer is fast enough you can convert it all when your doing other work.

  • By nawal - 10:19 AM on January 26, 2016   Reply

    oh c’est belle

  • By Rustam - 3:06 AM on February 20, 2016   Reply

    Very informative article, thanks for share.

  • By Jon Tinkler (Melbourne Wedding Photographer) - 4:10 PM on February 24, 2016   Reply

    Thanks for the great post Tom. Even though I’ve used DNG’s at times via necessity, I never really understood them properly. This is a great soup-to-nuts post – cheers.

  • By Idioms - 3:10 AM on March 8, 2016   Reply

    This automatically updates the XMP metadata in all catalog files, but only does this when it is possible to do so without affecting Lightroom performance.

  • By Pedro Marques - 4:00 AM on March 28, 2016   Reply

    We have start 2 years ago using DNG instead of CR2 + sidecars and we are very satisfied.

    We have arround 20 different studios, each with its own color profiles.
    We shoot daily arround 6000 CR2 raw images, and lightroom is converting all of them nicely and embedding the color profiles has well as the xmp.

    We have successfully improve the productivity when changing to dngs and the loss of quality is quite residual.

    If you must deliver a high volume of images on a short time, this is crucial. Even more on a complex IT international network using teams and studios around the world like we have.

  • By Angelina veronica - 12:41 PM on May 5, 2016   Reply

    Hello Tmm,
    Thanks for the great post . i am using DNG’s often but i did not understand about it but after reading your article i have understood about it.

  • By Mr. King - 4:15 AM on May 6, 2016   Reply

    Really it’s a informative and helpful post .

  • By than tuong am nhac nhi 2016 tap 3 - 12:57 AM on May 8, 2016   Reply

    Đón xem Thần tượng âm nhạc nhí 2016 tập 3 – Vietnam idol kids 2016 tập 3 vào lúc 20h05 ngày 08/05/2016 được trực tiếp full hd trên kênh video ovuinhi.com (tại đây).

  • By 5s online mua 3 tập 15 - 6:40 AM on May 16, 2016   Reply

    Đón xem 5s online mùa 3 tập 15 gái đảm thời nay vào lúc 20h ngày 16/05/2016 được trực tiếp full hd trên kênh video ovuinhi.com (tại đây).

  • By cuoc dua ky thu 2016 chung ket - 9:48 AM on June 8, 2016   Reply

    Mời quý khán giả cùng đón xem chương trình cuộc đua kỳ thú 2016 tập 11 chặng chung kết phát sóng trực tiếp lúc 21h thứ 5 ngày 09/06/2016 và được cập nhật nhanh nhất trên kênh video ovuinhi.com (Tại đây).

  • By Status hay - 2:59 AM on June 13, 2016   Reply

    Gửi đến bạn những Stt hay và ý nghĩa về tình yêu

  • By SOKI - 2:58 AM on June 27, 2016   Reply

    Great article, thanks for your posting !

  • DNG Format helped photographers to Get best quality of their camera.
    جدیدترین سریال کره ای

  • By john matacola - 1:37 PM on November 24, 2016   Reply

    I keep the file and make a copy to use in different processors. Someday in the future someone might come up with new algorithms to process the originals in a better method. I know this creates the need for more storage. Isn’t that why hd/ssd’s and other flash drives are so numerous?

Join the discussion