darktable 2.2.0rc1 released

we’re proud to announce the second release candidate of darktable 2.2.0, with some fixes over the previous release candidate. the most important one might be bringing back read support for very old xmp files (~4 years).

the github release is here: https://github.com/darktable-org/darktable/releases/tag/release-2.2.0rc1.

as always, please don’t use the tarball autogenerated by github, but only our .tar.xz with the following sha256sum:

0612163b0020bc3326909f6d7f7cbd8cfb5cff59b8e0ed1a9e2a2aa17d8f308e  darktable-2.2.0~rc1.tar.xz

the changelog vs. the stable 2.0.x series is below:

Well over 2k commits since 2.0.0

The Big Ones:

Add new automatic perspective correction module (" A new module for automatic perspective correction ")
Liquify tool for all your fancy pixel moving (" Liquify, liquify? ")
A new image module to use a Color Look Up Table (CLUT) to change colors in the image (" colour manipulation with the colour checker lut module ")
In Highlight reconstruction module, the mode LCh reconstruction was completely rewritten, and is no longer useless!
A new tool, darktable-chart, that goes along with the CLUT module, to create styles for the latter
Exposure fusion in the basecurve module to lower the dynamic range of images (" compressing dynamic range with exposure fusion ")
Add new raw overexposure indication (" Visualizing the raw (sensor) highlight clipping ")
Darkroom: the preview (in top-left corner) is now no longer pre-demosaiced (but just downscaled without demosaicing it at the same time), thus the preview, color picker, histogram show the proper results, especially when there is highlight clipping.

Quite Interesting Changes:

Split the database into a library containing images and a general one with styles, presets and tags. That allows having access to those when for example running with a :memory: library
Support running on platforms other than x86 (64bit little-endian, currently ARM64 only) (" Running on non-x86 platforms ")
darktable is now happy to use smaller stack sizes (no less than 256Kb). That should allow using musl libc
Allow darktable-cli to work on directories
Allow to import/export tags from Lightroom keyword files
Allow using modifier keys to modify the step for sliders and curves. Defaults: Ctrl – x0.1; Shift – x10
Allow using the [keyboard] cursor keys to interact with sliders, comboboxes and curves; modifiers apply too
Support presets in “more modules” so you can quickly switch between your favorite sets of modules shown in the GUI
Add range operator and date compare to the collection module
Add basic undo/redo support for the darkroom (masks are not accounted !)
Support the Exif date and time when importing photos from camera
Input color profile module, when profile is just matrix (and linear curve), is 1/3 faster now.
Rudimentary CYGM and RGBE color filter array support
Nicer web gallery exporter – now touch friendly!
OpenCL implementation of VNG/VNG4 demosaicing methods
OpenCL implementation of Markesteijn demosaicing method for X-Trans sensors
Filter-out some useless EXIF tags when exporting, helps keep EXIF size under ~64Kb
OpenCL: properly discard CPU-based OpenCL devices. Fixes crashes on startup with some partially-working OpenCL implementations like pocl.
darktable-cli: do not even try to open display, we don’t need it.
Hotpixels module: make it actually work for X-Trans

Some More Changes, Probably Not Complete:

Drop darktable-viewer tool in favor of slideshow view
Remove gnome keyring password backend, use libsecret instead
When using libsecret to store passwords then put them into the correct collection
Hint via window manager when import/export is done
Quick tagging searches anywhere, not just at the start of tags
The sidecar XMP schema for history entries is now more consistent and less error prone
Rawspeed: fixes for building with libjpeg (as opposed to libjpeg-turbo)
Give the choice of equidistant and proportional feathering when using elliptical masks (shift+click)
Add geolocation to watermark variables
Fix some crashes with missing configured ICC profiles
Support greyscale color profiles
OSX: add trash support (thanks to Michael Kefeder for initial patch)
Attach Xmp data to EXR files
Several fixes for HighDPI displays
Use Pango for text layout, thus supporting RTL languages
Feathering size in some mask shapes can be set with shift+scroll
Many bugs got fixed and some memory leaks plugged
The usermanual was updated to reflect the changes in the 2.2 series

Changed Dependencies:

CMake 3.0 is now required.
In order to compile darktable you now need at least gcc-4.7+/clang-3.3+, but better use gcc-5.0+
Drop support for OS X 10.6
Bump required libexiv2 version up to 0.24
Bump GTK+ requirement to gtk-3.14. (because even debian stable has it)
Bump GLib requirement to glib-2.40.
Port to OpenJPEG2
SDL is no longer needed.

A special note to all the darktable Fedora users: Fedora-provided darktable packages are intentionally built with Lua disabled. Thus, Lua scripting will not work. This breaks e.g. darktable-gimp integration. Please bug Fedora. In the mean time you could fix that by self-compiling darktable (pass -DDONT_USE_INTERNAL_LUA=OFF to cmake in order to enable use of bundled Lua5.2.4).

Base Support

Canon EOS-1D X Mark II
Canon EOS 5D Mark IV
Canon EOS 80D
Canon EOS 1300D
Canon EOS Kiss X80
Canon EOS Rebel T6
Canon EOS M10
Canon PowerShot A720 IS (dng)
Canon PowerShot G7 X Mark II
Canon PowerShot G9 X
Canon PowerShot SD450 (dng)
Canon PowerShot SX130 IS (dng)
Canon PowerShot SX260 HS (dng)
Canon PowerShot SX510 HS (dng)
Fujifilm FinePix S100FS
Fujifilm X-Pro2
Fujifilm X-T2
Fujifilm X70
Fujifilm XQ2
GITUP GIT2 (chdk-a, chdk-b)
(most nikon cameras here are just fixes, and they were supported before already)
Nikon 1 AW1 (12bit-compressed)
Nikon 1 J1 (12bit-compressed)
Nikon 1 J2 (12bit-compressed)
Nikon 1 J3 (12bit-compressed)
Nikon 1 J4 (12bit-compressed)
Nikon 1 J5 (12bit-compressed, 12bit-uncompressed)
Nikon 1 S1 (12bit-compressed)
Nikon 1 S2 (12bit-compressed)
Nikon 1 V1 (12bit-compressed)
Nikon 1 V2 (12bit-compressed)
Nikon 1 V3 (12bit-compressed, 12bit-uncompressed)
Nikon Coolpix A (14bit-compressed)
Nikon Coolpix P330 (12bit-compressed)
Nikon Coolpix P340 (12bit-compressed, 12bit-uncompressed)
Nikon Coolpix P6000 (12bit-uncompressed)
Nikon Coolpix P7000 (12bit-uncompressed)
Nikon Coolpix P7100 (12bit-uncompressed)
Nikon Coolpix P7700 (12bit-compressed)
Nikon Coolpix P7800 (12bit-compressed)
Nikon D1 (12bit-uncompressed)
Nikon D100 (12bit-compressed, 12bit-uncompressed)
Nikon D1H (12bit-compressed, 12bit-uncompressed)
Nikon D1X (12bit-compressed, 12bit-uncompressed)
Nikon D200 (12bit-compressed, 12bit-uncompressed)
Nikon D2H (12bit-compressed, 12bit-uncompressed)
Nikon D2Hs (12bit-compressed, 12bit-uncompressed)
Nikon D2X (12bit-compressed, 12bit-uncompressed)
Nikon D3 (14bit-compressed, 14bit-uncompressed, 12bit-compressed, 12bit-uncompressed)
Nikon D300 (14bit-compressed, 14bit-uncompressed, 12bit-compressed, 12bit-uncompressed)
Nikon D3000 (12bit-compressed)
Nikon D300S (14bit-compressed, 14bit-uncompressed, 12bit-compressed, 12bit-uncompressed)
Nikon D3100 (12bit-compressed)
Nikon D3200 (12bit-compressed)
Nikon D3300 (12bit-compressed, 12bit-uncompressed)
Nikon D3400 (12bit-compressed)
Nikon D3S (14bit-compressed, 14bit-uncompressed, 12bit-compressed, 12bit-uncompressed)
Nikon D3X (14bit-compressed, 14bit-uncompressed)
Nikon D4 (14bit-compressed, 14bit-uncompressed, 12bit-compressed, 12bit-uncompressed)
Nikon D40 (12bit-compressed, 12bit-uncompressed)
Nikon D40X (12bit-compressed, 12bit-uncompressed)
Nikon D4S (14bit-compressed)
Nikon D5 (14bit-compressed, 14bit-uncompressed, 12bit-compressed, 12bit-uncompressed)
Nikon D50 (12bit-compressed)
Nikon D500 (14bit-compressed, 12bit-compressed)
Nikon D5000 (12bit-compressed, 12bit-uncompressed)
Nikon D5100 (14bit-compressed, 14bit-uncompressed)
Nikon D5200 (14bit-compressed)
Nikon D5300 (12bit-uncompressed, 14bit-compressed, 14bit-uncompressed)
Nikon D5500 (12bit-uncompressed, 14bit-compressed, 14bit-uncompressed)
Nikon D60 (12bit-compressed, 12bit-uncompressed)
Nikon D600 (14bit-compressed, 12bit-compressed)
Nikon D610 (14bit-compressed, 12bit-compressed)
Nikon D70 (12bit-compressed)
Nikon D700 (12bit-compressed, 12bit-uncompressed, 14bit-compressed)
Nikon D7000 (14bit-compressed, 12bit-compressed)
Nikon D70s (12bit-compressed)
Nikon D7100 (14bit-compressed, 12bit-compressed)
Nikon D80 (12bit-compressed, 12bit-uncompressed)
Nikon D800 (14bit-compressed, 12bit-compressed, 12bit-uncompressed)
Nikon D800E (14bit-compressed, 12bit-compressed, 12bit-uncompressed)
Nikon D90 (12bit-compressed, 12bit-uncompressed)
Nikon Df (14bit-compressed, 14bit-uncompressed, 12bit-compressed, 12bit-uncompressed)
Nikon E5400 (12bit-uncompressed)
Nikon E5700 (12bit-uncompressed)
Olympus PEN-F
OnePlus One (dng)
Panasonic DMC-FZ150 (1:1, 16:9)
Panasonic DMC-FZ18 (16:9, 3:2)
Panasonic DMC-FZ300 (4:3)
Panasonic DMC-FZ50 (16:9, 3:2)
Panasonic DMC-G8 (4:3)
Panasonic DMC-G80 (4:3)
Panasonic DMC-GX80 (4:3)
Panasonic DMC-GX85 (4:3)
Panasonic DMC-LX3 (1:1)
Panasonic DMC-LX10 (3:2)
Panasonic DMC-LX15 (3:2)
Panasonic DMC-LX9 (3:2)
Pentax K-1
Pentax K-70
Samsung GX20 (dng)
Sony DSC-F828
Sony DSC-RX10M3
Sony DSLR-A380
Sony ILCA-68
Sony ILCE-6300

We were unable to bring back these 3 cameras, because we have no samples. If anyone reading this owns such a camera, please do consider providing samples.

Nikon E8400
Nikon E8800
Nikon D3X (12-bit)

White Balance Presets

Canon EOS 1200D
Canon EOS Kiss X70
Canon EOS Rebel T5
Canon EOS 1300D
Canon EOS Kiss X80
Canon EOS Rebel T6
Canon EOS 5D Mark IV
Canon EOS 5DS
Canon EOS 5DS R
Canon EOS 750D
Canon EOS Kiss X8i
Canon EOS Rebel T6i
Canon EOS 760D
Canon EOS 8000D
Canon EOS Rebel T6s
Canon EOS 80D
Canon EOS M10
Canon EOS-1D X Mark II
Canon PowerShot G7 X Mark II
Fujifilm X-Pro2
Fujifilm X-T2
Fujifilm X-T10
Fujifilm X100T
Fujifilm X20
Fujifilm X70
Nikon 1 V3
Nikon D5500
Olympus PEN-F
Pentax K-1
Pentax K-70
Pentax K-S1
Pentax K-S2
Sony ILCA-68
Sony ILCE-6300

Noise Profiles

Canon EOS 5DS R
Canon EOS 80D
Canon PowerShot G15
Canon PowerShot S100
Canon PowerShot SX50 HS
Fujifilm X-T10
Fujifilm X-T2
Fujifilm X100T
Fujifilm X20
Fujifilm X70
Nikon 1 V3
Nikon D5500
Olympus E-PL6
Olympus PEN-F
Panasonic DMC-FZ1000
Panasonic DMC-GF7
Pentax K-S2
Ricoh GR
Sony DSLR-A900
Sony DSC-RX10
Sony SLT-A37

New Translations

Hebrew
Slovenian

Updated Translations

Catalan
Czech
Danish
Dutch
French
German
Hungarian
Russian
Slovak
Spanish
Swedish

These are comments from the old website, archived as static HTML

Jan Herodes on Wed Nov 23 17:25:12 2016:

Hey,
from version 2.1 I stopped be me working lens correction. I have openSUSE 13.2
João Almeida on Wed Nov 23 18:42:14 2016:

And it's on the Unstable PPA also, nice!
Axel on Wed Nov 23 22:00:40 2016:

Great job!
Thank you so much guys, I am enjoying darktable day by day.

Currently perspective correction is my favourite. Is soooooo cool!

Just one question: I am starting getting doubts about the histogram in 2.2.0_rc[01]
It seems, no any of my pictures has correct exposure and histogram exceeds heavily on both ends (I think I am not that poor and don't remember so in the past)

Anything wrong with my/my settings or my doubts may have some points? (pity cannot go back easily to 2.0.7 to check :->)

Thanks again and keep on going
Cheers
Axel
Axel on Wed Nov 23 22:09:58 2016:

ammendment:
no strange changes to from my side:
- histogramm = logarithmic (all colors)
- exposure = standard levels, no blending or whatsoever...
gato on Thu Nov 24 06:10:55 2016:

.dmg, please...
Peter on Thu Nov 24 06:35:13 2016:

Has anybody a link to a flatpak file?
That would be great!
Alex on Thu Nov 24 08:10:38 2016:

Does release 2.2 include support for compressed Fuji RAW files? There are some issues open for that and I kind a remember a target version 2.2?!

Thanks!
houz on Thu Nov 24 10:07:17 2016:

The histogram is in the display color space (which sucks, we know that :-( ). Maybe that's why it looks strange?
Joe Giampaoli on Thu Nov 24 10:56:55 2016:

Maybe if there's no support at the moment for those compressed RAWs you could try Adobe's DNG converter, it will convert many RAW formats to the Adobe open RAW (DNG) format, so it will still be a RAW. If you're in Mac you won't have problems running it, in Linux it will run under wine, I have latest version on my linux pc's.
Joe Giampaoli on Thu Nov 24 10:58:01 2016:

Thanks again to all your hard work!

Always pleased with this great amazing software...
Sven Lamprecht on Thu Nov 24 12:23:23 2016:

Thanks for all the effort, great!

I'm wondering why no noise profile for Pentax K-1 is added. There are user-provided profiles already uploaded within bug #11024 and #11144 so I anticipated them for next major release.

Thanks!
Sven
João Almeida on Thu Nov 24 17:14:33 2016:

For me I'd rather shoot uncompressed RAW than add an extra step to convert files to DNG, but I'm curious to see current state of the implementation.
Axel on Thu Nov 24 19:15:41 2016:

Dear houz,

my CS270 is calibrated with displaycal. Let me try, to figure the effect. I thought, I remember, it wasn't like this in 2.0.7. Would be pitty, if I have to live without histogramm somehow.

I don't have dropbox or something yet. If you send me an PM to a.gerber(at)axel-gerber.de, I would like to send you a screenshot

TNX
Luya Tshimbalanga on Fri Nov 25 01:24:26 2016:

"A special note to all the darktable Fedora users: Fedora-provided darktable packages are intentionally built with Lua disabled."

Will darktable be build on lua above 5.2.4 instead? Looking at the fedora repository:
lua.x86_64 5.3.3-3.fc25 @System
Roman on Fri Nov 25 07:27:41 2016:

Lua is not forward-compatible. Should some distro would build dt with lua 5.3, that will most likely break all the lua scripts.
So no, either fedora will get some common sense and package lua5.2 (i bet it won't happen), or some day we will upgrade to lua5.3
But who says fedora by that time will not ditch lua5.3 in favor of lua5.4? :)
houz on Fri Nov 25 09:57:47 2016:

The Fedora packager just announced that the next releases will ship with Lua support enabled. :-)
Klaus on Sat Nov 26 11:53:34 2016:

Thanks a lot for all the great work that is being done here. I am enjoying DT since about 2 years and it is an outstanding tool.
madSec on Sun Nov 27 22:05:40 2016:

Tried to convert compressed Fuji RAW to DNG using the Adobe converter, but I couldn't process the DNG with Darktable anyway. I guess we just have wo wait for the native support of the compressed files.
Jan Herodes on Thu Dec 01 09:10:07 2016:

Can anyone advise me, why me from version 2.1 on openSUSE 13.2 does not function Lens Correction.
Thanks
Jan
Jack on Thu Dec 01 14:13:32 2016:

Thanks for the continued improvements of an excellent tool.
Could Mac version be simultaneously released to save me sleepless nights?

If you need Canon 1Dx and 1Dx II files for full support, I'm willing to post files on my server if anyone wants d/load them.
houz on Sat Dec 03 15:07:12 2016:

The OSX packages are not created by “the darktable team”. It's just one guy who maintains dt on OSX and creates the DMGs. There isn't much we can do about that.
Iloper on Sat Dec 03 23:34:49 2016:

cant wait!
Iloper on Sat Dec 03 23:47:59 2016:

Just to ask why does the shadow recovery always has a predefined value. I always reset it..

Cheers and good work!
gato on Sun Dec 04 19:21:45 2016:

.dmg

Ma :(