Next Article in Journal
Performance Evaluation of Source Camera Attribution by Using Likelihood Ratio Methods
Next Article in Special Issue
Computer Vision Meets Image Processing and UAS PhotoGrammetric Data Integration: From HBIM to the eXtended Reality Project of Arco della Pace in Milan and Its Decorative Complexity
Previous Article in Journal
DCNet: Noise-Robust Convolutional Neural Networks for Degradation Classification on Ancient Documents
Previous Article in Special Issue
Comparing CAM Algorithms for the Identification of Salient Image Features in Iconography Artwork Analysis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Camera Color Correction for Cultural Heritage Preservation Based on Clustered Data

1
Department of Electrical, Electronics and Telecommunication Engineering and Naval Architecture, Università degli Studi di Genova, Via All’Opera Pia 11A, 16145 Genoa, Italy
2
Department of Chemistry and Industrial Chemistry, Università degli Studi di Genova, Via Dodecaneso 31, 16146 Genoa, Italy
*
Author to whom correspondence should be addressed.
Submission received: 27 May 2021 / Revised: 9 July 2021 / Accepted: 10 July 2021 / Published: 13 July 2021
(This article belongs to the Special Issue Fine Art Pattern Extraction and Recognition)

Abstract

:
Cultural heritage preservation is a crucial topic for our society. When dealing with fine art, color is a primary feature that encompasses much information related to the artwork’s conservation status and to the pigments’ composition. As an alternative to more sophisticated devices, the analysis and identification of color pigments may be addressed via a digital camera, i.e., a non-invasive, inexpensive, and portable tool for studying large surfaces. In the present study, we propose a new supervised approach to camera characterization based on clustered data in order to address the homoscedasticity of the acquired data. The experimental phase is conducted on a real pictorial dataset, where pigments are grouped according to their chromatic or chemical properties. The results show that such a procedure leads to better characterization with respect to state-of-the-art methods. In addition, the present study introduces a method to deal with organic pigments in a quantitative visual approach.

1. Introduction

Cultural heritage bears witness to life and history, provides an identity to nations, and represents an irreplaceable source of inspiration. Its importance from cultural, historical, and economic points of view is invaluable; thus, its preservation and valorization are crucial topics for our society. Natural aging and deterioration due to external agents endanger artworks such as paintings, sculptures, and architecture, and therefore diagnostic tools are needed for monitoring and preservation.
Monitoring historical artistic heritage consists of the evaluation of possible modifications of some characteristics of the object under observation. When it comes to a artwork or, more generally, a mono- or polychromatic surface, color is one of those characteristics, as it is easily perceivable by the human eye, allows one to distinguish an artwork, and provides information on the nature and status of an artwork.
Color analysis on artworks is generally performed via specific instruments such as colorimeters and spectrophotometers, both of which use sophisticated technologies to accurately and precisely quantify and define color, working in a device-independent color space as Commission Internationale de l’Éclairage (CIE) L*a*b* [1,2] This allows for objective assessment of color changes in order to monitor the state of the painting over time and appropriately plan periodic protection or restoration actions. Color studies of artworks could also make use of Infrared (IR) and Ultraviolet (UV) data (by means of, e.g., infrared reflectography, UV–Visible spectrophotometry, UV reflectance, etc.) or X-ray fluorescence spectroscopy (XRF) [3,4].
However, several drawbacks may limit the efficacy of such devices/methodologies. First, colorimeters and spectrophotometers give, as with XRF, pointwise measurements; thus, color studies on large areas require several time-consuming repetitions. Furthermore, even though spectrophotometers are defined as non-invasive devices [5], they must perfectly lean onto the artwork surface in order to exclude external light radiation, thus, risking ruining the painting. Finally, it is still rare nowadays that small laboratories are equipped with the abovementioned costly devices.
In order to address such issues, recent studies have proposed performing color monitoring through photographic documentation. Here, the necessary equipment is conceivably minimal and considerably cheaper, consisting of a professional digital camera and a photographic set with adequate lighting; then, the color data of each pixel of the selected area can be stored from a single photoshoot, limited only by illumination [6]. However, uncorrected digital data are not directly comparable, in terms of quantitative reliability, to the standard provided by the more specific spectrophotometric instrumentation. In addition, a well-defined procedure consisting of camera calibration, arrangement of lights, and positioning of the artwork, although necessary, is not sufficient per se for a correct comparison of digital data with colorimetric data. Finally, another major problem when using a digital camera for measuring color is that consumer-level sensors (either CCD or CMOS type) are typically uncalibrated.
Therefore, camera characterization is needed, i.e., some specific digital image processing to transform raw color digital values into objective L*a*b* values equivalent to colorimetric measures.
A common approach to minimize the difference between digital and colorimetric determinations relies on the application of a correction based on a least-squares regression to the uncalibrated digital data. Linear [7,8], nonlinear, and mixed [9] approaches have all been described in the literature. Regarding nonlinear regressions, one can mention polynomial regressions [10,11], neural networks (NNs) [12,13], and look-up tables [14]. In addition, the problem of different color spaces based on the acquisition device must be addressed. Indeed, camera data usually refer to RGB or sRGB color spaces. Several approaches have been proposed [15], such as linear or quadratic models, neural networks for L*a*b* regression starting from RGB values, and models requiring RGB data to be converted into XYZ values, which are then used to derive L*a*b* values, with and without a linearization of sRGB data via a gamma model. Gamma correction is also involved in the method [16].
Further aiming at minimization of the correction error, other features to be preserved may be considered. For instance, characterization should be robust across different illuminants and reflectance types, and across noise [17,18,19].
To achieve better results, the use of digital image processing techniques for camera characterization can also be combined with different disciplines. Indeed, a multidisciplinary approach allows one to deal with specific features related to the heterogeneity of the data under analysis. Therefore, in order to overcome the lack of homoscedasticity required to apply a single-step procedure, an innovative approach combining pattern recognition and image processing techniques with chemistry information is proposed here.
In the present study, 117 tiles from the database of diagnostic analyses of The Foundation Centre for Conservation and Restoration of Cultural Heritage “La Venaria Reale” (in collaboration with the National Institute of Metrological Research and Laboratorio Analisi Scientifiche of Regione Autonoma Valle d’Aosta) represent the basic dataset [3,20].
As proposed by the state-of-the-art literature, the methods of linear regression, polynomial regression, and NN [8,9,19] were initially applied herein to the whole dataset, but the resulting performances unfortunately proved to be not satisfactory. It is worthwhile mentioning that a preliminary camera calibration using the X-Rite ColorChecker Passport Photo failed to provide satisfactory results [9], as expected, due to the limited color content of such a color chart.
To understand the reason for such poor results, the work was adapted by conducting a closer investigation of the pigments’ characteristics and their corresponding statistical analysis in photographic images in order to overcome the significant lack of the homoscedasticity feature that is required for proper application of approaches in the literature, which work at a global level.
Consequently, from the perspective of optimizing the analysis, the original idea proposed herein is to apply state-of-the-art characterization methods to clusters of data rather than to the whole digital dataset, selected by means of two different criteria, i.e., the color and chemical properties of pigments. Regarding the latter, based on Kremer code, the main chemical element can be objectively defined for each pictorial layer analyzed.
To overcome the issue of a small amount of data and to find one-to-one correspondence between an image and colorimetric data, samples referring to the same tile are sorted by hue values, which provides coupled data and the use of supervised methods for precise and punctual color correction.
Thus, the application of several methods for camera characterization to numerous clusters of the base dataset is described hereinafter, in order to minimize the difference between digital and spectrophotometric quantitative color data, and therefore validate a handy diagnostic tool such as a digital camera for color determination. The best characterization approach results were achieved from a polynomial regression, while the predominant factor that affects the efficacy of the color correction could be found in the chemical composition, more precisely, in the nature of the central element. The best results were those splitting the data by chemical composition. In addition, the proposed method also proved to be effective with organic pigments, which could not be analyzed via standard approaches such as XRF; in fact, the latter has been employed to identify the presence of inorganic pigments, characterized by elements with an atomic number higher than 13. Instead, other non-invasive approaches for the study of organic pigments (usually referred to as “lakes”) include IR and Raman spectroscopy, but still require rather sophisticated instrumentation.
The considered approaches are briefly presented in Section 2, along with the dataset. Additionally, details on how data were collected and split into clusters and how camera images were used are provided.
Although a complete color analysis of artworks is also based on IR and UV data, the scope of the present study is to investigate how deep an analysis performed with traditional photographic data can be.

2. Materials and Methods

2.1. Background

Sensors’ responses to light distribution are clearly defined in the literature [21,22]. For the sake of clarity, let I λ be the illuminant spectral power distribution falling on the surface patch ( λ is the wavelength), and let γ λ be the reflectance function of the material the object is made from (or that its surface is painted with), so that the spectral power distribution P λ can be expressed as follows:
P λ = I λ γ λ
where P λ is the spectrum of the light that reaches the sensor and is associated with the corresponding pixels of the image.
Then, let σ λ be the spectral filter function of the sensor, and define the sensor’s response to P λ as follows:
s = λ P λ σ λ d λ
As mentioned in the Introduction, in the present study, camera and colorimeter sensors are involved. Hence, hereinafter, whenever s refers to the camera, it will be referred to as c m , while the colorimeter, s , will be referred to as c l (which will be the reference measurement). Specifically, based on the available data, c m is a three-dimensional vector c m = R , G , B T , laying in the RGB color space. Similarly, the colorimeter response comes from the device-independent color space CIE L*a*b*, namely c l = L , a , b T .
In order to perform an efficient correction on error-prone measurements of color changing, such as those deriving from commercial cameras, an optimal transformation f such that c m f c l must be found. In fact, the final value of such a correction is only an approximation of the real corresponding c m value, namely f c m = c l ^ , due to the different nature of the considered color spaces, to noise, estimation, and computation errors, etc. Some constraints can be added to improve the precision of the correction and are discussed later in the paper. The general requirement for the function f is to be error-minimizing, i.e.:
f = a r g m i n g i = 1 N | | u c l u g ( c m ) | | ,  
where N is the number of color triplets in the dataset, u is a color space transformation to ensure that g c m and c l refer to the same color space, and · is the norm. In the present manuscript, the considered norms will be the root mean squared error (Euclidean distance) and ΔE00 [23]. In addition, a similarity measure will also be involved, i.e., Pearson’s correlation coefficient.
In the following, since f is properly designed to correct c m to be more similar to c l , hence, both c l and f c m are in the CIE L*a*b* color space, and u is assumed to be the identity function.
In general, methods in the literature are applied to the entire dataset. However, it appeared that no conditions for a single correction were present because of the non-homoscedasticity of the data. Hence, the methods were applied to clusters of tiles that could be determined according to some criterion. Here, this multi-cluster approach is based on either the chemical element or color, which is the major novelty of this study.
In this paper, the dependance of the color on the predominant chemical composition as well as on its chromaticity is investigated. More specifically, let C i be the i-th cluster of color, based on either the chemical properties or the chromaticity. The purpose is to find many functions f i , one for each cluster, which, of course, depends on the cluster that the input color belongs to:
c m C i   c l ^ = f i c m = f ( c m | C i )

2.2. Instrumentation

According to the CIE standard definition [24], reference measurements were made using a Konica Minolta CM2600d spectrophotometer (Konica Minolta, Ramsey, NJ, USA) [25] with the following setup: standard observer at 10°, illuminant D65, and acquisition SCI. Five measurements were acquired for each pictorial layer.
Photographic image data were acquired with a Lumix DMC-FZ200 camera (Panasonic, Osaka, Japan). The following image acquisition setup was used: The camera was placed vertically at 46.5 cm from the samples. The angle between the axis of the lens and the sources of illumination was approximately 45°. Illumination was achieved with two Natural Daylight 23 W fluorescent lights (OSRAM, Munich, Germany), color temperature 6500 K, reproducing the standard D65 illuminant. The photos were shot in a dark room. The settings of the camera are summarized in Table 1.

2.3. Dataset

As previously mentioned, the dataset of the present study consisted of 117 tiles from the database of diagnostic analyses of La Venaria Reale [20]. A picture for each tile was taken to enable analysis. Figure 1a shows an example of a photographic picture of the tables from Venaria.
In the table, each pigment (Figure 1b) is presented in a mixture with two binders: polyvinyl acetate (PVAc) (column on the left) and linseed oil (column on the right). Then, the painted surface is divided into 3 rows. The first two present 2 different finishings: terpene resin (stripe on the top) and acrylic resin (middle stripe), while the third one is unprotected. For the present study, only the unprotected and the linseed oil sectors were taken into consideration (the red box in Figure 1b), because the linseed oil technique is the one most used by painters since the 15th century. The central portion of the camera acquisition was considered in order to avoid specularity and saturation problems. Figure 2 shows some of the selected parts of tiles involved in the study.
To address the local color inhomogeneity of tiles, the characterization was performed by taking into consideration five measurements via the colorimeter and five RGB triplets extracted from the pictures in order to create paired couples and to develop a robust supervised color correction.
Specifically, pixels from each tile were sorted by hue (in ascending order). Then, five triplets were extracted, namely the first one (i.e., the one with minimal hue), the last one (i.e., the one with maximal hue), and the ones corresponding to the 25th, 50th, and 75th percentiles. This was done to obtain as many samples as possible for the reference dataset.

2.4. Linear Regression

The method consists of estimating the L*, a*, and b* values separately via linear regression. In particular, let α L , β L , α a , β a , and α b , β b be the regression coefficients for L*, a*, and b*, respectively, so that the estimated values are L e = α L L l + β L , a e = α a a l + β a , and b e = α b b l + β b , where L l , a l , and b l are the colorimeter values. To find the best characterization of the camera data with L m ^ ,   a m , ^ and b m ^ , the constraints L m L m ^ L l , a m a m ^ a l , and b m b m ^ b l are added, yielding the following:
L m ^ = L e β L α L ,   a m ^ = a e β a α a ,   b m ^ = b e β b α b

2.5. Polynomial Regression

The polynomial regression approach consists of mapping a polynomial expansion of the device RGB values to estimated L*a*b*. In the following, the polynomial P 8 was used:
P 8 = R , G , B , R G , R B , G B , R G B , 1 ,
The corrected L*a*b* triplet c l ^ is obtained via the following equation:
c l ^ = M P 8 ,
where M is the 3 × 8 tranformation matrix, which is derived via a pseudo-inversion procedure as in [11].

2.6. Hue-Plane-Preserving Camera Characterization—Weighted Constrained Matrixing Method

The Hue-Plane-Preserving Camera Characterization—Weighted Constrained Matrixing (HPPCC-WCM) method [19] is aimed at ensuring that the characterization preserves the hue plane and minimizes error. Starting from the camera data, the transformation matrix is defined in function of the device hue angle φ m and of the parameter p referring to the order of the transformation, as follows:
M φ m , p = 1 σ i = 1 N π Δ φ i p M i ,
where N is the number of training coupled colorimeter–camera data ( c l , c m ), M i is the transforming matrix c m , i = M i c l , i , Δ φ i = m i n | φ m φ i , 2 π | φ m φ i , with φ i being the i-th training color hue angle, and σ = i = 1 N π Δ φ i p .
To sum up, the color correction here proposed is as follows:
c l ^ = M φ m , p c m

2.7. Data Grouping

To avoid the application of each method in a global way, the dataset under analysis was clustered according to two different criteria, i.e., according to chromatic appearance and the chemical composition, with reference to the central metal atom. Table A1 in Appendix A shows the available pigments and relevant features (pigment name and color, chemical composition, chemical cluster, and chromatic cluster). Regarding the chromatic appearance, five classes were subjectively identified. Conversely, regarding the chemical composition, Kremer code [26] was objectively considered. The clusters and relevant numbers of tiles are summarized in Table 2.
Some considerations regarding this clustering are made in the following.
In general, three phases drove the choice of the different chemical clusters. Firstly, three major classes were considered referring to the elements most spread in the dataset: iron, lead, and copper (Phase 1).
Then, by looking at the copper class, it was found that some tiles were organic lakes, generating the idea that this clustering method could also be effectively applied to organic dyestuff. Accordingly, the clusters “copper (organic)” and “organic” (collecting all the lakes in the dataset) were considered (Phase 2).
Finally, a mixed class was also considered, characterized by the presence of either iron, manganese, or cobalt, i.e., vicinal transition metals with very similar electronic properties (Phase 3).
Regarding the chromatic clusters, the gray cluster collects pigments with similar R, G, and B values (thus also including black and white pigments).
In Table A1, one can notice that the color grouping of some pigments differs from the chromatic class to which they belong, according to the closest color perception. For example, tile number 57, despite being visually brown/violet, also has shades of red given by its chemical description provided by Kremer, which identifies it as a red pigment.

2.8. Proposed Method

The proposed approach involves a combination of the aforementioned procedures. The data grouping procedure splits the dataset into clusters, which are homogeneous in terms of either color or chemical properties. The color correction methods are independently applied to each cluster. Recall that colorimetric and camera data are precisely coupled by hue, as specified in Section 2.3. Altogether, this leads to an adaptive color correction method.

3. Results

The color correction process was assessed via a five-fold cross-validation approach. The effectiveness of the procedure was evaluated on the grounds of statistical parameters such as Pearson’s correlation coefficient and the three measures of color distance. The root mean squared error in the L*, a*, and b* parameters (RMS) and the related color distance measure expressed in color units, according to the formula Δ = R M S L 2 + R M S a 2 + R M S b 2 [23], represent traditional metrics. The ΔE00 distance, officially adopted in 2001 as the new CIE color difference equation, improves the performance on blue and gray colors thanks to an interactive term between chroma and hue differences and a scaling factor for the CIELAB a* scale, respectively [27]. The latter is implemented, here, according to the CIEDE2000 formula [21] (MATLAB implementation [28]).
The relevant values in Table 3, Table 4, Table 5, Table 6, Table 7, Table 8, Table 9, Table 10, Table 11, Table 12 and Table 13 are the means of the five attempts performed during the cross-validation. In addition, the error associated with each value is specified in brackets. It was computed as the semi-difference between the maximum and minimum values in the five measurements, and it assesses the robustness of the k-fold procedure.
Some examples of color correction applied to the pigments are reported in Figure 3. All five measurements extracted from the considered tile are shown, coupled according to the described approach. Each visualization depicts the uncalibrated color values, the colorimeter data, and the correction when the polynomial regression characterization was trained on the whole dataset and on the specific cluster. The reader may notice the improvement in the visual rendering when dealing with clustered data by chromatic properties.

4. Discussion

First, the obtained results are discussed in terms of the values of the metric considered. Then, the importance of the preliminary cluster analysis is highlighted, with observations mainly relevant to the two clustering procedures. To conclude, possible applications of the proposed pipeline are disclosed, along with the limitations of the present research and foreseeable future developments.

4.1. Discussing the Considered Indexes’ Values

Table 3, referring to the application of the methods to the whole dataset, shows a strong agreement among the traditional metrics of correlation, the RMS on the L*, a*, and b* parameters, and the color distance Δ .
In general, for both the whole dataset and the different selected clusters, the characterization method that produced the best color correction was polynomial regression, which was always able to improve similarity with colorimetric data as compared with uncalibrated data. Linear regression dramatically worsened the result as compared with the original data, as did the HPPCC-WCM method on most of the indexes. However, even though polynomial regression always showed improvements, according to the ΔE00 distance, the HPPCC-WCM method outperformed the others since both the method and the metric rely on the more recent CIE standards, facing some drawbacks of the traditional standards.
Table 4, Table 5, Table 6 and Table 7 confirm the best performances of polynomial regression, which improved uncalibrated data on all clusters, even in the challenging case of copper (organic), where the acquired colorimetric and photographic L parameters showed a strong misalignment.
Table 8 gives further evidence that the ΔE00 metric can solve some problems of traditional colorimetry as, except for the lead cluster, it gives better improvements. Additional results reported in Table 11 show that the blue, green, and, to a lesser extent, the gray clusters might benefit from hue preservation and the new metric, as declared in the new standard scope.
The Pearson coefficients were already high for the whole dataset; hence, the improvement obtained by clustering was less relevant for this index. Conversely, by taking into consideration RMS, ΔE00, and Δ, the improvement when passing from the global correction to the cluster-based correction was significant, as they both decreased when focusing on chemical and chromatic clusters. In fact, the expression of the prediction error in terms of color units is only intended to evaluate the human perception of the correction; indeed, recall that if the error is approximately less than 2.2 color units, then, the difference is considered to be imperceptible to the human eye. It is worthwhile noting the improvement in this index, which decreased from a mean value across classes of 27.56 (Table 12, “uncalibrated”) to 13.95 with respect to the chemical clusters (Table 12, “polynomial regression”), and from a mean value across classes of 24.14 (Table 13, “uncalibrated”) to 13.26 with respect to the chromatic clusters (Table 13, “polynomial regression”). In such a case, clustering based on the chemical components is the most effective procedure, i.e., the one producing the lowest error. It is expected that more sophisticated algorithms, which could be investigated in future developments of the present study, would lead to an even lower color unit error.

4.2. The Significance of the Clustering Procedure

Splitting the dataset into clusters led to a better color correction for both splitting criteria (chromatism or chemical composition). The efficacy of clustering can be appreciated by comparing the value of, for example, the Δ index for the whole dataset (Table 3, 16.60 after polynomial regression characterization, with a 32% decrease with respect to the value for the uncalibrated data) with the values for the single clusters in Table 12 and Table 13, for example, for the “lead” cluster, the value is 9.67, with a 54% decrease after characterization. Therefore, one can infer that the clustering procedure effectively addresses the homoscedasticity of the data. Indeed, the major contribution of the present study is the efficiency of the coupling between clustering and application of some state-of-the-art color correction methods. In addition, it is worth stressing that, although one might expect better results and a more effective color correction from chromatic clusters, the best correction was provided by chemical clusters. This is likely due to the objectivity of the chemical component criterion for defining clusters, while chromatic properties are more dependent on human perception, thus, leading to less homogeneous classes.
To stress once more the novelty of the present study, to the best of our knowledge, such an approach as well as the results relevant to the different clustering criteria are unprecedented.

4.3. Chromatic Clusters

As outlined above, clustering by chromatism seems less effective for color correction purposes. The perceived colors driving the selection of the chromatic clustering depend, to some extent, on the observer, and therefore are subjective. In addition, several color shades are present, which may lead to heterogeneous classes. Of course, having more samples for each tile would allow one to split the data into more classes, each being characterized by a closer chromatic similarity; as a result, the training phase would benefit, thus, conceivably leading to better color correction.
The correction provided by the polynomial regression method on the coordinates of the Lab color space suggests some additional considerations, recalling that “L” represents the perceptual lightness, while “a” and “b” refer to the four colors in the opposite component model of human vision, i.e., red, green, blue, and yellow.
The most improved coordinate was L, meaning that this procedure addresses the problems in terms of the lightness sensitivity of photographic data. Without correction, the error is so high that the observer perceives a consistently different color with respect to the colorimetric data (see Figure 3).
Regarding the coordinates “a” and “b”, it is interesting to consider the chromatic class of gray. The values in this class are supposed to be similar, and so the difference between colorimeter and photographic data should also be similar. However, by looking at the RMS index (Table 10), we found that the difference between colorimeter and photographic data was much higher for “b” than for “a”. Conversely, once the values were corrected with polynomial regression, the errors were similar, thus, suggesting that the procedure is useful to address some imbalance for the gray class.

4.4. Chemical Clusters

The criterion based on chemical composition is more univocal, an aspect that surely contributes, in general, to the results being more similar as well as rewarding across the considered classes.
In particular, the RMS index mirrors a gratifying, effective color correction for the main elemental clusters (lead, iron, and copper, see Table 6) after polynomial regression characterization.
Regarding the additional elemental classes reported in Table 2, particular attention must be paid to the copper-based samples. In fact, the “copper” cluster of Table 2 (16 samples) also included nine organic samples, where copper was the metal cation of an organic salt, which made up the selected subcluster defined as “copper (organic)”. In terms of the RMS index, both the “copper” cluster and the subcluster performed extremely well (Table 6 and Table 7, respectively) as far as the “L” component was concerned, while the components “a” and “b” did not seem to be significantly corrected for the subcluster by the characterization method of choice. Nonetheless, we paid attention to the consistent number of tiles containing organic pictorial matter (either organic dyes or metal salts of organic acids); satisfactorily enough, the rather crowded (34 samples of lakes) “organic dyes and salts” cluster responded positively to the polynomial regression characterization (as compared with the values of the RMS index in Table 7 or of the ∆ index in Table 12) or to the HPPCC-WCM treatment (as compared with the value of the ∆E00 index in Table 8).
The performance provided by the cluster of lakes represents, in our opinion, a further original and very interesting aspect of the camera characterization procedure herein. This is because the identification and study of organic matter on pictorial artworks cannot be achieved by means of XRF, a non-invasive technique that is widely applied in the presence of pigments containing heavy metals, but which fails to detect organic dyestuff because C, N, and O atoms are too light. Instead, the current approach based on the correction of digital data grouped in elemental clusters does not depend on the atomic weight, and thus opens very appealing perspectives as to the analysis of lakes. Developments and applications to study cases are necessary to sustain this hypothesis.
A first hypothesis about the reason why elemental clustering is a good approach is suggested by the results of the analysis on the mixed “iron, manganese, and cobalt” cluster. In fact, these three elements are transition metals adjacent in the periodic table, whose electronic configuration differs only for the number of electrons at the internal level, with the external one being identical for all three. The good results obtained for such a mixed class may mean that the proposed approach is sensitive to the outermost electronic level. Of course, more experimental trials are needed to validate the hypothesis, particularly by selecting other mixed clusters responding to the same characteristics.

4.5. A Possible Usage of the System for the Programming of Restoration Actions

A main concern about cultural heritage is the preservation of artwork for future generations. Of course, artworks, whatever the typology, inevitably tend to change or degrade with time due to several different causes, and restoration campaigns must be conducted whenever necessary. As far as pictorial artworks are concerned, color is surely the main sentinel to be observed in order to decide what actions to take. A handy and low-cost tool such as a digital camera would be optimal for frequent periodic control on artworks, as well as on large surfaces. In this way, time-dependent data describing the state of the paintings could be easily collected and analyzed preliminarily to further deepen more sophisticated analyses, if necessary, prior to a restoration action.
To this end, repeated periodical collections of data are necessary to verify the feasibility of selecting a parameter as a valid index of color deterioration. While elemental clustering has proven optimal for the identification of color, it could be foreseen that chromatic clustering would be best to handle the fading/deterioration of color with time. Of course, at the present time, this is only a conjecture to be verified in the future as a compulsory development of the present study.

4.6. Limitations and Future Developments

First, the amount of available data needs to be increased, as it is supposed that it would lead to better correction, at least on statistical grounds.
Of course, the present study cannot be limited to “theory”; in addition to the desirable significance of the method outlined in the previous paragraph, a main interest would be the application of the training to real cases in order to perform identification and study of the pictorial layers of an unknown composition. Thus, once the chemical clusters have been characterized, one can consider an “unknown” painting and focus on a particular area. If such an area fits a particular cluster, i.e., proper color correction is obtained by considering the parameters for that class, then it would mean that the relevant chemical elements are present in the considered area.
A continuing collaboration with the laboratories of “La Venaria Reale” and contacts with museums or galleries would surely satisfy both the outlined forms of progress and enable the development of a novel machine-learning-based approach, which is presently hampered by the limited size of the available dataset.

5. Conclusions

A dataset of digital camera photographs and of colorimetric measurements on 117 tiles from the database of diagnostic analyses of The Foundation Centre for Conservation and Restoration of Cultural Heritage “La Venaria Reale” was collected and analyzed with the aim of minimizing the difference between digital and spectrophotometric quantitative color data, from the perspective of validating a handy diagnostic tool such as a digital camera for quantitative color determination.
To address the homoscedasticity of the data acquired, the current study proposed a supervised approach to camera characterization and color correction based on clustered data. To this end, within the dataset, samples were grouped into clusters based on either the chromatic or the chemical properties of the pigments.
Among the different approaches studied in the present study, a polynomial regression obtained the best results with both of the proposed clustering criteria. Thus, while the correlation between characterized photographic data and colorimetric data remains high when considering both the entire dataset and the single clusters, in the latter case, notable improvements can be seen in the three parameters considered to test the efficacy of the characterization (i.e., RMS, ΔE00, and Δ). The central thesis that the piecewise method improves prediction accuracy was supported by numerical evaluations, even though, in absolute terms, the results were short of an error low enough to be imperceptible to a human expert.
In future studies, the aim could be to extend the dataset, for example, by developing the collaboration with La Venaria Reale. Of course, increasing the dataset would allow one to define new or more densely populated clusters, and therefore study the chemical and chromatic properties of the pigments in more detail, hopefully confirming the hypotheses above. A larger dataset may substantially improve the error, and therefore achieve imperceptible differences between the acquired data and the corrected data.
Furthermore, different approaches could be investigated, no longer based on the mean value of the colorimetric data, but rather looking for other significant parameters to perform the analysis. Additionally, further applications of the proposed approach are being investigated, such as applying it for characterizing the chemical composition of unknown artworks by leveraging the photographic data.

Author Contributions

Conceptualization, G.P. and S.D.; methodology, M.T. and F.F.; software, M.T. and F.F.; validation, M.T., F.F., G.P. and S.D.; formal analysis, M.T. and F.F.; investigation, M.T., F.F., G.P. and S.D.; resources, E.M.; data curation, M.T., F.F., E.M., G.P. and S.D.; writing—original draft preparation, M.T. and F.F.; writing—review and editing, G.P. and S.D.; visualization, M.T. and F.F.; supervision, G.P. and S.D.; project administration, G.P. and S.D. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The authors would like to thank Marco Nervo and Tiziana Cavaleri (Foundation Centre for Conservation and Restoration of Cultural Heritage “La Venaria Reale”), who made the present study possible by providing access to databases of colorimetric analyses.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

In this appendix, a table presenting the pigments’ descriptions is provided.
Table A1. List of the available pigments with their name, chemical composition, and chemical and chromatic classes.
Table A1. List of the available pigments with their name, chemical composition, and chemical and chromatic classes.
TilePigment NamePigment ColorChemical CompositionChemical ClassChromatic Class
Tile 1Lead WhiteLead white2PbCO3.Pb(OH)2LeadGray
Tile 4Calcium CarbonateWhiteCaCO3OtherGray
Tile 5Vine Black GermanBlackRetouching color in aldehyde resin 81. Carbon with impurities of potassium and sodium ionsOrganicGray
Tile 9Azurite MP, sky-blue lightAzureCu3(CO3)2.(OH)2CopperBlue
Tile 13SmaltBlueK2O.nSiO2 with the presence of cobaltCobaltBlue
Tile 15OrpimentYellowAs4S6OtherYellow
Tile 16RealgarOrange, yellowAs4S4OtherYellow
Tile 19Yellow Ochre Iron OxideYellowα-FeO(OH) or K,Fe(SO4)2(OH)6 or γFeO(OH))IronYellow
Tile 20Raw Sienna ItalianRaw sienna, yellow, brownFe2O3.nH2O + MnO2 + Al2O3 + SiO2IronYellow
Tile 21Massicot LithargeYellowPbOLeadYellow
Tile 22Burnt Sienna ItalianBurnt sienna, red, brownFe2O3.nH2O + Al2O3 (60%) + MnO2 (1%)IronRed
Tile 23Burnt Umber ReddishBurnt umber, brownFe2O3 + MnO2 + Si + Al2O3IronRed
Tile 25French Ochre SOFOROUGERedSiO2 + Al2O3 + Fe2O3IronRed
Tile 28Pozzuolana Red EarthPurple, redMix of landsIronRed
Tile 30Madder Lake GenuinePink, redOrganic natureOrganicRed
Tile 31Red Ochre EnglishRedFe2O3.nH2OIronRed
Tile 33Red BoleBrown, redAl2Si2O5(OH)4OtherRed
Tile 34Red Lead, minimumOrange, redPbO4LeadRed
Tile 36Malachite Natural StandardGreenCu3(CO3).(OH)2CopperGreen
Tile 41Verdigris, syntheticBlue, turquoise, greenCu(CH3COO)2Copper (organic)Blue
Tile 42Barium SulfateWhiteBaSO4OtherGray
Tile 43Sepia FineBlack-brownSepia, fine (colorant of cuttlefish)OrganicGray
Tile 44Bone BlackBlack15–20% of carbon, 60–70% of Ca3(PO4)2OtherGray
Tile 45Asphaltum BlackBlackHigh molecular weight hydrocarbonsOrganicGray
Tile 46Blue BiceBlue, turquoiseCu2(CO3)2.Cu(OH)2CopperBlue
Tile 47Lapis LazuliBlue(Na,Ca)8(AlSiO4)6 + % of ironIronBlue
Tile 48Ultramarine AshBlue ultramarineNa2O3Al6SiO2.2Na2SOtherBlue
Tile 49Lead Tin Yellow LightLemon yellowLead stannate, type I (Pb2SnO4)LeadYellow
Tile 50Indian Yellow ImitationIndian yellowConsisting primarily of euxanthic acid saltsOrganicYellow
Tile 51Naples Yellow, darkNaples yellowPb2Sb2O7LeadYellow
Tile 52Van Dyck BrownVan Dyke brownConsists mainly of humic acids and iron oxideIronRed
Tile 53Natural CinnabarOrange, redMineral cinnabar, HgSOtherRed
Tile 54Lac DyePink, redLac dye (from coccus lacta secretion, Natural Red 25; gum lac, Indian lake)OrganicRed
Tile 55VermilionVermilion redMine cinnabar, HgSOtherRed
Tile 56Caput Mortuum ReddishRed, violetFe2O3IronRed
Tile 57Caput Mortuum VioletBrown, violetFe2O3IronRed
Tile 58Green Earth LightGreenIron-based silicateIronGreen
Tile 59Prussian BluePrussian blueFe4[Fe(CN)6]3.6H2O or KFe[Fe(CN)6].6H2OIronBlue
Tile 60Lead Tin Yellow IILemon yellowType II, Pb(Sn,Si)O3LeadYellow
Tile 61Naples Yellow from ParisYellowPb(Sb,Sn)O3LeadYellow
Tile 62Venetian RedVenetian redFe2O3IronRed
Tile 67Lead SulfateWhitePbSO4LeadGray
Tile 68LithoponeWhiteBaSO4 + ZnSOtherGray
Tile 69Titanium White RutileTitanium whiteTiO2OtherGray
Tile 70Zinc WhiteZinc whiteZnO + % of ironIronGray
Tile 71Zinc SulfideWhiteZnSOtherGray
Tile 72Manganese BlackBlack(Fe,Mn)3O4IronGray
Tile 73Ploss BlueBlue, turquoise,(CuCa)CO3(CH3COO)2.2H2O)Copper (organic)Blue
Tile 74Blue VerditerBlueCuCO3 Cu(OH)2CopperBlue
Tile 75Ultramarine Blue very darkUltramarine blueAl6Na8O24S3Si6OtherBlue
Tile 76Copper BlueBlue, turquoiseCopper basedCopperBlue
Tile 77Zirconium cerulean blueCerulean blueDerived from zirconOtherBlue
Tile 78CavansiteBlue, turquoiseCa(VO)Si4O10.4(H2O)OtherBlue
Tile 79Ultramarine Blue DarkUltramarine blueNa2O3Al6SiO2.2Na2SOtherBlue
Tile 80Cobalt Blue DarkBlue(Co,Zn)2SiO4CobaltBlue
Tile 81Cobalt Blue PaleBlueCoAl2O4OtherBlue
Tile 82Natural Chromium Yellow or crocoiteYellowPbCrO4LeadYellow
Tile 83Cadmium Yellow n°6 mediumCadmium yellowCdS + ZnOOtherYellow
Tile 84Permanent Yellow mediumYellowOrganic natureOrganicYellow
Tile 85Brilliant YellowYellowC18H18N4O6OrganicYellow
Tile 86Studio YellowYellowC16H12Cl2N4O4OrganicYellow
Tile 87Cobalt YellowYellow[Co(NO2)6]K3 + 3H2OCobaltYellow
Tile 88Bismuth-Vanadate YelLow LemonYellow(Bi,V)O4OtherYellow
Tile 89Baryte YellowYellowBaCrO4OtherYellow
Tile 90Studio Pigment YellowYellowC18H18N4O6OrganicYellow
Tile 91Studio Pigment Yellow Sun GoldYellowOrganic natureOrganicYellow
Tile 92Cadmium Orange n°0 very lightOrangeCd2SSeOtherRed
Tile 93Paliotol® OrangeOrangeC8H9NOrganicRed
Tile 94Paliogen® OrangeOrangeC23H8Cl8N4O2OrganicRed
Tile 95Irgazin® Yellow, light orangeYellowC8H7NOOrganicYellow
Tile 96Isoindolol OrangeOrangeC8H7NOrganicRed
Tile 97Titanium OrangeOrange, yellowTi-Sb-Cr-O RutileOtherYellow
Tile 98Iron Oxide Orange 960OrangeFe(O)OH + Fe2O3IronRed
Tile 99IWA-Enogu® ShinsiaPinkSodium aluminosilicate with oxides of metals other than ironOtherRed
Tile 100IWA-Enogu® IwamomoPinkSodium aluminosilicate with oxides of metals other than ironOtherRed
Tile 101IWA-Enogu® Usukuchi-MurasakiVioletSodium aluminosilicate with oxides of metals other than ironOtherRed
Tile 102Côte d’Azur VioletGray, violetFe2O3IronGray
Tile 103Thioindigo Red LightfastRedOrganic natureOrganicRed
Tile 104Cinquasia® Violet RT 201 DReddish violetOrganic natureOrganicRed
Tile 105Ultramarine Violet mediumViolet, bluishSodium, alumino, sulfo, silicateOtherBlue
Tile 106Manganese VioletManganese violet(NH4)2Mn2(P2O7)ManganeseBlue
Tile 107Cobalt Violet DarkCobalt violetCo3(PO4)2CobaltBlue
Tile 108Pink colorPink, redCa(Sn,Cr)SiO5OtherRed
Tile 109Cadmium Red n°2 mediumCadmium redCdSOtherRed
Tile 110Irgazine® Scarlet DPP EKScarlet redC6H2N2O2OrganicRed
Tile 111Alizarine Crimson darkPink, redColorant/organic pigment for coatingsOrganicRed
Tile 112XSL Irgazine® Red DPPRedOrganic natureOrganicRed
Tile 113Rosso SartoriusBrown, redFe2O3.nH2OIronRed
Tile 114Aegirine FineGreenNaFeSi2O6IronGreen
Tile 115Andeer Green FineGreenGraniteOtherGreen
Tile 116Phthalo Green darkGreen, bluishCu(C32N8Cl14).16HClCopper (organic)Green
Tile 117ChromiteGreenFeCr2O4IronGreen
Tile 118Cobalt GreenGreenCo2SnO4CobaltGreen
Tile 119Cobalt Green Bluish AGreen, turquoiseCobalt-basedCobaltGreen
Tile 120Chrome Oxide GreenGreenCr2O3OtherGreen
Tile 122Permanent GreenGreen, turquoiseCoAl2O4CobaltGreen
Tile 123Cadmium Green LightGreenCadmium-basedOtherGreen
Tile 124Cadmium Green DarkGreenCadmium-basedOtherGreen
Tile 125Fluorescent Pigment BlueBlueUnspecifiedOtherBlue
Tile 126Phthalo BlueBlueC32H16CuN8Copper (organic)Blue
Tile 127Phthalo Blue Royal BlueBlueC32H16CuN8Copper (organic)Blue
Tile 129Indanthren® BlueBlueUnspecifiedOrganicBlue
Tile 130XSL Phthalo Blue Royal Blue Very LightfastBlueC32H16CuN8Copper (organic)Blue
Tile 131Indigo Blue LakeBlueOrganic natureOrganicBlue
Tile 132Indigo Red-VioletBlue, violetOrganic natureOrganicBlue
Tile 133Studio Pigment Sky BlueBlueUnspecifiedOtherBlue
Tile 134Studio Pigment Dark BlueBlueUnspecifiedOtherBlue
Tile 135XSL Translucent YellowYellowUnspecifiedIronYellow
Tile 136IWA-Enogu® IwabeniRedUnspecifiedOtherRed
Tile 137Phthalo Green, yellowishgreen, yellowishCopper-basedCopper (organic)Green
Tile 138Heliogen® GreenGreen, bluishCopper-basedCopper (organic)Green
Tile AMadder Lake glazing over natural cinnabarRedOrganic natureOrganicRed
Tile BAzurite glazing over Madder LakeBlueCu3(CO3)2.(OH)2CopperBlue
Tile CLapis Lazuli glazing over AzuriteBlue(Na,Ca)8(AlSiO4)6 + % of ironIronBlue
Tile DCopper resinate glazing over VerdigrisGreenCu(CH3CO)2.2Cu(OH)2.nH2OCopper (organic)Green
Tile EBisso (mixture of Madder Lake and Lapis Lazuli)BlueOrganic natureOrganicBlue
Tile FMixture of Azurite and Lead Tin Yellow LightGreenCu3(CO3)2.(OH)2 and Pb2SnO4Copper lead (*)Green
(*): Tile F presents both copper and lead in its chemical composition, so it belongs to both copper and lead clusters.

References

  1. Ibraheem, N.A.; Hasan, M.M.; Khan, R.Z.; Mishra, P.K. Understanding color models: A review. ARPN J. Sci. Technol. 2012, 2, 265–275. [Google Scholar]
  2. Sanmartín, P.; Chorro, E.; Vázquez-Nion, D.; Martínez-Verdú, F.M.; Prieto, B. Conversion of a digital camera into a non-contact colorimeter for use in stone cultural heritage: The application case to Spanish granites. Measurement 2014, 56, 194–202. [Google Scholar] [CrossRef] [Green Version]
  3. Cavaleri, T.; Buscaglia, P.; Migliorini, S.; Nervo, M.; Piccablotto, G.; Piccirillo, A.; Zucco, M. Pictorial materials database: 1200 combinations of pigments, dyes, binders and varnishes designed as a tool for heritage science and conservation. Appl. Phys. A 2017, 123, 419. [Google Scholar] [CrossRef]
  4. Pelagotti, A.; Mastio, A.D.; Rosa, A.D.; Piva, A. Multispectral imaging of paintings. IEEE Signal Process. Mag. 2008, 25, 27–36. [Google Scholar] [CrossRef]
  5. Brunetti, B.; Miliani, C.; Rosi, F.; Doherty, B.; Monico, L.; Romani, A.; Sgamellotti, A. Non-invasive investigations of paintings by portable instrumentation: The MOLAB experience. Top. Curr. Chem. 2016, 374, 10. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Jackman, P.; Sun, D.W.; ElMasry, G. Robust colour calibration of an imaging system using a colour space transform and advanced regression modelling. Meat Sci. 2012, 91, 402–407. [Google Scholar] [CrossRef] [PubMed]
  7. Johnson, T. Methods for characterizing colour scanners and digital cameras. Displays 1996, 16, 183–191. [Google Scholar] [CrossRef]
  8. Vrhel, M.J. Mathematical Methods of Color Correction. Ph.D. Thesis, North Carolina State University, Raleigh, NC, USA, 1993. [Google Scholar]
  9. Manfredi, E.; Petrillo, G.; Dellepiane, S. A Novel Digital-Camera Characterization Method for Pigment Identification in Cultural Heritage. In International Workshop on Computational Color Imaging; Springer: Cham, Switzerland, 2019; pp. 195–206. [Google Scholar]
  10. Finlayson, G.D.; Drew, M.S. Constrained least-squares regression in color spaces. J. Electron. Imaging 1997, 6, 484–493. [Google Scholar] [CrossRef]
  11. Hong, G.; Luo, M.R.; Rhodes, P.A. A Study of Digital Camera Colorimetric Characterization Based on Polynomial Modeling. Color Res. Appl. 2001, 26, 76–84. [Google Scholar] [CrossRef]
  12. Cheung, T.L.V.; Westland, S. Color camera characterisation using artificial neural networks. In Color and Imaging Conference. Soc. Imaging Sci. Technol. 2002, 2002, 117–120. [Google Scholar]
  13. Xinwu, L. A new color correction model for based on BP neural network. Adv. Inf. Sci. Serv. Sci. 2011, 3, 72–78. [Google Scholar]
  14. Hung, P.C. Colorimetric calibration in electronic imaging devices using a look-up-table model and interpolations. J. Electron. Imaging 1993, 2, 53–61. [Google Scholar] [CrossRef]
  15. Leon, K.; Mery, D.; Pedreschi, F.; Leon, J. Color measurement in L∗ a∗ b∗ units from RGB digital images. Food Res. Int. 2006, 39, 1084–1091. [Google Scholar] [CrossRef]
  16. Cheung, V.; Westland, S.; Thomson, M. Accurate estimation of the nonlinearity of input/output response for color cameras. Color Res. Appl. 2004, 29, 406–412. [Google Scholar] [CrossRef]
  17. Vora, P.; Herley, C. Trade-Offs Between Color Saturation and Noise Sensitivity in Image Sensors. In Proceedings of the 1998 International Conference on Image Processing, Chicago, IL, USA, 7 October 1998; Cat. No. 98CB36269. Volume 1, pp. 196–200. [Google Scholar]
  18. Finlayson, G.D.; Mackiewicz, M.; Hurlbert, A. Color correction using root-polynomial regression. IEEE Trans. Image Process. 2015, 24, 1460–1470. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  19. Andersen, C.F.; Connah, D. Weighted constrained hue-plane preserving camera characterization. IEEE Trans. Image Process. 2016, 25, 4329–4339. [Google Scholar] [CrossRef] [PubMed]
  20. Pictorial Material Database. Available online: https://webimgc.inrim.it/Hyperspectral_imaging/Database.aspx (accessed on 16 February 2021).
  21. Sharma, G. Color Fundamentals for Digital Imaging. In Digital Color Imaging Handbook; CRC Press: Boca Raton, FL, USA, 2003; Volume 20, pp. 1–114. [Google Scholar]
  22. Petrou, M.M.; Petrou, C. Image Processing: The Fundamentals; John Wiley & Sons: Hoboken, NJ, USA, 2010. [Google Scholar]
  23. Sharma, G.; Wu, W.; Dalal, E.N. The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations. Color Res. Appl. 2005, 30, 21–30. [Google Scholar] [CrossRef]
  24. International Commission of Illumination. Available online: http://cie.co.at (accessed on 24 February 2021).
  25. Konica Minolta CM2600d Documentation. Available online: https://www.konicaminolta.com/instruments/download/catalog/color/pdf/cm2600d_catalog_eng.pdf (accessed on 24 February 2021).
  26. Kremer Pigmente. Available online: https://shop.kremerpigments.com (accessed on 24 February 2021).
  27. Luo, M.R.; Cui, G.; Rigg, B. The development of the CIE 2000 colour-difference formula: CIEDE2000. Color Res. Appl. 2001, 26, 340–350. [Google Scholar] [CrossRef]
  28. Qiu, J. Calculate Color Difference Delta E of a Set of Srgb Data Pairs. 2021. Available online: https://www.mathworks.com/matlabcentral/fileexchange/53156-calculates-color-difference-delta-e-of-a-set-of-srgb-data-pairs (accessed on 24 February 2021).
Figure 1. (a) On the left, a picture of a table with a collection of colored tiles from The Foundation Centre for Conservation and Restoration of Cultural Heritage “La Venaria Reale”; (b) on the right, a single tile. The reader may notice the presence of two columns and three rows. The red box indicates the area considered for this study.
Figure 1. (a) On the left, a picture of a table with a collection of colored tiles from The Foundation Centre for Conservation and Restoration of Cultural Heritage “La Venaria Reale”; (b) on the right, a single tile. The reader may notice the presence of two columns and three rows. The red box indicates the area considered for this study.
Jimaging 07 00115 g001
Figure 2. A subset of tile samples involved in the present study.
Figure 2. A subset of tile samples involved in the present study.
Jimaging 07 00115 g002
Figure 3. Images depicting an example of color correction by means of the polynomial regression method.
Figure 3. Images depicting an example of color correction by means of the polynomial regression method.
Jimaging 07 00115 g003
Table 1. Camera setup.
Table 1. Camera setup.
VariableValue
Focal distance4 mm
FlashOff
ISO speed400
Operation modeManual
Exposure time1/60 s
QualityRaw
f-Numberf/3.2
Table 2. Number of tiles for each selected cluster.
Table 2. Number of tiles for each selected cluster.
Red33Iron23
Green16Lead10
Blue31Copper16
Yellow23Copper (organic)9
Gray14Organic dyes and salts34
Iron, manganese, and cobalt31
Other36
Table 3. Evaluation of the considered methods for the whole dataset. The bold font highlights the best values throughout.
Table 3. Evaluation of the considered methods for the whole dataset. The bold font highlights the best values throughout.
Pearson’s CoefficientRMS
LabLab
Uncalibrated0.95 (0.03)0.85 (0.02)0.95 (0.02)13.52 (3.94)13.26 (4.28)15.22 (5.12)
Linear regression0.80 (0.03)−0.16 (0.01)−0.34 (0.02)106.70 (9.44)126.18 (18.11)98.22 (11.26)
Polynomial regression0.95 (0.02)0.91 (0.01)0.96 (0.02)8.17 (1.57)9.89 (2.08)10.53 (1.88)
HPPCC-WCM0.94 (0.03)0.87 (0.03)0.44 (0.02)38.30 (9.44)46.83 (8.11)90.74 (11.91)
ΔE00 Δ
Uncalibrated 127.31 (10.5) 24.30 (4.16)
Linear regression 140.13 (14.16) 192.23 (14.10)
Polynomial regression 101.26 (8.93) 16.60 (2.94)
HPPCC-WCM 53.52 (7.18) 109.06 (9.87)
Table 4. Pearson’s correlation coefficients of the considered methods for the major chemical clusters (Phase 1). The bold font highlights the best values throughout.
Table 4. Pearson’s correlation coefficients of the considered methods for the major chemical clusters (Phase 1). The bold font highlights the best values throughout.
LeadIron
LabLab
Uncalibrated0.92 (0.03)0.93 (0.03)0.97 (0.02)0.76 (0.02)0.92 (0.02)0.90 (0.02)
Linear regression0.59 (0.03)−0.67 (0.03)−0.87 (0.03)0.87 (0.03)0.16 (0.03)−0.28 (0.02)
Polynomial regression0.92 (0.02)0.98 (0.02)0.97 (0.02)0.91 (0.02)0.93 (0.02)0.94 (0.01)
HPPCC-WCM0.66 (0.02)0.90 (0.03)0.84 (0.01)0.85 (0.03)0.76 (0.03)0.25 (0.02)
Copper
Lab
Uncalibrated0.89 (0.03)0.51 (0.03)0.78 (0.03)
Linear regression0.24 (0.01)−0.16 (0.02)0.02 (0.03)
Polynomial regression0.91 (0.01)0.87 (0.03)0.92 (0.01)
HPPCC-WCM0.66 (0.03)0.84 (0.02)0.81 (0.01)
Table 5. Pearson’s correlation coefficients of the considered methods for the other chemical clusters (Phase 2 and Phase 3). The bold font highlights the best values throughout.
Table 5. Pearson’s correlation coefficients of the considered methods for the other chemical clusters (Phase 2 and Phase 3). The bold font highlights the best values throughout.
Copper (Organic)Organic
LabLab
Uncalibrated−0.31 (0.02)0.75 (0.04)0.66 (0.03)0.91 (0.03)0.88 (0.02)0.90 (0.02)
Linear regression−0.52 (0.02)−0.04 (0.01)−0.52 (0.03)0.89 (0.03)−0.11 (0.04)−0.32 (0.03)
Polynomial regression0.77 (0.03)0.90 (0.02)0.92 (0.02)0.97 (0.02)0.91 (0.04)0.92 (0.03)
HPPCC-WCM0.23 (0.02)−0.43 (0.04)0.22 (0.03)0.92 (0.01)0.78 (0.03)−0.53 (0.05)
Iron + Mn + Co
Lab
Uncalibrated0.77 (0.04)0.93 (0.03)0.90 (0.03)
Linear regression0.44 (0.03)−0.56 (0.03)−0.39 (0.02)
Polynomial regression0.82 (0.02)0.93 (0.02)0.91 (0.02)
HPPCC-WCM0.65 (0.03)0.59 (0.03)0.09 (0.03)
Table 6. RMS of the considered methods for the major chemical clusters (Phase 1). The bold font highlights the best values throughout.
Table 6. RMS of the considered methods for the major chemical clusters (Phase 1). The bold font highlights the best values throughout.
LeadIron
LabLab
Uncalibrated12.46 (2.49)9.96 (2.33)13.87 (2.92)14.02 (1.91)5.98 (1.4)13.91 (1.74)
Linear regression156.97 (9.88)198.51 (8.91)143.58 (8.56)81.13 (6.5)58.64 (5.19)51.34 (7.92)
Polynomial regression5.29 (2.03)4.25 (2.94)6.89 (0.8)5.22 (2.53)4.04 (1.97)4.89 (1.69)
HPPCC-WCM35.59 (7.37)44.91 (6.39)123.48 (5.89)82.81 (6.95)122.67 (5.48)152.47 (5.76)
Copper
Lab
Uncalibrated12.42 (2.98)19.45 (3.89)14.97 (3.98)
Linear regression39.11 (7.13)136.14 (6.89)899.47 (44.13)
Polynomial regression5.21 (1.42)8.79 (3.03)5.92 (1.78)
HPPCC-WCM147.46 (14.71)91.33 (6.86)116.78 (12.03)
Table 7. RMS of the considered methods for the other chemical clusters (Phase 2 and Phase 3). The bold font highlights the best values throughout.
Table 7. RMS of the considered methods for the other chemical clusters (Phase 2 and Phase 3). The bold font highlights the best values throughout.
Copper (Organic)Organic
LabLab
Uncalibrated13.07 (3.04)10.44 (3.29)12.02 (4.21)17.77 (4.28)23.12 (5.82)21.38 (6.92)
Linear regression31.48 (6.92)166.89 (22.12)66.34 (2.96)164.24 (12.98)231.84 (12.95)89.29 (5.98)
Polynomial egression3.38 (0.24)9.92 (2.31)12.34 (4.32)6.14 (3.07)4.96 (0.45)10.33 (1.89)
HPPCC-WCM142.29 (14.56)113.95 (8.22)125.13 (16.21)39.34 (5.89)87.43 (18.19)194.90 (23.67)
Iron + Mn + Co
Lab
Uncalibrated15.72 (2.68)7.44 (2.03)14.49 (2.23)
Linear regression73.15 (9.86)79.74 (9.65)73.92 (6.73)
Polynomial regression7.47 (2.33)6.83 (1.12)7.39 (2.11)
HPPCC-WCM89.09 (7)109.32 (13.13)132.52 (16.18)
Table 8. ΔE00 of the considered methods for the chemical clusters. The bold font highlights the best values throughout.
Table 8. ΔE00 of the considered methods for the chemical clusters. The bold font highlights the best values throughout.
LeadIronCopperCopper (Organic)OrganicIron + Mn + Co
Uncalibrated47.35 (9.68)152.59 (13.72)336.47 (24.68)129.96 (7.34)166.31 (29.76)138.61 (12.91)
Linear regression136.43 (13.8)135.49 (14.25)149.02 (18.32)176.22 (16.43)172.15 (32.94)142.90 (19.94)
Polynomial regression9.78 (3.18)126.50 (10.18)95.24 (8.58)111.38 (13.23)113.29 (22.63)93.38 (8.22)
HPPCC-WCM46.87 (5.97)79.42 (6.38)68.48 (3.69)82.11 (9.56)78.62 (9.35)83.09 (5.63)
Table 9. Pearson’s correlation coefficients of the considered methods for the chromatic clusters. The bold font highlights the best values throughout.
Table 9. Pearson’s correlation coefficients of the considered methods for the chromatic clusters. The bold font highlights the best values throughout.
RedGreen
LabLab
Uncalibrated0.86 (0.03)0.90 (0.03)0.92 (0.02)0.89 (0.03)0.70 (0.02)0.84 (0.02)
Linear regression0.86 (0.04)0.13 (0.03)−0.60 (0.03)0.32 (0.03)−0.35 (0.04)−0.15 (0.02)
Polynomial regression0.92 (0.02)0.91 (0.01)0.94 (0.03)0.91 (0.01)0.84 (0.02)0.86 (0.01)
HPPCC-WCM0.91 (0.02)0.47 (0.02)−0.30 (0.01)0.54 (0.03)0.83 (0.02)0.74 (0.01)
BlueYellow
LabLab
Uncalibrated0.89 (0.03)0.38 (0.03)0.84 (0.02)0.87 (0.02)0.35 (0.03)0.81 (0.02)
Linear regression0.74 (0.02)−0.33 (0.02)0.04 (0.02)0.39 (0.02)−0.43 (0.01)−0.71 (0.03)
Polynomial regression0.92 (0.02)0.73 (0.02)0.89 (0.01)0.90 (0.03)0.87 (0.03)0.92 (0.02)
HPPCC-WCM0.73 (0.02)0.87 (0.01)0.75 (0.02)0.78 (0.01)0.65 (0.01)−0.13 (0.02)
Gray
Lab
Uncalibrated0.99 (0.01)0.74 (0.01)0.76 (0.01)
Linear regression0.98 (0.02)0.18 (0.03)0.10 (0.02)
Polynomial regression0.99 (0.01)0.88 (0.01)0.75 (0.01)
HPPCC-WCM0.98 (0.02)0.99 (0.01)0.95 (0.02)
Table 10. RMS of the considered methods for the chromatic clusters. The bold font highlights the best values throughout.
Table 10. RMS of the considered methods for the chromatic clusters. The bold font highlights the best values throughout.
RedGreen
LabLab
Uncalibrated14.72 (2.58)9.70 (1.56)14.68 (2.01)13.58 (2.09)14.32 (3.23)12.77 (2.98)
Linear regression138.58 (7.55)62.36 (5.79)53.43 (6.69)47.86 (7.36)142.85 (11.81)80.63 (6.40)
Polynomial regression6.64 (1.73)6.31 (0.82)9.42 (1.72)6.72 (1.23)10.28 (2.34)8.23 (0.82)
HPPCC-WCM36.15 (2.68)129.90 (7.76)176.77 (11.24)118.15 (15.73)69.96 (4.61)104.65 (18.03)
BlueYellow
LabLab
Uncalibrated13.61 (2.71)14.22 (2.94)14.65 (2.20)12.90 (1.96)17.31 (2.51)19.75 (3.31)
Linear regression49.17 (4.73)78.28 (7.31)310.77 (29.33)163.72 (6.69)204.02 (9.87)83.26 (6.39)
Polynomial regression7.65 (0.74)9.99 (2.06)7.93 (1.05)3.77 (1.48)4.10 (1.24)8.91 (1.61)
HPPCC-WCM60.56 (7.88)49.43 (7.61)51.42 (9.26)14.48 (16.56)65.89 (7.41)252.45 (16.67)
Gray
Lab
Uncalibrated8.98 (1.95)9.48 (1.09)15.71 (3.96)
Linear regression117.32 (9.34)257.94 (8.92)180.36 (8.27)
Polynomial regression5.67 (1.42)8.39 (2.04)8.14 (1.89)
HPPCC-WCM22.82 (4.22)23.65 (3.92)52.87 (4.54)
Table 11. ΔE00 of the considered methods for the chromatic clusters. The bold font highlights the best values throughout.
Table 11. ΔE00 of the considered methods for the chromatic clusters. The bold font highlights the best values throughout.
RedGreenBlueYellowGray
Uncalibrated55.45 (6.21)211.41 (22.39)201.16 (19.35)18.74 (4.56)45.29 (6.86)
Linear regression110.13 (7.47)161.11 (5.69)129.01 (8.07)153.30 (8.51)146.29 (6.94)
Polynomial regression35.12 (3.67)558.33 (44.10)186.45 (13.96)5.83 (0.67)61.26 (5.90)
HPPCC-WCM69.11 (7.23)68.03 (5.50)79.12 (6.16)56.71 (5.15)51.81 (5.28)
Table 12. Δ of the considered methods for the chemical clusters. The bold font highlights the best values throughout.
Table 12. Δ of the considered methods for the chemical clusters. The bold font highlights the best values throughout.
LeadIronCopperCopper (Organic)OrganicIron + Mn + Co
Uncalibrated21.14 (4.82)20.64 (5.96)26.89 (5.17)29.49 (5.25)44.53 (11.72)22.64 (5.75)
Linear regression290.97 (13.67)112.50 (8.02)939.86 (22.37)188.19 (9.89)304.21 (35.28)131.05 (10.07)
Polynomial regression9.67 (1.22)8.21 (1.94)11.32 (1.16)22.77 (1.92)19.18 (5.92)12.53 (2.47)
HPPCC-WCM136.13 (13.64)212.49 (12.88)211.75 (16.36)233.65 (9.37)226.56 (18.37)193.52 (9.53)
Table 13. Δ of the considered methods for the chromatic clusters. The bold font highlights the best values throughout.
Table 13. Δ of the considered methods for the chromatic clusters. The bold font highlights the best values throughout.
RedGreenBlueYellowGray
Uncalibrated22.94 (4.35)23.51 (5.01)24.54 (4.02)29.26 (5.19)20.43 (5.25)
Linear regression161.08 (13.49)170.87 (9.13)324.23 (18.08)274.52 (13.35)335.90 (16.27)
Polynomial regression13.14 (1.58)14.78 (2.37)14.87 (2.79)10.51 (2.03)12.99 (2.49)
HPPCC-WCM222.33 (13.35)172.64 (8.35)93.57 (8.26)261.31 (11.31)62.25 (5.78)
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Trombini, M.; Ferraro, F.; Manfredi, E.; Petrillo, G.; Dellepiane, S. Camera Color Correction for Cultural Heritage Preservation Based on Clustered Data. J. Imaging 2021, 7, 115. https://0-doi-org.brum.beds.ac.uk/10.3390/jimaging7070115

AMA Style

Trombini M, Ferraro F, Manfredi E, Petrillo G, Dellepiane S. Camera Color Correction for Cultural Heritage Preservation Based on Clustered Data. Journal of Imaging. 2021; 7(7):115. https://0-doi-org.brum.beds.ac.uk/10.3390/jimaging7070115

Chicago/Turabian Style

Trombini, Marco, Federica Ferraro, Emanuela Manfredi, Giovanni Petrillo, and Silvana Dellepiane. 2021. "Camera Color Correction for Cultural Heritage Preservation Based on Clustered Data" Journal of Imaging 7, no. 7: 115. https://0-doi-org.brum.beds.ac.uk/10.3390/jimaging7070115

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop