Panel test and chemical analyses of commercial olive oils: a comparative study
Chemical and Biological Technologies in Agriculture volume 4, Article number: 18 (2017)
The quality grade of an olive oil is defined according to the results of analytical and organoleptic examinations.The increasing attention towards both olive oil quality and quality verification methods prompted us to undertake a “critical” analysis of analytical and sensory data supplied by an International Certificated Body (ICB), relative to commercial olive oils produced in Mediterranean areas and purchased in Italy and in USA.
ICB data included chemical analyses namely free acidity, peroxide index, spectrophotometric UV evaluation, fatty acid ethyl esters and stigmadiens content and organoleptic evaluations carried out by nine official International Olive Council labs according to EEC Regulation 2568/91.
The results of the chemical analyses, except the fatty acid ethyl ester content, obtained from the nine labs were consistent giving rise to the same quality grade. In nearly all samples, the fatty acid ethyl ester content was close to the threshold established for extra virgin olive oils indicating a non-excellent quality of the olive oils. Organoleptic evaluations, commonly called panel test, given by the nine labs were not consistent.
The EEC Regulation 2568/91 does not give any indication on the way to report the uncertainty of the results, and in the case of extra virgin olive oils with a borderline value, the way to report the fatty acid ethyl ester content, with or without the uncertainty, can create confusion in defining the olive oil quality grade. Panel test seemed to work well only in the case of extremely good olive oils, whereas, in commercial extra virgin olive oils with borderline value of fatty acid ethyl ester content, a different sensory sensibility seems to be in the different IOC labs.
EEC Regulation 2568/91  and International Olive Council (IOC)  have established both analytical and organoleptic criteria to define the quality grade of an olive oil. According to the results of chemical and sensory analyses, an olive oil can be classified as extra virgin olive oil (EVOO), virgin olive oil or lampante olive oil. Each category has a completely different commercial and nutritional value. Extra virgin olive oil (EVOO) is a natural fruit juice with peculiar nutritional, healthy  and sensory  qualities as well as it represents a fundamental component of Mediterranean diet which is very rich in mono-unsaturated fatty acids  and polyphenols . On the contrary, lampante olive oils have a distinctly unpleasant smell, are not edible and are used for the production of refined olive oils. It is well known that selling virgin olive oils or lampante olive oils as EVOOs is a fraud. However, another important aspect to consider is that the downgrading of an EVOO to a lower category implies a big economic loss for the producers. So, it is fundamental that both the chemical analyses and the organoleptic evaluations used to define quality grade are “sufficiently” objective and reproducible.
In this paper, a pilot analysis of data supplied by International Certificated Body, relative to 16 olive oils produced in the Mediterranean area, was carried out to verify reproducibility and consistency of chemical analyses and organoleptic evaluations and therefore to highlight possible problems relative to quality grade classification. ICB data, including chemical analyses and organoleptic evaluations, were produced by nine official IOC labs according to EEC Regulation 2568/91. The recent scandals involving Italian olive oils, such as the one revealed in the ‘New York Times’ , prompted us to include data from olive oils purchased not only in Italy, the largest consumer of EVOOs, but also in non-Mediterranean countries such as USA.
Olive oils (16 samples) of 2014/2015 harvest year were purchased in Italy and Miami (USA) by an International Certificated Body, a recognized EU company that deals with services of certification. ICB also verified the preparation of samples carried out according to EN ISO 5555 reported in EEC Regulation 2568/91, shipped olive oils to laboratories and released a report on all the activity. Samples were collected and labelled with an alphanumeric code without any reference to the origin country. Brands and the packaging places of olive oils were made purposely anonymous to avoid damage from a possible negative or defamatory propaganda.
Chemical analyses and organoleptic evaluation were carried out by nine recognized IOC laboratories, selected from the lists of IOC-recognized laboratories [8, 9], see Additional file 1: Table S1, located in countries with a well-recognized tradition in the production of olive oils such as Italy (5 labs in Abruzzo, Lazio, Liguria, Sicily and Veneto regions), Spain (2 labs), and Greece (1 lab). A Slovenian lab was also included as a reference for the Eastern countries.
Chemical analyses included the determination of free acidity, peroxide index, UV spectrophotometric evaluation (K 232, K 270, Δ K), fatty acid ethyl esters (FAEE) and stigmadiens content. Stigmadiens content, a parameter closely related to the presence of refined oils rather than a quality marker, was also considered as genuineness index. All the analyses were carried out according to the EEC Regulation 2568/91 (Annex II, III, IX, XVII, XX). For the determination of free acidity and peroxide index, the Slovenian lab used IOC method (ISO 660:2009 and ISO 3960:2010, respectively).
According to the official method (EEC Regulation 2568/91, Annex XII), in each IOC lab, organoleptic evaluations were carried out by a group of 8–12 professional tasters trained to recognize, describe and quantify basic taste and odour properties. Olive oils were described through positive (“fruity”, “bitter” and “pungent”) and negative (for instance “rancid”, “fusty”, “musty” and “winey”) attributes.
Quality grade classifications of olive oils purchased in Italy and in USA were determined by our laboratory according to EEC Regulation 2568/91.
Results and discussion
Quality grade classifications of olive oils purchased in Italy and in USA, reported in Tables 3 and 4, respectively, were determined according to EEC Regulation 2568/91 and will be discussed separately. Defects detected by panel test of olive oils purchased in Italy and Miami are reported in Additional files 2: Tables S2 and 3: Table S3, respectively, whereas positive attributes are reported in Additional file 4: Table S4. Classification percentages of the olive oils purchased in Italy and in USA are reported in Additional files 5: Tables S5 and 6: Table S6, respectively.
Samples purchased in Italy
In the case of olive oils purchased in Italy, samples turned out to be EVOOs or virgin olive oils from the chemical point of view (Tables 1, 3 and Additional file 5: Table S5). Five samples (Oi 1, Oi 3, Oi 6, Oi 7 and Oi 8) were judged as EVOOs whereas samples Oi 2, Oi 4 and Oi 5 turned out to be EVOOs or virgin olive oils according to the specific lab. In particular, sample Oi 2 turned out to be EVOO according to the chemical analysis results provided by Sicilian and Venetian labs and virgin olive oil for Abruzzo, Slovenian and Ligurian labs, whereas sample Oi 4 turned out to be EVOO according to Abruzzo and Sicilian labs and virgin olive oil for Slovenian, Ligurian and Venetian labs. Sample Oi 5 was classified virgin olive oil according to all the labs except the Venetian one. The parameter responsible for the declassing of Oi 2, Oi 4 and Oi 5 samples from EVOOs to not EVOOs was the content of FAEE. The importance of FAEE content to define the quality of an olive oil is well known [10, 11]: fatty acid ethyl esters are the products of the trans-esterification reaction between fatty acids and ethanol produced by bacteria fermentation that occurs when olives are of poor quality. Because of this narrow relationship between olive oil quality and FAEE content, the threshold for FAEE content in EVOOs has been decreased along the time, from 40 mg/kg in 2013/2014 harvest year down to 35 mg/kg in 2014/2015. Although this limit has been further reduced to ≤30 mg/kg in 2015, it has been set again to 35 mg/kg [12, 13] on July 2016 by IOC and on September 2016 by EEC.
It is interesting to note, see Table 1, that the FAEE content was reported by different IOC labs with or without uncertainty. For instance, IOC lab located in Veneto (Italy) never provided the uncertainty related to FAEE measurement. Sample Oi 4 with a FAEE content of 39.7 mg/kg reported without any uncertainty has to be classified as virgin olive oil, whereas Oi 1 with a FAEE content of 28 mg/kg has to be classified as extra virgin olive oil. On the other hand, some labs reported a value higher than 35 mg/kg (the threshold value for year 2014/2015) with the threshold value within the uncertainty, see for example the results of Slovenian lab reported for sample Oi 2 with a FAEE content of 36.8 ± 5.1 mg/kg. Finally, other labs reported a value lower than 35 mg/kg with the threshold within the uncertainty, see for example the results of Ligurian lab for sample Oi 1 with a FAEE content of 32 ± 8 mg/kg. How to use these data to classify olive oils? A strict interpretation of EEC Regulation 2568/91 that does not give any indication on the way to report the uncertainty of the results implies that any olive oil with a FAEE content value above the threshold has to be declassified from extra virgin olive oil to not extra virgin olive. Therefore, Oi 2 with a FAEE content of 36.8 ± 5.1 mg/kg has to be classified as not extra virgin olive oil, whereas Oi 1 with a FAEE content of 32 ± 8 mg/kg has to be classified as extra virgin olive oil. Whereas an analytical point of view to report a result with the uncertainty is a correct way, to consider the uncertainty for the olive oil classification can give rise to confusion. In fact, if the uncertainty is considered, these two olive oils should have the same grade, i.e. extra virgin olive oil. On the other hand, taking into account the upper limit of uncertainty, an olive oil with a value of 32 ± 8 mg/kg could be considered not extra virgin. Therefore, the way to report the FAEE content with the uncertainty can create confusion, when the olive oil commercial classification is required.
Organoleptic evaluation carried out from the different labs were extremely controversial. For instance, all the olive oils were judged as EVOOs according to the results of the Sicilian lab, whereas no sample was judged as EVOO according to the results of the Greek lab. These results clearly show that the same olive oil can be judged EVOO, virgin olive oil or lampante olive oil according to the the lab. This is the case of samples Oi 2, Oi 3, Oi 4, Oi 5, whereas samples Oi 1, Oi 6, Oi 7, Oi 8 were judged virgin olive oils or EVOOs. Only sample Oi 6 was judged EVOO according to the results of all the labs except the Greek one. It is important to note that this olive oil has a FAEE concentration <15 mg/kg well below the threshold of 35 mg/kg, whereas the other olive oils exhibit a FAEE content which is slightly less or higher than the threshold value. The strict connection between FAEE content and the positive attributes by organoleptic evaluation of an olive oil has been previously reported [10, 14].
Therefore, all the obtained results seem to suggest that only in the case of olive oils with extremely “good” chemical analyses, including a low FAEE content (neither borderline nor higher than the threshold value), the organoleptic evaluation can be reproducible.
Samples purchased in USA
Olive oils purchased in Miami (USA) were judged, see Tables 2 and 4 and Additional file 6: Table S6, EVOOs (Ou 6 and Ou 8), virgin olive oils (Ou 4, Ou 5 and Ou 7) and lampante olive oils (Ou 2 and Ou 3) according to the chemical analysis results. The judgment given by the different labs for these five samples was univocal: samples Ou 2 and Ou 3 turned out to be lampante olive oils because of their high K 232 value (>2.60) whereas samples Ou 4 and Ou 7 were classified as virgin olive oil due to the high FAEE content (>35 mg/kg). Sample Ou 5 turned out to be virgin olive oil because of the high content of FAEE (>35 mg/kg) in the case of Ligurian and Venetian labs or for both K 270 value (0.22 < K 270 < 0.25) and FAEE content in the case of Slovenian, Sicilian and Spain 2 labs.
Finally, samples Ou 1 and Ou 4 were judged virgin olive oils or EVOOs according to the labs results: the critical point was again the FAEE content given without error or with a high error.
The results of organoleptic evaluation given by the different laboratories turned out to be in disagreement. For instance, all samples were judged virgin olive oils due to a median of defects >0 according to the Lazio lab results, whereas all samples, except one, were judged EVOOs according to the Sicilian lab results. Samples Ou 1, Ou 2, Ou 3 and Ou 5 turned out to be lampante olive oils, virgin olive oils or EVOOs according to the lab, whereas sample Ou 7 was judged lampante olive oil or virgin olive oil. Finally, samples Ou 4, Ou 6 and Ou 8 were judged virgin olive oils or EVOOs according to the labs.
Again, this disagreement of sensory evaluation can be related to some borderline value in the chemical parameters. It is interesting to note that the only two samples, Ou 6 and Ou 8, judged EVOOs by the chemical analysis, with a slightly less FAEE content than the threshold value were classified as EVOOs or virgin olive oils by the organoleptic evaluation. A similar case is also represented by the sample Ou 1 which, through chemical analyses, was judged EVOO in three cases out of five with a borderline FAEE content, whereas, through organoleptic evaluation, it was classified as EVOO, virgin olive oil or even lampante olive oil.
The results reported in this paper highlight some important aspects to be considered in the olive oil commercial classification.
First of all, the non-uniform way to report the FAEE content with or without uncertainty can create confusion in the quality grade classification, especially in case of borderline values of FAEE content. It is important to underline that the EEC Regulation 2568/91 does not give any indication on the way to report the uncertainty of the results.
Our data analysis underlines that it is crucial to find out what causes the variability of judgement in the organoleptic evaluation. Sensory panel test seems to work well in the case of extremely good olive oils, whereas in the case of common commercial EVOOs can give discordant results. A different sensory sensibility seems to be present in the different IOC panel labs, especially in case of EVOOs characterized by a FAEE content very close to the threshold. For a given olive oil, the question to be or not to be classified as EVOO becomes a question strictly linked to the lab.
In our opinion, organoleptic evaluation is extremely important for a global picture of the sensory properties of olive oil and it is particularly precious and not replaceable with other analysis to give add values to PDO or other peculiar EVOOs. On the other hand, this analysis seems to be not enough reproducible in the case of common commercial EVOOs probably due to different sensory sensibility in the different IOC panel labs and therefore it is not suitable for a legally accepted official evaluation.
extra virgin olive oil
International Olive Council
International Certificated Body
fatty acid ethyl esters
The Commission of the European Communities. Commission Regulation (EEC) No. 2568/91 on the characteristics of olive oil and olive-residue oil and on the relevant methods of analysis. Off J Eur Union. 1991;L248:1–102.
International Olive Oil Council. Sensory analysis of olive oil, method for the organoleptic assessment of virgin olive oil. 2015. IOC/T.20/Doc. No. 15/Rev. 8. http://www.internationaloliveoil.org/estaticos/view/224-testing-methods. Accessed 22 Jan 2017.
Frankel EN. Nutritional and biological properties of extra virgin olive oil. J Agric Food Chem. 2011;59:785–92.
Angerosa F. Sensory quality of olive oils. In: Aparicio R, Harwood J, editors. Handbook of olive oil, analysis and properties. Gaithersburg: Aspen Publishers; 2000. p. 355–92.
Salas JJ, Harwood JL, Martínez-Force E. Lipid metabolism in olive: biosynthesis of triacylglycerols and aroma components. In: Aparicio R, Harwood J, editors. Handbook of olive oil, analysis and properties. New York: Springer; 2013. p. 97–127.
The European Commission. Commission Regulation (EU) No. 432/2012 establishing a list of permitted health claims made on foods, other than those referring to the reduction of disease risk and to children’s development and health. Off J Eur Union. 2012;L136:1–40.
Camin F, Pavone A, Bontempo L, Wehrens R, Paolini M, Faberi A, Marianella RM, Capitani D, Vista S, Mannina L. The use of IRMS, 1H NMR and chemical analysis to characterise Italian and imported Tunisian olive oils. Food Chem. 2016;19:98–105.
International Olive Oil Council. List of chemical testing laboratories recognised by the International Olive Council for the period from 1.12.2014 to 30.11.2015. 2014. IOC/T.21/Doc. No. 13/Rev. 17.
International Olive Oil Council. List of laboratories undertaking the sensory analysis of virgin olive oils recognised by the International Olive Council for the period from 1.12.2014 to 30.11.2015. 2014. IOC/T.28/Doc. No. 3/Rev. 17.
Gómez-Coca RB, Moreda W, Pérez-Camino MC. Fatty acid alkyl esters presence in olive oil versus organoleptic assessment. Food Chem. 2012;135:1205–9.
Conte L, Mariani C, Gallina Toschi T, Tagliabue S. Alchil esteri e composti correlati in oli d’oliva vergini: loro evoluzione nel tempo. RISG. 2014;91:21–9.
International Olive Oil Council. Trade standard applying to olive oils and olive pomace oils. 2016. IOC/T.15/NC No. 3/Rev. 11.
The European Commission. Commission Delegated Regulation (EU) No. 2016/2095 of 26 September 2016 amending Regulation (EEC) No. 2568/91 on the characteristics of olive oil and olive-residue oil and on the relevant methods of analysis. Off J Eur Union. 2016;L326:1–6.
Loreto G, Giansante L, Alfei B, Giacinto L. Alchil esteri ed altri indicatori per la tutela della qualità e della genuinità degli oli extra vergini italiani. RISG. 2014;91:35–45.
All research has been done by the authors. All authors read and approved the final manuscript.
This work was supported by “e-ALIERB: un OPEN LAB per caratterizzare e valorizzare i prodotti alimentari ed erboristici del territorio laziale” Project (Regione Lazio LR13/2008, CUP B82I15003570002).
The authors declare that they have no competing interests.
Availability of data and materials
The datasets supporting the conclusions of this article are included within the article and its additional files.
This work was supported by “e-ALIERB: un OPEN LAB per caratterizzare e valorizzare i prodotti alimentari ed erboristici del territorio laziale” Project (Regione Lazio LR13/2008, CUP B82I15003570002).
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file 2: Table S2. Defects, resulting by organoleptic evaluation performed by the eight IOC laboratories, of the eight olive oils purchased in Italy. The median values are reported for each defect. In certain cases, some laboratories provided only the predominant defect of an olive oil despite the detection of more defects. Labs of Spain 1 and Greece just supplied the median of the predominant defect without further details.
Additional file 3: Table S3. Defects, resulting by organoleptic evaluation performed by 8 IOC laboratories, of the eight olive oils purchased in USA (Miami). The median values are reported for each defect. In certain cases, some laboratories provided only the predominant defect of an olive oil despite the detection of more defects. Labs of Spain 2 and Greece just supplied the median of the predominant defect without further details. *Sample Ou 2 was not analyzed by Spain 2 lab.
Additional file 4: Table S4. Positive attributes, resulting by organoleptic evaluation performed by 8 IOC laboratories, of the eight olive oils purchased in Italy and the eight olive oils purchased in USA (Miami). The median values are reported for each defect. Results of “Bitter” and “Pungent” attributes were not provided by all laboratories. *Sample Ou 2 was not analyzed by Spain 2 lab.
Additional file 5: Table S5. Percentage of classification of the eight olive oils purchased in Italy using results obtained by Organoleptic Evaluation and Chemical Analysis performed on these olive oils by 8 IOC laboratories. * In brackets the percentages of classification according to the chemical analysis without the ethyl esters content are reported.
Additional file 6: Table S6. Percentage of classification of the eight olive oils purchased in USA using results obtained by Panel Test and Chemical Analysis performed on these olive oils by 8 IOC laboratories. *In brackets the percentages of classification according to the chemical analysis without the ethyl esters content are reported.
About this article
Cite this article
Circi, S., Capitani, D., Randazzo, A. et al. Panel test and chemical analyses of commercial olive oils: a comparative study. Chem. Biol. Technol. Agric. 4, 18 (2017). https://doi.org/10.1186/s40538-017-0101-0
- Olive oil
- Panel test (organoleptic evaluation)
- Chemical analyses
- Fatty acid ethyl ester content