Author Ann-Christine Engström SCA R&D CENTRE Report No F4203 Project 2013-01-07 GraphoInvent Information classification INTERNAL Perceived quality evaluation of printed products by 200 end-users Keywords: Market research, market study, perception, product development, sales In November 2012 a quantitative market investigation regarding the new paper product GraphoInvent was performed. 200 persons in Stockholm and Gothenburg compared the quality of GraphoInvent to a wood free uncoated (WFU) paper in the high-quality segment. In the study both unprinted and printed areas were compared. The respondents followed a questionnaire with questions for comparing the quality. They also had the opportunity to make comments. The results in the investigation showed that GraphoInvent was better than the WFU competitor but that the differences between the samples were small. Regarding both paper and print quality over 50% of the respondents considered GraphoInvent the better paper. Approximately 30% preferred the WFU competitor, whereas around 20% were unable to see any noticeable difference between the samples. The market investigation was conducted at bus stations, train stations and shopping malls in different illuminations and surroundings. Despite the varying light conditions GraphoInvent was considered a high-quality paper. In the print quality comments GraphoInvent was described as having less print through, better print evenness and clearer colours. The tactile feeling of the paper was described as solid and stable which also contributed strongly to the high-quality sense. Furthermore people believed that GraphoInvent had higher production costs and a higher price than the competitor. In a parallel study with the panel in the perception laboratory at SCA R&D Centre, GraphoInvent was preferred by a majority of the panelists. Question No 2: “Which sample do you think looks best?” F4203.doc 1 (1) Author Ann-Christine Engström SCA R&D CENTRE Report No F4203 Project 2013-01-07 GraphoInvent Information classification INTERNAL Contents Page 1. Introduction 3 2. Experimental 3 2.1 2.2 2.3 2.4 Market investigation methodology Panel evaluation methodology Sample preparation Analysis of the comments 3 4 5 6 3. Results 6 4. Conclusions 12 5. Recommendations 13 6. References 13 7. 7.1 7.2 Appendix Questionnaire Panel results 15 15 16 Sent to: Rolf Johannesson Lars Lindgren Anette Rosenlöv Kristina Enander Jan Knuts Thomas Jansson Per-Johan Ahlzén Susanna Fält Marcus Edbom Anders Hillvall F4203.doc SCA Sales and Marketing Publication Papers/pulp “ ” SCA Ortviken ” “ “ ” “ ” Örjan Petterson Bengt Wikman Marie Nässbjer Jerker Jäder Karin Persson Annica Widersten SCA R&D Centre ” ” ” ” ” 2 (2) Author Ann-Christine Engström SCA R&D CENTRE Report No F4203 Project 2013-01-07 GraphoInvent Information classification INTERNAL 1. Introduction During the autumn 2012 a market investigation was initiated to increase awareness of the paper and print quality of GraphoInvent. Since the paper is intended to compete with both coated and uncoated high-quality papers, a thorough investigation of the quality was considered necessary. A decision was made to perform a quantitative investigation based on answers from a large number of respondents. Parallel studies with the trained panel at SCA R&D Centre in the perception laboratory were performed for comparison. Initially a pre-study was made in September 2012 to investigate the perceived quality of GraphoInvent [1]. In the pre-study 50 persons at SCA R&D Centre and at Mid Sweden University examined GraphoInvent in comparison to a wood free competitor. In the study GraphoInvent was preferred by 44% of the respondents whereas 26% did not see any noticeable difference. In comparison to an LWC paper GraphoInvent was preferred by 28% of the respondents whereas 14% did not see any difference. Due to the promising results it was decided to proceed with the larger study. At the end of November a market investigation with 200 respondents was performed in Stockholm and Gothenburg. This report focuses mainly on the results from that investigation. 2. Experimental 2.1 Market investigation methodology The market investigation aimed at studying how the visual impression of GraphoInvent was perceived by a randomly selected population. When performing a quantitative measurement a minimum of 50 respondents is needed in order to statistically assure the investigation [2]. In this study 200 respondents were used which increases the statistical significance. The study was performed with structured face-to-face interviews, following a questionnaire and with the interviewer taking notes. In so doing, important comments about the paper products were collected and the number of measurement errors could be decreased by avoiding misunderstandings or misinterpretations of the task. The majority of the investigations were made in the two biggest cities (Stockholm and Gothenburg) in Sweden in order to receive a representative selection of the population. Some initial respondents were collected in Sundsvall. The random selection of respondents was made at central bus and train stations and in shopping malls. This also conveyed that both light conditions and surrounding environment varied during the visual examination (See Figure 1). F4203.doc 3 (3) Author Ann-Christine Engström SCA R&D CENTRE Report No F4203 Project 2013-01-07 GraphoInvent Information classification INTERNAL Figure 1. Interview with untrained persons in varying environments. In making contact with the respondents they were asked to participate in a market investigation for evaluating a new paper product released from SCA. Since, generally, no marketing is allowed during a market investigation [5], the identities of the two samples were not revealed even after the inquiry. This approach also benefits the objectivity and the statistical reliability of the study. The same questionnaire was used in all interviews and exactly the same routine was followed in order not to influence the result. The questionnaire was made simple with both open and closed questions. It was elaborated from recommended marketing guidelines combined with valid questions for evaluating paper characteristics [3, 4, 5, 6, and 7] (See Appendix 7.1). The respondents also had the opportunity to freely make comments in connection to each question. The time for each interview varied from 3 to 6 min depending on the amount of comments made. After the inquiry each respondent received a lottery ticket for participating in the study. 2.2 Panel evaluation methodology The panel evaluations were made in the perception laboratory with 15 persons from SCA R&D Centre participating. The full panel consists of 38 persons (18 men and 20 women) and the majority of this group has long experience in evaluating paper and print quality. The reliability and validity of perceptual evaluations are well documented in the literature, especially in the food and consumer research area [8]. The use of a trained panel means that certain attributes in print quality are distinguished to a greater extent compared to the average observer [9, 10]. Rating properties such as “colourfulness”, most people will respond similarly [10]. In a study [11] it was found that the majority of the results from uncontrolled and controlled viewing conditions were comparable at general preference assessments. The best correlation was obtained when evaluating specific preferences in controlled conditions (standardized laboratory) and uncontrolled conditions performed in daylight [11, 12]. In this study the panelists were given exactly the same instructions as the respondents of the market investigation. The light source in the laboratory was D50. All panel results are compiled in Appendix 7.2. F4203.doc 4 (4) Author Ann-Christine Engström SCA R&D CENTRE Report No F4203 Project 2013-01-07 GraphoInvent Information classification INTERNAL Figure 2. Interview with the panel in the perception laboratory. 2.3 Sample preparation In this study GraphoInvent and a competitor paper (a European wood free uncoated, WFU paper) with brightness ~103% (ISO 2470 D65) were compared. The paper samples used in the comparisons were two adverts selected from the fashion magazine “Elle”. These were HSWO printed with optimized print settings (See Figure 2). Both adverts were selected in order to reveal the paper quality in the printing. Sample set I, picturing a girl, mainly consisted of half tones and skin tones whereas sample set II had some full tones but also paper white, unprinted areas. 72% of the respondents made their assessments based on sample set I and the rest (56 persons) evaluated sample set II. Figure 2. Sample set I and II in the study. The adverts were cut out and mounted on cardboard in order to facilitate the examination. The respondents were informed of the mounting before evaluating the samples. Since no gloves were used in the study around 20 persons could examine each sample set before these needed to be exchanged. F4203.doc 5 (5) Author Ann-Christine Engström SCA R&D CENTRE Report No F4203 Project 2013-01-07 GraphoInvent Information classification INTERNAL 2.4 Analysis of the comments In order to facilitate the further treatment of data the notes from the comments were sorted into different quality categories. In the category “Better print quality” judgements connected to the printing, such as better colours, contrast, colour reproduction etc. were compiled. Different optical properties and better quality in general were sorted into “looks brighter”. In the category “tactile feeling” judgements of how the paper felt were put together. Regarding GraphoInvent the latter category primarily included comments such as “the paper feels thicker”, “is more robust” etc. For the wood free uncoated paper (WFU) frequent comments were “thinner paper” and “smoother paper”. In the “Looks worse” category all negative comments about the paper and the print quality were compiled. 3. Results The market investigation was performed in Stockholm (48%), Gothenburg (46%) and Sundsvall (6%). Of the 200 respondents 51% were men and 49% women. The age groups statistics are presented in Figure 3. As shown in the graph the majority of the respondents were in the 21-50 year categories. Figure 3. Age distribution of the 200 respondents participating in the study. F4203.doc 6 (6) Author Ann-Christine Engström SCA R&D CENTRE Report No F4203 Project 2013-01-07 GraphoInvent Information classification INTERNAL The first question in the questionnaire was “At a first impression – Do you think there is any difference between the samples?”. The answer was to be put into a pre-defined scale from 1-5 where 1 was “No difference” and 5 was “Big difference”, See Figure 4. As seen in the graph the majority of the answers were between 2 and 4. In the comments it was evident that the respondents saw a difference but that it was small or very small. Only ~4% saw a big difference between the samples and 19% did not see any difference at all. Regarding the panel at SCA R&D Centre the majority chose number 4. This was most likely due to that the panel is trained to detect small-scale differences in the laboratory. Nevertheless only ~3% of the trained panel chose the “Big difference” value, which is similar to the larger study. Figure 4. Difference between the samples as perceived by 200 respondents. The following two questions were connected to the reason for the perceived quality differences. The comments given in connection to questions 3 and 4 were jointly compiled and the evaluations were based on the total number of comments received, See Figure 5 and 6. Similar comments are categorised into different paper and print related properties, See 2.3 in the Experimental part. In the graphs the negative comments were given negative numbers. Regarding the WFU paper the majority of the respondents reacted negatively to the low opacity of the paper which, in turn, affected the print quality. F4203.doc 7 (7) Author Ann-Christine Engström SCA R&D CENTRE Report No F4203 Project 2013-01-07 GraphoInvent Information classification INTERNAL Figure 5. Comments about GraphoInvent compiled in quality categories. Figure 6. Comments about the WFU competitor paper in quality categories. It is interesting to note that the WFU competitor paper was judged as being an environmental or green paper by some respondents. When the respondents were asked why, they claimed that low quality papers often are more environmentally friendly than high-quality papers. F4203.doc 8 (8) Author Ann-Christine Engström SCA R&D CENTRE Report No F4203 Project 2013-01-07 GraphoInvent Information classification INTERNAL The fourth question was “Which sample do you think looks the best?”. As is shown in Figure 7 the majority of the respondents, 53% preferred GraphoInvent whereas 29% preferred the WFU paper. 19% of the respondents did not see any noticeable difference between the samples. Figure 7. The respondents answer of “which sample do you think looks best?” In the results some differences were observed between the preferences in Stockholm compared to Gothenburg. In Stockholm 48% of the respondents preferred GraphoInvent while the result in Gothenburg was 58% in favour of GraphoInvent. The corresponding numbers for the WFU paper were 30% and 26% for Stockholm and Gothenburg, respectively. “No notable difference” scored 22% and 16%, respectively. Despite these differences the ranking of the answers was identical. Some scatter in the analysis was expected due to more variables affecting the precision compared to the environment in the perception laboratory. In the panel results GraphoInvent was preferred by 90%. When comparing sample sets I and II the differences between the results were minor, See Figure 8. Regarding sample set I (halftones, skin tones) 53% of the respondents preferred GraphoInvent and the corresponding number for sample set II (with more paper white areas) was 51%. The rest of the values also matched which means that the general quality evaluation is valid for both unprinted and printed areas. F4203.doc 9 (9) Author Ann-Christine Engström SCA R&D CENTRE Report No F4203 Project 2013-01-07 GraphoInvent Information classification INTERNAL Figure 8. Comparing results of sample set I and II regarding the question: ”Which sample do you think looks best?”. The final question was “Which sample do you think has the highest price?” In Figure 9 results are presented which show that 54% of the respondents believed that GraphoInvent had the highest price and 17% thought the WFU paper to be the most expensive. Almost one third (28%) of the 200 respondents thought that the two printed papers had the same price. This verifies the outcome from the initial questions which showed that the quality of GraphoInvent is preferred but the differences between the samples are small. F4203.doc 10 (10) Author Ann-Christine Engström SCA R&D CENTRE Report No F4203 Project 2013-01-07 GraphoInvent Information classification INTERNAL Figure 9. Question: “Which sample do you think has the highest price?” When the respondents were asked to comment why they thought the printed paper had a high price the answer was clearly connected to the quality of the paper, See Figure 10. As seen in the graph the advantages for GraphoInvent are obvious. It is interesting to notice that GraphoInvent was experienced as a more exclusive, high-quality paper compared to the WFU paper. The majority of the respondents commented that both the feeling of the paper and the print result contributed to this sense. F4203.doc 11 (11) Author Ann-Christine Engström SCA R&D CENTRE Report No F4203 Project 2013-01-07 GraphoInvent Information classification INTERNAL Figure 10. Comments regarding “the highest price” of GraphoInvent respectively the WFU paper. The panel results regarding the “highest price” showed that 63% of the panelists believed that GraphoInvent had the highest price whereas 13% reckoned the WFU paper was the most expensive. Around 17% thought the papers had the same price. 4. Conclusions The results of the market investigation showed that GraphoInvent is better compared to the WFU competitor. However, the differences between the papers are small. Over 50% of the 200 participating persons preferred GraphoInvent whereas 30% preferred the WFU paper. Around 20% were unable to see any noticeable difference between the samples. Furthermore over 50% believed that GraphoInvent had a higher price than the WFU paper and almost one third of the respondents believed they had the same price. In the study both printed and unprinted areas were evaluated with similar results which mean that both the paper and print quality of GraphoInvent are high. GraphoInvent was considered an exclusive, high-quality paper mainly due to the print evenness and the solid paper feeling. The paper properties contributing most to these results are the bulk and opacity but also brightness, light spreading and paper formation affect the impression. The factor contributing most to the relatively poor performance of the WFU paper was the low opacity which negatively affected both unprinted and printed areas. F4203.doc 12 (12) Author Ann-Christine Engström SCA R&D CENTRE Report No F4203 Project 2013-01-07 GraphoInvent Information classification INTERNAL Some differences were found between Stockholm and Gothenburg. These can most likely be explained in terms of the different light and surrounding environments in the evaluation of the samples. Within the panel at SCA R&D Centre an even higher preference for GraphoInvent was found (90%). This can be explained by the use of standardized light and grey surroundings in the laboratory but also that the trained panel is more sensitive to detect small differences in ordinary evaluations. GraphoInvent received good results both by the panel and ordinary people and also in varying light and environments which facilitates demonstrations of the paper at customer visits. 5. Recommendations This study with 200 persons participating revealed that GraphoInvent is highly comparable to high-quality papers. Comments from the investigation concerning the performance of GraphoInvent, such as less print through, higher print evenness and clearer colours can be used as arguments in sales contacts. The tactile feeling of the paper, described in terms such as a solid and stable paper, is also a strong argument connected to the high-quality sense. 6. References 1. Engström A-C “Förstudie till marknadsundersökning av GraphoInvent” Internal document within the GraphoInvent project, September 2012 2. Christensen et. al ”Marknadsundersökning: en handbok” studentlitteratur AB 2010 3. Faarup P.K., Hansen K. ”Marknadsundersökningar – i teori och praktik” Liber 2008 4. Hamilton J. ”Vad du behöver veta om marknadsundersökningar” translation of ”What is Market research” ESOMAR, European Society for Opinion and Marketing Research 1989 5. ICC / ESOMAR, (International council on marketing practice / Essential organisation for encouraging, advancing and elevating market research) ”Internationella regler för marknadsundersökningar” ICC Sweden 1996 6. Edström J. ”Marknadsundersökning SCA – en jämförelse mellan två papperstyper” Master’s thesis , Mid Sweden University 2012 7. Bell E., Bryman A. ”Business research methods” 3rd edition Oxford University Press Inc. 2011 F4203.doc 13 (13) Author Ann-Christine Engström SCA R&D CENTRE Report No F4203 Project 2013-01-07 GraphoInvent Information classification INTERNAL 8. Keelan W B “Handbook of image quality” Marcel Dekker Inc.m 2002 9. Lindberg S “Perceptual determinants of print quality” Ph D thesis, Department of psychology, Stockholm University 2004 10. Engeldrum P G “Physchometric scaling” A toolkit for imaging systems development, Imcotek Press 2000 11. Zuffi S, Brambilla C, Eschbach R, Rizzi A “Controlled and uncontrolled viewing conditions in the evaluation of prints” ITC, IMATI, Consiglio Nazionale delle Ricerche, Milano Italy, Xerox, Webster USA, Universita degli studi di Milano 2008 12. Pedersen M “Image quality metrics for the evaluation of printing workflows” Doctoral dissertation from the Faculty of mathematics and natural science, University of Oslo 2011 F4203.doc 14 (14) Author Ann-Christine Engström SCA R&D CENTRE Report No F4203 Project 2013-01-07 GraphoInvent Information classification INTERNAL 7. Appendix 7.1 Questionnaire (Template translated from Swedish) 1) Sex Female Male 2) Age (categories) ‐ 20 You will now see 2 printed paper samples 3) At a first impression –Do you think there is any difference between sample 1 and sample 2? What is the difference? ………………………………………………………………………………………………………… Sample 1 is:………………………………………………………………………………………………………………………………………………… Sample 2 is:………………………………………………………………………………………………………………………………………………… 21‐30 31‐40 41‐50 1 2 3 1= No Difference 51‐60 4 ‐60 years 5 5= Big Difference 4) Which sample do you think looks the best? Sample 1 Sample 2 No notable difference Comments:…………………………………………………………………………………………………………………………………… 5) Which paper sample do you think has the highest price? Sample 1 Sample 2 Comments:…………………………………………………………………………………………………………………………………… They have the same price Thank you for partcipating! F4203.doc 15 (15) Author Ann-Christine Engström SCA R&D CENTRE Report No F4203 Project 2013-01-07 GraphoInvent Information classification INTERNAL 7.2 Panel results Age distribution in panel. “At a first impression –Do you think there is any difference between sample 1 and sample 2?” F4203.doc 16 (16) Author Ann-Christine Engström SCA R&D CENTRE Report No F4203 Project 2013-01-07 GraphoInvent Information classification INTERNAL “Which sample do you think looks the best?” Comments from the panel about the GraphoInvent quality in categories. F4203.doc 17 (17) Author Ann-Christine Engström SCA R&D CENTRE Report No F4203 Project 2013-01-07 GraphoInvent Information classification INTERNAL Comments from the panel about the WFU paper quality in categories. “Which sample has the highest price?” F4203.doc 18 (18) Author Ann-Christine Engström SCA R&D CENTRE Report No F4203 Project 2013-01-07 GraphoInvent Information classification INTERNAL Comments from the panel connected to the papers price F4203.doc 19 (19)