“New trends in statistical methods applied in a semiconductor company” Luigi Radaelli Statistical Methods eng. PC & Robustness group - Micron Workshop on “Statistical methods applied in microelectronics” Catholic University of Milan and University of Milan-Bicocca June 13th, 2011 ©2009 Micron Technologies, Inc. All rights reserved. Products are warranted only to meet Micron’s production data sheet specifications. Information, products, and/or specifications are subject to change without notice. All information is provided on an “AS IS” basis without warranties of any kind. Dates are estimates only. Drawings are not to scale. Micron and the Micron logo are trademarks of Micron Technology, Inc. All other trademarks are the property of their respective owners. Company Confidential | ©2009 Micron Technology, Inc. | 1 Incorporated 1978, Boise, Idaho 20,794 worldwide Stock Information ▶ Traded on the NYSE - Symbol, MU Developer of DRAM, NAND and Image Sensors ▶ Only US producer of DRAM Company Divisions ▶ Crucial Technology – Meridian, ID ▶ SpecTek – Nampa, ID ▶ Lexar Media – San Jose, CA ▶ Aptina Imaging – San Jose, CA Related Joint Ventures ▶ TECH Semiconductor – DRAM ▶ IM Flash Technologies – Flash ▶ IM Flash Singapore – Flash ▶ Inotera Memories – DRAM ▶ MP Mask Technology Center ©2009 Micron Technologies, Inc. All rights reserved. Products are warranted only to meet Micron’s production data sheet specifications. Information, products, and/or specifications are subject to change without notice. All information is provided on an “AS IS” basis without warranties of any kind. Dates are estimates only. Drawings are not to scale. Micron and the Micron logo are trademarks of Micron Technology, Inc. All other trademarks are the property of their respective owners. Company Confidential | ©2009 Micron Technology, Inc. | 2 ©2009 Micron Technologies, Inc. All rights reserved. Products are warranted only to meet Micron’s production data sheet specifications. Information, products, and/or specifications are subject to change without notice. All information is provided on an “AS IS” basis without warranties of any kind. Dates are estimates only. Drawings are not to scale. Micron and the Micron logo are trademarks of Micron Technology, Inc. All other trademarks are the property of their respective owners. Company Confidential | ©2009 Micron Technology, Inc. | 3 Introduction • The continuous technology development requires complex manufacturing processes with consequent increasing of the difficulties in monitoring their evolution over time. • Most process monitoring involve several quality characteristics. A large number of variables, often strongly correlated, must be kept under control to guarantee the effectiveness of the manufacturing process. • For these reasons, although the usual univariate techniques are adequate for the single variable, the use of multivariate approaches, jointly considering the variables, avoid inefficient and erroneous conclusions. ©2009 Micron Technologies, Inc. All rights reserved. Products are warranted only to meet Micron’s production data sheet specifications. Information, products, and/or specifications are subject to change without notice. All information is provided on an “AS IS” basis without warranties of any kind. Dates are estimates only. Drawings are not to scale. Micron and the Micron logo are trademarks of Micron Technology, Inc. All other trademarks are the property of their respective owners. Company Confidential | ©2009 Micron Technology, Inc. | 4 Introduction • Because of the complexities of the process the standard methodologies do not always give a satisfying answer; so new approaches, conform to more strict requirements, must be developed. • A further frequent drawback, looking at the data describing manufacturing processes, is the evidence that they show distributions different from the Gaussian. • Seldom the characteristics are independent and heteroschedasticity is often observed. As a consequence, most of the classical statistical techniques must be integrated with modern non parametric statistics inferential procedures. ©2009 Micron Technologies, Inc. All rights reserved. Products are warranted only to meet Micron’s production data sheet specifications. Information, products, and/or specifications are subject to change without notice. All information is provided on an “AS IS” basis without warranties of any kind. Dates are estimates only. Drawings are not to scale. Micron and the Micron logo are trademarks of Micron Technology, Inc. All other trademarks are the property of their respective owners. Company Confidential | ©2009 Micron Technology, Inc. | 5 Some new trends… • Among the non standard methodologies, geostatistic was implemented in the development of new and interesting applications for process control. • Also about the LogVariance methodology, interesting application can be performed • In this presentation some case studies will be showed: • the study of the spatial distribution of the defectivity over the wafer surface • the optimization of the size of the maps used to measure parameters on wafer • joint modelling of mean and variance surface to monitor Critical Dimension parameter ©2009 Micron Technologies, Inc. All rights reserved. Products are warranted only to meet Micron’s production data sheet specifications. Information, products, and/or specifications are subject to change without notice. All information is provided on an “AS IS” basis without warranties of any kind. Dates are estimates only. Drawings are not to scale. Micron and the Micron logo are trademarks of Micron Technology, Inc. All other trademarks are the property of their respective owners. Company Confidential | ©2009 Micron Technology, Inc. | 6 The spatial distribution defectivity over the wafer surface • The aim is to investigate if the defects on the surface are dislocated in clusters after a washing step process. Cluster Cluster • Are any defectivity clusters present on the surface of the wafer? And if yes where are they dislocated? • How can we decide if any clusters are present? ©2009 Micron Technologies, Inc. All rights reserved. Products are warranted only to meet Micron’s production data sheet specifications. Information, products, and/or specifications are subject to change without notice. All information is provided on an “AS IS” basis without warranties of any kind. Dates are estimates only. Drawings are not to scale. Micron and the Micron logo are trademarks of Micron Technology, Inc. All other trademarks are the property of their respective owners. Company Confidential | ©2009 Micron Technology, Inc. | 7 The spatial distribution defectivity over the wafer surface • A situation where no clusters are present is desiderable, because it means the process is in control (e.g. no “special” source of particles is present) • This situation is statistically modellized by a Homogeneous Poisson Process (HPP). The process is defined Complete Spatial Randomness (CSR). • The defectivity pattern is evaluated by the estimation of the distribution function of the euclidean distances between pairs of defects. ©2009 Micron Technologies, Inc. All rights reserved. Products are warranted only to meet Micron’s production data sheet specifications. Information, products, and/or specifications are subject to change without notice. All information is provided on an “AS IS” basis without warranties of any kind. Dates are estimates only. Drawings are not to scale. Micron and the Micron logo are trademarks of Micron Technology, Inc. All other trademarks are the property of their respective owners. Company Confidential | ©2009 Micron Technology, Inc. | 8 The spatial distribution defectivity over the wafer surface • A comparison between the empirical cumulative distribution function (EDF) and the CSR cumulative distribution function is performed by a graphical test. envpp No Clusters 0.2 0.2 0.4 0.4 F(r) F(r) 0.6 0.6 0.8 0.8 1.0 1.0 envpp Clusters 0 5000 10000 15000 r • 20000 25000 obs theo hi lo 0.0 0.0 obs theo hi lo 30000 0 5000 10000 15000 20000 25000 r The CSR hypothesis should be rejected if the EDF (the continuous black colored line), lies outside the envelope identified by the dotted lines. The EDF is far below the lower bound of the envelope: we can assume that there is a presence of clusters Company Confidential | ©2009 Micron Technology, Inc. | 9 ©2009 Micron Technologies, Inc. All rights reserved. Products are warranted only to meet Micron’s production data sheet specifications. Information, products, and/or specifications are subject to change without notice. All information is provided on an “AS IS” basis without warranties of any kind. Dates are estimates only. Drawings are not to scale. Micron and the Micron logo are trademarks of Micron Technology, Inc. All other trademarks are the property of their respective owners. The optimization of the size of the measurement maps • Starting from an in-use monitoring map, the goal is to consider all the possible configurations of a reduced map, to evaluate for each of them the fitness function and to select the optimum by some criteria. • This means to consider a very high number of possible configurations that is impossible to evaluate by enumeration. The simulating annealing, a combinatorial optimization algorithm, allows to draw the optimum reduced map. • Because technical constraints, only a sub-grid of the n starting point grid can be selected. ©2009 Micron Technologies, Inc. All rights reserved. Products are warranted only to meet Micron’s production data sheet specifications. Information, products, and/or specifications are subject to change without notice. All information is provided on an “AS IS” basis without warranties of any kind. Dates are estimates only. Drawings are not to scale. Micron and the Micron logo are trademarks of Micron Technology, Inc. All other trademarks are the property of their respective owners. Company Confidential | ©2009 Micron Technology, Inc. | 10 The optimization of the size of the measurement maps • Universal kriging was used to predict the deposition surface assuming a complete polynomial of second order for the mean function of the process. • To select the optimum reduced map, the fitness function should be related to the kriging variance, evaluated at the current sample configuration. • The algorithm starts from a random configuration of sample points and sequentially updates it. At each step i, the current configuration is modified by replacing one point by one point. The candidate point for replacement is selected randomly and it is accepted if this determines an improvement in the value of the fitness function. ©2009 Micron Technologies, Inc. All rights reserved. Products are warranted only to meet Micron’s production data sheet specifications. Information, products, and/or specifications are subject to change without notice. All information is provided on an “AS IS” basis without warranties of any kind. Dates are estimates only. Drawings are not to scale. Micron and the Micron logo are trademarks of Micron Technology, Inc. All other trademarks are the property of their respective owners. Company Confidential | ©2009 Micron Technology, Inc. | 11 The optimization of the size of the measurement maps The procedure is iterated until the value of the fitness function gets stable and cannot be further reduced. campione ottimo 49 sites starting map 100 Optimal fitness= submap 499.911- 20sites x x x 50 x x x x 0 -50 x x x x x x x x x x x x x Y x x x x x x x x x -100 • -100 -50 50 0 100 X ©2009 Micron Technologies, Inc. All rights reserved. Products are warranted only to meet Micron’s production data sheet specifications. Information, products, and/or specifications are subject to change without notice. All information is provided on an “AS IS” basis without warranties of any kind. Dates are estimates only. Drawings are not to scale. Micron and the Micron logo are trademarks of Micron Technology, Inc. All other trademarks are the property of their respective owners. Company Confidential | ©2009 Micron Technology, Inc. | 12 The LogVariance methods • The early development phase for a technological step is the study of a working point able to both center the specification limits and minimize the unavoidable differences among positions on wafer area. • In this phase the measurement time and data analysis are only possible for a small number of samples. If the system response match the specification limits, the technological step is implemented on an experimental WIP, in order to monitor its behavior. • Data produced are very important to estimate whether the process will be stable enough for production volumes or not. • The aim of the method is to give a quantitative evaluation of the degree of stability of a technological step. ©2009 Micron Technologies, Inc. All rights reserved. Products are warranted only to meet Micron’s production data sheet specifications. Information, products, and/or specifications are subject to change without notice. All information is provided on an “AS IS” basis without warranties of any kind. Dates are estimates only. Drawings are not to scale. Micron and the Micron logo are trademarks of Micron Technology, Inc. All other trademarks are the property of their respective owners. Company Confidential | ©2009 Micron Technology, Inc. | 13 The LogVariance methods • The wafers come from different lots processed in different times and they are randomly selected and supposed to be stochastically independent each other and by time. • The aim is to evaluate the homogeneity in mean and variance on the whole wafer. -0.5 -1.5 -3.5 -3.5 -2.5 1.5 -1.5 0.5 3.5 2.5 1.5 0.5 -0.5 -1.5 -3.5 3.5 0.5 2.5 2.5 -2.5 Standard deviation RS 3.5 3 2.5 2 1.5 1 0.5 0 -0.5 -1 Mean RS -1.5 -2 ©2009 Micron Technologies, Inc. All rights reserved. Products are warranted only to meet Micron’s production data sheet specifications. Information, products, and/or specifications -2.5 are subject to change without notice. All information is provided on an “AS IS” basis without warranties of any kind. Dates are estimates only. Drawings are not to scale. Micron and -3 the Micron logo are trademarks of Micron Technology, Inc. All other trademarks are the property of their respective owners. -3.5 -3 -2.5 -2 -1.5 -1 -0.5 0 0.5 1 1.5 2 2.5 3 3.5 -3.5 -3 Company Confidential | 0.5 1 1.5 2Inc. 2.5 ©2009 Micron 0Technology, -2.5 -2 -1.5 -1 -0.5 -3.5 3 | 3.5 14 The LogVariance methods • Using the mean and the standard deviation estimated over the whole wafer surface by the L-RS model, it is possible both to point out whether a region is far from the target and to find the distribution of the Cpk over the surface. -3.5 Region expected to be not on the target -3 -2.5 -2 Cpk contour plot 4-4.25 -1.5 -1 -0.5 0 0.5 1 1.5 2 2.5 3 4.2 1.2 1.7 2.2 2.7 3.2 3.7 1.5 2.5 3.5 1 2 3 4 5 -3.5 3.5 -3 -2.5 -2 -1.5 -1 -0.5 0 0.5 1 1.5 2 2.5 3 3.5 3.75-4 3.5-3.75 3.25-3.5 3-3.25 2.75-3 2.5-2.75 2.25-2.5 2-2.25 1.75-2 1.5-1.75 1.25-1.5 1-1.25 -3.5 -3 -2.5 -2 -1.5 -3.5 -1 -0.5 0 0.5 1 1.5 2 2.5 3 3.5 1.73 1.91 2.04 2.11 2.11 2.05 1.94 -3 1.59 1.86 2.1 2.31 2.46 2.53 2.46 2.33 2.16 1.96 1.75 -2.5 1.57 1.89 2.21 2.49 2.72 2.79 2.76 2.67 2.54 2.36 2.16 1.93 1.69 -2 1.84 2.2 2.56 2.85 2.94 2.98 2.95 2.87 2.73 2.55 2.34 2.1 1.85 -1.5 1.69 2.09 2.5 2.83 2.99 3.1 3.14 3.12 3.05 2.91 2.73 2.51 2.26 2 1.73 -1 1.89 2.32 2.71 2.93 3.1 3.22 3.28 3.27 3.2 3.07 2.89 2.67 2.41 2.14 1.86 -0.5 2.05 2.49 2.76 2.99 3.18 3.31 3.38 3.38 3.32 3.2 3.02 2.8 2.54 2.26 1.98 0 2.18 2.5 2.78 3.02 3.22 3.36 3.44 3.46 3.41 3.3 3.13 2.91 2.65 2.37 2.07 0.5 2.18 2.48 2.76 3.01 3.22 3.38 3.47 3.5 3.47 3.36 3.2 2.99 2.73 2.45 2.15 1 2.14 2.44 2.72 2.98 3.19 3.36 3.47 3.51 3.49 3.39 3.24 3.04 2.79 2.51 2.21 1.5 2.07 2.36 2.65 2.91 3.13 3.31 3.43 3.48 3.47 3.39 3.25 3.05 2.81 2.53 2.17 2 2.27 2.55 2.81 3.04 3.22 3.35 3.42 3.42 3.35 3.22 3.03 2.8 2.49 2.5 2.15 2.43 2.69 2.92 3.1 3.24 3.31 3.33 3.27 3.15 2.98 2.73 2.29 3 2.29 2.54 2.77 2.96 3.1 3.18 3.2 3.16 3.05 2.84 2.46 3.5 2.6 2.79 2.93 3.02 3.04 3.01 2.82 ©2009 Micron Technologies, Inc. All rights reserved. Products are warranted only to meet Micron’s production data sheet specifications. Information, products, and/or specifications are subject to change without notice. All information is provided on an “AS IS” basis without warranties of any kind. Dates are estimates only. Drawings are not to scale. Micron and the Micron logo are trademarks of Micron Technology, Inc. All other trademarks are the property of their respective owners. Company Confidential | ©2009 Micron Technology, Inc. | 15 The LogVariance methods Possible other applications The algorithm proposed may be used in other applications: • to check the alignment between two equipments that produce wafers (are they aligned regarding average and variance?) • in a DOE experiment to find the area with the smallest variance and the best average value or to understand what are the most relevant factors. ©2009 Micron Technologies, Inc. All rights reserved. Products are warranted only to meet Micron’s production data sheet specifications. Information, products, and/or specifications are subject to change without notice. All information is provided on an “AS IS” basis without warranties of any kind. Dates are estimates only. Drawings are not to scale. Micron and the Micron logo are trademarks of Micron Technology, Inc. All other trademarks are the property of their respective owners. Company Confidential | ©2009 Micron Technology, Inc. | 16 Conclusions • The application of the approaches here presented allows to save measurement time and to reduce equipment access time. • The use of non appropriate methods can yield misleading results with consequent erroneous decisions and waste of time and materials. • The study and the development of adequate statistical approaches are fundamentals also for a better understanding of the process. ©2009 Micron Technologies, Inc. All rights reserved. Products are warranted only to meet Micron’s production data sheet specifications. Information, products, and/or specifications are subject to change without notice. All information is provided on an “AS IS” basis without warranties of any kind. Dates are estimates only. Drawings are not to scale. Micron and the Micron logo are trademarks of Micron Technology, Inc. All other trademarks are the property of their respective owners. Company Confidential | ©2009 Micron Technology, Inc. | 17 References • Diggle PJ. 2003, Statistical Analysis of Spatial Point Patterns. 2-nd edition, Arnold London • Illian J, Penttinen A, Stoyan D. 2008 Statistical Analysis and Modeling of Spatial Point Patterns. Wiley New York • Aarts, E., Korst, J.: Simulated Annealing and Boltzmann Machines - A • Stochastic Approach to Combinatorial Optimization and Neural Computing. Wiley, New York (1990) Chiles, J.P., Delfiner, P.: Geostatistics: Modeling Spatial Uncertainty, John Wiley & Sons, New York (1999) • Aitkin, M. (1987), Modelling Variance Heterogeneity in Normal Regression Using GLIM. Applied Statistics, 36, 332-339. • Faraway, J. J. (2006), Extending the Linear Model with R. Chapmanand Hall ©2009 Micron Technologies, Inc. All rights reserved. Products are warranted only to meet Micron’s production data sheet specifications. Information, products, and/or specifications are subject to change without notice. All information is provided on an “AS IS” basis without warranties of any kind. Dates are estimates only. Drawings are not to scale. Micron and the Micron logo are trademarks of Micron Technology, Inc. All other trademarks are the property of their respective owners. Company Confidential | ©2009 Micron Technology, Inc. | 18 Thank you for your kind attention ©2009 Micron Technologies, Inc. All rights reserved. Products are warranted only to meet Micron’s production data sheet specifications. Information, products, and/or specifications are subject to change without notice. All information is provided on an “AS IS” basis without warranties of any kind. Dates are estimates only. Drawings are not to scale. Micron and the Micron logo are trademarks of Micron Technology, Inc. All other trademarks are the property of their respective owners. Company Confidential | ©2009 Micron Technology, Inc. | 19