Section 20. DOEOptimizing


20. DOEOptimizing

Overview

Optimizing a process using Designed experiments involves

  • Determining at what level the critical Inputs should be set

  • Determining real specification limits

Before reading this section it is important that the reader has read and understood "DOEIntroduction," "DOECharacterizing," and "DOEScreening" in this chapter. This section covers only designing, analyzing, and interpreting an Optimizing Design, not the full DOE roadmap.

Optimizing Designs (sometimes known as Response Surface Methodology[37]) in Lean Sigma are based on the set of experimental design techniques known as sequential experimentation and rely on Screening Designs as well as Characterizing Designs. Screening Designs allow a narrowing of the Xs down to the few potential candidates. Characterizing Designs determine for the shortened list of Xs how much each X contributes and how it contributes. The result of Screening and Characterizing Designs is a shortlist of critical Xs that need to be controlled to maintain a consistent level of the Y. What they do not provide is an optimized Y.

[37] For more detail see Introduction to Linear Regression Analysis by Douglas Montgomery and Elizabeth Beck.

To explain this more readily, it is best to follow an example. Assume the first DOE work was a Screening Design that narrowed the Xs down to two key Xs. The associated Y is the Yield of the process. A subsequent Full Factorial on the two Xs yielded the results shown in Figure 7.20.1. The model explains 91.06% of the variation in the data and both Xs are significant.

Figure 7.20.1. Example Characterizing Design analysis results for two Factors (output from Minitab v14).

Results for: RSM 1

Factorial Fit: Yield versus Time, Temp

Estimated Effects and Coefficients for Yield (coded units)

Term

Effect

Coef

SE Coef

T

P

Constant

 

62.014

0.6011

103.16

0.000

Time

4.700

2.350

0.7952

2.96

0.042

Temp

9.000

4.500

0.7952

5.66

0.005

S = 1.59049

R Sq = 91.06%

R Sq(adj) = 86.59%


To take this analysis further, an understanding of the solution space needs to be gained. Because there are only two Factors involved here, it is possible to represent the solution space graphically with a Surface Map of the model, as shown in Figure 7.20.2.

Figure 7.20.2. Surface Plot of Yield versus Time and Temperature (output Minitab v14).


Clearly to improve the Yield, the Time and Temperature need to be changed to levels outside the Design space, preferably toward the top right-hand corner; the question is where? The Surface Map gives a good visual representation of the direction to travel, but the Contour Plot, as shown in Figure 7.20.3, really shows the best direction to travel in terms of Time and Temperature to get an improved Yield.

Figure 7.20.3. Contour Plot of Yield versus Time and Temperature (output Minitab v14).


If the journey is commenced from the Center Point of the Plot, the fastest way to move in the direction of increased Yield is known as the Path of Steepest Ascent and is perpendicular to the contour lines, as drawn on Figure 7.20.3. To proceed, additional data points (experimental runs) should be taken at regular reasonable intervals up the Path of Steepest Ascent until a maximum Yield is reached. This direction can be approximated by eye if there are only two Factors (as in this case) or calculated from the analysis results in Figure 7.20.1 irrespective of the number of Factors involved. Either way is appropriate in this case where there are only two Factors; however, Belts can become a little confused with the latter approach so the former is recommended here.

To approximate the Path of Steepest Ascent, use the Contour Plot as shown in Figure 7.20.1. Extend the arrow out from the Center Point perpendicular to the contours until it reaches the boundary of the square. Read off the coordinates of the point where the arrow touches the square. In this case Time 78.2, Temperature = 132.5.

As Temperature goes up 2.5 units from the Center Point, Time needs to go up approximately 3.2 units to stay on the Path of Steepest Ascent. From this, a simple table can be created and populated as shown in Table 7.20.1. Just a few of the steps were run with the associated Yield value in the table.

Table 7.20.1. Calculating the Path of Steepest Ascent
 

Time

Temp

Yield

Origin (Center Point)

75

130

62.3

Step Size

3.2

2.5

 

Origin + 1 Step

78.2

132.5

 

Origin + 2 Steps

81.4

135

71.0

Origin + 3 Steps

84.6

137.5

 

Origin + 4 Steps

87.8

140

 

Origin + 5 Steps

91

142.5

85.1

Origin + 6 Steps

94.2

145

 

Origin + 7 Steps

97.4

147.5

 

Origin + 8 Steps

100.6

150

56.7

Origin + 9 Steps

103.8

152.5

 


Clearly the Yield reaches a maximum value somewhere around "Origin + 5 Steps" at [91, 142], so no further runs are conducted after "Origin + 8 Steps." The experimental sequence could be halted at this point with a new, much improved Yield of 85%, but there might be an even better Yield value somewhere in the solution space.

The approach at this point would be to start the process again with a new Full Factorial centered somewhere around the highest point found from the Path of Steepest Ascent. Based on attainable settings for the Xs, the Team, in this case, decides to center the experiment on [90,145] and stretch the levels of the Xs to cover a broader area, as shown in Figure 7.20.4.

Figure 7.20.4. Sequence of experimentation for the Time-Temperature example.


The Team chose new levels:

  • Time: Low = 80, High = 100

  • Temperature: Low = 140, High = 150

The Team designed a Full Factorial, shown as Experiment 3 in Figure 7.20.4. The runs in Experiment 3 were conducted on the process (including two Center Points) and the associated Yield recorded. Analysis of the runs gave the results shown in Figure 7.20.5.

Figure 7.20.5. Analysis results for experiment 3 in the Time-Temperature example (output from Minitab v14).

Factorial Fit: Yield versus Time, Temp

Estimated Effects and Coefficients for Yield (coded units)

Term

Effect

Coef

SE Coef

T

P

Constant

 

82.975

0.7654

108.41

0.000

Time

4.050

2.025

0.7654

2.65

0.118

Temp

2.650

1.325

0.7654

1.73

0.226

Time*Temp

9.750

4.875

0.7654

6.37

0.024

Ct Pt

 

4.992

1.1692

4.27

0.051


At first glance, the results seem a little strange; the linear model is no longer correct (high p-values) and there are now interaction and curvature effects (both with low p-values). This makes complete sense though upon further consideration. The previous experiment showed liner effects representing the side of a hill. Here it looks as though the experiment is sitting on the top of the same hill. There are no linear effects, but there is curvature, which are both indicative of a peak in the response surface. It could be that the experimental region is close to the maximum value for Yield. If there is curvature present then a linear model is no longer of any use, a quadratic model would be better.

To see curvature in a given direction, at least three points are needed in a line. To do this here, the model is expanded by adding what are known as "Star Points" or "Axial Points" to create a new design, known as a Central Composite Design, as shown in Figure 7.20.6.

Figure 7.20.6. Adding a Central Composite Design to the time-temperature example.


This design is efficient in representing curvature. As can be seen from the figure, the addition of the Star Points creates a line of three points horizontally, vertically, and on both diagonals. Only the four Star Points are required as extra runs to create this design from the Full Factorial. Two additional Center Points are usually added to make sure that conditions haven't changed from when the Full Factorial was run to when the additional points were run. All the Full Factorial runs, along with the Star Points and all four Center Points, are analyzed together in the Central Composite Design. A Block is used to distinguish the first set of runs (Full Factorial) from the second set (Star Points) and to check that no conditions have changed. The results are shown in Figure 7.20.7.

Figure 7.20.7. Analysis results of the Central Composite Design for the time-temperature example (output from Minitab v14).

Response Surface Regression: Yield versus Block, Time, Temp

The analysis was done using coded units.

Estimated Regression Coefficients for Yield

Term

Coef

SE Coef

T

P

Constant

87.5141

0.6617

132.252

0.000

Block

0.7025

0.4332

1.621

0.149

Time

1.3939

0.5760

2.420

0.046

Temp

0.3687

0.5760

0.640

0.542

Time*Time

2.2298

0.6053

3.684

0.008

Temp*Temp

3.1992

0.6053

5.285

0.001

Time*Temp

4.8750

0.8105

6.015

0.001

S = 1.621

R Sq = 92.3%

R Sq (adj) = 85.7%


From the Figure it is clear that the Block has no effect (a p-value above 0.05); so conditions appear not to have changed from the Full factorial to the addition of the Star Points. The analysis can be rerun eliminating the Block term and the results are shown in Figure 7.20.8.

Figure 7.20.8. Analysis results of the Central Composite Design excluding the Block (output from Minitab v14).

The analysis was done using coded units.

Estimated Regression Coefficients for Yield

Term

Coef

SE Coef

T

P

Constant

87.5047

0.7259

120.539

0.000

Time

1.3939

0.6319

2.206

0.058

Temp

0.3687

0.6319

0.583

0.576

Time*Time

2.2214

0.6641

3.345

0.010

Temp*Temp

3.1908

0.6641

4.805

0.001

Time*Temp

4.8750

0.8892

5.483

0.001

S = 1.778

R Sq = 89.4%

R Sq (adj) = 82.8%


The model seems reasonable in that it explains 89.4% of the variation seen in the data (from the R-Sq value). The R-Sq(adj) value is a little lower at 82.8% indicating some redundant terms in the model, but that can be explained by the inclusion of the Factors Time and Temperature, even though their p-values indicate they aren't significant. The Factors cannot be removed for the sake of hierarchy. The equation for Yield can be determined from the "Coef" column, which lists the coefficients:

Yield = 87.5047 1.3939 (Temp) 2.2214 (Time2) 3.1908 (Temp2)

 

4.8750 (Temp*Time)


Remember these are in coded units; most software packages give the equation in actual units as well. Figure 7.20.9 shows the graphical representation of the response surface at this point.

Figure 7.20.9. Contour Plot of the response surface from the Central Composite Design (output from Minitab v14).


From the Contour Plot it seems that there is another area of even higher Yield off to the top left corner. To proceed, the approach would be to determine the Path of Steepest Ascent in that direction and conduct experiments along the Path until a maximum value is reached and then center a further experiment in that region. For the example in question, an expanded response surface is shown in Figure 7.20.10, which clearly shows the progression from the original experiment up to the top of a saddle and then the potential for further experiments leading to a higher Yield in the top left corner.

Figure 7.20.10. The "big picture view" of Yield (output modified from Minitab v13).


Most DOE software packages provide an optimization algorithm, which can be applied to the model to determine the maxima or minima. Many Belts fall into the mode of optimizing beyond practicality. Remember that this is an imperfect model that is based on just a sample of data from a varying process with inherent noise in the Measurement System. To optimize to anything more then two significant figures is fairly meaningless. Use the optimizer instead to identify a region of operation. If there is a choice between operating regions then choose the flattest one, because this creates a more robust process (variation in the Xs has little effect in the Y).

The final step in the process is to set the specifications for the Xs based on contour lines in the Y. If the Yield has to be kept above a certain value, then simply reading the associated value of the Xs from the Contour Plot can give specifications for the Xs. This is shown graphically in Figure 7.20.11; in this example, to maintain a Yield above 86%, the Xs should be controlled within the following specifications:

  • Time: LSL[38] = 87, USL = 93

    [38] Lower Specification Limit and Upper Specification Limit.

  • Temperature: LSL = 143°, USL = 147°

Figure 7.20.11. Creating specifications for the Xs (adapted from output from Minitab v14).


Roadmap

The roadmap to designing, analyzing and interpreting an Optimizing DOE is as follows:

Step 1.

Conduct a Screening DOE to narrow down the Xs (see "DOEScreening" in this chapter).

Step 2.

For the reduced set of Xs conduct a Characterizing DOE to determine the critical Xs and the shape of the response surface at this point using a Contour Plot and Surface Plot. Include two Center Points in the Full Factorial Design. For more detail see "DOECharacterizing" in this chapter.

Step 3.

Determine the Path of Steepest Ascent if the Y is to be maximized, the Path of Steepest Descent if the Y is to be minimized. This can be done using the graphical method described in "Overview" in this section (note this is applicable only to 2-Factor experiments) or using the analytical method shown in "Other Options" later in this section (applicable to two or more Factors).

Step 4.

Collect the data from the process as per the runs on the Path of Steepest Ascent (or Descent) in Step 3. After a turning point is reached along the Path, stop.

Step 5.

Center another Full Factorial around the highest (lowest) point found on the Path of Steepest Ascent (Descent). Include two Center Points in the Design. Determine the shape of the response surface at this point using a Contour Plot and Surface Plot. For more detail see "DOECharacterizing" in this chapter. If the Design is still on the side of a hill, repeat Steps 35 until the surface levels out.

Step 6.

Add Star Points and two additional Center Points to the final Full Factorial from Step 5 to create a Central Composite Design Matrix. These should be added as a second Block to ensure that conditions haven't changed from the Full Factorial runs.

Step 7.

Capture data from the process as per the Design Matrix. Complete all of the runs in the Design Matrix.

Step 8.

Analyze the data from the Central Composite Design runs. If a potentially higher area of Y is seen outside of the current Design space, then repeat Steps 38. If the optimum value of the Y appears to be within the current design space, then use the optimizer algorithm in the software or read the best value by eye from the Contour Plot to identify the best operating conditions.

Step 9.

Conduct a confirmatory run at the optimum process settings.

Step 10.

Determine specifications for the Xs to maintain the Y at the optimum value, as described in "Overview."

Step 11.

Formulate conclusions and recommendations. Process settings are generally implemented at this point and recommendations for improvements to control the Xs are submitted or put in place.

Other Options

Calculating the Path of Steepest Ascent for Two or more Factors

To calculate the exact Path of Steepest Ascent for two or more Factors, the model equation in coded units (1s and +1s) from the analysis is used. Using the example from "Overview" in this section:

Yield = 62.0 + 2.35 x Time + 4.50 x Temp

For any model equation, the Path can be calculated by choosing the step size in one of the process variables, for example, ΔX1 = 1 (usually a step size of 1 or 2 at most). The step size for the other variable(s) is


where:

  • ΔX1 is the step size in variable X1, which is Time in this example. The step size taken is 1 or 2 coded units.

  • β1 is the coefficient of the Factor X1 (Time) from the model, which is 2.35 in this example.

  • βk is the coefficient from the model of the Factor in question. In this case, the Factor is X2 (temperature) and its coefficient is 4.5.

So for the preceding example, for every increase of 1 coded unit of Time, the associated step size for temperature to follow the Path of Steepest Ascent is


It should be quite straightforward to create a table using a spreadsheet to represent this, as shown in Table 7.20.2. Remember that the listed equation for Time and Temperature from the analysis is in coded units, so before the experiment can be run, the coded units have to be converted back to real life or "Natural Units," as shown in the table in the columns "Nat Time" and "Nat Temp."

Table 7.20.2. Calculating the Path of Steepest Ascent

Steps

Coded Time

Coded Temp

Nat. Time

Nat. Temp

Run

Yield

       

Origin

0

0

75

130

5,6,7

62.3 (Mean)

Δ

1

1.91

5

4.8

  

Origin + 1Δ

1

1.91

80

134.8

8

73.3

Origin + 2Δ

2

3.82

85

139.6

  

Origin + 3Δ

3

5.73

90

144.4

9

86.8

Origin + 4Δ

4

7.64

95

149.2

  

Origin + 5Δ

5

9.55

100

154

10

58.2


This is done with the equation:


For the example here: and


and


The next steps are the same as in "Overview" in this section; the runs are conducted sequentially on the process until a highest value is determined. At this point a Full Factorial Design is centered on the highest point from the Path of Steepest Ascent.




Lean Sigma(c) A Practitionaer's Guide
Lean Sigma: A Practitioners Guide
ISBN: 0132390787
EAN: 2147483647
Year: 2006
Pages: 138

flylib.com © 2008-2017.
If you may any questions please contact us: flylib@qtcs.net