Abstract
This paper examines the experience of the Georgia Manufacturing Extension Alliance (GMEA) in implementing an evaluation of its industrial extension services. As part of the U.S. Manufacturing Extension partnership, GMEA provides assistance to manufacturers to resolve industrial and business problems and upgrade technology, training, and business performance, focusing primarily on firms within the state of Georgia. The program has established an evaluation component along with other assessment and review mechanisms. Several evaluation methods are employed, including customer surveys, economic analyses of benefits and costs, controlled studies, and logic-based case studies. The article examines the strengths and weaknesses of these different approaches, reviews the insights each method offers, and discusses how the resulting evaluative information is used.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Clifton D., L. Edens, H. Johnson and R. Springfield. “Elements of an effective technology assistance policy to stimulate economic development.”Economic Development Quarterly 3, pp. 52–57, 1989.
Cosmos Corporation.A Day in the Life of the Manufacturing Extension Partnership: Case Studies of Exemplary Engagements with Clients by MEP Centers (draft). Gaithersburg, MD: National Institute of Standards and Technology, Manufacturing Extension Partnership, June, 1996.
Feller, I. Presentation at the NIST MEP Evaluation Working Group Meeting, Atlanta, GA, January 26, 1995.
Feller, I., and E. Anderson. “A Benefit-Cost Approach to the Evaluation of State Technology Development Programs.”Economic Development Quarterly 8, pp. 127–140, 1994.
Jarmin, R. “Measuring the Impact of Manufacturing Extension.” InManufacturing Modernization: Learning from Evaluation Practices and Results, ed. Philip Shapira and Jan Youtie. Atlanta, GA: Georgia Institute of Technology, pp. 129–153, 1997a.
Jarmin, R. “Estimated Impact of Manufacturing Extension” (memorandum), February 12, 1997b.
Luria. D. “Toward Rich or Lean: What Performance Benchmarking Tells Us about SME Performance, and Some Implications for Extension Center Services and Mission.” InManufacturing Modernization: Learning from Evaluation Practices and Results, ed. Philip Shapira and Jan Youtie. Atlanta, GA: Georgia Institute of Technology, 1997, pp. 99–114.
Oldsman, E., and C. Heye. “The Impact of the New York Manufacturing Extension Program: A Quasi-Experiment.” InManufacturing Modernization: Learning from Evaluation Practices and Results, ed. Philip Shapira and Jan Youtie. Atlanta, GA: Georgia Institute of Technology, 1997, pp. 155–166.
Roessner, D., Y. Lee, P. Shapira, and B. Bozeman.Evaluation of Iowa State University's Center for Advanced Technology Development. Volume I: Assessments of Benefits and Costs Associated with CATD. Atlanta, GA: School of Public Policy, Georgia Institute of Technology, June 1996.
Shapira, P. “Manufacturing Extension: Performance, Challenges and Policy Issues.” InInvesting in Innovation: Creating a Research and Innovation Policy That Works, ed. L. M. Branscomb and J. H. Keller. Cambridge, MA: MIT Press, 1998.
Shapira, P., and J. Youtie.Georgia Manufacturing Extension Alliance: Overview of the Evaluation Plan. Georgia Manufacturing Extension Alliance: Evaluation Working Paper E9401, Atlanta, GA: Georgia Institute of Technology, 1994.
Shapira, P., and J. Youtie. “Assessing the Impacts of Technology Deployment: A Benefit-Cost Analysis of the Georgia Manufacturing Extension Alliance.” Paper presented at Annual Meeting of the American Evaluation Association, Atlanta, GA, October 1996.
Shapira, P., J. Youtie, and J. D. Roessner. “Current Practices in the Evaluation of US Industrial Modernization Program.”Research Policy 25, 1996, pp. 185–214.
Yin, R. “Use of the Case Study Method for Evaluating the MEP Program: Discussion Paper in Support of MEP National Evaluation Strategic Planning Processes.” Paper prepared for the Manufacturing Extension Partnership, National Institute of Standards and Technology. Cosmos Corporation, Bethesda, MD, 1995.
Youtie, J. “GMEA Recommended Manufacturing Technologies Reduce Costs, Increase Production Output For Footwhere-USA Group, Inc.” GMEA Evaluation Paper E9604. Atlanta, GA: School of Public Policy and Economic Development Institute, Georgia Institute of Technology, 1996.
Youtie, J., and P. Shapira.Manufacturing Needs, Practices and Performance in Georgia: 1994 Georgia Manufacturing Technology Survey. GMEA Evaluation Paper E9501. Atlanta, GA: School of Public Policy and Economic Development Institute, Georgia Institute of Technology, 1995.
Youtie, J., and P. Shapira. “Tracking Customer Progress: A Follow-up Study of Customers of the Georgia Manufacturing Extension Alliance.”Journal of Technology Transfer 22(2), 1997a, pp. 43–52.
Youtie, J., and Shapira, P.Manufacturing Needs, Practices and Performance in Georgia: 1994–1998. GMEA Evaluation Paper E9703. Atlanta, GA: School of Public Policy and Economic Development Institute, Georgia Institute of Technology, 1997b.
Youtie, J. “Toward a Cross-case Analysis of Outcomes of Exemplary Engagements by MEP Centers.” InManufacturing Modernization: Learning from Evaluation Practices and Results, ed. Philip Shapira and Jan Youtie. Atlanta, GA: Georgia Institute of Technology, 1997, pp. 167–178.
Author information
Authors and Affiliations
Additional information
The views expressed in this paper are the authors' and not necessarily those of the Georgia Manufacturing Extension Alliance or its sponsoring organizations.
Rights and permissions
About this article
Cite this article
Shapira, P., Youtie, J. Evaluating industrial modernization: Methods, results, and insights from the Georgia Manufacturing Extension Alliance. J Technol Transfer 23, 17–27 (1998). https://doi.org/10.1007/BF02511612
Issue Date:
DOI: https://doi.org/10.1007/BF02511612