Should Economists Use Open Source Software for Doing Research?
- 237 Downloads
We survey the literature on the accuracy of econometric software. We also assess the advantages of open source software from the point of view of reliability and discuss its potential in applied economics, which has now become fully dependent on computers. As a case study, we apply various accuracy tests on GNU Regression, Econometrics and Time-series Library (gretl) and demonstrate that the open source nature of the program made it possible to see the cause, facilitated a rapid fix, and enabled verifying the correction of a number of flaws that we uncovered. We also run the same tests on four widely-used proprietary econometric packages and observe the known accuracy errors that remained uncorrected for more than 5 years.
KeywordsOpen source Econometric software Gretl Accuracy Software reliability
Unable to display preview. Download preview PDF.
- Altman M., McDonald M. P. (2001) Choosing reliable scientific software. PS: Political Science and Politics 34: 681–687Google Scholar
- Altman M., Gill J., McDonald M. P. (2004) Numerical issues in statistical computing for the social scientist (1st ed.). Wiley, New JerseyGoogle Scholar
- Boehm B. W. (1981) Software engineering economics (1st ed.). Prentice Hall, New JerseyGoogle Scholar
- Boehm B. W., Abts C., Brown A. W., Chulani S., Clark B. K., Horowitz E., Madachy R., Reifer D. J., Steece B. (2000) Software cost estimation with Cocomo II (1st ed.). Prentice Hall, New JerseyGoogle Scholar
- Bruno G., Bonis R. D. (2004) A comparative study of alternative econometric packages with an application to Italian deposit interest rates. Journal of Economic and Social Measurement 29: 271–295Google Scholar
- Cryer J. D., Chan K. S. (2008) Time series analysis: With applications in R (2nd ed.). Springer, New York, NYGoogle Scholar
- Heiser, D. A. (2006). Microsoft Excel 2000 and 2003 faults, problems, workarounds and fixes. Computational Statistics and Data Analysis, 51, 1442–1443. http://www.daheiser.info/excel/frontpage.html.
- Kitchen A. M., Drachenberg R., Symanzik J. (2003) Assessing the reliability of web-based statistical software. Computational Statistics 18: 107–122Google Scholar
- Kleiber C., Zeileis A. (2008) Applied Econometrics with R (1st ed.). Springer, New York, NYGoogle Scholar
- Knüsel L. (1996) Telegrams. Computational Statistics and Data Analysis 21: 116Google Scholar
- Knüsel L. (2002) On the reliability of Microsoft Excel XP for statistical purposes. Computational Statistics and Data Analysis 39: 109–110Google Scholar
- Koch, A., & Haag, U. (1995). The statistical software guide ‘94/95. A. Koch & U. Haag (Eds.). Computational Statistics and Data Analysis, 19, 237–261.Google Scholar
- Lucchetti, R. (2009). Who uses gretl? An analysis of the SourceForge download data. In Econometrics with gretl. Proceedings of the gretl conference 2009, Bilbao, Spain (pp. 45–55).Google Scholar
- Maurer S. M., Scotchmer S. (2006) Open source software: The new IP paradigm. In: Hendershott T. (eds) Handbook of economics and information systems. Elsevier, Amsterdam, pp 285–319Google Scholar
- McCullough, B. D. (2001). Does Microsoft fix errors in Excel? In Proceedings of the 2001 joint statistical meetings. Alexandria, VA: American Statistical Association.Google Scholar
- McCullough, B. D. (2004a). Fixing statistical errors in spreadsheet software: The cases of Gnumeric and Excel. CSDA Statistical Software Newsletter. Retrieved December 10, 2008, from http://www.csdassn.org/software_reports/gnumeric.pdf.
- McCullough B. D. (2004b) Wilkinson’s tests and econometric software. Journal of Economic and Social Measurement 29: 261–270Google Scholar
- McCullough B. D. (2009) Testing econometric software. In: Mills T. C., Patterson K. (eds) Handbook of econometrics. Pargrave, New York, pp 1293–1320Google Scholar
- McCullough B. D., Renfro C. G. (1998) Benchmarks and software standards: A case study of GARCH procedures. Journal of Economic and Social Measurement 25: 59–71Google Scholar
- McCullough B. D., Vinod H. D. (1999) The numerical reliability of econometric software. Journal of Economic Literature 37: 633–655Google Scholar
- Nerlove M. (2004) Programming languages: A short history for economists. Journal of Economic and Social Measurement 29: 189–203Google Scholar
- Renfro C. G. (2004a) A compendium of existing econometric software packages. Journal of Economic and Social Measurement 29: 359–409Google Scholar
- Renfro C. G. (2004b) Econometric software: The first fifty years in perspective. Journal of Economic and Social Measurement 29: 9–107Google Scholar
- Rosenblad, A. (2008). Gretl 1.7.3. Journal of Statistical Software, 25, 19. http://www.jstatsoft.org/v25/s01.
- Schwarz, M., & Takhteyev, Y. (to appear). Half a century of public software institutions: Open source as a solution to the hold-up problem. Journal of Public Economic Theory.Google Scholar
- Stokes H. H. (2004) On the advantage of using two or more econometric software systems to solve the same problem. Journal of Economic and Social Measurement 29: 307–320Google Scholar
- Vinod H. D. (2008) Hands-on intermediate econometrics using R (1st ed.). World Scientific Publishing Company, New JerseyGoogle Scholar
- West J. (2003) How open is open enough? melding proprietary and open source platform strategies. Reseach Policy 32: 1258–1286Google Scholar
- Wilkinson L. (1985) Statistics quiz: Problems which reveal deficiencies in statistical programs (1st ed.). SYSTAT, Evanston, ILGoogle Scholar
- Wilkinson, L. (1994). Practical guidelines for testing statistical software. In P. Dirschedl & R. Ostermann (Eds.), Computational statistics, 25th conference on statistical computing at Schloss Reisenburg. Physica, Verlag.Google Scholar