A Survey of Quality Assurance Practices in Biomedical Open Source Software Projects

Reviewer: Murray, Peter

Year of publication:	2007-05-07
Authors:	Koru, Günes ; El Emam, Khaled ; Neisa, Angelica ; Umarji, Medha
Publisher:	Gunther Eysenbach; Centre for Global eHealth Innovation, Toronto, Canada
Subject:	Original Paper \| Open source software \| medical informatics \| computational biology \| information systems \| software quality assurance \| software/program verification \| code inspections and walkthroughs \| software reliability

freely available

Open website |

More access options

More details

Type of publication:	Other
Language:	English
Notes:	Prada G, Roberts G, Vail S, Anderson M, Down E, Fooks G, Howaston A, Grimes K, Morgan S, Parent K, Sinclair D, Thompson V, Yalnizyan A. Understanding Health Care Cost Drivers and Escalators The Conference Board of Canada; Ottawa, ON. 2004. Prada G, Grimes K, McCleery A, Nguyen D, Pomey MP, Reed V, Stonebridge C, Roberts G. Challenging Health Care System Sustainability: Understanding Health System Performance of Leading Countries The Conference Board of Canada; Ottawa, ON. 2004. Irving R. Report on IT in Canadian Hospitals. Canadian Healthcare Technology 2003. Raymond B, Dold C. Clinical Information Systems: Achieving the Vision Kaiser Permanente Institute for Health Policy; Oakland, CA. 2002. Bates D, Ebell M, Gotlieb E, Zapp J, Mullins H. A proposal for electronic medical records in US primary care. J Am Med Inform Assoc 2003. Vol. 10(1) p. 1-10. Goulde M, Brown E. Open Source Software: A Primer for Health Care Leaders California HealthCare Foundation; Oakland, CA. 2006. Kantor Gareth S, Wilson Wayne D, Midgley Adrian. Open-source software and the primary care EMR. J Am Med Inform Assoc 2003. Vol. 10(6) p. 616. Giera J. The Costs and Risks of Open Source Forrester Research Inc; Cambridge, MA. 2004. Hunt F, Probert D, Barratt S. Adopting new technology: the case of open source software at Marconi. The 12th International Conference on Management of Technology (IAMOT May 12-15 2003) Nancy, France 2003. Dal Molin J. Open Source Software in Canada. A Collaborative Fact Finding Study. e-cology Corporation 2003. Dedrick J, West J. An exploratory study into open source platform adoption. Proceedings of the 37th Hawaii International Conference on System Sciences 2004. p. 10. DiDio L. Linux, Unix and Windows TCO Comparison, Part 1 The Yankee Group; Boston, MA. 2004. Valdes Ignacio, Kibbe David C, Tolleson Greg, Kunik Mark E, Petersen Laura A. Barriers to proliferation of electronic medical records. Inform Prim Care 2004. Vol. 12(1) p. 3-9. Kolata G. In unexpected Medicare benefit, US will offer doctors free electronic records system. New York Times Jul 21 2005. p. 14. Goldstein D, Ponkshe S, Maduro R. Analysis of Open Source Software (OSS) and EHRs: Profile of Increasing Use of OSS in the Federal Government and Healthcare Medical Alliances Inc; Atlantis, FL. 2004. Elsner C, Egbring M, Kottkamp H, Berger T, Zoller S, Hinricks G. Open source or commercial products for electronic data capture in clinical trials? A scorecard comparison. Comput Cardiol 2003. Vol. 30 p. 371-373. Erickson Bradley J, Langer Steve, Nagy Paul. The role of open-source software in innovation and standardization in radiology. J Am Coll Radiol Nov 2005. Vol. 2(11) p. 927-31. Gentleman RC, Carey VJ, Bates DM, Bolstad B, Dettling M, Dudoit S, Ellis B, Gautier L, Ge Y, Gentry J, Hornik K, Hothorn T, Huber W, Iacus S, Irizarry R, Leisch F, Li C, Maechler M, Rossini AJ, Sawitzki G, Smith C, Smyth G, Tierney L, Zha J. Yang JYH. Bioconductor: open software development for computational biology and bioinformatics. Genome Biol 2004. Vol. 5(10) p. R80. Stajich J. The Bioperl Project: A Look Ahead. Talk presented at: Bioinformatics Open Source Conference; August 1-2, Edmonton, Canada 2002. Pocock M. BioJava Toolkit Progress. Talk presented at: Bioinformatics Open Source Conference; August 1-2, 2002. Vol. Edmonton, Canada. URL McCormick J, Gage D. Cincinnati Children's Hospital: Shots in the Dark. Baseline. 2004 Aug 1. Gage D, McCormick J. Why Software Quality Matters: 'We Did Nothing Wrong'. Baseline. 2004 Mar 4. Basili V, Belady L, Boehm B, Brooks F, Browne J, DeMillo R, Feldman S, Green C, Lampson B, Lawrie D, Leveson N, Lynch N, Weiser M, Wing J. Final report: NSF workshop on a software research program for the 21st century. Software Eng Notes 1999. Vol. 24(3) p. 37-45. Report of the Inquiry into the London Ambulance Service. South West Thames Regional Health Authority; UK. 1993. van Heusden P. Applying Software Validation Techniques to Bioperl. Talk presented at: Bioinformatics Open Source Conference; July 29-30, 2004. Vol. Glasgow, UK. URL Konrad M, Shrum S. Chrissis M-B. Guidelines for Process Integration and Product Improvement. Addison-Wesley; CMMI. 2003. Raymond ES. Musings on Linux and Open Source by an Accidental Revolutionary. O'Reilly; The Cathedral and the Bazaar. 1999. Greiner S, Boskovic B, Brest J, Zumer V. Security issues in information systems based on open source technologies. EUROCON 2003. p. 12-15. El Emam K. Software Inspection Best Practices. In: Agile Project Management Advisory Service, Executive Report. Volume 2. Number 9 Cutter Consortium; Arlington, MA. 2001. Bagchi S, Madeira H. 14th International Symposium on Software Reliability Engineering (ISSRE) 2003; Open source software - a recipe for vulnerable software, or the only way to keep the bugs and the bad guys out? Panel position statement presented at. 1234. Jorgensen N. Putting it all in the trunk: incremental software development in the FreeBSD open source project. Inform Syst J 2001. Vol. 11(4) p. 321-336. Stark J. Peer reviews as a quality management technique in open-source software development projects. European Conference on Software Quality 2002. p. 340-350. Maccormack A, Kemerer C, Cusumano M, Crandall B. Trade-offs between productivity and quality in selecting software development practices. IEEE Software 2003. Vol. (5) p. 78-84. Cusumano M, MacCormack A, Kemerer C, Randall B. the state of the practice. IEEE Software 2003; Software development worldwide. 1234. Zhao L, Elbaum S. A survey on quality related activities in open source. Software Eng Notes 2000. Vol. 25(3) p. 54-57. Porter A, Siy H, Toman C, Votta L. An experiment to assess the cost-benefits of code inspections in large scale software development. IEEE T Software Eng 1997. Vol. 23(6) p. 329-346. STD I. IEEE Standard for Software Reviews and Audits. ANSI/IEEE STD 1028-1988 1989. p. . Ackerman AF, Buchwald LS, Lewski FH. Software inspections: an effective verification process. IEEE Software 1989. Vol. 6(3) p. 31-36. Lau L, Jeffery R, Sauer C. Some Empirical Support for Software Development Technical Reviews University of New South Wales; Sydney, Australia. 1996. Grady RB. Practical Software Metrics for Project Management and Process Improvement Prentice-Hall; Englewood Cliffs, NJ. 1992. Laitenberger O, Debaud JM. An encompassing life-cycle centric survey of software inspection. J Syst Software 2000. Vol. 50(1) p. 5-31. Fagan ME. Design and code inspections to reduce errors in program development. IBM Syst J 1976. Vol. 15(3) p. 182-211. Weller EF. Lessons from three years of inspection data. IEEE Software 1993. Vol. 10(5) p. 38-45. Madachy R, Little L, Fan S. Analysis of a successful inspection program. Proceedings of the 18th Annual NASA Software Engineering Laboratory Workshop 1993. p. 176-188. Gilb T, Graham D. Software Inspection Addison-Wesley; New York. 1993. Strauss S, Ebenau R. Software Inspection Process McGraw Hill; New York. 1994. Kelly J, Sheriff J, Hops J. An analysis of defect densities found during software inspections. J Syst Software 1992. Vol. 17(2) p. 111-117. Johnson P. Reengineering inspection. Comm ACM 1998. Vol. 41(2) p. 49-52. Eick S, Loader C, Long M, Votta L, Weil SV. Estimating software fault content before coding. Proceedings of the 14th International Conference on Software Engineering 1992. p. 59-65. Dunsmore A, Roper M, Wood M. The development and evaluation of three diverse techniques for object-oriented code inspection. IEEE T Software Eng 2003. Vol. 29(8) p. 677-686. Halloran T, Scherlis WL. High quality and open source software practices. Position paper presented at: The Second Workshop on Open Source Software Engineering, International Conference on Software Engineering; May 19-25, 2002. Vol. Orlando, FL. URL Gacek C, Arief B. The many meanings of open source. IEEE Software 2004. Vol. 21(1) p. 34-40. Zhao L, Elbaum S. Quality assurance under the open source development model. J Syst Software 2003. Vol. 66(1) p. 65-75. Mockus A, Fielding R, Herbsleb J. Two case studies of open source software development: Apache and Mozilla. ACM T Softw Eng Meth 2002. Vol. 11(3) p. 309-346. Sharma S, Sugumaran V, Rajagoplan B. A framework for creating hybrid open source software communities. Inform Syst J 2002. Vol. 12(1) p. 7-25. Erenkrantz J. Release management within open source projects. Proceedings of the Third Workshop on Open Source Software Engineering, Portland, OR 2003. Thomas C. Improving verification, validation, and test of the Linux kernel: the Linux stabilization project. Proceedings of the Third Workshop on Open Source Software Engineering Portland, OR. 2003. Iyer M. Analysis of Linux test project's kernel code coverage IBM Corporation; Austin, TX. 2002. Myers G. A controlled experiment in program testing and code walkthroughs/inspections. Comm ACM 1978. Vol. 21(9) p. 760-768. Basili V, Selby R. Comparing the effectiveness of software testing strategies. IEEE T Software Eng 1987. Vol. 13(12) p. 1278-1296. Kamsties E, Lott C. An empirical evaluation of three defect-detection techniques. Proceedings of the 5th European Software Engineering Conference, Sitges, Spain, September 25-28, 1995. Wood M, Roper M, Brooks A, Miller J. Comparing and combining software defect-detection techniques. Proceedings of the 6th European Conference on Software Engineering 1997. p. 262-277. Jalote P, Haragopal M. Overcoming the NAH Syndrome for Inspection Deployment. Proceedings of the International Conference on Software Engineering 1998. p. 371-378. Hissam S, Weinstock C, Plakosh D, Asundi J. Perspectives on Open Source Software. CMU/SEI-2001-TR-019 Carnegie Mellon Software Engineering Institute; Pittsburg, PA. 2001. Mockus A, Fielding RT, Herbsleb J. The Apache server.. Proceedings of the 22nd International Conference on Software Engineering A case study of open source software development. 2000. p. 263-272. Miller B, Fredriksen L, So B. An Empirical Study of the Reliability of Unix Utilities. Comm ACM 1990. Vol. 33(12) p. 32-44. Capiluppi A, Lago P, Morisio M. Characteristics of open source projects. Proceedings of the Seventh European Conference on Software Maintenance and Engineering; 2003. Vol. p. 317. Hunt F, Johnson P. On the Pareto Distribution of Sourceforge Projects Cambridge University; Cambridge, UK. 2003. Dinh-Trong T, Bieman J. The FreeBSD project: a replication case study of open source development. IEEE T Software Eng 2005. Vol. 31(6) p. 481-494. Stark JE. Peer Reviews in Open-Source Software Development Griffith University; Australia. 2001. SourceForge Home page. sourceforge.net FreshMeat Home page. freshmeat.net BioMed Central Home page. biomedcentral.com Koru AG, Tian J. Defect Handling in Medium and Large Open Source Projects. IEEE Software 2004. Vol. 21(4) p. 54-61. Kreft I, Yoon B. Are multilevel techniques necessary? An attempt at demystification. Annual Meeting of the American Educational Research Association; April 4-8, New Orleans, LA. 1994. Maas C, Hox J. Sufficient Sample Sizes for Multilevel Modeling. Methodology 2005. Vol. 1(3) p. 86-92. Hosmer D, Lemeshow S. Applied Logistic Regression John Wiley & Sons; New York. 1989. Schonlau M, Fricker RD, Elliott MN. Conducting Research Surveys via E-mail and the Web RAND Corporation; Santa Monica, CA. 2002. Hars A, Ou S. Working for free? Motivations for participating in open source projects. Int J Electron Comm 2002. Vol. 6(3) p. 25-39. Hars A, Ou S. Working for free? Motivations of participating in open source projects. Proceedings of the 34th Hawaii International Conference on System Sciences 2001. Vol. 7 p. 7014. Lakhani K, Wolf R. Why hackers do what they do: understanding motivation and effort in free/open source software projects Feller J, Fitzgerald B, Hissam S, Lakhani K, editors. Perspectives on Free and Open Source Software. Cambridge, MA; The MIT Press; In. 2005. Lindner JR, Murphy TH, Briers GE. Handling nonresponse in social science research. J Agr Educ 2001. Vol. 42(4) p. 43-53. Siegel S, Castellan J. Nonparametric Statistics for the Behavioral Sciences McGraw Hill; New York. 1988. Eysenbach Gunther. Improving the quality of Web surveys: the Checklist for Reporting Results of Internet E-Surveys (CHERRIES). J Med Internet Res Sep 29, 2004. Vol. 6(3) p. e34. Serlin R, Levin J. Teaching how to derive directly interpretable coding schemes for multiple regression analysis. J Educ Stat 1985. Vol. 10(3) p. 223-238. Wendorf C. Primer on multiple regression coding: Common forms and the additional case of repeated contrasts. Understand Stat 2004. Vol. 3(1) p. 47-57. Robles G, Scheider H, Tretkowski I, Weber N. Who is doing it? A research on Libre Software developers Technical University of Berlin; Berlin, Germany. 2001. Lakhani K, Wolf B, Bates J, DiBona C. The Boston Consulting Group hacker survey. O'Reilly Open Source Conference; July 22-26, 2002. Vol. San Diego, CA. URL Hertel G, Niedner S, Herrmann S. Motivation of software developers in open source projects: an Internet-based survey of contributors to the Linux kernel. Res Pol 2003. Vol. 32(7) p. 1159-1177. Briand L, El Emam K, Laitenberger O, Fussbroich T. Using simulation to build inspection efficiency benchmarks for development projects. Proceedings of the 20th International Conference on Software Engineering 1998. p. 340-349. Wohlin C, Aurum A, Petersson H, Shull F, Ciolkowski M. Software inspection benchmarking - a qualitative and quantitative comparative opportunity. METRICS '02 Proceedings of the 8th International Symposium on Software Metrics 2002. p. 118-127. Runeson P, Wohlin C. An experimental evaluation of an experience-based capture-recapture method in software code inspections. Empir Softw Eng 1998. Vol. 3(4) p. 381-406. Sauer C, Jeffery R. Land LPW. Validating the defect detection performance advantage of group designs for software reviews: report of a laboratory experiment using program code. ESEC '97/FSE-5: Proceedings of the 6th European conference held jointly with the 5th ACM SIGSOFT international symposium on Foundations of software engineering 1997. p. 294-309-309. Porter A, Siy H, Toman C, Votta L. An experiment to assess the cost-benefits of code inspections in large scale software development. Proceedings of the 3rd ACM SIGSOFT Symposium on Foundations of Software Engineering 1995. Vol. p. 92-103. The Good Automated Manufacturing Practice (GAMP) Guide for Validation of Automated Systems in Pharmaceutical Manufacture. International Society for Pharmaceutical Engineering; Tampa, FL. 2002.
Other identifiers:	10.2196/jmir.9.2.e8 [DOI]
Source:	BASE

Persistent link: https://www.econbiz.de/10009455316

A service of the