Papers/Pubs for our class: divided into four areas

• Area I: Overview of Empirical Software Engineering (ESE).
• Area II: Risk Identification in ESE.
• Area III: Hypothesis Testing
• Area IV: Current and Future Trends etc. in ESE.

Area I: ESE Overview

1. B. Kitchenham, S. L. Pfleeger, L. M. Pickard, P. W. Jones, D. C. Hoaglin, K. E. Emam, and J. Rosenberg. Preliminary guidelines for empirical research in software engineering. IEEE Trans. on Software Engineering, 28(8):721--734, Aug. 2002.
2. S. L. Pfleeger and L. Hatton. Investigating the influence of formal methods. IEEE Computer, 30(2):33--43, Feb. 1997.
3. V. R. Basili and H. D. Rombach. The TAME project: Towards improvement-oriented software environments. IEEE Trans. on Software Engineering, 14(6):758--773, June 1988.
4. Here is a paper on EF, or Experience Factory, by Basili et al., recommended by Prema Krishnaswamy.
5. J. Tian, An Emerging Experience Factory to Support High-quality Applications Based on Software Components and Services. Journal of Software, Vol.6, No.2, pp.289-297, Feb., 2011.
6. J. Tian, "Measurement and Continuous Improvement of Software Reliability throughout Software Life-cycle", Journal of Systems and Software, Vol. 47, Nos.2-3, pp.189-195, July, 1999.
   (Paper available in BlackBoard, and here is the set of slides for the paper)

   (Broader pictures/linkage: ESE)

7. Jeff Tian, "Software Quality Engineering: Testing, Quality Assurance, and Quantifiable Improvement", John Wiley and Sons, Inc. and IEEE Computer Society Press, 2005. ISBN: 0-471-71345-7.
   Complete set of slides for the above book is available online.
8. A. A. Avizienis, J.-C. Laprie, B. Randell, and C. Landwehr. Basic concepts and taxonomy of dependable and secure computing. IEEE Transactions on Dependable and Secure Computing, Vol.1, No.1, pp.11-33, Jan., 2004.
9. M.F. Siok and J. Tian, "Empirical Study of Embedded Software Quality and Productivity", 10th IEEE Int. Symposium on High Assurance Systems Engineering (HASE'07), Dallas, TX, pp.313-320, Nov., 2007.
   (Available in BlackBoard, and here is the set of slides for the paper).
10. M.F. Siok, C.J. Whittaker and J. Tian, "Exposing Software Field Failures", CrossTalk: The Journal of Defense Software Engineering, Vol.19, No.11, pp.15-20, Nov., 2006.

Area II: Risk Identification in ESE

(more quantitative)
1. J. Tian. Risk identification techniques for defect reduction and quality improvement. Software Quality Professional, 2(2):32--41, Mar. 2000.
   Alternatively, read Tian/SQE Book (see above), Chapter 21.
2. T. M. Khoshgoftaar, E. B. Allen, K. S. Kalaichelvan and N. Goel, Early quality prediction: A case study in telecommunications. IEEE Software, pages 65--71, Jan. 1996.
3. T. M. Khoshgoftaar, A. S. Pandya, and D. L. Lanning. Application of neural networks for predicting program faults. Annals of Software Engineering, 1:141--154, Sept. 1995.
4. J. Tian, A. Nguyen, C. Allen, and R. Appan. Experience with identifying and characterizing problem prone modules in telecommunication software systems. Journal of Systems and Software, 57(3):207--215, July 2001.
5. J. Troster and J. Tian. "Measurement and Defect Modeling for a Legacy Software System". Annals of Software Engineering. Vol.1, pp.95-118, Sept., 1995.
6. L. C. Briand, V. R. Basili, and C. J. Hetmanski. Developing interpretable models with optimal set reduction for identifying high-risk software components. IEEE Trans. on Software Engineering, 19(11):1028--1044, Nov. 1993.

   (More qualitative)

7. Janne Ropponen and Kalle Lyytinen, "Components of Software Development Risk; How to Address Them? A Project Manager Survey", IEEE Transaction on Software Engineering, Feb. 2000, pp. 98-112.
8. Hoodat, Hooman, and Hassan Rashidi. "Classification and analysis of risks in software engineering." World Academy of Science, Engineering and Technology, Volume 56: 446-452 (2009).
9. "Analysis of pervasive multiple-component defects in a large software system", Zude Li et el. from IEEE International Conference on Software Maintenance
10. D. N. Card. Learning from our mistakes with defect causal analysis. IEEE Software, 15(1):56--63, Jan. 1998.

Area III: Hypothesis Testing (some formal, some informal)

1. A. A. Porter, H. P. Siy, C. A. Toman, and L. G. Votta. An experiment to assess the cost-benefits of code inspection in large scale software development. IEEE Trans. on Software Engineering, 23(6):329--346, June 1997.
2. A.G. Koru and J. Tian, "Comparing High-Change Modules and Modules with the Highest Measurement Values in Two Large Scale Open-Source Products", IEEE Trans. on Software Engineering, Vol.31, No.8, pp.625-642, Aug., 2005.
3. A.G. Koru and J. Tian, "An Empirical Comparison and Characterization of High Defect and High Complexity Modules", Journal of Systems and Software, Vol.67, No.3, pp.153-163, Sep., 2003.
4. J. D. Arthur, M. K. Groner, K. J. Hayhurst, and C. M. Holloway. Evaluating the effectiveness of independent verification and validation. IEEE Computer, 32(10):79--83, Oct. 1999.
5. L. Prechelt. An empirical comparison of seven programming languages. IEEE Computer, 33(10):23--29, Oct. 2000.
6. Lutz Prechelt, Barbara Uner-Lamprecht, Michael Philippsen, Walter F. Tichy, "Two controlled experiments assessing the usefulness of design pattern documentation in program maintenance", IEEE Transactions on Software Engineering, Vol. 28, No. 6, JUNE 2002 PP.595-606.
7. J.C. Jacobs, J.H. van Moll, P.J. Krause, R.J. Kusters, and J.J.M. Trienekens: "Effects of Virtual Development on Product Quality: Exploring Defect Causes", Proceedings of the Eleventh Annual International Workshop on Software Technology and Engineering Practice (STEP.04)
8. K. E. Emam and O. Laitenberger. Evaluating capture-recapture models with two inspectors. IEEE Trans. on Software Engineering, 27(9):851--864, Sept. 2001.
9. J. Tian and J. Troster. "A Comparison of Measurement and Defect Characteristics of New and Legacy Software Systems", Journal of Systems and Software, Vol. 44, No. 2, pp.135-146, Dec., 1998.
10. J. Tian, A. Nguyen, C. Allen, and R. Appan, "Experience with Identifying and Characterizing Problem Prone Modules in Telecommunication Software Systems", Journal of Systems and Software, Vol. 57, No.3, pp.207-215, July, 2001.

Area IV: Current/Future Trends etc. in ESE

(Data issues)
1. L. Huang, V. Ng, I. Persing, R. Geng, X. Bai, J. Tian, "AutoODC: Automated Generation of Orthogonal Defect Classifications", 26th IEEE/ACM International Conference on Automated Software Engineering (ASE 2011), Lawrence, Kansas, Nov., 2011.
2. Ingunn Mrytveit, Erik Stensrud, and Ulf H. Olsson, "Analyzing Data Sets with Missing Data: Empirical Evaluation of Imputation Methods and Likelihood Based Methods " IEEE Transactions on Software Engineering, November 2001, Vol. 27, No. 11.
3. J. Tian, "Better Reliability Assessment and Prediction through Data Clustering", IEEE Trans. on Software Engineering, Vol.28, No.10, pp.997-1007, Oct., 2002.
4. Kumaresh, S., and Baskaran, R. (2010). "Defect Analysis and Prevention for Software Process Quality Improvement". International Journal of Computer Applications, 8(7), 42-47.
5. J. Tian, J. Troster and J. Palma. "Tool Support for Software Measurement, Analysis, and Improvement", Journal of Systems and Software. Vol.39, No.2, pp.165-178, Nov., 1997.
6. "Improving Software Reliability and Productivity via Mining Program Source Code", by Tao Xie, Mithun Acharya, Suresh Thummalapenta, and Kunal Taneja.

   (New application domains)

7. Z. Li, N. Alaeddine and J. Tian, "Multi-Faceted Quality and Defect Measurement for Web Software and Source Contents", Journal of Systems and Software, Vol.83, No.1, pp.18-28, Jan., 2010.
8. L. Ma and J. Tian, "Web Error Classification and Analysis for Reliability Improvement", Journal of Systems and Software, Vol.80, No.6, pp.795-804, June, 2007.
9. A.G. Koru and J. Tian, "Defect Handling in Medium and Large Open-Source Software Projects", IEEE Software, Vol.21, No.4, pp.54-61, July/August, 2004.
10. Miao Jiang; Munawar, M.A.; Reidemeister, T.; Ward, P.A.S.; , "Efficient Fault Detection and Diagnosis in Complex Software Systems with Information-Theoretic Monitoring," Dependable and Secure Computing, IEEE Transactions on , vol.8, no.4, pp.510-522, July-Aug. 2011 doi: 10.1109/TDSC.2011.16
11. "Self-checking Software: Improving the Quality of Mission-Critical Systems" by Reinhart, T.; Boettcher, C.; Tomashefsky, S.; Digital Avionics Systems Conference, 1999. Proceedings. 18th , vol.1/17 pp.2.D.4-1-2.D.4-7, Nov 1999
12. "Issues with Object Orientation in verifying Safety-Critical Systems" - IEEE ISORC 2003.
13. "A Model-Driven Approach to Assuring Process Reliability" by Ibrahim Habil and Tim Kelly, 2008 19th International Symposium on Software Reliability Engineering.
14. J. Tian, S. Nair, L. Huang, N, Alaeddine and M.F. Siok, "Developing Dependable Systems by Maximizing Component Diversity", In J. Dong, R. Paul and L.-J. Zhang, editors, High Assurance Services Computing, pp.193-217, Springer-Verlag, 2009,

    (Some new models)

15. Ingunn Myrtveit and Erik Stensrud. "A Controlled Experiment to Assess the Benefits of Estimating with Analogy and Regression Models", IEEE TSE, Vol. 25, No4, July/August 1999.
16. Sharma, K., Garg, R., Nagpal, C. K., and Garg, R.K. "Selection of Optimal Software Reliability Growth Models Using a Distance Based Approach". IEEE Transactions on Reliability, Vol. 59(2). June 2010. pp. 266-276.
17. "Software reliability prediction by soft computing techniques", by N.R. Kiran and V. Ravi, J. of Systems and Software, May, 2007.
18. S. Cardenas, J. Tian and M.V. Zelkowitz. "An Application of Decision Theory for the Evaluation of Software Prototypes". Journal of Systems and Software, Vol.19, No.1, pp.27-39, Sept., 1992.