Research papers that have used, or refer to, the ISBSG repositories

The ISBSG welcomes submissions of papers that refer to the ISBSG or are based on ISBSG repository data.  To have a paper listed here please email details to:

“Sensitivity of results to different data quality meta-data criteria in the sample selection of projects from the ISBSG dataset”
M Fernández-Diego, M Martínez-Gómez, J Torralba-Martínez
Proceedings of the 6th International Conference on Predictive Models in Software Engineering, 2010

“Improvement Opportunities and Suggestions for Benchmarking”
C Gencel, L Buglione, A Abran
Proceedings of IWSM/MENSURA 2009, Amsterdam (Netherlands), November 4-6 2009, pp.144-156

“Using Chronological Splitting to Compare Cross- and Single-company Effort Models: Further Investigation”
C. Lokan & E. Mendes, January 2009
ACSC 2009 (32nd Australasian Computer Science Conference), Wellington, New Zealand

“Investigating the Use of Chronological Splitting to Compare Software Cross-company and Single-company Effort Predictions”
C. Lokan & E. Mendes
EASE 2008 (12th International Conference on Evaluation and Assessment in Software Engineering), Bari, Italy.  June 2008

“Replicating Studies on Cross- vs. Single-company Effort Models using the ISBSG Database”
E. Mendes & C. Lokan
Empirical Software Engineering, 13(1): 3-37. February 2008

“Impact of Base Functional Component Types on Software Functional Size based Effort Estimation”
L Buglione, C Gencel
Proceedings of PROFES 2008 Conference, Frascati, Rome (Italy), 23-25 June 2008, LNCS 5089, A.Jedlitschka & O.Salo (Eds.), pp.75-89!OpenDocument

” Maximizing data retention from the ISBSG repository”
Kefu Deng and Stephen G. MacDonell
EASE 2008 (12th International Conference on Evaluation and Assessment in Software Engineering), Bari, Italy. June 2008.

“Performance calculation and estimation with QEST/LIME using ISBSG r10 data”
L Buglione, A Abran
Proceedings of the 5th Software Measurement European Forum (SMEF 2008), Milan (Italy), 28-30 May 2008, ISBN 9-788870-909999, pp. 175-192

“The value and validity of software effort estimation models built from a multiple organization data set”
Kefu Deng
Masters thesis, University of Auckland, 2008

“Evaluation of a black-box estimation tool: a case study”
A Abran, I. Ndiaye and P. Bourque
Software Process Improvement and Practice 12, 2007, 199-218

“An Algorithm for the Generation of Segmented Parametric Software Estimation Models and its Empirical Evaluation”
Juan J. Cuadrado-Gallego, Miguel-Angel Sicilia
Computing and Informatics, Vol. 26, 2007, 1-15

“Comparación de diferentes algoritmos de clustering en la estimación de coste en el desarrollo de software”
Miguel Garre, Juan José Cuadrado, Miguel A. Sicilia, Daniel Rodríguez, Ricardo Rejas
Revista Española de Innovación, Calidad e Ingeniería del Software, Vol.3, No. 1, 2007

“Software Project Effort Estimation Based on Multiple Parametric Models Generated Through Data Clustering”
Juan J. Cuadrado Gallego, Daniel Rodríguezl, Miguel Ángel Sicilial, Miguel Garre Rubiol, Angel García Crespo
Journal of Computer Science and Technology 22(3): 371~378 May 2007

“A Measurement Approach Integrating ISO 15939, CMMI and ISBSG”
Luc Bégnoche, Alain Abran, Luigi Buglione
Software Measurement European Forum – SMEF2007, ISBN: 9-788870-909425, May 8-11 2007, Rome, Italy, pp. 111-130

“ISBSG Software Project Repository from the ISO 9126: Quality Perspective”
Laila Cheikhi, Alain Abran, Luigi Buglione
ASQ Software Quality Professional, American Society for Quality, Vol.9, No. 2, March 2007, pp. 4-22

“Using Genetic A1gorithms to Generate Estimation Models”
D. Rodriguez, J. J. Cuadrado-Gallego, J. Aguilar
Applied Software Measurement Conference, IWSM/MetriKon, Germany, 2-3 November 2006

“Cross-company and Single-company Effort Models using the ISBSG Database: a Further Replicated Study”
C. Lokan & E. Mendes
ISESE 2006 (International Symposium on Empirical Software Engineering), Rio de Janeiro, Brazil, September 2006

“ISBSG Software Project Repository & ISO 9126: An Opportunity for Quality Benchmarking”
Laila Cheikhi, Alain Abran, Luigi Buglione
European Journal for the Informatics Professional, Vol.7, No.1, February 2006, pp. 46-52 . Upgrade: ISSN 1684-5285 Novática: ISSN 0211-2124

“Convertibility of Function Points to COSMIC-FFP: Identification and Analysis of Functional Outliers”
Jean-Marc Desharnais, Alain Abran, Juan Cuadrado

“An empirical study of process related attributes in segmented software cost estimation relationships”
Juan J. Cuadrado-Gallego, Miguel-A´ngel Sicilia, Miguel Garre, Daniel Rodrýguez
The Journal of Systems and Software79(2006)353–361

“A Replicated Comparison of Cross-company and Within-company Effort Estimation Models using the ISBSG Database”
E. Mendes, C. Lokan, R. Harrison, C. Triggs
METRICS 2005 (11th International Software Metrics Symposium), Como, Italy, September 2005

“Obvious Outliers in the ISBSG Repository of Software Projects: Exploratory Research”
D Paré, A Abran
Metrics News, Otto Von Gueriske Universitat, Magdeburg (Germany), Vo. 10, no. 1, August, 2005, pp. 28-36

“Segmented Parametric Software Estimation Models: Using the EM Algorithm with the ISBSG 8 Database”
M. Garre, J.J. Cuadrado, M.A. Sicilia, M Charro, D Rodríguez
27th International Conference on Information Technology Interfaces, June 20-23, 2005 Croatia

“Investigation of the Effort Data Consistency in the ISBSG Repository”
David Déry, Alain Abran
15th International Workshop on Software Measurement – IWSM’2005, Montreal, Canada, Shaker-Verlag, 2005, pp. 123-136

“Assessing Variation in Development Effort Consistency Using a Data Source with Missing Data”
John Moses; Malcolm Farrow
Found in: Software Quality Journal, Volume 13, Issue 1, Mar 2005, Pages: 71-89

“Advances in Statistical Analysis from the ISBSG Benchmarking Database”
GUFPI-ISMA SBC (Software Benchmarking Committee).  Participating authors: Luca Santillo, Stefania Lombardi, Domenico Natale
SMEF 2005, Rome (Italy), March 2005
“Proposals for Project Collection & Classification from the Analysis of the ISBSG Benchmark Release 8”
Domenico Natalie, Luca Santillo, Italo Della Noce, Monica Lelli, Stephania Lombardi, Guido Moretto, Simonetta Ortona
IWSM 2004 (14th International Workshop on Software Measurement), Berlin (Germany), Nov. 3-5, 2004

“Modelos Segmentados De Estimacion Del Esfuerzo De Desarrollo Del Software: Un Caso De Estudio Con La Base De Datos ISBSG”
J. Cuadrado–Gallego
Revista de Procesos y Métricas de las Tecnologías de la Información (RPM) ISSN: 1698-2029, VOL. 1, Nº 2, Agosto 2004, 25-30, AEMES

“Contribution of Software Size in Effort Estimation”
A. Abran, I. Ndiaye and P.Bourque
Submitted for publication, Journal of Software Quality (2003)

“Software Project Effort Estimation Using Genetic Programming”
Y. Shan, R.I. McKay, C.J. Lokan and D.L. Essam
ICCCAS’02 (International Conference on Communications, Circuits and Systems), pages 1108-1112. Chengdu, China. July 2002

“Organizational Benchmarking Using the ISBSG Data Repository”
Chris Lokan, Terry Wright, Peter R. Hill, Michael Stringer
IEEE Software, pages 26-32, September/October 2001

“BRACE: BootstRap based Analogy Cost Estimation”
I. Stamelos, L. Angelis, E. Sakellaris,
Proc. 12th European Software Control Metrics, (ESCOM), to appear (April 2001)

“Function Point Analysis; Measurement Practices for Successful Software Projects”
D.Garmus, D.Herron
ISBN 0-201-69944-3
Addison-Wesley, Nov 2000, with David Herron

“An Empirical Analysis of Function Point Adjustment Factors”
C.J. Lokan
Information and Software Technology, 42(9):649-659, June 2000

“An Empirical Study of the Correlations Between Function Point Elements”
C.J. Lokan
METRICS 1999 (6th International Software Metrics Symposium), pages 200-206, Boca Raton FL, November 1999. IEEE

“Estimating Time, Effort, and Cost”
Software Testing & Quality Engineering, Nov/Dec 1999

“An Empirical Study of Elements in Function Point Analysis”
C. J. Lokan, March 1999

“Benchmarking Software Development Productivity” (published by IEEE)
Katrina D. Maxwell & Pekka Forselius, 1999
The abstract is available at .
A free copy can be requested from Katrina Maxwell at:

“An Empirical Study of the Correlations between Function Point Elements”
C. J. Lokan, April 1999

“An Empirical Analysis of Function Point Adjustment Factors”
C. J. Lokan, December 1998

“Building a Software Cost Estimation Model Based on Categorical Data”
L. Angelis, I. Stamelos, M. Morisio.
Proc. 8th IEEE International Symposium on Software Metrics.

“Controlling the Custom Software Development Cost of Information Systems for the Supply Chain: a Case Study”
I. Stamelos, L. Angelis, M. Morisio, E. Sakellaris, G. Bleris.

“Software cost estimation : assessments and practical user guide”.
Thomas Kessler ( ) supervised by Professor Frederic Geurts ( ).
The abstract is written in English and the thesis is written in French.  It can be downloaded from:

“Sizing Software with Testable Requirements”
Testable Requirements defined and their use as a software sizing measure (eg. function points and lines of code) discussed. Provides examples of the application of a testable requirements size measure. Includes other related articles also.
Email: Peter B Wilson Ph.D.

“Contribution of Software Size in Effort Estimation”
Alain Abran, Iphigenie Ndiaye, Pierre Bourque
Ecole de Technologie Superieure, Universite du Quebec, Canada