Dr Handan Gul Calikli
- Lecturer in Software Engineering (School of Computing Science)
email:
HandanGul.Calikli@glasgow.ac.uk
School of Computing Science, University of Glasgow, Sir Alwyn Williams Building, Lilybank Gardens Glasgow SCOTLAND, G12 8QQ
Biography
I am a Lecturer (Assistant Professor) in Software Engineering at the School of Computing Science, University of Glasgow, United Kingdom. I obtained my Ph.D. and M.Sc. degrees in Computer Engineering and B.Sc. degree in Mechanical Engineering from Boğaziçi University, Istanbul. After my Ph.D., I worked as a postdoc fellow at The Open University, United Kingdom, and Ryerson University, Canada, and later as a lecturer (biträdande universitetslektor) at Chalmers | University of Gothenburg, Sweden. Before joining School of Computing at the University of Glasgow, I was a senior researcher in Zurich Empirical Software Engineering Team (ZEST) at the Department of Informatics, University of Zurich (UZH), Switzerland.
Personal Website: https://gulcalikli.github.io/
Research interests
Research Interests
- Empirical Software Engineering (SE)
- Human Aspects in SE
- Program Comprehension
- Data Analytics for SE
Further details about my research are available on my personal website
Publications
2022
Fregnan, E., Braz, L., D’Ambros, M., Calikli, G. and Bacchelli, A. (2022) First come first served: The impact of file position on code review. In: ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2022), Singapore, 14-18 November 2022, pp. 483-494. ISBN 9781450394130 (doi: 10.1145/3540250.3549177)
Gonçalves, P. W., Çalıklı, G. , Serebrenik, A. and Bacchelli, A. (2022) Competencies for Code Review. In: 26th ACM Conference On Computer-Supported Cooperative Work And Social Computing (CSCW2023), Minneapolis, MN, USA, 13-18 October 2022, (Accepted for Publication)
Braz, L., Aeberhard, C., Çalikli, G. and Bacchelli, A. (2022) Less is More: Supporting Developers in Vulnerability Detection during Code Review. In: 44th International Conference on Software Engineering (ICSE 2022), Pittsburgh, PA, USA, 22-27 May 2022, pp. 1317-1329. ISBN 9781450392211 (doi: 10.1145/3510003.3511560)
Gonçalves, P. W., Çalıklı, G. and Bacchelli, A. (2022) Interpersonal Conflicts During Code Review: Developers' Experience and Practices. In: 25th ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW 22), 12 - 16 November 2022, p. 98. (doi: 10.1145/3512945)
2021
Braz, L., Fregnan, E., Çalikli, G. and Bacchelli, A. (2021) Why Don’t Developers Detect Improper Input Validation? '; DROP TABLE Papers; --. In: 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE), 22-30 May 2021, pp. 499-511. ISBN 9781665402965 (doi: 10.1109/ICSE43902.2021.00054)
2020
Spadini, D., Çalikli, G. and Bacchelli, A. (2020) Primers or Reminders? The Effects of Existing Review Comments on Code Review. In: ACM/IEEE 42nd International Conference on Software Engineering, 27 Jun - 29 Jul 2020, pp. 1171-1182. ISBN 9781450371216 (doi: 10.1145/3377811.3380385)
2019
Alahdab, M. and Çalıklı, G. (2019) Empirical analysis of hidden technical debt patterns in machine learning software. In: Franch, X., Männistö, T. and Martínez-Fernández, S. (eds.) Product-Focused Software Process Improvement: 20th International Conference, PROFES 2019, Barcelona, Spain, November 27–29, 2019, Proceedings. Series: Lecture notes in computer science (11915). Springer: Cham, pp. 195-202. ISBN 9783030353322 (doi: 10.1007/978-3-030-35333-9_14)
Krüger, J., Çalıklı, G. , Berger, T., Leich, T. and Saake, G. (2019) Effects of Explicit Feature Traceability on Program Comprehension. In: 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2019), Tallinn, Estonia, 26-30 Aug 2019, pp. 338-349. ISBN 9781450355728 (doi: 10.1145/3338906.3338968)
2018
Tuma, K., Calikli, G. and Scandariato, R. (2018) Threat analysis of software systems: a systematic literature review. Journal of Systems and Software, 144, pp. 275-294. (doi: 10.1016/j.jss.2018.06.073)
Kasauli, R., Knauss, E., Kanagwa, B., Nilsson, A. and Calikli, G. (2018) Safety-Critical Systems and Agile Development: a Mapping Study. In: 2018 44th Euromicro Conference on Software Engineering and Advanced Applications (SEAA), Prague, Czech Republic, 29-31 Aug 2018, pp. 470-477. ISBN 9781538673836 (doi: 10.1109/SEAA.2018.00082)
Steghöfer, J.-P., Burden, H., Hebig, R., Calikli, G. , Feldt, R., Hammouda, I., Horkoff, J., Knauss, E. and Liebel, G. (2018) Involving external stakeholders in project courses. ACM Transactions on Computing Education, 18(2), 8. (doi: 10.1145/3152098)
Calikli, G. , Al-Eryani, M., Baldebo, E., Horkofff, J. and Ask, A. (2018) Effects of Automated Competency Evaluation on Software Engineers' Emotions and Motivation: a Case Study. In: 3rd International Workshop on Emotion Awareness in Software Engineering (SEmotion '18), Gothenburg, Sweden, 02 Jun 2018, pp. 44-50. ISBN 9781450357517 (doi: 10.1145/3194932.3194939)
Çalikli, G. , Staron, M. and Meding, W. (2018) Measure Early and Decide Fast: Transforming Quality Management and Measurement to Continuous Deployment. In: 2018 International Conference on Software and System Process (ICSSP '18), Gothenburg, Sweden, 26-27 May 2018, pp. 51-60. ISBN 9781450364591 (doi: 10.1145/3202710.3203156)
Perera, C., Vasilakos, A. V., Calikli, G. , Sheng, Q. Z. and Li, K.-C. (2018) Guest editorial special section on engineering industrial big data analytics platforms for Internet of Things. IEEE Transactions on Industrial Informatics, 14(2), pp. 744-747. (doi: 10.1109/TII.2017.2788080)
2017
Rafiq, Y., Dickens, L., Russo, A., Bandara, A. K., Yang, M., Stuart, A., Levine, M., Calikli, G. , Price, B. A. and Nuseibeh, B. (2017) Learning to Share: Engineering Adaptive Decision-Support for Online Social Networks. In: 2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE), Urbana, IL, USA, 30 Oct - 03 Nov 2017, pp. 280-285. ISBN 9781538626849 (doi: 10.1109/ASE.2017.8115641)
Price, B. A., Stuart, A., Calikli, G. , Mccormick, C., Mehta, V., Hutton, L., Bandara, A. K., Levine, M. and Nuseibeh, B. (2017) Logging you, logging me: a replicable study of privacy and sharing behaviour in groups of visual lifeloggers. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 1(2), 22. (doi: 10.1145/3090087)
2016
Calikli, G. , Law, M., Bandara, A. K., Russo, A., Dickens, L., Price, B. A., Stuart, A., Levine, M. and Nuseibeh, B. (2016) Privacy Dynamics: Learning Privacy Norms for Social Software. In: 2016 IEEE/ACM 11th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS), Austin, TX, USA, 16-17 May 2016, pp. 47-56. ISBN 9781450341875 (doi: 10.1145/2897053.2897063)
2015
Calikli, G. and Bener, A. (2015) Empirical analysis of factors affecting confirmation bias levels of software engineers. Software Quality Journal, 23(4), pp. 695-722. (doi: 10.1007/s11219-014-9250-6)
2014
Calikli, G. , Andersen, M. S., Bandara, A., Price, B. and Nuseibeh, B. (2014) Personal Informatics for Non-geeks: Lessons Learned From Ordinary People. In: 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication (UbiComp '14), Seattle, WA, USA, 13-17 Sep 2014, pp. 683-686. ISBN 9781450330473 (doi: 10.1145/2638728.2641316)
Mısırlı, A. T., Bener, A., Çağlayan, B., Çalıklı, G. and Turhan, B. (2014) Field studies: a methodology for construction and evaluation of recommendation systems in software engineering. In: Robillard, M. P., Maalej, W., Walker, R. J. and Zimmermann, T. (eds.) Recommendation Systems in Software Engineering. Springer: Berlin, pp. 329-355. ISBN 9783642451348 (doi: 10.1007/978-3-642-45135-5_13)
2013
Calikli, G. , Bener, A., Aytac, T. and Bozcan, O. (2013) Towards a Metric Suite Proposal to Quantify Confirmation Biases of Developers. In: 2013 ACM / IEEE International Symposium on Empirical Software Engineering and Measurement, Baltimore, MD, USA, 10-11 Oct 2013, pp. 363-372. ISBN 9780769550565 (doi: 10.1109/ESEM.2013.47)
Calikli, G. and Bener, A. (2013) An Algorithmic Approach to Missing Data Problem in Modeling Human Aspects in Software Development. In: 9th International Conference on Predictive Models in Software Engineering (PROMISE '13), Baltimore, MD, USA, 09 Oct 2013, p. 10. ISBN 9781450320160 (doi: 10.1145/2499393.2499398)
Calikli, G. and Nemer, A. (2013) The Impact of Confirmation Bias on the Release-based Defect Prediction of Developer Groups. In: 25th International Conference on Software Engineering and Knowledge Engineering (SEKE 2013), Boston, MA, USA, 27-29 Jun 2013, pp. 461-466. ISBN 9781510841598
Çalıklı, G. and Bener, A. B. (2013) Influence of confirmation biases of developers on software quality: an empirical study. Software Quality Journal, 21(2), pp. 377-416. (doi: 10.1007/s11219-012-9180-0)
2012
Calikli, G. , Bener, A., Caglayan, B. and Misirli, A. T. (2012) Modeling Human Aspects to Enhance Software Quality Management. In: 33rd International Conference on Information Systems (ICIS 2012), Orlando, FL, USA, 16-19 Dec 2012, ISBN 9780615718439
Caglayan, B., Misirli, A. T., Calikli, G. , Bener, A., Aytac, T. and Turhan, B. (2012) Dione: an Integrated Measurement and Defect Prediction Solution. In: ACM SIGSOFT 20th International Symposium on the Foundations of Software Engineering (FSE '12), Cary, NC, USA, 11-16 Nov 2012, p. 20. ISBN 9781450316149 (doi: 10.1145/2393596.2393619)
2010
Calikli, G. and Bener, A. (2010) Preliminary Analysis of the Effects of Confirmation Bias on Software Defect Density. In: 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM '10), Bolzano-Bozen, Italy, 16-17 Sep 2010, p. 68. ISBN 9781450300391 (doi: 10.1145/1852786.1852870)
Calikli, G. and Bener, A. (2010) Empirical Analyses of the Factors Affecting Confirmation Bias and the Effects of Confirmation Bias on Software Developer/Tester Performance. In: 6th International Conference on Predictive Models in Software Engineering (PROMISE '10), Timişoara, Romania, 12-13 Sep 2010, p. 10. ISBN 9781450304047 (doi: 10.1145/1868328.1868344)
Calikli, G. , Bener, A. and Arslan, B. (2010) An Analysis of the Effects of Company Culture, Education and Experience on Confirmation Bias Levels of Software Developers and Testers. In: 32nd ACM/IEEE International Conference on Software Engineering (ICSE '10), Cape Town, South Africa, 01-09 May 2010, pp. 187-190. ISBN 9781605587196 (doi: 10.1145/1810295.1810326)
2009
Calikli, G. , Tosun, A., Bener, A. and Celik, M. (2009) The Effect of Granularity Level on Software Defect Prediction. In: 2009 24th International Symposium on Computer and Information Sciences, Guzelyurt, Cyprus, 14-16 Sep 2009, pp. 531-536. ISBN 9781424450213 (doi: 10.1109/ISCIS.2009.5291866)
2005
Çalıklı, H. G. and Çağlayan, U. (2005) A formal policy specification language for an 802.11 WLAN with enhanced security network. In: Yolum, P., Güngör, T., Gürgen, F. and Özturan, C. (eds.) Computer and Information Sciences - ISCIS 2005: 20th International Symposium, Istanbul, Turkey, October 26-28, 2005. Proceedings. Series: Lecture notes in computer science (3733). Springer: Berlin, Heidelberg, pp. 183-192. ISBN 9783540294146 (doi: 10.1007/11569596_21)
Articles
Tuma, K., Calikli, G. and Scandariato, R. (2018) Threat analysis of software systems: a systematic literature review. Journal of Systems and Software, 144, pp. 275-294. (doi: 10.1016/j.jss.2018.06.073)
Steghöfer, J.-P., Burden, H., Hebig, R., Calikli, G. , Feldt, R., Hammouda, I., Horkoff, J., Knauss, E. and Liebel, G. (2018) Involving external stakeholders in project courses. ACM Transactions on Computing Education, 18(2), 8. (doi: 10.1145/3152098)
Perera, C., Vasilakos, A. V., Calikli, G. , Sheng, Q. Z. and Li, K.-C. (2018) Guest editorial special section on engineering industrial big data analytics platforms for Internet of Things. IEEE Transactions on Industrial Informatics, 14(2), pp. 744-747. (doi: 10.1109/TII.2017.2788080)
Price, B. A., Stuart, A., Calikli, G. , Mccormick, C., Mehta, V., Hutton, L., Bandara, A. K., Levine, M. and Nuseibeh, B. (2017) Logging you, logging me: a replicable study of privacy and sharing behaviour in groups of visual lifeloggers. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 1(2), 22. (doi: 10.1145/3090087)
Calikli, G. and Bener, A. (2015) Empirical analysis of factors affecting confirmation bias levels of software engineers. Software Quality Journal, 23(4), pp. 695-722. (doi: 10.1007/s11219-014-9250-6)
Çalıklı, G. and Bener, A. B. (2013) Influence of confirmation biases of developers on software quality: an empirical study. Software Quality Journal, 21(2), pp. 377-416. (doi: 10.1007/s11219-012-9180-0)
Book Sections
Alahdab, M. and Çalıklı, G. (2019) Empirical analysis of hidden technical debt patterns in machine learning software. In: Franch, X., Männistö, T. and Martínez-Fernández, S. (eds.) Product-Focused Software Process Improvement: 20th International Conference, PROFES 2019, Barcelona, Spain, November 27–29, 2019, Proceedings. Series: Lecture notes in computer science (11915). Springer: Cham, pp. 195-202. ISBN 9783030353322 (doi: 10.1007/978-3-030-35333-9_14)
Mısırlı, A. T., Bener, A., Çağlayan, B., Çalıklı, G. and Turhan, B. (2014) Field studies: a methodology for construction and evaluation of recommendation systems in software engineering. In: Robillard, M. P., Maalej, W., Walker, R. J. and Zimmermann, T. (eds.) Recommendation Systems in Software Engineering. Springer: Berlin, pp. 329-355. ISBN 9783642451348 (doi: 10.1007/978-3-642-45135-5_13)
Çalıklı, H. G. and Çağlayan, U. (2005) A formal policy specification language for an 802.11 WLAN with enhanced security network. In: Yolum, P., Güngör, T., Gürgen, F. and Özturan, C. (eds.) Computer and Information Sciences - ISCIS 2005: 20th International Symposium, Istanbul, Turkey, October 26-28, 2005. Proceedings. Series: Lecture notes in computer science (3733). Springer: Berlin, Heidelberg, pp. 183-192. ISBN 9783540294146 (doi: 10.1007/11569596_21)
Conference Proceedings
Fregnan, E., Braz, L., D’Ambros, M., Calikli, G. and Bacchelli, A. (2022) First come first served: The impact of file position on code review. In: ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2022), Singapore, 14-18 November 2022, pp. 483-494. ISBN 9781450394130 (doi: 10.1145/3540250.3549177)
Gonçalves, P. W., Çalıklı, G. , Serebrenik, A. and Bacchelli, A. (2022) Competencies for Code Review. In: 26th ACM Conference On Computer-Supported Cooperative Work And Social Computing (CSCW2023), Minneapolis, MN, USA, 13-18 October 2022, (Accepted for Publication)
Braz, L., Aeberhard, C., Çalikli, G. and Bacchelli, A. (2022) Less is More: Supporting Developers in Vulnerability Detection during Code Review. In: 44th International Conference on Software Engineering (ICSE 2022), Pittsburgh, PA, USA, 22-27 May 2022, pp. 1317-1329. ISBN 9781450392211 (doi: 10.1145/3510003.3511560)
Gonçalves, P. W., Çalıklı, G. and Bacchelli, A. (2022) Interpersonal Conflicts During Code Review: Developers' Experience and Practices. In: 25th ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW 22), 12 - 16 November 2022, p. 98. (doi: 10.1145/3512945)
Braz, L., Fregnan, E., Çalikli, G. and Bacchelli, A. (2021) Why Don’t Developers Detect Improper Input Validation? '; DROP TABLE Papers; --. In: 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE), 22-30 May 2021, pp. 499-511. ISBN 9781665402965 (doi: 10.1109/ICSE43902.2021.00054)
Spadini, D., Çalikli, G. and Bacchelli, A. (2020) Primers or Reminders? The Effects of Existing Review Comments on Code Review. In: ACM/IEEE 42nd International Conference on Software Engineering, 27 Jun - 29 Jul 2020, pp. 1171-1182. ISBN 9781450371216 (doi: 10.1145/3377811.3380385)
Krüger, J., Çalıklı, G. , Berger, T., Leich, T. and Saake, G. (2019) Effects of Explicit Feature Traceability on Program Comprehension. In: 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2019), Tallinn, Estonia, 26-30 Aug 2019, pp. 338-349. ISBN 9781450355728 (doi: 10.1145/3338906.3338968)
Kasauli, R., Knauss, E., Kanagwa, B., Nilsson, A. and Calikli, G. (2018) Safety-Critical Systems and Agile Development: a Mapping Study. In: 2018 44th Euromicro Conference on Software Engineering and Advanced Applications (SEAA), Prague, Czech Republic, 29-31 Aug 2018, pp. 470-477. ISBN 9781538673836 (doi: 10.1109/SEAA.2018.00082)
Calikli, G. , Al-Eryani, M., Baldebo, E., Horkofff, J. and Ask, A. (2018) Effects of Automated Competency Evaluation on Software Engineers' Emotions and Motivation: a Case Study. In: 3rd International Workshop on Emotion Awareness in Software Engineering (SEmotion '18), Gothenburg, Sweden, 02 Jun 2018, pp. 44-50. ISBN 9781450357517 (doi: 10.1145/3194932.3194939)
Çalikli, G. , Staron, M. and Meding, W. (2018) Measure Early and Decide Fast: Transforming Quality Management and Measurement to Continuous Deployment. In: 2018 International Conference on Software and System Process (ICSSP '18), Gothenburg, Sweden, 26-27 May 2018, pp. 51-60. ISBN 9781450364591 (doi: 10.1145/3202710.3203156)
Rafiq, Y., Dickens, L., Russo, A., Bandara, A. K., Yang, M., Stuart, A., Levine, M., Calikli, G. , Price, B. A. and Nuseibeh, B. (2017) Learning to Share: Engineering Adaptive Decision-Support for Online Social Networks. In: 2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE), Urbana, IL, USA, 30 Oct - 03 Nov 2017, pp. 280-285. ISBN 9781538626849 (doi: 10.1109/ASE.2017.8115641)
Calikli, G. , Law, M., Bandara, A. K., Russo, A., Dickens, L., Price, B. A., Stuart, A., Levine, M. and Nuseibeh, B. (2016) Privacy Dynamics: Learning Privacy Norms for Social Software. In: 2016 IEEE/ACM 11th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS), Austin, TX, USA, 16-17 May 2016, pp. 47-56. ISBN 9781450341875 (doi: 10.1145/2897053.2897063)
Calikli, G. , Andersen, M. S., Bandara, A., Price, B. and Nuseibeh, B. (2014) Personal Informatics for Non-geeks: Lessons Learned From Ordinary People. In: 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication (UbiComp '14), Seattle, WA, USA, 13-17 Sep 2014, pp. 683-686. ISBN 9781450330473 (doi: 10.1145/2638728.2641316)
Calikli, G. , Bener, A., Aytac, T. and Bozcan, O. (2013) Towards a Metric Suite Proposal to Quantify Confirmation Biases of Developers. In: 2013 ACM / IEEE International Symposium on Empirical Software Engineering and Measurement, Baltimore, MD, USA, 10-11 Oct 2013, pp. 363-372. ISBN 9780769550565 (doi: 10.1109/ESEM.2013.47)
Calikli, G. and Bener, A. (2013) An Algorithmic Approach to Missing Data Problem in Modeling Human Aspects in Software Development. In: 9th International Conference on Predictive Models in Software Engineering (PROMISE '13), Baltimore, MD, USA, 09 Oct 2013, p. 10. ISBN 9781450320160 (doi: 10.1145/2499393.2499398)
Calikli, G. and Nemer, A. (2013) The Impact of Confirmation Bias on the Release-based Defect Prediction of Developer Groups. In: 25th International Conference on Software Engineering and Knowledge Engineering (SEKE 2013), Boston, MA, USA, 27-29 Jun 2013, pp. 461-466. ISBN 9781510841598
Calikli, G. , Bener, A., Caglayan, B. and Misirli, A. T. (2012) Modeling Human Aspects to Enhance Software Quality Management. In: 33rd International Conference on Information Systems (ICIS 2012), Orlando, FL, USA, 16-19 Dec 2012, ISBN 9780615718439
Caglayan, B., Misirli, A. T., Calikli, G. , Bener, A., Aytac, T. and Turhan, B. (2012) Dione: an Integrated Measurement and Defect Prediction Solution. In: ACM SIGSOFT 20th International Symposium on the Foundations of Software Engineering (FSE '12), Cary, NC, USA, 11-16 Nov 2012, p. 20. ISBN 9781450316149 (doi: 10.1145/2393596.2393619)
Calikli, G. and Bener, A. (2010) Preliminary Analysis of the Effects of Confirmation Bias on Software Defect Density. In: 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM '10), Bolzano-Bozen, Italy, 16-17 Sep 2010, p. 68. ISBN 9781450300391 (doi: 10.1145/1852786.1852870)
Calikli, G. and Bener, A. (2010) Empirical Analyses of the Factors Affecting Confirmation Bias and the Effects of Confirmation Bias on Software Developer/Tester Performance. In: 6th International Conference on Predictive Models in Software Engineering (PROMISE '10), Timişoara, Romania, 12-13 Sep 2010, p. 10. ISBN 9781450304047 (doi: 10.1145/1868328.1868344)
Calikli, G. , Bener, A. and Arslan, B. (2010) An Analysis of the Effects of Company Culture, Education and Experience on Confirmation Bias Levels of Software Developers and Testers. In: 32nd ACM/IEEE International Conference on Software Engineering (ICSE '10), Cape Town, South Africa, 01-09 May 2010, pp. 187-190. ISBN 9781605587196 (doi: 10.1145/1810295.1810326)
Calikli, G. , Tosun, A., Bener, A. and Celik, M. (2009) The Effect of Granularity Level on Software Defect Prediction. In: 2009 24th International Symposium on Computer and Information Sciences, Guzelyurt, Cyprus, 14-16 Sep 2009, pp. 531-536. ISBN 9781424450213 (doi: 10.1109/ISCIS.2009.5291866)