Dr Handan Gul Calikli

Lecturer in Software Engineering (School of Computing Science)

email: HandanGul.Calikli@glasgow.ac.uk
pronouns: She/her/hers

School of Computing Science, University of Glasgow, Sir Alwyn Williams Building, Office: SAWB 221b, Glasgow, SCOTLAND, G12 8QQ

Import to contacts

https://orcid.org/0000-0003-4578-1747

Biography

I am a Lecturer (Assistant Professor) in Software Engineering at the School of Computing Science, University of Glasgow, United Kingdom. I obtained my Ph.D. and M.Sc. degrees in Computer Engineering and B.Sc. degree in Mechanical Engineering from Boğaziçi University, Istanbul. After my Ph.D., I worked as a postdoc fellow at The Open University, United Kingdom, and Ryerson University, Canada, and later as a lecturer (biträdande universitetslektor) at Chalmers | University of Gothenburg, Sweden. Before joining School of Computing at the University of Glasgow, I was a senior researcher in Zurich Empirical Software Engineering Team (ZEST) at the Department of Informatics, University of Zurich (UZH), Switzerland.

Personal Website: https://gulcalikli.github.io/

Research interests

Research Interests

Empirical Software Engineering (SE)
Human Aspects in SE
Program Comprehension
Data Analytics for SE

Further details about my research are available on my personal website

Publications

List by: Type | Date

Jump to: 2025 | 2024 | 2023 | 2022 | 2021 | 2020 | 2019 | 2018 | 2017 | 2016 | 2015 | 2014 | 2013 | 2012 | 2010 | 2009 | 2005

Number of items: 36.

2025

Das, S., Ghosh, M., Swami, P., Ganguly, D. and Calikli, G. (2025) In-Context Learning as an Effective Estimator of Functional Correctness of LLM-Generated Code. In: 48th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2025), Padua, Italy, 13-17 July 2025, (Accepted for Publication)

Bershadskyy, D., Kruger, J., Calikli, G. , Otto, S., Zabel, S., Greif, J. and Heyer, R. (2025) A laboratory experiment on using different financial-incentivization schemes in software-engineering experimentation. PeerJ Computer Science, 11, e2650. (doi: 10.7717/peerj-cs.2650)

Çalikli, G. and Alhamed, M. (2025) Impact of Request Formats on Effort Estimation: Are LLMs Different than Humans? In: ACM International Conference on the Foundations of Software Engineering (FSE 2025), Trondheim, Norway, 23-27 Jun 2025, (Accepted for Publication)

2024

Krüger, J., Calikli, G. , Bershadskyy, D., Otto, S., Zabel, S. and Heyer, R. (2024) Guidelines for using financial incentives in software-engineering experimentation. Empirical Software Engineering, 29(135), (doi: 10.1007/s10664-024-10517-w)

Mahmood, W., Çalıklı, G. , Strüber, D., Lämmel, R., Mukelabai, M. and Berger, T. (2024) Virtual platform: effective and seamless variability management for software systems. IEEE Transactions on Software Engineering, (doi: 10.1109/TSE.2024.3406224) (Early Online Publication)

2023

Gonçalves, P. W., Çalıklı, G. , Serebrenik, A. and Bacchelli, A. (2023) Competencies for Code Review. In: 26th ACM Conference On Computer-Supported Cooperative Work And Social Computing (CSCW2023), Minneapolis, MN, USA, 13-18 October 2023, pp. 1-33. (doi: 10.1145/3579471)

2022

Fregnan, E., Braz, L., D’Ambros, M., Calikli, G. and Bacchelli, A. (2022) First come first served: The impact of file position on code review. In: ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2022), Singapore, 14-18 November 2022, pp. 483-494. ISBN 9781450394130 (doi: 10.1145/3540250.3549177)

Braz, L., Aeberhard, C., Çalikli, G. and Bacchelli, A. (2022) Less is More: Supporting Developers in Vulnerability Detection during Code Review. In: 44th International Conference on Software Engineering (ICSE 2022), Pittsburgh, PA, USA, 22-27 May 2022, pp. 1317-1329. ISBN 9781450392211 (doi: 10.1145/3510003.3511560)

Gonçalves, P. W., Çalıklı, G. and Bacchelli, A. (2022) Interpersonal Conflicts During Code Review: Developers' Experience and Practices. In: 25th ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW 22), 12 - 16 November 2022, p. 98. (doi: 10.1145/3512945)

2021

Braz, L., Fregnan, E., Çalikli, G. and Bacchelli, A. (2021) Why Don’t Developers Detect Improper Input Validation? '; DROP TABLE Papers; --. In: 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE), 22-30 May 2021, pp. 499-511. ISBN 9781665402965 (doi: 10.1109/ICSE43902.2021.00054)

2020

Spadini, D., Çalikli, G. and Bacchelli, A. (2020) Primers or Reminders? The Effects of Existing Review Comments on Code Review. In: ACM/IEEE 42nd International Conference on Software Engineering, 27 Jun - 29 Jul 2020, pp. 1171-1182. ISBN 9781450371216 (doi: 10.1145/3377811.3380385)

2019

Alahdab, M. and Çalıklı, G. (2019) Empirical analysis of hidden technical debt patterns in machine learning software. In: Franch, Xavier, Männistö, Tomi and Martínez-Fernández, Silverio (eds.) Product-Focused Software Process Improvement: 20th International Conference, PROFES 2019, Barcelona, Spain, November 27–29, 2019, Proceedings. Series: Lecture notes in computer science (11915). Springer: Cham, pp. 195-202. ISBN 9783030353322 (doi: 10.1007/978-3-030-35333-9_14)

Krüger, J., Çalıklı, G. , Berger, T., Leich, T. and Saake, G. (2019) Effects of Explicit Feature Traceability on Program Comprehension. In: 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2019), Tallinn, Estonia, 26-30 Aug 2019, pp. 338-349. ISBN 9781450355728 (doi: 10.1145/3338906.3338968)

2018

Tuma, K., Calikli, G. and Scandariato, R. (2018) Threat analysis of software systems: a systematic literature review. Journal of Systems and Software, 144, pp. 275-294. (doi: 10.1016/j.jss.2018.06.073)

Kasauli, R., Knauss, E., Kanagwa, B., Nilsson, A. and Calikli, G. (2018) Safety-Critical Systems and Agile Development: a Mapping Study. In: 2018 44th Euromicro Conference on Software Engineering and Advanced Applications (SEAA), Prague, Czech Republic, 29-31 Aug 2018, pp. 470-477. ISBN 9781538673836 (doi: 10.1109/SEAA.2018.00082)

Steghöfer, J.-P., Burden, H., Hebig, R., Calikli, G. , Feldt, R., Hammouda, I., Horkoff, J., Knauss, E. and Liebel, G. (2018) Involving external stakeholders in project courses. ACM Transactions on Computing Education, 18(2), 8. (doi: 10.1145/3152098)

Calikli, G. , Al-Eryani, M., Baldebo, E., Horkofff, J. and Ask, A. (2018) Effects of Automated Competency Evaluation on Software Engineers' Emotions and Motivation: a Case Study. In: 3rd International Workshop on Emotion Awareness in Software Engineering (SEmotion '18), Gothenburg, Sweden, 02 Jun 2018, pp. 44-50. ISBN 9781450357517 (doi: 10.1145/3194932.3194939)

Çalikli, G. , Staron, M. and Meding, W. (2018) Measure Early and Decide Fast: Transforming Quality Management and Measurement to Continuous Deployment. In: 2018 International Conference on Software and System Process (ICSSP '18), Gothenburg, Sweden, 26-27 May 2018, pp. 51-60. ISBN 9781450364591 (doi: 10.1145/3202710.3203156)

Perera, C., Vasilakos, A. V., Calikli, G. , Sheng, Q. Z. and Li, K.-C. (2018) Guest editorial special section on engineering industrial big data analytics platforms for Internet of Things. IEEE Transactions on Industrial Informatics, 14(2), pp. 744-747. (doi: 10.1109/TII.2017.2788080)

2017

Rafiq, Y., Dickens, L., Russo, A., Bandara, A. K., Yang, M., Stuart, A., Levine, M., Calikli, G. , Price, B. A. and Nuseibeh, B. (2017) Learning to Share: Engineering Adaptive Decision-Support for Online Social Networks. In: 2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE), Urbana, IL, USA, 30 Oct - 03 Nov 2017, pp. 280-285. ISBN 9781538626849 (doi: 10.1109/ASE.2017.8115641)

Price, B. A., Stuart, A., Calikli, G. , Mccormick, C., Mehta, V., Hutton, L., Bandara, A. K., Levine, M. and Nuseibeh, B. (2017) Logging you, logging me: a replicable study of privacy and sharing behaviour in groups of visual lifeloggers. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 1(2), 22. (doi: 10.1145/3090087)

2016

Calikli, G. , Law, M., Bandara, A. K., Russo, A., Dickens, L., Price, B. A., Stuart, A., Levine, M. and Nuseibeh, B. (2016) Privacy Dynamics: Learning Privacy Norms for Social Software. In: 2016 IEEE/ACM 11th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS), Austin, TX, USA, 16-17 May 2016, pp. 47-56. ISBN 9781450341875 (doi: 10.1145/2897053.2897063)

2015

Calikli, G. and Bener, A. (2015) Empirical analysis of factors affecting confirmation bias levels of software engineers. Software Quality Journal, 23(4), pp. 695-722. (doi: 10.1007/s11219-014-9250-6)

2014

Calikli, G. , Andersen, M. S., Bandara, A., Price, B. and Nuseibeh, B. (2014) Personal Informatics for Non-geeks: Lessons Learned From Ordinary People. In: 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication (UbiComp '14), Seattle, WA, USA, 13-17 Sep 2014, pp. 683-686. ISBN 9781450330473 (doi: 10.1145/2638728.2641316)

Mısırlı, A. T., Bener, A., Çağlayan, B., Çalıklı, G. and Turhan, B. (2014) Field studies: a methodology for construction and evaluation of recommendation systems in software engineering. In: Robillard, Martin P., Maalej, Walid, Walker, Robert J. and Zimmermann, Thomas (eds.) Recommendation Systems in Software Engineering. Springer: Berlin, pp. 329-355. ISBN 9783642451348 (doi: 10.1007/978-3-642-45135-5_13)

2013

Calikli, G. , Bener, A., Aytac, T. and Bozcan, O. (2013) Towards a Metric Suite Proposal to Quantify Confirmation Biases of Developers. In: 2013 ACM / IEEE International Symposium on Empirical Software Engineering and Measurement, Baltimore, MD, USA, 10-11 Oct 2013, pp. 363-372. ISBN 9780769550565 (doi: 10.1109/ESEM.2013.47)

Calikli, G. and Bener, A. (2013) An Algorithmic Approach to Missing Data Problem in Modeling Human Aspects in Software Development. In: 9th International Conference on Predictive Models in Software Engineering (PROMISE '13), Baltimore, MD, USA, 09 Oct 2013, p. 10. ISBN 9781450320160 (doi: 10.1145/2499393.2499398)

Calikli, G. and Nemer, A. (2013) The Impact of Confirmation Bias on the Release-based Defect Prediction of Developer Groups. In: 25th International Conference on Software Engineering and Knowledge Engineering (SEKE 2013), Boston, MA, USA, 27-29 Jun 2013, pp. 461-466. ISBN 9781510841598

Çalıklı, G. and Bener, A. B. (2013) Influence of confirmation biases of developers on software quality: an empirical study. Software Quality Journal, 21(2), pp. 377-416. (doi: 10.1007/s11219-012-9180-0)

2012

Calikli, G. , Bener, A., Caglayan, B. and Misirli, A. T. (2012) Modeling Human Aspects to Enhance Software Quality Management. In: 33rd International Conference on Information Systems (ICIS 2012), Orlando, FL, USA, 16-19 Dec 2012, ISBN 9780615718439

Caglayan, B., Misirli, A. T., Calikli, G. , Bener, A., Aytac, T. and Turhan, B. (2012) Dione: an Integrated Measurement and Defect Prediction Solution. In: ACM SIGSOFT 20th International Symposium on the Foundations of Software Engineering (FSE '12), Cary, NC, USA, 11-16 Nov 2012, p. 20. ISBN 9781450316149 (doi: 10.1145/2393596.2393619)

2010

Calikli, G. and Bener, A. (2010) Preliminary Analysis of the Effects of Confirmation Bias on Software Defect Density. In: 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM '10), Bolzano-Bozen, Italy, 16-17 Sep 2010, p. 68. ISBN 9781450300391 (doi: 10.1145/1852786.1852870)

Calikli, G. and Bener, A. (2010) Empirical Analyses of the Factors Affecting Confirmation Bias and the Effects of Confirmation Bias on Software Developer/Tester Performance. In: 6th International Conference on Predictive Models in Software Engineering (PROMISE '10), Timişoara, Romania, 12-13 Sep 2010, p. 10. ISBN 9781450304047 (doi: 10.1145/1868328.1868344)

Calikli, G. , Bener, A. and Arslan, B. (2010) An Analysis of the Effects of Company Culture, Education and Experience on Confirmation Bias Levels of Software Developers and Testers. In: 32nd ACM/IEEE International Conference on Software Engineering (ICSE '10), Cape Town, South Africa, 01-09 May 2010, pp. 187-190. ISBN 9781605587196 (doi: 10.1145/1810295.1810326)

2009

Calikli, G. , Tosun, A., Bener, A. and Celik, M. (2009) The Effect of Granularity Level on Software Defect Prediction. In: 2009 24th International Symposium on Computer and Information Sciences, Guzelyurt, Cyprus, 14-16 Sep 2009, pp. 531-536. ISBN 9781424450213 (doi: 10.1109/ISCIS.2009.5291866)

2005

Çalıklı, H. G. and Çağlayan, U. (2005) A formal policy specification language for an 802.11 WLAN with enhanced security network. In: Yolum, Pinar, Güngör, Tunga, Gürgen, Fikret and Özturan, Can (eds.) Computer and Information Sciences - ISCIS 2005: 20th International Symposium, Istanbul, Turkey, October 26-28, 2005. Proceedings. Series: Lecture notes in computer science (3733). Springer: Berlin, Heidelberg, pp. 183-192. ISBN 9783540294146 (doi: 10.1007/11569596_21)

This list was generated on Fri May 23 20:47:29 2025 BST.

Jump to: Articles | Book Sections | Conference Proceedings