Dr Handan Gul Calikli

Lecturer in Software Engineering (School of Computing Science)

email: HandanGul.Calikli@glasgow.ac.uk
pronouns: She/her/hers

School of Computing Science, University of Glasgow, Sir Alwyn Williams Building, Office: SAWB 221b, Glasgow, SCOTLAND, G12 8QQ

Import to contacts

https://orcid.org/0000-0003-4578-1747

Biography

I am a Lecturer (Assistant Professor) in Software Engineering at the School of Computing Science, University of Glasgow, United Kingdom. I obtained my Ph.D. and M.Sc. degrees in Computer Engineering and B.Sc. degree in Mechanical Engineering from Boğaziçi University, Istanbul. After my Ph.D., I worked as a postdoc fellow at The Open University, United Kingdom, and Ryerson University, Canada, and later as a lecturer (biträdande universitetslektor) at Chalmers | University of Gothenburg, Sweden. Before joining School of Computing at the University of Glasgow, I was a senior researcher in Zurich Empirical Software Engineering Team (ZEST) at the Department of Informatics, University of Zurich (UZH), Switzerland.

Personal Website: https://gulcalikli.github.io/

Research interests

Research Interests

Empirical Software Engineering (SE)
Human Aspects in SE
Program Comprehension
Data Analytics for SE

Further details about my research are available on my personal website

Publications

List by: Type | Date

Jump to: 2025 | 2024 | 2023 | 2022 | 2021 | 2020 | 2019 | 2018 | 2017 | 2016 | 2015 | 2014 | 2013 | 2012 | 2010 | 2009 | 2005

Number of items: 36.

2025

Das, Susmita, Ghosh, Madhusudan, Swami, Priyanka, Ganguly, Debasis ORCID: https://orcid.org/0000-0003-0050-7138 and Calikli, Gul ORCID: https://orcid.org/0000-0003-4578-1747 (2025) In-Context Learning as an Effective Estimator of Functional Correctness of LLM-Generated Code. In: 48th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2025), Padua, Italy, 13-17 July 2025, (Accepted for Publication)

Bershadskyy, Dmitri, Kruger, Jacob, Calikli, Gül ORCID: https://orcid.org/0000-0003-4578-1747, Otto, Siegmar, Zabel, Sarah, Greif, Jannik and Heyer, Robert (2025) A laboratory experiment on using different financial-incentivization schemes in software-engineering experimentation. PeerJ Computer Science, 11, e2650. (doi: 10.7717/peerj-cs.2650)

Çalikli, Gül ORCID: https://orcid.org/0000-0003-4578-1747 and Alhamed, Mohammed (2025) Impact of Request Formats on Effort Estimation: Are LLMs Different than Humans? In: ACM International Conference on the Foundations of Software Engineering (FSE 2025), Trondheim, Norway, 23-27 Jun 2025, (Accepted for Publication)

2024

Krüger, Jacob, Calikli, Gül ORCID: https://orcid.org/0000-0003-4578-1747, Bershadskyy, Dmitri, Otto, Siegmar, Zabel, Sarah and Heyer, Robert (2024) Guidelines for using financial incentives in software-engineering experimentation. Empirical Software Engineering, 29(135), (doi: 10.1007/s10664-024-10517-w)

Mahmood, Wardah, Çalıklı, Gül ORCID: https://orcid.org/0000-0003-4578-1747, Strüber, Daniel, Lämmel, Ralf, Mukelabai, Mukelabai and Berger, Thorsten (2024) Virtual platform: effective and seamless variability management for software systems. IEEE Transactions on Software Engineering, (doi: 10.1109/TSE.2024.3406224) (Early Online Publication)

2023

Gonçalves, Pavlína Wurzel, Çalıklı, Gül ORCID: https://orcid.org/0000-0003-4578-1747, Serebrenik, Alexander and Bacchelli, Alberto (2023) Competencies for Code Review. In: 26th ACM Conference On Computer-Supported Cooperative Work And Social Computing (CSCW2023), Minneapolis, MN, USA, 13-18 October 2023, pp. 1-33. (doi: 10.1145/3579471)

2022

Fregnan, Enrico, Braz, Larissa, D’Ambros, Marco, Calikli, Gül ORCID: https://orcid.org/0000-0003-4578-1747 and Bacchelli, Alberto (2022) First come first served: The impact of file position on code review. In: ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2022), Singapore, 14-18 November 2022, pp. 483-494. ISBN 9781450394130 (doi: 10.1145/3540250.3549177)

Braz, Larissa, Aeberhard, Christian, Çalikli, Gül ORCID: https://orcid.org/0000-0003-4578-1747 and Bacchelli, Alberto (2022) Less is More: Supporting Developers in Vulnerability Detection during Code Review. In: 44th International Conference on Software Engineering (ICSE 2022), Pittsburgh, PA, USA, 22-27 May 2022, pp. 1317-1329. ISBN 9781450392211 (doi: 10.1145/3510003.3511560)

Gonçalves, Pavlína Wurzel, Çalıklı, Gül ORCID: https://orcid.org/0000-0003-4578-1747 and Bacchelli, Alberto (2022) Interpersonal Conflicts During Code Review: Developers' Experience and Practices. In: 25th ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW 22), 12 - 16 November 2022, p. 98. (doi: 10.1145/3512945)

2021

Braz, Larissa, Fregnan, Enrico, Çalikli, Gül ORCID: https://orcid.org/0000-0003-4578-1747 and Bacchelli, Alberto (2021) Why Don’t Developers Detect Improper Input Validation? '; DROP TABLE Papers; --. In: 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE), 22-30 May 2021, pp. 499-511. ISBN 9781665402965 (doi: 10.1109/ICSE43902.2021.00054)

2020

Spadini, Davide, Çalikli, Gül ORCID: https://orcid.org/0000-0003-4578-1747 and Bacchelli, Alberto (2020) Primers or Reminders? The Effects of Existing Review Comments on Code Review. In: ACM/IEEE 42nd International Conference on Software Engineering, 27 Jun - 29 Jul 2020, pp. 1171-1182. ISBN 9781450371216 (doi: 10.1145/3377811.3380385)

2019

Alahdab, Mohannad and Çalıklı, Gül ORCID: https://orcid.org/0000-0003-4578-1747 (2019) Empirical analysis of hidden technical debt patterns in machine learning software. In: Franch, Xavier, Männistö, Tomi and Martínez-Fernández, Silverio (eds.) Product-Focused Software Process Improvement: 20th International Conference, PROFES 2019, Barcelona, Spain, November 27–29, 2019, Proceedings. Series: Lecture notes in computer science (11915). Springer: Cham, pp. 195-202. ISBN 9783030353322 (doi: 10.1007/978-3-030-35333-9_14)

Krüger, Jacob, Çalıklı, Gül ORCID: https://orcid.org/0000-0003-4578-1747, Berger, Thorsten, Leich, Thomas and Saake, Gunter (2019) Effects of Explicit Feature Traceability on Program Comprehension. In: 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2019), Tallinn, Estonia, 26-30 Aug 2019, pp. 338-349. ISBN 9781450355728 (doi: 10.1145/3338906.3338968)

2018

Tuma, K., Calikli, G. ORCID: https://orcid.org/0000-0003-4578-1747 and Scandariato, R. (2018) Threat analysis of software systems: a systematic literature review. Journal of Systems and Software, 144, pp. 275-294. (doi: 10.1016/j.jss.2018.06.073)

Kasauli, Rashidah, Knauss, Eric, Kanagwa, Benjamin, Nilsson, Agneta and Calikli, Gul ORCID: https://orcid.org/0000-0003-4578-1747 (2018) Safety-Critical Systems and Agile Development: a Mapping Study. In: 2018 44th Euromicro Conference on Software Engineering and Advanced Applications (SEAA), Prague, Czech Republic, 29-31 Aug 2018, pp. 470-477. ISBN 9781538673836 (doi: 10.1109/SEAA.2018.00082)

Steghöfer, Jan-Philipp, Burden, Håkan, Hebig, Regina, Calikli, Gul ORCID: https://orcid.org/0000-0003-4578-1747, Feldt, Robert, Hammouda, Imed, Horkoff, Jennifer, Knauss, Eric and Liebel, Grischa (2018) Involving external stakeholders in project courses. ACM Transactions on Computing Education, 18(2), 8. (doi: 10.1145/3152098)

Calikli, Gul ORCID: https://orcid.org/0000-0003-4578-1747, Al-Eryani, Mohammed, Baldebo, Emil, Horkofff, Jennifer and Ask, Alexander (2018) Effects of Automated Competency Evaluation on Software Engineers' Emotions and Motivation: a Case Study. In: 3rd International Workshop on Emotion Awareness in Software Engineering (SEmotion '18), Gothenburg, Sweden, 02 Jun 2018, pp. 44-50. ISBN 9781450357517 (doi: 10.1145/3194932.3194939)

Çalikli, Gül ORCID: https://orcid.org/0000-0003-4578-1747, Staron, Miroslaw and Meding, Wilhelm (2018) Measure Early and Decide Fast: Transforming Quality Management and Measurement to Continuous Deployment. In: 2018 International Conference on Software and System Process (ICSSP '18), Gothenburg, Sweden, 26-27 May 2018, pp. 51-60. ISBN 9781450364591 (doi: 10.1145/3202710.3203156)

Perera, C., Vasilakos, A. V., Calikli, G. ORCID: https://orcid.org/0000-0003-4578-1747, Sheng, Q. Z. and Li, K.-C. (2018) Guest editorial special section on engineering industrial big data analytics platforms for Internet of Things. IEEE Transactions on Industrial Informatics, 14(2), pp. 744-747. (doi: 10.1109/TII.2017.2788080)

2017

Rafiq, Yasmin, Dickens, Luke, Russo, Alessandra, Bandara, Arosha K., Yang, Mu, Stuart, Avelie, Levine, Mark, Calikli, Gul ORCID: https://orcid.org/0000-0003-4578-1747, Price, Blaine A. and Nuseibeh, Bashar (2017) Learning to Share: Engineering Adaptive Decision-Support for Online Social Networks. In: 2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE), Urbana, IL, USA, 30 Oct - 03 Nov 2017, pp. 280-285. ISBN 9781538626849 (doi: 10.1109/ASE.2017.8115641)

Price, Blaine A., Stuart, Avelie, Calikli, Gul ORCID: https://orcid.org/0000-0003-4578-1747, Mccormick, Ciaran, Mehta, Vikram, Hutton, Luke, Bandara, Arosha K., Levine, Mark and Nuseibeh, Bashar (2017) Logging you, logging me: a replicable study of privacy and sharing behaviour in groups of visual lifeloggers. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 1(2), 22. (doi: 10.1145/3090087)

2016

Calikli, Gul ORCID: https://orcid.org/0000-0003-4578-1747, Law, Mark, Bandara, Arosha K., Russo, Alessandra, Dickens, Luke, Price, Blaine A., Stuart, Avelie, Levine, Mark and Nuseibeh, Bashar (2016) Privacy Dynamics: Learning Privacy Norms for Social Software. In: 2016 IEEE/ACM 11th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS), Austin, TX, USA, 16-17 May 2016, pp. 47-56. ISBN 9781450341875 (doi: 10.1145/2897053.2897063)

2015

Calikli, Gul ORCID: https://orcid.org/0000-0003-4578-1747 and Bener, Ayse (2015) Empirical analysis of factors affecting confirmation bias levels of software engineers. Software Quality Journal, 23(4), pp. 695-722. (doi: 10.1007/s11219-014-9250-6)

2014

Calikli, Gul ORCID: https://orcid.org/0000-0003-4578-1747, Andersen, Mads Schaarup, Bandara, Arosha, Price, Blaine and Nuseibeh, Bashar (2014) Personal Informatics for Non-geeks: Lessons Learned From Ordinary People. In: 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication (UbiComp '14), Seattle, WA, USA, 13-17 Sep 2014, pp. 683-686. ISBN 9781450330473 (doi: 10.1145/2638728.2641316)

Mısırlı, Ayşe Tosun, Bener, Ayşe, Çağlayan, Bora, Çalıklı, Gül ORCID: https://orcid.org/0000-0003-4578-1747 and Turhan, Burak (2014) Field studies: a methodology for construction and evaluation of recommendation systems in software engineering. In: Robillard, Martin P., Maalej, Walid, Walker, Robert J. and Zimmermann, Thomas (eds.) Recommendation Systems in Software Engineering. Springer: Berlin, pp. 329-355. ISBN 9783642451348 (doi: 10.1007/978-3-642-45135-5_13)

2013

Calikli, Gul ORCID: https://orcid.org/0000-0003-4578-1747, Bener, Ayse, Aytac, Turgay and Bozcan, Ovunc (2013) Towards a Metric Suite Proposal to Quantify Confirmation Biases of Developers. In: 2013 ACM / IEEE International Symposium on Empirical Software Engineering and Measurement, Baltimore, MD, USA, 10-11 Oct 2013, pp. 363-372. ISBN 9780769550565 (doi: 10.1109/ESEM.2013.47)

Calikli, Gul ORCID: https://orcid.org/0000-0003-4578-1747 and Bener, Ayse (2013) An Algorithmic Approach to Missing Data Problem in Modeling Human Aspects in Software Development. In: 9th International Conference on Predictive Models in Software Engineering (PROMISE '13), Baltimore, MD, USA, 09 Oct 2013, p. 10. ISBN 9781450320160 (doi: 10.1145/2499393.2499398)

Calikli, Gul ORCID: https://orcid.org/0000-0003-4578-1747 and Nemer, Ayse (2013) The Impact of Confirmation Bias on the Release-based Defect Prediction of Developer Groups. In: 25th International Conference on Software Engineering and Knowledge Engineering (SEKE 2013), Boston, MA, USA, 27-29 Jun 2013, pp. 461-466. ISBN 9781510841598

Çalıklı, Gül ORCID: https://orcid.org/0000-0003-4578-1747 and Bener, Ayşe Başar (2013) Influence of confirmation biases of developers on software quality: an empirical study. Software Quality Journal, 21(2), pp. 377-416. (doi: 10.1007/s11219-012-9180-0)

2012

Calikli, Gul ORCID: https://orcid.org/0000-0003-4578-1747, Bener, Ayse, Caglayan, Bora and Misirli, Ayse Tosun (2012) Modeling Human Aspects to Enhance Software Quality Management. In: 33rd International Conference on Information Systems (ICIS 2012), Orlando, FL, USA, 16-19 Dec 2012, ISBN 9780615718439

Caglayan, Bora, Misirli, Ayse Tosun, Calikli, Gul ORCID: https://orcid.org/0000-0003-4578-1747, Bener, Ayse, Aytac, Turgay and Turhan, Burak (2012) Dione: an Integrated Measurement and Defect Prediction Solution. In: ACM SIGSOFT 20th International Symposium on the Foundations of Software Engineering (FSE '12), Cary, NC, USA, 11-16 Nov 2012, p. 20. ISBN 9781450316149 (doi: 10.1145/2393596.2393619)

2010

Calikli, Gul ORCID: https://orcid.org/0000-0003-4578-1747 and Bener, Ayse (2010) Preliminary Analysis of the Effects of Confirmation Bias on Software Defect Density. In: 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM '10), Bolzano-Bozen, Italy, 16-17 Sep 2010, p. 68. ISBN 9781450300391 (doi: 10.1145/1852786.1852870)

Calikli, Gul ORCID: https://orcid.org/0000-0003-4578-1747 and Bener, Ayse (2010) Empirical Analyses of the Factors Affecting Confirmation Bias and the Effects of Confirmation Bias on Software Developer/Tester Performance. In: 6th International Conference on Predictive Models in Software Engineering (PROMISE '10), Timişoara, Romania, 12-13 Sep 2010, p. 10. ISBN 9781450304047 (doi: 10.1145/1868328.1868344)

Calikli, Gul ORCID: https://orcid.org/0000-0003-4578-1747, Bener, Ayse and Arslan, Berna (2010) An Analysis of the Effects of Company Culture, Education and Experience on Confirmation Bias Levels of Software Developers and Testers. In: 32nd ACM/IEEE International Conference on Software Engineering (ICSE '10), Cape Town, South Africa, 01-09 May 2010, pp. 187-190. ISBN 9781605587196 (doi: 10.1145/1810295.1810326)

2009

Calikli, Gul ORCID: https://orcid.org/0000-0003-4578-1747, Tosun, Ayse, Bener, Ayse and Celik, Melih (2009) The Effect of Granularity Level on Software Defect Prediction. In: 2009 24th International Symposium on Computer and Information Sciences, Guzelyurt, Cyprus, 14-16 Sep 2009, pp. 531-536. ISBN 9781424450213 (doi: 10.1109/ISCIS.2009.5291866)

2005

Çalıklı, Handan Gül ORCID: https://orcid.org/0000-0003-4578-1747 and Çağlayan, Ufuk (2005) A formal policy specification language for an 802.11 WLAN with enhanced security network. In: Yolum, Pinar, Güngör, Tunga, Gürgen, Fikret and Özturan, Can (eds.) Computer and Information Sciences - ISCIS 2005: 20th International Symposium, Istanbul, Turkey, October 26-28, 2005. Proceedings. Series: Lecture notes in computer science (3733). Springer: Berlin, Heidelberg, pp. 183-192. ISBN 9783540294146 (doi: 10.1007/11569596_21)

This list was generated on Sun Jun 15 06:01:41 2025 BST.

Jump to: Articles | Book Sections | Conference Proceedings