Dr Nicolas Pugeault

  • Reader (Computing Science)

email: Nicolas.Pugeault@glasgow.ac.uk

Office 321c, Sir Alwyn William Building, University of Glasgow, Glasgow, G12 8RZ

Import to contacts

ORCID iDhttps://orcid.org/0000-0002-3455-6280

Biography

After finishing my Engineer studies at the ESIEA Paris, I moved to the UK and did an MSc in Computational Intelligence at the University of Plymouth, before moving to Stirling to study with Norbert Krueger and Florentin Woergoetter on the European project ECOVISION.

I graduated my PhD from the University of Goettingen in 2008. From September 2007 to September 2009, I held a half-time Assistant Professor position at the University of Southern Denmark, and a half-time Research Associate position at the University of Edinburgh, collaborating with Prof. Norbert Krueger on the two EU projects DrivSco and PACOPLUS. I moved to the Centre for Vision Speech and Signal Processing (CVSSP) at the University of Surrey in 2009 as a Postdoc, working with Prof. Richard Bowden on autonomous driving and automatic sign language recognition (I was involved with the projects DIPLECS and Dicta-Sign), and was offered a lectureship in 2013.

In 2016, I moved to the Department of Computer Science at the University of Exeter, where my group's research focused on the use of deep neural networks for modelling visual attention and context in visual scenes (EPSRC grant DEVA).

I started as a Reader in the School of Computing at the University of Glasgow in June 2020.

Research interests

My core research interests are cognitive vision and machine learning. More specifically, I am interested in how we make sense of images and videos and use visual input for complex control tasks. I am particularly interested in what human vision can tell us, how vision develops from experience and how attention is deployed to understand complex scenes.

Publications

List by: Type | Date

Jump to: 2024 | 2023 | 2022 | 2021 | 2020 | 2019 | 2017 | 2015 | 2014 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2004 | 2003
Number of items: 59.

2024

Goksu, O. and Pugeault, N. (2024) The Bad Batches: Enhancing Self-Supervised Learning in Image Classification Through Representative Batch Curation. In: IEEE World Congress on Computational Intelligence (IEEE WCCI 2024), Yokohama, Japan, 30 Jun - 05 Jul 2024, (Accepted for Publication)

2023

Kascenas, A. et al. (2023) The role of noise in denoising models for anomaly detection in medical images. Medical Image Analysis, 90, 102963. (doi: 10.1016/j.media.2023.102963) (PMID:37769551)

2022

Alamri, F. and Pugeault, N. (2022) Improving object detection performance using scene contextual constraints. IEEE Transactions on Cognitive and Developmental Systems, 14(4), pp. 1320-1330. (doi: 10.1109/TCDS.2020.3008213)

Kirkwood, C., Economou, T., Pugeault, N. and Odbert, H. (2022) Bayesian deep learning for spatial interpolation in the presence of auxiliary information. Mathematical Geosciences, 54(3), pp. 507-531. (doi: 10.1007/s11004-021-09988-0)

Kascenas, A., Young, R., Jensen, B. S. , Pugeault, N. and O’Neil, A. Q. (2022) Anomaly Detection via Context and Local Feature Matching. In: IEEE International Symposium on Biomedical Imaging (ISBI) 2022, Kolkata, India, 28-31 Mar 2022, ISBN 9781665429238 (doi: 10.1109/ISBI52829.2022.9761524)

Kascenas, A., Pugeault, N. and O'Neil, A. Q. (2022) Denoising Autoencoders for Unsupervised Anomaly Detection in Brain MRI. In: Medical Imaging with Deep Learning (MIDL 2022), Zurich, Switzerland, 6-8 July 2022,

2021

Alarmi, F., Kalkan, S. and Pugeault, N. (2021) Transformer-Encoder Detector Module: Using Context to Improve Robustness to Adversarial Attacks on Object Detection. In: 25th International Conference on Pattern Recognition (ICPR2020), Milan, Italy, 10-15 Jan 2021, ISBN 9781728188096 (doi: 10.1109/ICPR48806.2021.9413344)

Alharbawee, L. and Pugeault, N. (2021) A benchmark of dynamic versus static methods for facial action unit detection. Journal of Engineering, 2021(5), pp. 252-266. (doi: 10.1049/tje2.12001)

Kirkwood, C., Economou, T., Odbert, H. and Pugeault, N. (2021) A framework for probabilistic weather forecast post-processing across models and lead times using machine learning. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 379, 20200099. (doi: 10.1098/rsta.2020.0099) (PMID:33583271)

He, S., Liao, W., Tavakoli, H. R., Yang, M., Rosenhahn, B. and Pugeault, N. (2021) Image Captioning through Image Transformer. In: 15th Asian Conference on Computer Vision, 30 Nov-04 Dec 2020, pp. 153-169. ISBN 9783030695378 (doi: 10.1007/978-3-030-69538-5_10)

2020

Mendez, O., Hadfield, S., Pugeault, N. and Bowden, R. (2020) SeDAR: reading floorplans like a human—using deep learning to enable human-inspired localisation. International Journal of Computer Vision, 128(5), pp. 1286-1310. (doi: 10.1007/s11263-019-01239-4)

Kerr, T., Clark, J. R., Fileman, E. S., Widdicombe, C. E. and Pugeault, N. (2020) Collaborative deep learning models to handle class imbalance in FlowCam plankton imagery. IEEE Access, 8, pp. 170013-170032. (doi: 10.1109/ACCESS.2020.3022242)

2019

He, S., Tavakoli, H. R., Borji, A. and Pugeault, N. (2019) Human Attention in Image Captioning: Dataset and Analysis. In: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, South Korea, 27 Oct - 02 Nov 2019, pp. 8528-8537. ISBN 9781728148038 (doi: 10.1109/ICCV.2019.00862)

He, S., Tavakoli, H. R., Borji, A., Mi, Y. and Pugeault, N. (2019) Understanding and Visualizing Deep Visual Saliency Models. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, 15-20 Jun 2019, pp. 10198-10207. ISBN 9781728132938 (doi: 10.1109/CVPR.2019.01045)

2017

Mustafa, W., Pugeault, N. , Buch, A. G. and Krüger, N. (2017) Multi-view object instance recognition in an industrial context. Robotica, 35(2), pp. 271-292. (doi: 10.1017/s0263574715000430)

2015

Pugeault, N. and Bowden, R. (2015) How much of driving is preattentive? IEEE Transactions on Vehicular Technology, 64(12), pp. 5424-5438. (doi: 10.1109/TVT.2015.2487826)

Rudzits, R. and Pugeault, N. (2015) Efficient learning of pre-attentive steering in a driving school framework. KI - Kunstliche Intelligenz, 29(1), pp. 51-57. (doi: 10.1007/s13218-014-0340-1)

2014

Çelikkanat, H., Orhan, G., Pugeault, N. , Guerin, F., Şahin, E. and Kalkan, S. (2014) Learning and Using Context on a Humanoid Robot Using Latent Dirichlet Allocation. In: 4th International Conference on Development and Learning and on Epigenetic Robotics, Genoa, Italy, 13-16 Oct 2014, pp. 201-207. ISBN 9781479975402 (doi: 10.1109/DEVLRN.2014.6982982)

Ong, E.-J., Koller, O., Pugeault, N. and Bowden, R. (2014) Sign Spotting Using Hierarchical Sequential Patterns With Temporal Intervals. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OS, USA, 23-28 Jun 2014, pp. 1931-1938. ISBN 9781479951185 (doi: 10.1109/CVPR.2014.248)

2013

Ellis, L., Pugeault, N. , Öfjäll, K., Hedborg, J., Bowden, R. and Felsberg, M. (2013) Autonomous Navigation and Sign Detector Learning. In: 2013 IEEE Workshop on Robot Vision (WORV), Clearwater Beach, FL, USA, 15-17 Jan 2013, pp. 144-151. ISBN 9781467356480 (doi: 10.1109/WORV.2013.6521929)

Mustafa, W., Pugeault, N. and Krüger, N. (2013) Multi-View Object Recognition Using View-Point Invariant Shape Relations and Appearance Information. In: 2013 IEEE International Conference on Robotics and Automation, Karlsruhe, Germany, 06-10 May 2013, pp. 4230-4237. ISBN 9781467356435 (doi: 10.1109/ICRA.2013.6631175)

Sheerman-Chase, T., Ong, E.-J., Pugeault, N. and Bowden, R. (2013) Improving Recognition and Identification of Facial Areas Involved in Non-Verbal Communication by Feature Selection. In: 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), Shanghai, China, 22-26 Apr 2013, ISBN 9781467355469 (doi: 10.1109/FG.2013.6553764)

2012

Cooper, H., Ong, E.-J., Pugeault, N. and Bowden, R. (2012) Sign language recognition using sub-units. Journal of Machine Learning Research, 13, pp. 2205-2231.

Ong, E.-J., Cooper, H., Pugeault, N. and Bowden, R. (2012) Sign Language Recognition using Sequential Pattern Trees. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA, 16-21 Jun 2012, pp. 2200-2207. ISBN 9781467312288 (doi: 10.1109/CVPR.2012.6247928)

2011

Cooper, H., Pugeault, N. and Bowden, R. (2011) Reading the Signs: a Video Based Sign Dictionary. In: 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), Barcelona, Spain, 06-13 Nov 2011, pp. 914-919. ISBN 9781467300636 (doi: 10.1109/ICCVW.2011.6130349)

Pugeault, N. and Bowden, R. (2011) Driving Me Around the Bend: Learning to Drive From Visual Gist. In: 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), Barcelona, Spain, 06-13 Nov 2011, pp. 1022-1029. ISBN 9781467300636 (doi: 10.1109/ICCVW.2011.6130363)

Pugeault, N. and Bowden, R. (2011) Spelling it Out: Real-Time ASL Fingerspelling Recognition. In: 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), Barcelona, Spain, 06-13 Nov 2011, pp. 1114-1119. ISBN 9781467300636 (doi: 10.1109/ICCVW.2011.6130290)

Klette, R. et al. (2011) Performance of correspondence algorithms in vision-based driver assistance using an online image sequence database. IEEE Transactions on Vehicular Technology, 60(5), pp. 2012-2026. (doi: 10.1109/TVT.2011.2148134)

Pugeault, N. and Krüger, N. (2011) Temporal accumulation of oriented visual features. Journal of Visual Communication and Image Representation, 22(2), pp. 153-163. (doi: 10.1016/j.jvcir.2010.12.001)

Jessen, J. B., Pilz, F., Kraft, D., Pugeault, N. and Krüger, N. (2011) Accumulation of different visual feature descriptors in a coherent framework. In: Heyden, A. and Kahl, F. (eds.) Image Analysis: 17th Scandinavian Conference, SCIA 2011, Ystad, Sweden, May 2011. Proceedings. Series: Lecture notes in computer science (6688). Springer: Berlin, pp. 79-90. ISBN 9783642212260 (doi: 10.1007/978-3-642-21227-7_8)

2010

Kraft, D., Detry, R., Pugeault, N. , Başeski, E., Guerin, F., Piater, J. H. and Krüger, N. (2010) Development of object and grasping knowledge by robot exploration. IEEE Transactions on Autonomous Mental Development, 2(4), pp. 368-383. (doi: 10.1109/TAMD.2010.2069098)

Başeski, E., Pugeault, N. , Kalkan, S., Bodenhagen, L., Piater, J. H. and Krüger, N. (2010) Using multi-modal 3D contours and their relations for vision and robotics. Journal of Visual Communication and Image Representation, 21(8), pp. 850-864. (doi: 10.1016/j.jvcir.2010.06.006)

Pugeault, N. , Wörgötter, F. and Krüger, N. (2010) Visual primitives: Local, condensed, semantically rich visual descriptors and their applications in robotics. International Journal of Humanoid Robotics, 7(3), pp. 379-405. (doi: 10.1142/S0219843610002209)

Pugeault, N. , Wörgötter, F. and Krüger, N. (2010) Disambiguating multi-modal scene representations using perceptual grouping constraints. PLoS ONE, 5(6), e10663. (doi: 10.1371/journal.pone.0010663) (PMID:20544006) (PMCID:PMC2882939)

Sabatini, S. P., Gastaldi, G., Solari, F., Pauwels, K., Van Hulle, M. M., Diaz, J., Ros, E., Pugeault, N. and Krüger, N. (2010) A compact harmonic code for early vision based on anisotropic frequency channels. Computer Vision and Image Understanding, 114(6), pp. 681-699. (doi: 10.1016/j.cviu.2010.03.008)

Popović, M., Kraft, D., Bodenhagen, L., Başeski, E., Pugeault, N. , Kragic, D., Asfour, T. and Krüger, N. (2010) A strategy for grasping unknown objects based on co-planarity and colour information. Robotics and Autonomous Systems, 58(5), pp. 551-565. (doi: 10.1016/j.robot.2010.01.003)

Pugeault, N. and Bowden, R. (2010) Learning Driving Behaviour Using Holistic Image Descriptors. 4th International Conference on Cognitive Systems (CogSys 2010), Zurich, Switzerland, 27-28 Jan 2010.

Pugeault, N. and Bowden, R. (2010) Learning pre-attentive driving behaviour from holistic visual features. In: Daniilidis, K., Maragos, P. and Paragios, N. (eds.) Computer Vision – ECCV 2010: 11th European Conference on Computer Vision, Heraklion, Crete, Greece, September 5-11, 2010, Proceedings, Part VI. Series: Lecture notes in computer science (6312). Springer: Berlin ; Heidelberg, pp. 154-167. ISBN 9783642155666 (doi: 10.1007/978-3-642-15567-3_12)

Pugeault, N. , Pauwels, K., Van Hulle, M. M., Pilz, F. and Krüger, N. (2010) A Three-Level Architecture for Model-Free Detection and Tracking of Independently Moving Objects. In: International Conference on Computer Vision Theory and Applications (VISAPP 2010), Angers, France, 17-21 May 2010, pp. 237-244. ISBN 9789896740283

2009

Dentry, R., Pugeault, N. and Piater, J. H. (2009) A probabilistic framework for 3D visual object representation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(10), pp. 1790-1803. (doi: 10.1109/TPAMI.2009.64)

Başeski, E., Baunegaard With Jensen, L., Pugeault, N. , Pilz, F., Pauwels, K., Van Hulle, M. M., Wörgötter, F. and Krüger, N. (2009) Road Interpretation for Driver Assistance Based on an Early Cognitive Vision System. In: 4th International Conference on Computer Vision Theory and Applications (VISAPP 2009), Lisboa, Portugal, 05-08 Feb 2009, pp. 496-505. ISBN 9789898111692

Başeski, E., Bodenhagen, L., Pugeault, N. , Kalkan, S., Piater, J. and Krüger, N. (2009) Using 3D Contours and their Relations for Cognitive Vision and Robotics. In: 2009 24th International Symposium on Computer and Information Sciences, Guzelyurt, Cyprus, 14-16 Sep 2009, pp. 409-414. ISBN 9781424450213 (doi: 10.1109/ISCIS.2009.5291815)

Boesman, B., Jensen, L.B., Başeski, E., Pugeault, N. and Krüger, N. (2009) Bayesian reasoning using 3D relations for lane marker detection. In: Vision, Modeling, and Visualization Workshop (VMV 2009), Braunschweig, Germany, 16-18 Nov 2009, pp. 127-133. ISBN 9783980487481

Kraft, D., Detry, R., Pugeault, N. , Başeski, E., Piater, J. and Krüger, N. (2009) Learning objects and grasp affordances through autonomous exploration. In: Fritz, M., Schiele, B. and Piater, J. H. (eds.) Computer Vision Systems: 7th International Conference on Computer Vision Systems, ICVS 2009 Liège, Belgium, October 13-15, 2009. Proceedings. Series: Lecture notes in computer science (5815). Springer: Berlin ; New York, pp. 235-244. ISBN 9783642046667 (doi: 10.1007/978-3-642-04667-4_24)

Pilz, F., Pugeault, N. and Krüger, N. (2009) Comparison of point and line features and their combination for rigid body motion estimation. In: Cremers, D., Rosenhahn, B., Yuille, A. L. and Schmidt, F. R. (eds.) Statistical and Geometrical Approaches to Visual Motion Analysis: International Dagstuhl Seminar, Dagstuhl Castle, Germany, July 13-18, 2008. Revised Papers. Series: Lecture notes in computer science (5604). Springer: Berlin ; New York, pp. 280-304. ISBN 9783642030604 (doi: 10.1007/978-3-642-03061-1_14)

Simonsen, K. B., Nielsen, M. T., Pilz, F., Krüger, N. and Pugeault, N. (2009) Spatial-temporal junction extraction and semantic interpretation. In: Bebis, G., Boyle, R., Parvin, B., Koracin, D., Kuno, Y., Wang, J., Wang, J.-X., Wang, J., Pajarola, R., Lindstrom, P., Hinkenjann, A., Encarnação, M. L., Silva, C. T. and Coming, D. (eds.) Advances in Visual Computing: 5th International Symposium, ISVC 2009, Las Vegas, NV, USA, November 30 - December 2, 2009, Proceedings, Part I. Series: Lecture notes in computer science (5875). Springer: Berlin ; New York, pp. 275-286. ISBN 9783642103308 (doi: 10.1007/978-3-642-10331-5_26)

2008

Kraft, D., Pugeault, N. , Başeski, E., Popvić, M., Kragić, D., Kalkan, D., Wörgötter, F. and Krüger, N. (2008) Birth of the object: Detection of objectness and extraction of object shape through object-action complexes. International Journal of Humanoid Robotics, 5(2), pp. 247-265. (doi: 10.1142/S021984360800139X)

Detry, R., Pugeault, N. and Piater, J. (2008) Probabilistic pose recovery using learned hierarchical object models. In: Caputo, B. and Vincze, M. (eds.) Cognitive Vision: 4th International Workshop, ICVW 2008, Santorini, Greece, May 12, 2008, Revised Selected Papers. Series: Lecture notes in computer science (5329). Springer: Berlin ; New York, pp. 107-120. ISBN 9783540927808 (doi: 10.1007/978-3-540-92781-5_9)

Jensen, L. B.W., Baseski, E., Kalkan, S., Pugeault, N. , Wörgötter, F. and Krüger, N. (2008) Semantic reasoning for scene interpretation. In: Caputo, B. and Vincze, M. (eds.) Cognitive Vision: 4th International Workshop, ICVW 2008, Santorini, Greece, May 12, 2008, Revised Selected Papers. Series: Lecture notes in computer science (5329). Springer: Berlin ; New York, pp. 121-134. ISBN 9783540927808 (doi: 10.1007/978-3-540-92781-5_10)

Pugeault, N. , Kalkan, S., Wörgötter, F., Baseski, E. and Krüger, N. (2008) Relations Between Reconstructed 3D Entities. In: 3rd International Conference on Computer Vision Theory and Applications (VISAPP 2008), Funchal, Madeira, Portugal, 22-25 Jan 2008, pp. 186-193. ISBN 9789898111210

Pugeault, N. , Wörgötter, F. and Krüger, N. (2008) Accumulated Visual Representation for Cognitive Vision. In: British Machine Vision Conference 2008, Leeds, UK, 01-04 Sep 2008, ISBN 9781901725360 (doi: 10.5244/C.22.98)

2007

Aarno, D., Sommerfeld, J., Kragci, D., Pugeault, N. , Kalkan, S., Wörgötter, F., Kraft, D. and Krüger, N. (2007) Early reactive grasping with second order 3D feature relations. In: Lee, S., Suh, I. H. and Kim, M. S. (eds.) Recent Progress in Robotics: Viable Robotic Service to Human: An Edition of the Selected Papers from the 13th International Conference on Advanced Robotics. Series: Lecture notes in control and information sciences (370). Springer: Berlin, pp. 91-105. ISBN 9783540767282 (doi: 10.1007/978-3-540-76729-9_8)

Başeski, E., Pugeault, N. , Kalkan, S., Kraft, D., Wörgötter, F. and Krüger, N. (2007) A Scene Representation Based on Multi-Modal 2D and 3D Features. In: 2007 IEEE 11th International Conference on Computer Vision, Rio de Janeiro, Brazil, 14-21 Oct 2007, ISBN 9781424416301 (doi: 10.1109/ICCV.2007.4408836)

Pilz, F., Shi, Y., Grest, D., Pugeault, N. , Kalkan, S. and Krüger, N. (2007) Utilizing semantic interpretation of junctions for 3D-2D pose estimation. In: Bebis, G., Boyle, R., Parvin, B., Koracin, D., Paragios, N., Tanveer, S.-M., Ju, T., Liu, Z., Coquillart, S., Cruz-Neira, C., Müller, T. and Malzbender, T. (eds.) Advances in Visual Computing: Third International Symposium, ISVC 2007, Lake Tahoe, NV, USA, November 26-28, 2007, Proceedings, Part I. Series: Lecture notes in computer science (4851). Springer: Berlin ; New York, pp. 692-701. ISBN 9783540768579 (doi: 10.1007/978-3-540-76858-6_67)

Pugeault, N. , Baseski, E., Kraft, D., Wörgötter, F. and Krüger, N. (2007) Extraction of Multi-Modal Object Representations in a Robot Vision System. In: 1st International Workshop on Robot Vision in Conjunction with VISAPP 2007, Barcelona, Spain, 08-11 Mar 2007, pp. 126-135. ISBN 9789728865764

Sabatini, S. P., Gastaldi, G., Solari, F., Pauwels, K., Van Hulle, M. M., Diáz, J., Ros, E., Pugeault, N. and Krüger, N. (2007) Compact (and Accurate) Early Vision Processing in the Harmonic Space. In: 2nd International Conference on Computer Vision Theory and Applications (VISAPP 2007), Barcelona, Spain, 08-11 Mar 2007, pp. 213-220. ISBN 9789728865733

2006

Pugeault, N. , Wörgötter, F. and Krüger, N. (2006) Multi-Modal Scene Reconstruction Using Perceptual Grouping Constraints. In: 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06), New York, NY, USA, 17-22 Jun 2006, ISBN 9780769526461 (doi: 10.1109/CVPRW.2006.133)

2004

Wörgötter, F., Krüger, N., Pugeault, N. , Calow, D., Lappe, M., Pauwels, K., Van Hulle, M., Tan, S. and Johnston, A. (2004) Early cognitive vision: using Gestalt-laws for task-dependent, active image-processing. Natural Computing, 3(3), pp. 293-321. (doi: 10.1023/B:NACO.0000036817.38320.fe)

2003

Pugeault, N. and Krüger, N. (2003) Multi-Modal Matching Applied to Stereo. In: British Machine Vision Conference 2003, Norwich, UK, 09-11 Sep 2003, ISBN 9781901725247 (doi: 10.5244/c.17.28)

This list was generated on Mon Apr 22 22:59:29 2024 BST.
Jump to: Articles | Book Sections | Conference or Workshop Item | Conference Proceedings
Number of items: 59.

Articles

Kascenas, A. et al. (2023) The role of noise in denoising models for anomaly detection in medical images. Medical Image Analysis, 90, 102963. (doi: 10.1016/j.media.2023.102963) (PMID:37769551)

Alamri, F. and Pugeault, N. (2022) Improving object detection performance using scene contextual constraints. IEEE Transactions on Cognitive and Developmental Systems, 14(4), pp. 1320-1330. (doi: 10.1109/TCDS.2020.3008213)

Kirkwood, C., Economou, T., Pugeault, N. and Odbert, H. (2022) Bayesian deep learning for spatial interpolation in the presence of auxiliary information. Mathematical Geosciences, 54(3), pp. 507-531. (doi: 10.1007/s11004-021-09988-0)

Alharbawee, L. and Pugeault, N. (2021) A benchmark of dynamic versus static methods for facial action unit detection. Journal of Engineering, 2021(5), pp. 252-266. (doi: 10.1049/tje2.12001)

Kirkwood, C., Economou, T., Odbert, H. and Pugeault, N. (2021) A framework for probabilistic weather forecast post-processing across models and lead times using machine learning. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 379, 20200099. (doi: 10.1098/rsta.2020.0099) (PMID:33583271)

Mendez, O., Hadfield, S., Pugeault, N. and Bowden, R. (2020) SeDAR: reading floorplans like a human—using deep learning to enable human-inspired localisation. International Journal of Computer Vision, 128(5), pp. 1286-1310. (doi: 10.1007/s11263-019-01239-4)

Kerr, T., Clark, J. R., Fileman, E. S., Widdicombe, C. E. and Pugeault, N. (2020) Collaborative deep learning models to handle class imbalance in FlowCam plankton imagery. IEEE Access, 8, pp. 170013-170032. (doi: 10.1109/ACCESS.2020.3022242)

Mustafa, W., Pugeault, N. , Buch, A. G. and Krüger, N. (2017) Multi-view object instance recognition in an industrial context. Robotica, 35(2), pp. 271-292. (doi: 10.1017/s0263574715000430)

Pugeault, N. and Bowden, R. (2015) How much of driving is preattentive? IEEE Transactions on Vehicular Technology, 64(12), pp. 5424-5438. (doi: 10.1109/TVT.2015.2487826)

Rudzits, R. and Pugeault, N. (2015) Efficient learning of pre-attentive steering in a driving school framework. KI - Kunstliche Intelligenz, 29(1), pp. 51-57. (doi: 10.1007/s13218-014-0340-1)

Cooper, H., Ong, E.-J., Pugeault, N. and Bowden, R. (2012) Sign language recognition using sub-units. Journal of Machine Learning Research, 13, pp. 2205-2231.

Klette, R. et al. (2011) Performance of correspondence algorithms in vision-based driver assistance using an online image sequence database. IEEE Transactions on Vehicular Technology, 60(5), pp. 2012-2026. (doi: 10.1109/TVT.2011.2148134)

Pugeault, N. and Krüger, N. (2011) Temporal accumulation of oriented visual features. Journal of Visual Communication and Image Representation, 22(2), pp. 153-163. (doi: 10.1016/j.jvcir.2010.12.001)

Kraft, D., Detry, R., Pugeault, N. , Başeski, E., Guerin, F., Piater, J. H. and Krüger, N. (2010) Development of object and grasping knowledge by robot exploration. IEEE Transactions on Autonomous Mental Development, 2(4), pp. 368-383. (doi: 10.1109/TAMD.2010.2069098)

Başeski, E., Pugeault, N. , Kalkan, S., Bodenhagen, L., Piater, J. H. and Krüger, N. (2010) Using multi-modal 3D contours and their relations for vision and robotics. Journal of Visual Communication and Image Representation, 21(8), pp. 850-864. (doi: 10.1016/j.jvcir.2010.06.006)

Pugeault, N. , Wörgötter, F. and Krüger, N. (2010) Visual primitives: Local, condensed, semantically rich visual descriptors and their applications in robotics. International Journal of Humanoid Robotics, 7(3), pp. 379-405. (doi: 10.1142/S0219843610002209)

Pugeault, N. , Wörgötter, F. and Krüger, N. (2010) Disambiguating multi-modal scene representations using perceptual grouping constraints. PLoS ONE, 5(6), e10663. (doi: 10.1371/journal.pone.0010663) (PMID:20544006) (PMCID:PMC2882939)

Sabatini, S. P., Gastaldi, G., Solari, F., Pauwels, K., Van Hulle, M. M., Diaz, J., Ros, E., Pugeault, N. and Krüger, N. (2010) A compact harmonic code for early vision based on anisotropic frequency channels. Computer Vision and Image Understanding, 114(6), pp. 681-699. (doi: 10.1016/j.cviu.2010.03.008)

Popović, M., Kraft, D., Bodenhagen, L., Başeski, E., Pugeault, N. , Kragic, D., Asfour, T. and Krüger, N. (2010) A strategy for grasping unknown objects based on co-planarity and colour information. Robotics and Autonomous Systems, 58(5), pp. 551-565. (doi: 10.1016/j.robot.2010.01.003)

Dentry, R., Pugeault, N. and Piater, J. H. (2009) A probabilistic framework for 3D visual object representation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(10), pp. 1790-1803. (doi: 10.1109/TPAMI.2009.64)

Kraft, D., Pugeault, N. , Başeski, E., Popvić, M., Kragić, D., Kalkan, D., Wörgötter, F. and Krüger, N. (2008) Birth of the object: Detection of objectness and extraction of object shape through object-action complexes. International Journal of Humanoid Robotics, 5(2), pp. 247-265. (doi: 10.1142/S021984360800139X)

Wörgötter, F., Krüger, N., Pugeault, N. , Calow, D., Lappe, M., Pauwels, K., Van Hulle, M., Tan, S. and Johnston, A. (2004) Early cognitive vision: using Gestalt-laws for task-dependent, active image-processing. Natural Computing, 3(3), pp. 293-321. (doi: 10.1023/B:NACO.0000036817.38320.fe)

Book Sections

Jessen, J. B., Pilz, F., Kraft, D., Pugeault, N. and Krüger, N. (2011) Accumulation of different visual feature descriptors in a coherent framework. In: Heyden, A. and Kahl, F. (eds.) Image Analysis: 17th Scandinavian Conference, SCIA 2011, Ystad, Sweden, May 2011. Proceedings. Series: Lecture notes in computer science (6688). Springer: Berlin, pp. 79-90. ISBN 9783642212260 (doi: 10.1007/978-3-642-21227-7_8)

Pugeault, N. and Bowden, R. (2010) Learning pre-attentive driving behaviour from holistic visual features. In: Daniilidis, K., Maragos, P. and Paragios, N. (eds.) Computer Vision – ECCV 2010: 11th European Conference on Computer Vision, Heraklion, Crete, Greece, September 5-11, 2010, Proceedings, Part VI. Series: Lecture notes in computer science (6312). Springer: Berlin ; Heidelberg, pp. 154-167. ISBN 9783642155666 (doi: 10.1007/978-3-642-15567-3_12)

Kraft, D., Detry, R., Pugeault, N. , Başeski, E., Piater, J. and Krüger, N. (2009) Learning objects and grasp affordances through autonomous exploration. In: Fritz, M., Schiele, B. and Piater, J. H. (eds.) Computer Vision Systems: 7th International Conference on Computer Vision Systems, ICVS 2009 Liège, Belgium, October 13-15, 2009. Proceedings. Series: Lecture notes in computer science (5815). Springer: Berlin ; New York, pp. 235-244. ISBN 9783642046667 (doi: 10.1007/978-3-642-04667-4_24)

Pilz, F., Pugeault, N. and Krüger, N. (2009) Comparison of point and line features and their combination for rigid body motion estimation. In: Cremers, D., Rosenhahn, B., Yuille, A. L. and Schmidt, F. R. (eds.) Statistical and Geometrical Approaches to Visual Motion Analysis: International Dagstuhl Seminar, Dagstuhl Castle, Germany, July 13-18, 2008. Revised Papers. Series: Lecture notes in computer science (5604). Springer: Berlin ; New York, pp. 280-304. ISBN 9783642030604 (doi: 10.1007/978-3-642-03061-1_14)

Simonsen, K. B., Nielsen, M. T., Pilz, F., Krüger, N. and Pugeault, N. (2009) Spatial-temporal junction extraction and semantic interpretation. In: Bebis, G., Boyle, R., Parvin, B., Koracin, D., Kuno, Y., Wang, J., Wang, J.-X., Wang, J., Pajarola, R., Lindstrom, P., Hinkenjann, A., Encarnação, M. L., Silva, C. T. and Coming, D. (eds.) Advances in Visual Computing: 5th International Symposium, ISVC 2009, Las Vegas, NV, USA, November 30 - December 2, 2009, Proceedings, Part I. Series: Lecture notes in computer science (5875). Springer: Berlin ; New York, pp. 275-286. ISBN 9783642103308 (doi: 10.1007/978-3-642-10331-5_26)

Detry, R., Pugeault, N. and Piater, J. (2008) Probabilistic pose recovery using learned hierarchical object models. In: Caputo, B. and Vincze, M. (eds.) Cognitive Vision: 4th International Workshop, ICVW 2008, Santorini, Greece, May 12, 2008, Revised Selected Papers. Series: Lecture notes in computer science (5329). Springer: Berlin ; New York, pp. 107-120. ISBN 9783540927808 (doi: 10.1007/978-3-540-92781-5_9)

Jensen, L. B.W., Baseski, E., Kalkan, S., Pugeault, N. , Wörgötter, F. and Krüger, N. (2008) Semantic reasoning for scene interpretation. In: Caputo, B. and Vincze, M. (eds.) Cognitive Vision: 4th International Workshop, ICVW 2008, Santorini, Greece, May 12, 2008, Revised Selected Papers. Series: Lecture notes in computer science (5329). Springer: Berlin ; New York, pp. 121-134. ISBN 9783540927808 (doi: 10.1007/978-3-540-92781-5_10)

Aarno, D., Sommerfeld, J., Kragci, D., Pugeault, N. , Kalkan, S., Wörgötter, F., Kraft, D. and Krüger, N. (2007) Early reactive grasping with second order 3D feature relations. In: Lee, S., Suh, I. H. and Kim, M. S. (eds.) Recent Progress in Robotics: Viable Robotic Service to Human: An Edition of the Selected Papers from the 13th International Conference on Advanced Robotics. Series: Lecture notes in control and information sciences (370). Springer: Berlin, pp. 91-105. ISBN 9783540767282 (doi: 10.1007/978-3-540-76729-9_8)

Pilz, F., Shi, Y., Grest, D., Pugeault, N. , Kalkan, S. and Krüger, N. (2007) Utilizing semantic interpretation of junctions for 3D-2D pose estimation. In: Bebis, G., Boyle, R., Parvin, B., Koracin, D., Paragios, N., Tanveer, S.-M., Ju, T., Liu, Z., Coquillart, S., Cruz-Neira, C., Müller, T. and Malzbender, T. (eds.) Advances in Visual Computing: Third International Symposium, ISVC 2007, Lake Tahoe, NV, USA, November 26-28, 2007, Proceedings, Part I. Series: Lecture notes in computer science (4851). Springer: Berlin ; New York, pp. 692-701. ISBN 9783540768579 (doi: 10.1007/978-3-540-76858-6_67)

Conference or Workshop Item

Pugeault, N. and Bowden, R. (2010) Learning Driving Behaviour Using Holistic Image Descriptors. 4th International Conference on Cognitive Systems (CogSys 2010), Zurich, Switzerland, 27-28 Jan 2010.

Conference Proceedings

Goksu, O. and Pugeault, N. (2024) The Bad Batches: Enhancing Self-Supervised Learning in Image Classification Through Representative Batch Curation. In: IEEE World Congress on Computational Intelligence (IEEE WCCI 2024), Yokohama, Japan, 30 Jun - 05 Jul 2024, (Accepted for Publication)

Kascenas, A., Young, R., Jensen, B. S. , Pugeault, N. and O’Neil, A. Q. (2022) Anomaly Detection via Context and Local Feature Matching. In: IEEE International Symposium on Biomedical Imaging (ISBI) 2022, Kolkata, India, 28-31 Mar 2022, ISBN 9781665429238 (doi: 10.1109/ISBI52829.2022.9761524)

Kascenas, A., Pugeault, N. and O'Neil, A. Q. (2022) Denoising Autoencoders for Unsupervised Anomaly Detection in Brain MRI. In: Medical Imaging with Deep Learning (MIDL 2022), Zurich, Switzerland, 6-8 July 2022,

Alarmi, F., Kalkan, S. and Pugeault, N. (2021) Transformer-Encoder Detector Module: Using Context to Improve Robustness to Adversarial Attacks on Object Detection. In: 25th International Conference on Pattern Recognition (ICPR2020), Milan, Italy, 10-15 Jan 2021, ISBN 9781728188096 (doi: 10.1109/ICPR48806.2021.9413344)

He, S., Liao, W., Tavakoli, H. R., Yang, M., Rosenhahn, B. and Pugeault, N. (2021) Image Captioning through Image Transformer. In: 15th Asian Conference on Computer Vision, 30 Nov-04 Dec 2020, pp. 153-169. ISBN 9783030695378 (doi: 10.1007/978-3-030-69538-5_10)

He, S., Tavakoli, H. R., Borji, A. and Pugeault, N. (2019) Human Attention in Image Captioning: Dataset and Analysis. In: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, South Korea, 27 Oct - 02 Nov 2019, pp. 8528-8537. ISBN 9781728148038 (doi: 10.1109/ICCV.2019.00862)

He, S., Tavakoli, H. R., Borji, A., Mi, Y. and Pugeault, N. (2019) Understanding and Visualizing Deep Visual Saliency Models. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, 15-20 Jun 2019, pp. 10198-10207. ISBN 9781728132938 (doi: 10.1109/CVPR.2019.01045)

Çelikkanat, H., Orhan, G., Pugeault, N. , Guerin, F., Şahin, E. and Kalkan, S. (2014) Learning and Using Context on a Humanoid Robot Using Latent Dirichlet Allocation. In: 4th International Conference on Development and Learning and on Epigenetic Robotics, Genoa, Italy, 13-16 Oct 2014, pp. 201-207. ISBN 9781479975402 (doi: 10.1109/DEVLRN.2014.6982982)

Ong, E.-J., Koller, O., Pugeault, N. and Bowden, R. (2014) Sign Spotting Using Hierarchical Sequential Patterns With Temporal Intervals. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OS, USA, 23-28 Jun 2014, pp. 1931-1938. ISBN 9781479951185 (doi: 10.1109/CVPR.2014.248)

Ellis, L., Pugeault, N. , Öfjäll, K., Hedborg, J., Bowden, R. and Felsberg, M. (2013) Autonomous Navigation and Sign Detector Learning. In: 2013 IEEE Workshop on Robot Vision (WORV), Clearwater Beach, FL, USA, 15-17 Jan 2013, pp. 144-151. ISBN 9781467356480 (doi: 10.1109/WORV.2013.6521929)

Mustafa, W., Pugeault, N. and Krüger, N. (2013) Multi-View Object Recognition Using View-Point Invariant Shape Relations and Appearance Information. In: 2013 IEEE International Conference on Robotics and Automation, Karlsruhe, Germany, 06-10 May 2013, pp. 4230-4237. ISBN 9781467356435 (doi: 10.1109/ICRA.2013.6631175)

Sheerman-Chase, T., Ong, E.-J., Pugeault, N. and Bowden, R. (2013) Improving Recognition and Identification of Facial Areas Involved in Non-Verbal Communication by Feature Selection. In: 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), Shanghai, China, 22-26 Apr 2013, ISBN 9781467355469 (doi: 10.1109/FG.2013.6553764)

Ong, E.-J., Cooper, H., Pugeault, N. and Bowden, R. (2012) Sign Language Recognition using Sequential Pattern Trees. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA, 16-21 Jun 2012, pp. 2200-2207. ISBN 9781467312288 (doi: 10.1109/CVPR.2012.6247928)

Cooper, H., Pugeault, N. and Bowden, R. (2011) Reading the Signs: a Video Based Sign Dictionary. In: 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), Barcelona, Spain, 06-13 Nov 2011, pp. 914-919. ISBN 9781467300636 (doi: 10.1109/ICCVW.2011.6130349)

Pugeault, N. and Bowden, R. (2011) Driving Me Around the Bend: Learning to Drive From Visual Gist. In: 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), Barcelona, Spain, 06-13 Nov 2011, pp. 1022-1029. ISBN 9781467300636 (doi: 10.1109/ICCVW.2011.6130363)

Pugeault, N. and Bowden, R. (2011) Spelling it Out: Real-Time ASL Fingerspelling Recognition. In: 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), Barcelona, Spain, 06-13 Nov 2011, pp. 1114-1119. ISBN 9781467300636 (doi: 10.1109/ICCVW.2011.6130290)

Pugeault, N. , Pauwels, K., Van Hulle, M. M., Pilz, F. and Krüger, N. (2010) A Three-Level Architecture for Model-Free Detection and Tracking of Independently Moving Objects. In: International Conference on Computer Vision Theory and Applications (VISAPP 2010), Angers, France, 17-21 May 2010, pp. 237-244. ISBN 9789896740283

Başeski, E., Baunegaard With Jensen, L., Pugeault, N. , Pilz, F., Pauwels, K., Van Hulle, M. M., Wörgötter, F. and Krüger, N. (2009) Road Interpretation for Driver Assistance Based on an Early Cognitive Vision System. In: 4th International Conference on Computer Vision Theory and Applications (VISAPP 2009), Lisboa, Portugal, 05-08 Feb 2009, pp. 496-505. ISBN 9789898111692

Başeski, E., Bodenhagen, L., Pugeault, N. , Kalkan, S., Piater, J. and Krüger, N. (2009) Using 3D Contours and their Relations for Cognitive Vision and Robotics. In: 2009 24th International Symposium on Computer and Information Sciences, Guzelyurt, Cyprus, 14-16 Sep 2009, pp. 409-414. ISBN 9781424450213 (doi: 10.1109/ISCIS.2009.5291815)

Boesman, B., Jensen, L.B., Başeski, E., Pugeault, N. and Krüger, N. (2009) Bayesian reasoning using 3D relations for lane marker detection. In: Vision, Modeling, and Visualization Workshop (VMV 2009), Braunschweig, Germany, 16-18 Nov 2009, pp. 127-133. ISBN 9783980487481

Pugeault, N. , Kalkan, S., Wörgötter, F., Baseski, E. and Krüger, N. (2008) Relations Between Reconstructed 3D Entities. In: 3rd International Conference on Computer Vision Theory and Applications (VISAPP 2008), Funchal, Madeira, Portugal, 22-25 Jan 2008, pp. 186-193. ISBN 9789898111210

Pugeault, N. , Wörgötter, F. and Krüger, N. (2008) Accumulated Visual Representation for Cognitive Vision. In: British Machine Vision Conference 2008, Leeds, UK, 01-04 Sep 2008, ISBN 9781901725360 (doi: 10.5244/C.22.98)

Başeski, E., Pugeault, N. , Kalkan, S., Kraft, D., Wörgötter, F. and Krüger, N. (2007) A Scene Representation Based on Multi-Modal 2D and 3D Features. In: 2007 IEEE 11th International Conference on Computer Vision, Rio de Janeiro, Brazil, 14-21 Oct 2007, ISBN 9781424416301 (doi: 10.1109/ICCV.2007.4408836)

Pugeault, N. , Baseski, E., Kraft, D., Wörgötter, F. and Krüger, N. (2007) Extraction of Multi-Modal Object Representations in a Robot Vision System. In: 1st International Workshop on Robot Vision in Conjunction with VISAPP 2007, Barcelona, Spain, 08-11 Mar 2007, pp. 126-135. ISBN 9789728865764

Sabatini, S. P., Gastaldi, G., Solari, F., Pauwels, K., Van Hulle, M. M., Diáz, J., Ros, E., Pugeault, N. and Krüger, N. (2007) Compact (and Accurate) Early Vision Processing in the Harmonic Space. In: 2nd International Conference on Computer Vision Theory and Applications (VISAPP 2007), Barcelona, Spain, 08-11 Mar 2007, pp. 213-220. ISBN 9789728865733

Pugeault, N. , Wörgötter, F. and Krüger, N. (2006) Multi-Modal Scene Reconstruction Using Perceptual Grouping Constraints. In: 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06), New York, NY, USA, 17-22 Jun 2006, ISBN 9780769526461 (doi: 10.1109/CVPRW.2006.133)

Pugeault, N. and Krüger, N. (2003) Multi-Modal Matching Applied to Stereo. In: British Machine Vision Conference 2003, Norwich, UK, 09-11 Sep 2003, ISBN 9781901725247 (doi: 10.5244/c.17.28)

This list was generated on Mon Apr 22 22:59:29 2024 BST.

Grants

  • Fellowship of the Alan Turing Institute, 2018-20
  • DEVA Principal Investigator on an EPSRC First Grant proposal, 2016-18
  • Floor surface analysis and autonomous remedial. PI on a Knowledge Transfer Partnership (InnovateUK) with RCR Flooring, 2019-21
  • Lights, Camera, Action? Using Body Worn Video to assess (de)escalation in police use of force CI on a Policing Lab Fund from Devon and Cornwall Police, 2020
  • Machine Learning for Automatic Plankton Detection, Identification and Quantification CI on a collaboration fund with the Plymouth Marine Laboratory, 2020

Supervision

2020– Yu Amano: PhD on retinotopic sampling for image recognition 

2018– Charlie Kirkwood: PhD on Machine Learning Approaches for Weather Prediction (second supervisor)

 

  • Akbari Movahed, Reza
    Bayesian Deep Atlases for Cardiac Motion Abnormality Assessment by Integrating Imaging and Metadata
  • Audonnet, Florent Philippe Jean
    Shared Autonomy Using Virtual Reality as a Building Block Towards Autonomous Robots
  • GOKSU, OZGU
    B18 Using Deep Reinforcement Learning in order to Improve the Effectiveness of Training for Unseen Domains
  • He, Zhuo
    Generalized Machine Learning with limited Training Data
  • Hu, Wenhao
    A New Point of View of Channel Pruning for Deep Neural Networks
  • Shi, Tong
    Deep Learning based Audio-Visual Emotion Recognition to Enhance Human-Robot Interaction
  • Sulaiman, Yiliyasi
    Visual Nowcasting for Robot Control
  • Young, Rory
    Reinforcement learning for unknown stochastic environments with sparse and dynamic rewards
  • 2020–2021 Linfeng Yuan: Masters on transfer learning for image segmentation

  • 2017–21 Sen He: PhD on Learning Dynamic Attention (first supervisor)

  • 2017–2020 Mohammad Rami Koujan: PhD on 3D Facial Analysis (second supervisor)

  • 2016–20 Faisal Alamri: PhD on Contextual Information in Object Recognition (first supervisor, writing up)

  • 2016–20 Luma Al-Harwabi: PhD on Feature Learning for Visual Emotion Recognition (first supervisor, writing up)

  • 2018–19 Lukas Smyth: MRes on Curriculum Learning (first supverisor, thesis submitted). 

  • 2018-19 Nicholas Kirk, MPhil by publications (graduated in 2019 from the University of Exeter) on Cognitive Robotics (first supervisor)

  • 2014–18 Dr Oscar Mendez Maldonado, PhD (graduated in 2018 from the University of Surrey) on Autonomous Collaborative UAV Swarms for Visual Inspection awarded at the University of Surrey (first supervisor until I left Surrey, then second)

  • 2012–16 Dr Wail Mustafa PhD (graduated in 2016 from the University of Southern Denmark), on The semantic interpretation of visual scenes in the context of learning by demonstration (external supervisor)

  • 2005-11 Dr Florian Pilz PhD (graduated in 2011 from the University of Southern Denmark) on Using Point and Line Features for Motion Estimation and 3D Scene Interpretation (external supervisor)

  • 2007-10 Dr Emre Başeski PhD (graduated in 2010 from the University of Southern Denmark) on Multi-modal 3D Contours and Their Relations Applied in Cognitive Vision and Robotics (external supervisor)

Teaching

I teach the following modules:

  • COMPSCI5085 Deep Learning (lead)
  • COMPSCI5089 Introduction to Data Science and Systems (lead)

Additional information

I am a member of the IEEE, the British Machine Vision Association, and I have been awarded a Fellowship of the Alan Turing Institute between 2018 and 2020.


mugshot