Version 2
Universidade Nacional da Irlanda em Galway -- Ciência sem Fronteiras
PhD Project Template



Use one form per project
Please complete & submit to international@nuigalway.ie as soon as possible, and by 27/11/2012
In your email, begin the subject line with [SWB] (be sure to use square brackets) to ensure that
your email is filed correctly. Emails will be automatically filed
PI name & contact details:
School:
Dr Michael Madden:
michael.madden@nuigwalway.ie +353 91 493797
Information Technology,
College of Engineering & Informatics
Has project been agreed with head (or
nominee) of proposed registration school?
Yes
Research Centre / group affiliation:
Machine Learning & Data Mining Research Group
Research group / centre website:
http://datamining.it.nuigalway.ie/
PI website / link to CV:
http://datamining.it.nuigalway.ie/
Brief summary of PI research / research group / centre activity (2 or 3 lines max):
We focus on advances in techniques for machine learning and data mining, motivated by solving
important and interesting practical applications. We work on classification algorithms, kernel
methods, reinforcement learning, probabilistic inference, and data stream mining.
Title & brief description of PhD project (suitable for publication on web):
Machine Learning for Non-Player Characters in Computer Games
In recent years, our research group has been working on new techniques for incorporating machine
learning into non-player characters (NPCs) in first-person shooter games. See for example, “DREBot: A Hierarchical First Person Shooter Bot Using Multiple Sarsa(λ) Reinforcement Learners” by
Glavin & Madden, CGAMES USA 2012.
We work in particular on techniques based on reinforcement learning, in which a computer system
can learn to play better through trial and error, with the goal of maximising its long-term score. We
have developed a hierarchical approach to breaking a game into separate modes that require
different strategies, and then using separate reinforcement learners to perform well at each
strategy. We have also developed methods to transfer experience gained in simple environments to
more complex ones, inspired by how humans learn.
This project will build on our past work in this area, and will involve research into different methods
for planning, reasoning, and other forms of artificial intelligence in games, in order to improve the
Version 2
Universidade Nacional da Irlanda em Galway -- Ciência sem Fronteiras
performance of NPCs when playing against other intelligent NPCs and against humans. This work is
likely to involve participating in gameplay contests against other human and computer players.
Unique selling points of PhD project in NUI Galway:
The National University of Ireland Galway, founded in 1845, has a distinguished record in scholarship and
research. The University enjoys a close relationship with Galway city, which is shaped by artistic communities,
active student life, innovative industry and leading edge research.
The University’s Structured PhD programme enables researchers to take advanced technical courses as well as
to develop their research skills in the early stages of their PhD work.
The Machine Learning & Data Mining Group has been working on techniques related to Reinforcement
Learning over many years. The group has strong links with research groups in other universities
internationally, such as the University of California Berkeley, the University of California Irvine and the
University of Helsinki, Finland.
Name & contact details for project queries, if different from PI named above:
As above.
Please indicate the graduates of which disciplines that should apply:
Computer Science, Software Engineering, Mathematics, or similar disciplines.
Ciência sem Fronteiras / Science Without Borders Priority Area:
Please indicate the specific programme priority area under which the proposed PhD project fits- choose only
one (tick box):
Engineering and other technological areas
Pure and Natural Sciences (e.g. mathematics, physics, chemistry)/Physical Sciences (Mathematics,
Physics, Chemistry, Biology and Geosciences)
Health and Biomedical Sciences / Clinical, Pré-clinical and Health Sciences

Information and Communication Technologies (ICTs), Computing
Aerospace
Pharmaceuticals
Sustainable Agricultural Production
Oil, Gas and Coal
Renewable Energy
Minerals, Minerals Technology
Biotechnology
Nanotechnology and New Materials
Technologies for Prevention and Mitigation of Natural Disasters
Bioprospecting and Biodiversity
Marine Sciences
Creative Industry
New technologies in constructive engineering
Version 2
Universidade Nacional da Irlanda em Galway -- Ciência sem Fronteiras
Please indicate which of the following applies to this project (referring to Science Without Borders
arrangements):
Suitable only as a Full PhD (Y/N): _ ____
Available to candidates seeking a Sandwich PhD arrangement (Y/N): _____
Suitable for either/Don’t know: 