Majid Alkaee Taleghan School of Electrical Engineering and Computer Science 1148 Kelley Engineering Center Oregon State University Email: alkaee [AT] eecs.oregonstate.edu Corvallis, OR 97331-5501 http://eecs.oregonstate.edu/∼alkaeetm Education School of Electrical Engineering and PhD in Computer Science (Machine Learning) Computer Science, Oregon State Research Assistant University Corvallis, OR Spring 2011-Summer 2016 Thesis: Simulator-Defined MDP Planning with Applications in Resource Management Advisor: Dr. Tom Dietterich School of Electrical Engineering and Computer Science, Oregon State University Corvallis, OR Advisor: Dr. Bechir Hamdaoui Teaching/Research Assistant in Computer Science (Wireless Networking) Winter 2009-Winter 2011 Computer Engineering Department, Iran Master of Science in Software Engineering University of Science and Technology Tehran, Iran 9/2003-2/2006 Thesis: A Service-Oriented Middleware with QoS Support in Wireless Sensor Networks Advisor: Dr. Mohsen Sharifi Ranked 1st among all Software Engineering graduates, entered in 2003 in M.Sc. Program Computer Engineering Department, Sharif Bachelor of Science in Software Engineering University of Technology (SUT) Tehran, Iran 9/1999-9/2003 Thesis: Presenting a Web-Based Environment for Cooperative Learning Advisor: Dr. Hamid Reza Rabiee Research Interests Research Experience • Reinforcement Learning • Software Engineering • Deep Learning • Artificial Intelligence • Machine Learning • Distributed Embedded Systems Machine Learning Group Research Assistant EECS Department Spring 2011 - Summer 2016 Oregon State University Research on Sample-Efficient Algorithms for Solving Spatial Markov Decision Processes I am currently working with Dr. Dietterich on the problem of managing invasive species under the field of Computational Sustainability. The goal of the project is to solve spatio-temporal optimization problems under uncertainty. The main challenges are to find exact (or bounded approximate) solutions for real-sized instances. Wireless Networking Group Research Assistant EECS Department Winter 2009 - Winter 2011 Oregon State University Research on Optimal Mechanism Design for Dynamic Spectrum Allocation Distributed Systems Lab CE Department Iran University of Science and Technology Research on QoS Consideration in Distributed Wireless Sensor Networks 1 Research Assistant 2004 - 2007 Graduate Courses • Computer Vision • Theory of Computation • Applied Multivariate Analysis • Advanced Databases • Algorithms and Data Structures • Advanced Software Engineering • Nonlinear Optimization • Introduction to Bayesian Networks • Distributed Systems Applications (Advanced Operating Systems) • Theory of Statistics 1 & 2 • Advanced Computer Networks • Intelligent Agent & Decision Making • Advanced Compiler Design • Machine Learning • Advanced Computer Architectures • Applied Stochastic Models • Parallel Algorithms and Architectures • Graph Theory with Applications to Computer Professional Experience NASA Ames Research Center Mountain View, CA Deep Learning Intern Summer 2015 • Applied deep learning algorithms for anomaly detection to time-series data • Utilized the following technologies: Matlab, Python, Theano Caspian Co. Tehran, Iran Software Engineer 2006 - 2009 • Senior Java Designer and Developer • Developed lending and cheque projects • Taught Java to a group of employees • Utilized the following technologies: Spring, Hibernate, Caching, Oracle 10g, Jasper Reports IUST Tehran, Iran Software Engineer Fall 2005 - Summer 2006 • Senior Java Designer and Developer • Developed a pilot of the Iranian Insurance Project • Utilized the following technologies: J2EE, Oracle, Jrules, Struts, Magic Draw, and Toplink Nebras Informatics Co Tehran, Iran Software Engineer 2003 - 2005 • Junior/Senior Java Designer and Developer • Developed online office and document management projects • Supervised two undergraduate interns during their internships • Utilized the following technologies: J2EE, Java (JSP, Swing) Publications Refereed Journal Publications • Majid Alkaee Taleghan, Thomas G. Dietterich, Mark Crowley, Kim Hall, Heidi J. Albers, “PAC Optimal MDP Planning with Application to Invasive Species Management,” Journal of Machine Learning Research (JMLR), 16 (Dec), 3877-3903, 2015. • Amirhosein Taherkordi, Majid Alkaee Taleghan and Mohsen Sharifi, “Dependability Considerations in Wireless Sensor Networks Applications,” Journal of Networks (JNW), Vol. 1, No. 6, 2006. Refereed Conference/Workshop Publications • Thomas G. Dietterich, Majid Alkaee Taleghan, Mark Crowley, “PAC Optimal Planning for Invasive Species Management: Improved Exploration for Reinforcement Learning from Simulator-Defined MDPs,” In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), USA, 2013. 2 • Kim Hall, Majid Alkaee Taleghan, Heidi J. Albers, Mark Crowley, Thomas G. Dietterich, “Managing Invasive Species in a River Network,” Third International Conference on Computational Sustainability (CompSust), Denmark, 2012. • Majid Alkaee Taleghan, Bechir Hamdaoui, “Efficiency-Revenue Optimality Tradeoffs in Dynamic Spectrum Allocation,” In Proceedings of IEEE International Global Communications Conference (Globecom) 2010, USA, 2010. • Majid Alkaee Taleghan, Amirhosein Taherkordi, Mohsen Sharifi and Tai-Hoon Kim, “A Survey of System Software for Wireless Sensor Networks,” In Proceedings of the International Workshop on Wireless Ad-Hoc, Mesh, and Sensor Networks (WAMSNet), Korea, 2007. • Mohsen Sharifi, Majid Alkaee Taleghan and Amirhosein Taherkordi, “A Publish-Subscribe Middleware for Real-Time Wireless Sensor Networks,” In Proceedings of International Conference on Computational Science (ICCS), Springer, No. 3991, 2006. • Amirhosein Taherkordi, Majid Alkaee Taleghan and Mohsen Sharifi, “Achieving Availability and Reliability in Wireless Sensor Networks Applications,” In Proceedings of the First International Conference on Availability, Reliability and Security (ARES), Austria, 2006. • Mohsen Sharifi, Majid Alkaee Taleghan and Amirhosein Taherkordi, “A Middleware Layer Mechanism for QoS Support in Wireless Sensor Networks,” In Proceedings of the 4th IEEE International Conference on Networking (ICN), Mauritius, 2006. Under Review • Majid Alkaee Taleghan and Thomas G. Dietterich, “Combining global and local confidence intervals for more efficient MDP planning”, Journal of Machine Learning Research (JMLR). • Kim Hall, Heidi J. Albers, Majid Alkaee Taleghan, Thomas G. Dietterich, “Optimal Spatial-Dynamic Management of Stochastic Species Invasions, Environmental and Resource Economics,” Environmental and Resource Economics Journal (EARE). Teaching Experience Teaching Assistant & Instructor Software Engineering I, Introduction to Computer Networking, Operating System I, Introduction to Computer Architecture EECS, OSU, Corvallis, OR Awards and Honors 2011 (W), 2010 (FWSS), 2009 (FWS), 2013 (S) • Ranked 1st among all Software Engineering graduates, entered in 2003 in M.Sc. Program, Computer Engineering Department, IUST, Tehran, Iran. • Programming Languages: Java, Python, JSP, Pascal, C++, SQL, HTML, JavaScript. Professional Skills • Open Source Packages: Spring, Struts, Hibernate, Log4j, JUnit, JMeter, JProbe, Jasper Report, Ant, JProfiler, POI, Weka, MPI, MPI4Py, Tomcat, Maven, SVN, Theano. R and related Toolboxes, MATLAB • Mathematical Analysis and Simulation using MATLAB GUI, R, Octave. Miscellaneous • Invasive species domain for RL competition 2013 link to code • I completed the online Machine Learning course (ml-class.org) in Fall 2011. 3