Robert Kozma Computer Science Professional Development Assignment 2005-2006 Overview of main activities during PDA: June - October, 2005 NASA Jet Propulsion Laboratory, at California Institute of Technology, Pasadena, CA Visiting Professor & Contractor at Santa Barbara Advanced Research Co. SBAR October - December, 2005 Sarnoff Corporation, Princeton, NJ Visiting Researcher at Intelligent Data Processing Group January - April, 2006 Lawrence Berkeley National Laboratory (LBNL) University of California at Berkeley Visiting Scholar affiliated with Berkeley Initiative on Soft Computing May - August, 2006 US Air Force Research Laboratory, Hanscom AFB, MA Senior NRC Fellow at Electromagnetic Scattering Branch Awarded by National Research Council, National Academy of Sciences Additional major service tasks during PDA: Chair of Finances WCCI06 IEEE 2006 World Congress on Computational Intelligence Chair for Finances and Treasurer of WCCI 2006 Extensive work on preparations & coordinating of 1500+ attendees Over $800,000 budget, July 2006, Vancouver, Canada PI and Co-Chair NSF US-Hungarian Workshop on Large-Scale Random Graph Co-Chair (with Bela Bollobas) NSF interdisciplinary show-case (MathCS-NeuroSci-Physics) 70 attendees from US, Hungary & other countries, Budapest 27-Sept. 4, 2006, Budapest, Hungary Summary of My Efforts at Individual Labs: 1. NASA Jet Propulsion Laboratory, at California Institute of Technology, Pasadena, CA Planetary Robotics and Autonomy Group, June - October, 2005 Summary of work: Application of self-organized development of autonomous systems (SODAS) using nonlinear dynamics for perception and action for onboard processing of sensor inputs and onboard dynamic behavior tasking based on those inputs using NASA SRR2K (Sample Return Rover) robotic rover platform for Martian planetary exploration. Develop a prototype guidance, navigation and control (GNC) architecture and test in NASA relevant domains. Experiments are conducted at the indoor facility of the Planetary Robotics Group, JPL. It includes an approximately 300 sqft irregularly shaped test area covered by sand and rocks imitating natural exploration environments. The terrain layout is variable from smooth surface for easy advance to rough terrain with various hills and slopes posing more challenges to SRR2K traversing through it. The lighting conditions are adjustable at need. Outputs: 1. Public release of the results is in progress. One book chapter and one journal paper is already available (listed at the end of the report). 2. Disclosures: Three Invention and New Technology Disclosures have been filed (Nov. 2005) with NASA New Technology office on the subjects: KIV Model of Dynamic Memories and Decision Making in Autonomous Systems, Computational Method and Software for Sensation and Perception by Multisensory Agents, Dynamical Control and Navigation System for Mobile Robots 3. Talks have been given during my work with NASA/JPL at JPL, Pasadena, CA, The Neuroscience Institute, La Jolla, CA, and Montreal, Canada (listed at end of the report). 4. Based on the success of my tenure at JPL in 2005, NASA offered additional funding ($93k) to support my stay with NASA/JPL during 2006-2007 in order to implement the results of the research started during my sabbatical leave in 2005. However, I could not accept this attractive NASA offer as I was unable to secure the support of the Dean of A&S for awarding me an additional leave from my permanent employer the UoM for the award duration. 2. Sarnoff Corporation, Princeton, NJ, October - December, 2005 - Visiting Researcher at Intelligent Data Processing Group Summary of work: The main activities were aimed at the development of self-evolving data-retrieval system for hypothesis generation and testing. Users often formulate hypotheses that they want to find supporting data for when performing search. The initial hypothesis reflects their preliminary knowledge of the subject. The final hypotheses at the end of the search reflect what they have learnt about a given subject and reflect the supporting information they have found during search. We proposed an evolutionary computation-based method that automatically generates queries and retrieves information to prove or disprove a given hypothesis. In case there is no supporting data, the system evolves another hypothesis for which it can find supporting data. This work has been aimed at biomedical data search and hypothesis testing. Outputs: 1. Technical disclosure with Sarnoff Co. on data retrieval method and software based of evolutionary hypothesis testing. 2. Initial publication of the results at a Data Mining Conference (see list of publications). 3. Several talks and seminars were given at Sarnoff Co. during my stay with the company. 3. Lawrence Berkeley National Laboratory (LBNL), University of California at Berkeley - January - April, 2006 Summary of work: Large-scale dynamics of cortical activity is studied using theoretical models based on neuropercolation approach. The behavior of the power spectral densities near criticality is analyzed. The following results have been achieved: We introduced the two-layer excitatory-inhibitory model and studied the behavior of its major parameters. The simulated neural network has been coarse-grained into groups of neurons and the group activation levels tested for synchrony. Massive computations have been carried out with the lattice model. Various connectivity configurations have been used to derive conditions for the onset of scale-free neural dynamics. It is concluded that $1/f^{\alpha}$ behavior in power spectra are highly sensitive to the critical state of the system. Close to criticality, the value of the exponent is $\alpha\approx 2$. We have interpreted results of EEG and EMG experiments based on our model data. Various normal and abnormal mental states have been interpreted as dynamic systems using our brain theory. Outputs: 1. Several Talks have been given in Berkeley and other places related to my work at Berkeley: UC Berkeley, Division of Computer Science, March, 2006 Florida Atlantic University, center of Complex and Cognitive Systems, January, 2006, Boca Raton, Florida Chaos and Complexity Conference, at Istanbul Kultur University, Turkey, May 12-13, 2006 2. About 6 publications have been prepared and submitted to journals and/or conferences (see attached list of publications). 4. US Air Force Research Laboratory, Hanscom, AFB, MA, Senior NRC Fellow at Electromagnetic Scattering Branch, May - August 2006 Summary of work: Theoretical extension of model field theory approach to dynamic logic with time-dependent energy function. Derivation the mathematical model equations for the extended model. Software implementation in MATLAB of the time-dependent version of the dynamic logic model field theory and biomedical application of the results for the identification of phase transitions in brain experiments. Derivation of the equations of dynamical logic with numerically evaluated model derivatives. Implementation of the algorithm in MATLAB environment suitable for various practical applications. Application of dynamic logic for the problem of identification of targets behind multiple walls using SAR-based refocusing techniques. Outputs: 1. Public disclosure of some of the results is in progress. 2. During my tenure at AFRL I have given a number of talks at the Lab, and also at: 10th International Conference on Artificial Life ALIFEX, organized a 1-day long workshop with 8 speakers from around the world, June 3-6, 2006, Bloomington, IN 2006 IEEE World Congress on Computational Intelligence (1 invited talk, 1 panel talk, 2 further talks, and chaired/organized a 1 day-long special track), July 16-21, Vancouver, Canada 3. Based on my successful work with AFRL, I have received an offer from NRC to extend my tenure with AFL for another year, which I declined due to my contractual obligations to UoM. 4. Preparation of a joint DARPA project proposal with AFRL on the wall-penetrating radar project for more complex environments and multiple targets. 5. Co-authoring a book with my colleague from AFRL and Harvard University, MA about extending the application of time-dependent dynamical logic approach to the analysis of actual EEG multi-channel data with high noise level. 5. Educational Benefits to Department and College: Curricular work: Presently I work on a new course outline, which is directly based on my experiences at NASA related to dynamical approaches to intentional robots and autonomy Model Field Theory (MFT) is a powerful statistical tool for optimum estimation of mixture parameters in pattern recognition problems, and it is widely used in various Air Force problems. The method is in public domain. I will use it in my advanced graduate courses to broaden the students’ scope and their tools. Student mentoring: I have organized visits and exchanges for some of my students from Memphis to Caltech, JPL, and UC Berkeley. These visits broadened their perspective and provided help in their career development. Although I have been on sabbatical I maintained the supervision of my students in Memphis, I have visited Memphis several times (without financial support from University). I have rather donated some of my meager grant and salary money for student and postdoc support. One of my PhD students graduated in the fall 2005, and I paid several visits to Memphis for his graduation support. Appendix Major Publications Generated During my PDA: Books: 1. Kozma, R., L. Perlovsky (Editors) Neurodynamics and Higher-Level Cognitive Behavior and Consciousness, Springer Series: Lecture Notes in Computational Intelligence, Springer Verlag, Heidelberg, Germany (2007, to be published) 2. B. Bollobas, R. Kozma, G. Tusnady, D. Miklos (Editors) Large-scale Random Graph Methods for Modeling Mesoscopic Behavior in Biological and Physical Systems, Bolyai-Springer Series on Advanced Combinatorics, Springer Verlag, New York (2007, to be published) Journals: 3. R. Ilin, R. Kozma, Stability of coupled excitatory-inhibitory neural populations and application to control of multi-stable systems, Physics Letters A (2006), doi:10.1016/j.physleta.2006.07.050 (in press, July 2006) 4. Kozma, R., Fukuda, T. Dynamical Intentional Systems - Fundamental Concepts and Applications, Int. J. Intelligent Systems (in press, August 2006) 5. Harter, D., Kozma, R. Aperiodic Dynamics and self-organization of cognitive maps in autonomous agents, Int. J. Intelligent Systems (in press, August 2006) 6. Beliaev, I., Kozma, R. Time series prediction using chaotic neural networks, Neurocomputing, (revised 2006) 7. R. Kozma, R.W. Deming, L.I. Perlovsky, Dynamic Logic with Time-Dependent Energy Function - Application to Optimal Estimation of Parameters of Transient Mixture Processes, IEEE Transactions on Neural Networks (in progress 2006) 8. Kozma, R. Modeling Scale-Free Cortical Dynamics using Neuropercolation Approach, (to be published, 2006) 9. Kozma, R., Huntsberger, T. A dynamical approach to robot intelligence and autonomy, J. Autonomous Robots (in progress, 2006) Proceedings and Book Chapters: 10. Huntsberger, T., H. Aghazarian, E. Tunstel, R. Kozma, Onboard learning strategies for planetary surface rovers, Chapter 20, in volume: E. Tunstel, A. Howard (eds), TCI Press, Alburquerque, NM. (2006) 11. R. Kozma, Neuropercolation Model of Cortical Phase Transitions - Dynamics of Cognition and Intelligence, Keynote Talk at Chaos & Complex Systems Symposium May 12-13, 2006, Istanbul, Turkey (in progress, 2006) 12. Kozma, R., Buczak, A., Biomedical Hypothesis Generation and Testing by Evolutionary Computation, 2006 Data Mining Conference DMIN, June 2006, Las Vegas 13. R. Kozma, Influence of Criticality on 1/f^a Spectral Characteristics of Cortical Neuron Populations, Proc. IEEE World Congress on Computational Intelligence, July 16-21, 2006, Vancouver, Canada, IEEE Press, 2006 14. K.K. Majumdar, R. Kozma, Studies on Sparse Array Cortical Modeling and Memory Cognition Duality, Proc. IEEE World Congress on Computational Intelligence, July 16-21, 2006, Vancouver, Canada, IEEE Press, 2006 15. Beliaev, I., Kozma, R. Studies on the memory capacity and robustness of chaotic dynamic neural networks, Proc. IEEE World Congress on Computational Intelligence, July 16-21, 2006, Vancouver, Canada, IEEE Press, 2006 16. Ilin, R., Kozma, R., Werbos, P. Cellular SRN trained by extended Kalman Filter shows promis for ADP, Proc. IEEE World Congress on Computational Intelligence, July 16-21, 2006, Vancouver, Canada, IEEE Press, 2006 17. R. Kozma, M. Puljic, Noise-Mediated Intermittent Synchronization of Collective Behaviors in the Probabilistic Cellular Automata Model of Neural Populations, 10th Artificial Life Conference ALIFEX, June 3-7, 2006, Bloomington, In, MIT Press 18. R. Kozma, R. Linnehan, L. Perlovsky, D. Brady, John Schindler, Target Localization Behind Walls Using Dynamic Logic-Based Autofocusing Approach, IEEE 2007 Radar Conference, April 17-20, 2007, Waltham, MA (submitted) 19. R. Kozma, R. Linnehan, L. Perlovsky, D. Brody, Estimation of Parameters of Multiple Walls Using Dynamic Logic-based SAR Imaging, Conference on Knowledge-Intensive Multi-Agent Systems KIMAS’07, April 29-30, 2007, Boston, MA (submitted) 20. R. Kozma, R. Deming, L. Perlovsky, Optimal Estimation of Parameters of Transient Mixture Processes using Dynamic Logic Approach, Conference on KnowledgeIntensive Multi-Agent Systems KIMAS’07, April 29-30, 2007, Boston, MA (submitted) Workshops/Special Sessions organized: R. Kozma, A. Seth, J. Tani, Neurodynamics Methods for Analysis and Control of Cognitive Behaviors, Workshop organized at 10th Artificial Life Conference ALIFEX, June 3-7, 2006, Bloomington, IN Kozma, R., Perlovsky, L. Neurodynamics of Higher-Level Cognitive Behavior, Special Session at IJCNN’06 at WCCI’06, July 16-21, 2006, Vancouver, Canada R. Kozma, B. Bollobas, NSF US-Hungarian Workshop on Large Scale Random Graphs Methods for Modeling Mesoscopic Behavior in Biological and Physical Systems, Cochair of the conference, and Panel Session speaker, August 28-September 4, 2006, Budapest, Hungary