Trench Gothic: The Computer Visualisation of a Disturbing Great War Artwork Derek J. SMITH, C.Eng., C.I.T.P. High Tower Consultants Limited International Software Products, Toronto Cardiff Metropolitan University (Retired) smithsrisca@btinternet.com http://www.smithsrisca.co.uk A Presentation to the BCS EVA Conference, 2014 BCS HQ, London Wednesday 9th July 2014 ABOUT THE AUTHOR • During the 1980s Derek Smith worked for British Telecom, Cardiff, where he specialised in the design and operation of very large CA IDMS "semantic network" databases. • Between 1991 and 2010 he taught psycholinguistics and neuropsychology to the Speech and Language Therapy students at Cardiff Metropolitan University. • He is currently working with International Software Products, Toronto, on "Project Konrad", an artificial consciousness project using a CA IDMS platform. WHY WE ARE HERE TODAY Here is a critically acclaimed painting. In a moment you will find out if you love it or hate it. But you probably won’t know why. In fact, there is no single science to explain such moments of artistic appreciation. Francis Bacon "Portrait of Lucien Freud" [ONE OF THREE] (1952) PLAN OF THE PRESENTATION • PART 1 - INTRODUCTION [5 mins] • PART 2 - THE MIND AS A REAL-TIME CONTROL SYSTEM [4 mins] • PART 3 – KONRAD, THE TECHNICALITIES [6 mins] • CONCLUSIONS AND QUESTIONS [2 + 3 mins] PART 1 INTRODUCTION A CRASH COURSE IN VISUAL PERCEPTION Why vision evolved, how the eye feeds information to the visual areas of the brain, and what it feels like. THE VERTEBRATE NERVOUS SYSTEM HOW IT ALL BEGAN This is a Pikaia, a wormlike creature from 530 MYA. Its nerve cord coordinates the pulsed contraction and relaxation of its muscle segments . HEAD TAIL Creatures like Pikaia are the evolutionary ancestors of all modern vertebrates, including humans. | ---------------------- 50mm -------------------- | THE VERTEBRATE NERVOUS SYSTEM HOW IT ALL BEGAN As new animals evolved, this nerve cord gradually thickened at the head end to form a brain. Visual information was processed in an area known as the "optic tectum" [solid blue]. The surface layer, or "cortex", of the "cerebrum" [light blue] provided additional general intelligence when called for. THE VERTEBRATE NERVOUS SYSTEM HOW IT ALL BEGAN As evolution continued, brains didn’t just become larger and more powerful, but … … many functions of the optic tectum were taken over by the cerebral cortex. THE VERTEBRATE NERVOUS SYSTEM HOW IT ALL BEGAN The underlying structure of all these nervous systems is the same. Vision just one cortical specialism amongst many. SMELL AND TASTE CONSCIOUSNESS, COMMAND, AND CONTROL HABIT, INSTINCT, AND EMOTION BALANCE AND REFLEXES BODILY SENSES INSTRUCTIONS TO MUSCLES VISION AND HEARING THE VERTEBRATE NERVOUS SYSTEM HOW IT ALL BEGAN Note that all this processing is multi-layered. Much totally unconscious. In fact we only “know” the world at 2nd/3rd hand! SMELL AND TASTE KNOWING HABIT, INSTINCT, AND EMOTION BALANCE AND REFLEXES BODILY SENSES INSTRUCTIONS TO MUSCLES VISION AND HEARING THE VERTEBRATE NERVOUS SYSTEM HOW IT ALL BEGAN Whenever vision and emotion cooccur we perceive both the world AND WHAT IT IS DOING TO US! Which is why art is so fascinating … SMELL AND TASTE KNOWING HABIT, INSTINCT, AND EMOTION BALANCE AND REFLEXES BODILY SENSES INSTRUCTIONS TO MUSCLES VISION AND HEARING DISTURBING ART ROMANTIC GOTHIC FROM ca. 1781 Henry Fuseli “The Nightmare" (1781) DARK DARK CHARACTERS DARK THEMES DISTURBING ART MODERN GOTHIC DISTURBING ART IS OFTEN BASED ON CONFLICTING EMOTIONS, AS SHOWN HERE. POSITIVE EMOTION FOR THE CHILD BUT NEGATIVE EMOTION FOR THE SETTING Zhang Peng "Untitled" (ca. 2010) DISTURBING ART TRENCH GOTHIC, 1914-1918 George Grosz “The Hero" (1933) EVOKES NEGATIVE EMOTIONS ASSOCIATED WITH WAR AND VIOLENCE TYPICALLY SATIRICAL IRONY OF TITLING, ETC. ART AS FELT EMOTION THE FUNDAMENTAL PROBLEM OF AESTHETICS SUBLIME EMOTION FELT EMOTION EMOTION SENSATION ART AS FELT EMOTION THE FUNDAMENTAL PROBLEM OF AESTHETICS OUR OWN RESEARCH IS TRYING TO SOLVE THE FUNDAMENTAL PROBLEM OF AESTHETICS USING COMPUTER SOFTWARE TO “GO THROUGH THE MOTIONS” OF A MIND APPRECIATING ART. OR TO PUT IT ANOTHER WAY … ART AS FELT EMOTION … WHAT MIGHT A ROBOT MAKE OF THIS? Albin Egger-Lienz “Den Namenlosen“ (1916) PART 2 THE MIND AS A REALTIME CONTROL SYSTEM COGNITION AS AN INTERMITTENT CYCLICAL PROCESS From brain to mind and back again. THE “HIGHER COGNITIVE FUNCTIONS” • Here’s a textbook view of cortical modularity. • Mapped 1861 to 1937 and hardly improved since. • Most areas known by what happens when they are damaged. A HIERARCHICAL ALTERNATIVE ? ? ? CORTICAL LEVEL HIGHER COGNITION AUTONOMOUS WILL DIRECTED ATTENTION CONCEPTS WILLED BEHAVIOURS SUBCORTICAL LEVEL SECONDARY SENSORY ANALYSIS FIGURE-GROUND / DRAMATIC GIST PRIMARY SENSORY ANALYSIS SENSORY INPUT EMOTIONAL STATES DRIVES AND INSTINCTS REFLEX LEVEL MOTOR SCHEMA MANAGEMENT MOVEMENT UNITS LOWER MOTOR SUBROUTINES MUSCLE OUTPUT A HIERARCHICAL ALTERNATIVE ? ? ? CORTICAL LEVEL HIGHER COGNITION AUTONOMOUS WILL DIRECTED ATTENTION CONCEPTS WILLED BEHAVIOURS SUBCORTICAL LEVEL SECONDARY SENSORY ANALYSIS FIGURE-GROUND / DRAMATIC GIST PRIMARY SENSORY ANALYSIS SENSORY INPUT EMOTIONAL STATES DRIVES AND INSTINCTS REFLEX LEVEL MOTOR SCHEMA MANAGEMENT MOVEMENT UNITS LOWER MOTOR SUBROUTINES MUSCLE OUTPUT THE NEXT DIAGRAM SHOWS HOW FAR SCIENCE HAS GOT / NOT GOT WITH PROGRAMMING THE MIND AFTER 2000 YEARS OF TRYING. NOTE VERY CAREFULLY WHERE THE PROBLEMS REMAIN. ESPECIALLY THE PROBLEMS OF FELT EMOTION AND CONSCIOUS EXPERIENCE CONCEPTUAL AND ALLEGORICAL ART CHESS AND SIMILAR PROBLEM SOLVING UNDERSTANDING THINKING FELT EMOTION AUTONOMY AND SELF-REFERENCED WILL AND CONSCIOUS EXPERIENCE ? ? ? CORTICAL LEVEL HIGHER COGNITION AUTONOMOUS WILL DIRECTED ATTENTION SIMPLE MACHINE EMOTIONAL STATES DRIVES AND INSTINCTS TRANSLATION CONCEPTS SENTENCE ANALYSIS SUBCORTICAL LEVEL SECONDARY SENSORY ANALYSIS FIGURE-GROUND / DRAMATIC GIST PATTERN RECOGNITION VOICE RECOGNITION WILLED BEHAVIOURS PRIMARY SENSORY ANALYSIS SENSORY INPUT SIMPLE BIONICS ARTIFICIAL RETINA INSTALLATION ART SENTENCE SYNTHESIS MOVEMENT UNITS REFLEX LEVEL EYES MOTOR SCHEMA MANAGEMENT VOICE LOWER MOTOR SUBROUTINES VOICE SYNTHESIS MUSCLE OUTPUT HAND MECHATRONICS PERFORMANCE ART PART 3 INTRODUCING KONRAD, THE TECHNICALITIES TOWARD A SOFTWARE MIND Data model; Database Schema; Processing Suite; The Processing Cycle INTRODUCING PROJECT KONRAD EXECUTIVE SUMMARY • Konrad models the end-to-end flow of biological cognition, with especial emphasis on the semantic network nature of the mind's long-term memory system. • It models a memory network with a memory network (unlike rival AI systems). Mental Associations INTRODUCING PROJECT KONRAD THE LOGICAL DATA MODEL • As is normal for all databases, a Relational Data Analysis exercise produced a Logical Data Model, which was then used to define a set-structured Database Schema. • More than 250 mental entity types were identified during the Data Analysis. The resulting "Bachman Diagram" is accordingly far too big for this screen, but it may be studied at leisure at http://www.smithsrisca.co.uk/PPTs/konrad-bachman.ppt. INTRODUCING PROJECT KONRAD THE DESIGN PHILOSOPHY • Fortunately, internal similarities and repetitions in the real world allowed the 250 logical entity types to be abstracted down to only seven different physical record types. • One processing module, four different types of module contents, one bill of materials record, and one domaining superchief. • Here’s the Database Schema … INTRODUCING PROJECT KONRAD THE CA IDMS DATABASE SCHEMA DATABASE AREA 2 A REALM OF FUNCTIONALLY SPECIFIED INFORMATION PROCESSORS, AND THEIR ASSOCIATED INFORMATION TYPES. • Processing Module (FDPX) AREA 2 FDPX-REC Functionally Discrete Processor FDPXs MAINTAIN MANY LTMs <NO AM> • STM, MTM, LTM, and Instinct • LTM "Bill of Materials" and "Superchief" to cope with memories made up of other memories. • Here’s how it works … AREA 2 MTEV-REC Medium-Term Event AREA 2 KML-REC Innate Read-Only Memory AREA 2 LTM-REC Long-Term Memory Primary Trace LTMR LINKS LTMs <NO AM> FDPXs RECEIVE MANY STEVs <NO AM> MTEVs CONSOLIDATE INTO MANY LTMs <NO AM> LTM OCCURS IN LTMRs <NO AM> LTMs ARE CLUSTERED UNDER LTMSs <NO AM> AREA 2 LTMR-REC Long-Term Memory Recursive Analysis AREA 2 STEV-REC Short-Term Event AREA 2 LTMS-REC Long-Term Memory Superchief INTRODUCING PROJECT KONRAD THE DESIGN PHILOSOPHY • The Processing Module (FDPX) and Long-Term Memory (LTM) records are two of the most versatile records in the physical design. • 21 "occurrences" of the FDPX-REC are identified, containing between them a total of 36 functionally (but not physiologically) different types of LTM-REC. • These 21 modules are the building blocks of Konrad's machine mind, and "animal spirits" of an electronic sort flow between them. KONRAD’S DATA MODEL PROPOSITIONAL ANALYSIS MODULE [LOGICAL PPAN-REC] SCENARIO EVALUATION MODULE [LOGICAL SCEV-REC] TV2247 TV2247 3 TV2247 3 MTEV(P 3 MTEV(P PNC) MTEV(B PNC) UNIT UNIT BACKS SKT) BACKS PROPOSITIONAL PROPOSITIONAL TACKE BACKS TACKE D TACKE OBJECT MEMORY D SELF MEMORY TRUTH D TRUTH [LOGICAL EMES TRUTH [LOGICAL EMES LTM(PPNM) POBM-REC] EMES PPSM-REC] NB: PROCESSES TO THE RIGHT OF THIS LINE DELIVER CYCLE LOCOMOTOR (N-1) POSTURAL OUTPUT IF MATCHES TRUE NOT YET IN USE DRAA-REC TRUE{<sememe1><sememe2>{{S TAMP07 ELSE IF MATCHES FALSE DRAA-REC TV224 TRUTHEM FALS{<sememe1><sememe2>{{S 74 ETAMP07 TV22 STEV( PRAXEME ELSE 454 DRAA) RETURN TESTEMEDRAA-REC STEV TRAN KEY TRUTHEM LTM(ACTM) PROPOSITIONAL TRUTH MEMORY NULL{<sememe1><sememe2>{{S (DRA LTM(PFMM) SMITT E TAMP07 DRAQ-REC PROPOSITIONAL FRAME MEMORY PSYCHOLOGICAL ACT MEMORY Q) TRUTHEMES ED ONWARD PPNMTESTEME{<sememe1><sememe TRAN DRAMEMESDRAMATIC ANALYSIS MODULETRUTHEMES TRUTH KEY RECTRUTHEME{???????? 2>{{STAMP05 [LOGICAL DRAN-REC] PFMM-REC ACTM-REC SMIT EMES DRAMEME{<sememe1><se LONG TRUTHEME TED SEMEME meme2> TEST TV2245 TV2245 TV2245 TV2245 EME TV2245 3 TV2245 3 TRUTHE 3 3 S 3 MTEV(I 7 TV22 MTEV(I MTEV(I TV2245 BSKS-REC ME MTEV(I MTEV(I STD) MTEV(B 444 STD) CONCEPTUAL MEMORY MODULE ONWARD STD) 8 SEMEME{sememe{{TSTAM STD) STD) BACKS SKP) STEV BACKS KEY FORMEMEBACKS STEV(A P04 BSKP-REC BACKS ISTD-REC [LOGICAL BACKS TACKE BACKS (SEM CONM-REC] TACKE DRAMEME TACKE CTO) PRAXEME{praxeme{{TSTAMP08 TACKE TESTEME{<sememe1><semem BEHAVIOURAL RELEASE TACKE D TACKE O) D ACTO-REC PRAXEM PRAXEM D ONWARD D e2>{{STAMP05 TACTICAL ACTION MODULE TRANS LTM(SEMM) MODULE D DRAME D TRAN DRAME E- PRAXEME{praxeme{{TSTAMP08 E- DRAME KEY DRAME MITTED TV224 DRAME MES PRAXE SMIT MES [LOGICAL TTAC-REC] [LOGICAL ACTEME TV224 SEMANTIC MEMORY DOEME MESBREL-REC] MES PRAXE 43 TV224 MES MES TED ONWARD 43 ONWARD MES SEMEMES MTEV( 43 SEM KEY MTEV( KEY SEMM-REC BSKS) MTEV( EME TV2246 BSKS) SEMEME{sememe TV2246 TV2246 BACK BSKS) S TV2246 TV2246 3 BACK TV2246 4 BSKS-REC TV2248 3 STAC BACK ACTE 44 3 TV2248 MTEV(F STAC STEV(P SEMEME{sememe{{TSTAM TV2248 3 MTEV(F KED STAC MESTEV(P LTM(TTAM) MTEV(F 3 TVS) KED STEV(P SQO) P04 FORMEM 3 MTEV(B SEME TVS) KED DOEM SQO) TVS) MTEV(B BACKS SEME SQO) TRANS EPROCEDURAL SEQUENCE MEMORY MTEV(B RLB) MES BACKS SEME E TRANS FTVS-REC TACKE PSQO-REC BACKS RLB) MES SEMEME TRANS MITTED LTM(BRLM) RLB) BUFFE TACKE MES PRAXEMES ACTEME{acteme{{TSTAMP0 ONWA MITTED ACTEME{acteme{{TSTAMP0 TV22 TACKE D BUFFE MITTED ACTEM ONWARD MEMORY MODULE BUFFE RED D BSKF-REC PERCEPTUAL RD ACTEM 9 CINGULATE MEMORY 9 TTAM-REC D ACTEM RED BOARDE ACTEM ES KEY434 RED DOEME ACTEM SEMEME{sememe{{TSTAM [LOGICAL KEY ES PEMM-REC] PRAXEME{praxeme STEV ACTEM ES DOEME DUMMY MEES DOEME S ES P03 (FRM ES S DRAMEM MAPO-REC TV2248 S O) E BOARDEME{retineme{{TST PRECA LTM(FRMM) 4 TRAN ONWARD AMP02 UTIONA TV224VISUAL FORM MEMORY STEV(E TV224 SMIT KEY RY MAPX-REC TV224 33 XEC) 33 TED FORMEMES INTERR INTERRUPT{TV22426{{STA 33 MTEV( ACTEM UPPER MOTOR NEURON MODULE MTEV( FOR UPT MP02 MTEV( BSKF) ES FOR FRMM-REC [LOGICAL MOT1-REC] BSKF) MEM TV2242 TV2242 (AS BSKF) BACK EXECU TACTICAL TRACKING MODULE BACK ES VFIGURE{retineme 5 6 NECES LTM(SEQM) EMOTIONAL EGO MODULE BACK STAC TION STAC STEV(M [LOGICAL STEV(M TTRK-REC] SARY) SEQUENTIAL FORM MEMORY STAC KED [LOGICAL EMOT-REC] KED APO) APX) KED FORM FORM TRANS CYCLE FORM EMES TV2248 LTM(EPIM) EMES RET MITTED INTERR TV2248 EMES TV2249 3 INE BOARD EPISODIC MEMORY UPT 3 3 MTEV(B TO FOLLOW ME EMES MTEV(B EPISODES MTEV(B LTM(SSQM) RLB) AS LTM(MAPM) RLB) VISION SKM) BUFFE MUSCLE SEQUENCE MEMORY ON BUFFE COGNITIVE MAP MEMORY BACKS MUSCLEMES RED HEARING WA TO FOLLOW RED RET TACKE DOEME BOARDEMES THALAMORD DOEME TOUCH INE TV2249 S D CORTICAL KEY TV224 MAPM-REC S ME 4 TV224 MUSCL PROJECTION 24 TV224 BOARDEME{retineme AS STEV(S 24 EMES EXTRA-PYRAMIDAL S MTEV( 24 ENHANCE ON SQO) MTEV( MOTOR (3RD FIGB) MTEV( FIGUREWA UNIT FIGB) TRACT SENSORY BACK FIGB) GROUND PYRAMIDAL TV224 RD MUSCU BACK FIGB-REC NEURON) STAC BACK RESOLUTI BASAL MOTOR MODULE MOTOR 14 KEY LAR STAC 3SNT-REC BOARDEME{retineme KED STAC ON TRACT CONTR KED retineme{TSTAMP01 STEV( {{TSTAMP02 [LOGICAL BMOT-REC] BOAR KED THALAMIC3SNT) TRANSCRIPTION MODULE ACTION BOAR DEME BOAR TRAN DEME [LOGICAL TSP2-REC] S DEME UNIT MOTOR SCHEMA MEMORY SMITT S TV224 S [LOGICAL SCHM-REC] TV224 ED LTM(TSP2) 13 TV224 13 RETIN THALAMIC MEMORY MTEV( 13 MTEV( EMES[DUMMY] CORTICO-SPINAL VFIG) MTEV( VFIG) LOW DIENCEPHALIC ATTENTIONAL MODULE BACK VFIG) TRACT MODULE VFIG-REC BACK LOW DIENCEPHALIC LORENZIAN MODULE STAC BACK [LOGICAL DAT1-REC] EXTRA-PYRAMIDAL [LOGICAL retineme{TSTAMP01 STAC KED STAC [LOGICAL LRNZ-REC] MOTOR INITI KED COSP-REC] RETIN KED TRACT ATIN PRIMITIVE KLEINIAN OBJECT MEMORY RETIN EMES RETIN G EMES [LOGICAL PKOM-REC] EMES HORM INSTI RETI ONAL NCTS NEM HIGH BRAINSTEM MOTOR MODULE PREE PYRAMIDAL ACTIV AS [LOGICAL BSMO-REC] MOTOR MEDIAL INPU BRAINSTEM ATTENTIONAL MODULE ATION TRACT LEMNISCUS LOOP T UNIT MOTOR SKILL MEMORY (2ND [LOGICAL BSAT-REC] KEY SENSORY [LOGICAL SKLM-REC] NEURON) PROPOSITIONAL SELF AND WORLD ACTS ACTS SPEECH ACTS INNENSTAND • Here’s as much as we can safely fit onto a single sheet of A4. OBJEKTIV COMPONENTS "MISSION MANAGEMENT" • There is a reader-friendly copy of this diagram in your Conference Pack. Further copies can be downloaded from http://www.smithsrisca.co.uk/PPTs/konrad-latestcartesian.ppt THE BIG BOARD RETIN EMES OBJECTUM MEDULLARY SENSORY TRANSCRIPTION MODULE [LOGICAL TSP1-REC] [GRACILE AND CUNEATE NUCLEI, ETC.] SPINAL (LOWER MOTOR NEURON) MOTOR MODULE [LOGICAL MOT2-REC] FAST PERIPHERAL GANGLIA MODULE REFLEXES AND [LOGICAL PGNG-REC] “FINAL SERVOCOMMON ASSISTANC SENSORY MODULE PATHWAY” AFFERENT TRANSDUCTION E VER TRACTS[LOGICAL TDXN-REC] Y FAS T REF LEX ES SPINAL/CR ANIAL SENSORY SYSTEMS EFFECTOR SYSTEMS [EYES, EARS, ETC.] GEGENSTAND INTRODUCING PROJECT KONRAD THE ACTIVATION CYCLE DATABASE AREA 2 • As each Processing Module (FDPX) is activated A REALM OF FUNCTIONALLY SPECIFIED INFORMATION PROCESSORS, AND THEIR ASSOCIATED INFORMATION TYPES. AREA 2 FDPX-REC Functionally Discrete Processor • Input STEV accesses resident LTM to see what is appropriate • Output STEV to next FDPX (delete input STEV; keep MTEV copy of output STEV) • MTEVs pruned after parameter-set time (many secs in humans) AREA 2 MTEV-REC Medium-Term Event FDPXs MAINTAIN MANY LTMs <NO AM> AREA 2 KML-REC Innate Read-Only Memory AREA 2 LTM-REC Long-Term Memory Primary Trace LTMR LINKS LTMs <NO AM> FDPXs RECEIVE MANY STEVs <NO AM> MTEVs CONSOLIDATE INTO MANY LTMs <NO AM> LTM OCCURS IN LTMRs <NO AM> LTMs ARE CLUSTERED UNDER LTMSs <NO AM> AREA 2 LTMR-REC Long-Term Memory Recursive Analysis AREA 2 STEV-REC Short-Term Event AREA 2 LTMS-REC Long-Term Memory Superchief • Etc., etc. INTRODUCING PROJECT KONRAD THE PHILOSOPHERS’ ZONE PROPOSITIONAL ANALYSIS MODULE [LOGICAL PPAN-REC] SCENARIO EVALUATION MODULE [LOGICAL SCEV-REC] • To date only the 11 processing modules for the higher cognitive functions have been implemented. • I.e., we are working in the “philosophers’ zone” of robotics. TV2247 TV2247 3 TV2247 3 MTEV(P 3 MTEV(P PNC) MTEV(B PNC) UNIT UNIT BACKS SKT) BACKS PROPOSITIONAL PROPOSITIONAL TACKE BACKS TACKE D TACKE OBJECT MEMORY D SELF MEMORY TRUTH D TRUTH [LOGICAL EMES TRUTH [LOGICAL EMES LTM(PPNM) POBM-REC] EMES PPSM-REC] NB: PROCESSES TO THE RIGHT OF THIS LINE DELIVER CYCLE LOCOMOTOR (N-1) POSTURAL OUTPUT IF MATCHES TRUE NOT YET IN USE DRAA-REC TRUE{<sememe1><sememe2>{{S TAMP07 ELSE IF MATCHES FALSE DRAA-REC TV224 TRUTHEM FALS{<sememe1><sememe2>{{S 74 ETAMP07 TV22 STEV( PRAXEME ELSE 454 DRAA) RETURN TESTEMEDRAA-REC STEV TRAN KEY TRUTHEM LTM(ACTM) PROPOSITIONAL TRUTH MEMORY NULL{<sememe1><sememe2>{{S (DRA LTM(PFMM) SMITT E TAMP07 DRAQ-REC PROPOSITIONAL FRAME MEMORY PSYCHOLOGICAL ACT MEMORY Q) TRUTHEMES ED ONWARD PPNMTESTEME{<sememe1><sememe TRAN DRAMEMESDRAMATIC ANALYSIS MODULETRUTHEMES TRUTH KEY RECTRUTHEME{???????? 2>{{STAMP05 [LOGICAL DRAN-REC] PFMM-REC ACTM-REC SMIT EMES DRAMEME{<sememe1><se LONG TRUTHEME TED SEMEME meme2> TEST TV2245 TV2245 TV2245 TV2245 EME TV2245 3 TV2245 3 TRUTHE 3 3 S 3 MTEV(I 7 TV22 MTEV(I MTEV(I TV2245 BSKS-REC ME MTEV(I MTEV(I STD) MTEV(B 444 STD) CONCEPTUAL MEMORY MODULE ONWARD STD) 8 SEMEME{sememe{{TSTAM STD) STD) BACKS SKP) STEV BACKS KEY FORMEMEBACKS STEV(A P04 BSKP-REC BACKS ISTD-REC [LOGICAL BACKS TACKE BACKS (SEM CONM-REC] TACKE DRAMEME TACKE CTO) PRAXEME{praxeme{{TSTAMP08 TACKE TESTEME{<sememe1><semem BEHAVIOURAL RELEASE TACKE D TACKE O) D ACTO-REC PRAXEM PRAXEM D ONWARD D e2>{{STAMP05 TACTICAL ACTION MODULE TRANS LTM(SEMM) MODULE D DRAME D TRAN DRAME E- PRAXEME{praxeme{{TSTAMP08 E- DRAME KEY DRAME MITTED TV224 DRAME MES PRAXE SMIT MES [LOGICAL TTAC-REC] [LOGICAL ACTEME TV224 SEMANTIC MEMORY DOEME MESBREL-REC] MES PRAXE 43 TV224 MES MES TED ONWARD 43 ONWARD MES SEMEMES MTEV( 43 SEM KEY MTEV( KEY SEMM-REC BSKS) MTEV( EME TV2246 BSKS) SEMEME{sememe TV2246 TV2246 BACK BSKS) S TV2246 TV2246 3 BACK TV2246 4 BSKS-REC TV2248 3 STAC BACK ACTE 44 3 TV2248 MTEV(F STAC STEV(P SEMEME{sememe{{TSTAM TV2248 3 MTEV(F KED STAC MESTEV(P LTM(TTAM) MTEV(F 3 TVS) KED STEV(P SQO) P04 FORMEM 3 MTEV(B SEME TVS) KED DOEM SQO) TVS) MTEV(B BACKS SEME SQO) TRANS EPROCEDURAL SEQUENCE MEMORY MTEV(B RLB) MES BACKS SEME E TRANS FTVS-REC TACKE PSQO-REC BACKS RLB) MES SEMEME TRANS MITTED LTM(BRLM) RLB) BUFFE TACKE MES PRAXEMES ACTEME{acteme{{TSTAMP0 ONWA MITTED ACTEME{acteme{{TSTAMP0 TV22 TACKE D BUFFE MITTED ACTEM ONWARD MEMORY MODULE BUFFE RED D BSKF-REC PERCEPTUAL RD ACTEM 9 CINGULATE MEMORY 9 TTAM-REC D ACTEM RED BOARDE ACTEM ES KEY434 RED DOEME ACTEM SEMEME{sememe{{TSTAM [LOGICAL KEY ES PEMM-REC] PRAXEME{praxeme STEV ACTEM ES DOEME DUMMY MEES DOEME S ES P03 (FRM ES S DRAMEM MAPO-REC TV2248 S O) E BOARDEME{retineme{{TST PRECA LTM(FRMM) 4 TRAN ONWARD AMP02 UTIONA TV224VISUAL FORM MEMORY STEV(E TV224 SMIT KEY RY MAPX-REC TV224 33 XEC) 33 TED FORMEMES INTERR INTERRUPT{TV22426{{STA 33 MTEV( ACTEM UPPER MOTOR NEURON MODULE MTEV( FOR UPT MP02 MTEV( BSKF) ES FOR FRMM-REC [LOGICAL MOT1-REC] BSKF) MEM TV2242 TV2242 (AS BSKF) BACK EXECU TACTICAL TRACKING MODULE BACK ES VFIGURE{retineme 5 6 NECES LTM(SEQM) EMOTIONAL EGO MODULE BACK STAC TION STAC STEV(M [LOGICAL STEV(M TTRK-REC] SARY) SEQUENTIAL FORM MEMORY STAC KED [LOGICAL EMOT-REC] KED APO) APX) KED FORM FORM TRANS CYCLE FORM EMES TV2248 LTM(EPIM) EMES RET MITTED INTERR TV2248 EMES TV2249 3 INE BOARD EPISODIC MEMORY UPT 3 3 MTEV(B TO FOLLOW ME EMES MTEV(B EPISODES MTEV(B LTM(SSQM) RLB) AS LTM(MAPM) RLB) VISION SKM) BUFFE MUSCLE SEQUENCE MEMORY ON BUFFE COGNITIVE MAP MEMORY BACKS MUSCLEMES RED HEARING WA TO FOLLOW RED RET TACKE DOEME BOARDEMES THALAMORD DOEME TOUCH INE TV2249 S D CORTICAL KEY TV224 MAPM-REC S ME 4 TV224 MUSCL PROJECTION 24 TV224 BOARDEME{retineme AS STEV(S 24 EMES EXTRA-PYRAMIDAL S MTEV( 24 ENHANCE ON SQO) MTEV( MOTOR (3RD FIGB) MTEV( FIGUREWA UNIT FIGB) TRACT SENSORY BACK FIGB) GROUND PYRAMIDAL TV224 RD MUSCU BACK FIGB-REC NEURON) STAC BACK RESOLUTI BASAL MOTOR MODULE MOTOR 14 KEY LAR STAC 3SNT-REC BOARDEME{retineme KED STAC ON TRACT CONTR KED retineme{TSTAMP01 STEV( {{TSTAMP02 [LOGICAL BMOT-REC] BOAR KED THALAMIC3SNT) TRANSCRIPTION MODULE ACTION BOAR DEME BOAR TRAN DEME [LOGICAL TSP2-REC] S DEME UNIT MOTOR SCHEMA MEMORY SMITT S TV224 S [LOGICAL SCHM-REC] TV224 ED LTM(TSP2) 13 TV224 13 RETIN THALAMIC MEMORY MTEV( 13 MTEV( EMES[DUMMY] CORTICO-SPINAL VFIG) MTEV( VFIG) LOW DIENCEPHALIC ATTENTIONAL MODULE BACK VFIG) TRACT MODULE VFIG-REC BACK LOW DIENCEPHALIC LORENZIAN MODULE STAC BACK [LOGICAL DAT1-REC] EXTRA-PYRAMIDAL [LOGICAL retineme{TSTAMP01 STAC KED STAC [LOGICAL LRNZ-REC] MOTOR INITI KED COSP-REC] RETIN KED TRACT ATIN PRIMITIVE KLEINIAN OBJECT MEMORY RETIN EMES RETIN G EMES [LOGICAL PKOM-REC] EMES HORM INSTI RETI ONAL NCTS NEM HIGH BRAINSTEM MOTOR MODULE PREE PYRAMIDAL ACTIV AS [LOGICAL BSMO-REC] MOTOR MEDIAL INPU BRAINSTEM ATTENTIONAL MODULE ATION TRACT LEMNISCUS LOOP T UNIT MOTOR SKILL MEMORY (2ND [LOGICAL BSAT-REC] KEY SENSORY [LOGICAL SKLM-REC] NEURON) PROPOSITIONAL SELF AND WORLD ACTS ACTS SPEECH ACTS INNENSTAND OBJEKTIV COMPONENTS "MISSION MANAGEMENT" THE BIG BOARD RETIN EMES OBJECTUM • In other words Konrad is a robot without a body. MEDULLARY SENSORY TRANSCRIPTION MODULE [LOGICAL TSP1-REC] [GRACILE AND CUNEATE NUCLEI, ETC.] SPINAL (LOWER MOTOR NEURON) MOTOR MODULE [LOGICAL MOT2-REC] FAST PERIPHERAL GANGLIA MODULE REFLEXES AND [LOGICAL PGNG-REC] “FINAL SERVOCOMMON ASSISTANC SENSORY MODULE PATHWAY” AFFERENT TRANSDUCTION E VER TRACTS[LOGICAL TDXN-REC] Y FAS T REF LEX ES SPINAL/CR ANIAL SENSORY SYSTEMS EFFECTOR SYSTEMS [EYES, EARS, ETC.] GEGENSTAND KONRAD’S COGNITIVE HIERARCHY • Here is a simplified view of the 11 sectional blocks of COBOL (no theoretical limit), with two doubled up at top right. • Short-term memory transmission between modules. • Each LTM occurrence with A-Keys and B-Keys. • Activated cyclically. INPUT KONRAD’S PROCESSING LOOPS • Many important sub-cycles. • The four blue arrows show feedforward processing. • The two red arrows show re-entrant - or "feedback" – processing. • Simulates “efference copy” in biology. INPUT INTRODUCING KONRAD THE ROBOT AWAITING A BODY • We also gave Konrad a simulated “will”, that is to say, a point at which its thoughts could become voluntary actions. INPUT INTRODUCING KONRAD THE BASIC PROCESSING CYCLE • We also allowed Konrad to take its own silent verbal outputs as silent inputs. NB: YOU CAN'T “SCIENTIFICALLY” STUDY INNER SPEECH IN HUMANS BECAUSE IT IS A SELFDESTRUCTIVE PROCESS INNER SPEECH INPUT INTRODUCING KONRAD THE BASIC PROCESSING CYCLE • It has been known since the 1950s that the mind cycles about 7 times a second … INPUT INTRODUCING KONRAD THE BASIC PROCESSING CYCLE • We also allowed Konrad to take inputs from its own emotional level. FEELS NASTY IS NASTY So that it can now talk about what it feels. INNER SPEECH INPUT INTRODUCING KONRAD THE PROGRAM STRUCTURE Konrad’s Jackson Diagram runs to eight sheets of A4. Email the author at smithsrisca@btinternet.com For a copy if interested INTRODUCING KONRAD THE POINT OF IT ALL IF YOU WANT TO DESIGN AN AUTONOMOUS SYSTEM, YOU NEED TO VISUALISE THE ACTIVITY OF THE INNERMOST NUMSKULL!!! INTRODUCING KONRAD THE PROCESSING SUITE THINKING AS RESEARCH DATA! THE KONRAD2 DATABASE CA IDMS DATABASE DETAILED LOG PRINTLOG COMMANDS COMMANDS FILE KONRAD MAIN SEMIOTICS FROM MAINFRAME FILE DOWNLINE LINGUISTIC INTERFACE PC DISPLAY KINESICI FROM MAINFRAME FILE DOWNLINE ROBOTIC INTERFACE PC DISPLAY SEMIOTICS KINESICS MOBILE DEVICE RUN NO LANGUAGE TO RESPOND IN PROPOSITIONAL OUTPUT STREAM JCL PARAMETERS THINKING MADE VISIBLE! Specimen on next sheet … MOBILE DEVICE PROPOSITIONAL SEQUENCE FILE COMING SOON INTERACTIVE USER INTRODUCING KONRAD How Konrad processes Den Namenlosen THE PROCESSING SUITE THE KONRAD2 DATABASE CA IDMS DATABASE ITHERE EXISTS A BATTLEFIELD THINKING OMY ACT IS NULL+ACTEME AS RESEARCH DATA! ITHERE EXISTS A PAINTING OMY ACT IS NULL+ACTEME ITHERE EXISTS A VIEWING+ARTWORK DETAILED LOG OMY ACT IS NULL+ACTEME ITHERE EXISTS A MEN IN LANDSCAPE OMY ACT IS NULL+ACTEME DOWNLINE PC DISPLAY SEMIOTICS FROM MAINFRAME LINGUISTIC ITHERE FILE EXISTS A NO-MAN'S-LAND INTERFACE OMY ACT IS NULL+ACTEME DOWNLINE ITHERE EXISTS A SOLDIERS, GERMAN PC DISPLAY KINESICI FROM MAINFRAME ROBOTIC FILE INTERFACE OMY ACT IS NULL+ACTEME ITHERE EXISTS A SOLDIERS, CARICA OMY ACT IS NULL+ACTEME ITHERE EXISTS A SHELL HOLES MOBILE DEVICE OMY ACT IS NULL+ACTEME PROPOSITIONAL SEQUENCE ITHERE EXISTS A VISCERAL+DISQUIE FILE COMING SOON OMY ACT IS NULL+ACTEME PRINTLOG COMMANDS COMMANDS FILE KONRAD MAIN SEMIOTICS KINESICS MOBILE DEVICE THINKING MADE VISIBLE! RUN NO LANGUAGE TO RESPOND IN JCL PARAMETERS PROPOSITIONAL OUTPUT STREAM INTERACTIVE USER IN CONCLUSION ..... ART - A SURPRISINGLY DIFFICULT SCIENCE THE MIND WORKS CYCLICALLY, CONSTANTLY SAMPLING THE PERCEPTUAL AND EMOTIONAL WORLDS. MAIN LOOP SEVEN TIMES A SECOND INPUT ART - A SURPRISINGLY DIFFICULT SCIENCE THE TRULY MYSTERIOUS MOMENT COMES WHEN OUR HIGHER MIND COMES TO FEEL ITS OWN EMOTIONAL RESPONSE. FEELS NASTY IS NASTY INNER SPEECH INPUT ART - A SURPRISINGLY DIFFICULT SCIENCE PRINTED OUTPUT GIVES US SOME IDEA WHAT NEEDS TO BE MOVED, FROM WHERE TO WHERE, AND IN WHAT ORDER. WE SEE THE BRAIN IN SLOW MOTION, COMPLETE WITH EVERY LONG- AND SHORT-TERM MEMORY ACCESS AND THE ACTIVATION KEYS USED. INPUT CALL FOR COLLABORATION CONTACT THE AUTHOR smithsrisca@btinternet.com IF YOU THINK KONRAD MIGHT BE ABLE TO HELP YOUR RESEARCH OR ARTISTIC PRACTICE THE END DATABASE AREA 2 A REALM OF FUNCTIONALLY SPECIFIED INFORMATION PROCESSORS, AND THEIR ASSOCIATED INFORMATION TYPES. AREA 2 FDPX-REC Functionally Discrete Processor AREA 2 MTEV-REC Medium-Term Event FDPXs MAINTAIN MANY LTMs <NO AM> AREA 2 KML-REC Innate Read-Only Memory FEELS NASTY AREA 2 LTM-REC Long-Term Memory Primary Trace IS NASTY LTMR LINKS LTMs <NO AM> FDPXs RECEIVE MANY STEVs <NO AM> MTEVs CONSOLIDATE INTO MANY LTMs <NO AM> LTM OCCURS IN LTMRs <NO AM> LTMs ARE CLUSTERED UNDER LTMSs <NO AM> INNER SPEECH AREA 2 LTMR-REC Long-Term Memory Recursive Analysis AREA 2 STEV-REC Short-Term Event AREA 2 LTMS-REC Long-Term Memory Superchief INPUT STILL THE END THINKING AS RESEARCH DATA! THE KONRAD2 DATABASE CA IDMS DATABASE DETAILED LOG PRINTLOG COMMANDS COMMANDS FILE KONRAD MAIN SEMIOTICS FROM MAINFRAME FILE DOWNLINE LINGUISTIC INTERFACE PC DISPLAY KINESICI FROM MAINFRAME FILE DOWNLINE ROBOTIC INTERFACE PC DISPLAY SEMIOTICS KINESICS MOBILE DEVICE RUN NO LANGUAGE TO RESPOND IN PROPOSITIONAL OUTPUT STREAM JCL PARAMETERS THINKING MADE VISIBLE! Specimen on next sheet … MOBILE DEVICE PROPOSITIONAL SEQUENCE FILE COMING SOON INTERACTIVE USER Copyright Notice: This material was written and published in Wales by Derek J. Smith, CEO of High Tower Consultants Limited, Chief Designer on the Konrad artificial consciousness project, and Editor of the Smithsrisca series of cognitive science study resources. It forms part of a multifile e-learning resource, and subject only to acknowledging Derek J. Smith's rights under international copyright law to be identified as author may be freely downloaded and printed off in single complete copies solely for the purposes of private study and/or review. Commercial exploitation rights are reserved. The remote hyperlinks have been selected for the academic appropriacy of their contents; they were free of offensive and litigious content when selected, and will be periodically checked to have remained so. Prior scholarship is acknowledged throughout, and precise references may be obtained from the author if needed. Internet images have been used in good faith on the understanding that they were in the public domain when imported. Copyright © 2014, High Tower Consultants Limited. Publication was by PowerPoint presentation on 9th July 2014. This online version comes to you for follow-up private study.