ITU - Telecommunication Standardization Sector
Temporary Document 5 (GEN)
(WPs 1, 2/16)
STUDY GROUP 16
Geneva, 5 – 15 February 2002
Questions:
G, 1-3, 11-14/16
SOURCE:
Study Group 7 – Bangalore, 28 August – 7 September 2001
TITLE:
Liaison statement on a morphological model for multi-sensory technologies and
coherence in security
__________________
LIAISON STATEMENT
TO:
Study Group 16
APPROVAL: Study Group 7
FOR:
Action
DEADLINE:
Mid-February 2002
CONTACT:
Dr. Hiroyuki Ohno
Tel: +81 42 327 5542
Emergency Communication Section
Fax:+81 42 327 7941
Communications Research Laboratory
Email: hohno-SG7-Q13@ohnolab.org
Ministry of Public Management,
Home Affairs, Post and Telecommunications
4-2-1 Nukui-Kitamachi, Koganei,
Tokyo, 184-8795, Japan
1
Introduction
ITU-T Study Group 7 is working on Communication Systems Security. We would appreciate your
review and comments on the attached document from the perspective of "Terminals".
Telebiometric data are going to be acquired and transferred by terminals, but each of our senses has
disparate adaptability and limitation to machine interface, and this human factor needs to be
identified and defined by International Standards.
2
Proposal
While exhaustiveness and coherence are required in order to provide full security to
telecommunicators at all possible levels of exchange, we must at least follow an international
standard in order to identify accurately all the levels and layers, as well as all the dynamics, that can
necessitate action by the regulator.
Attention: This is not a publication made available to the public, but an internal ITU-T Document intended only for use by the
Member States of the ITU, by ITU-T Sector Members and Associates, and their respective staff and collaborators in their ITU related
work. It shall not be made available to, and used by, any other persons or entities without the prior written consent of the ITU-T.
ITU-T\SG_DOC\SG16\FEB02\GENERAL\GEN-005.DOC
12.02.16
-2-
After consultations with scientific circles, it is recommended that diagrams be presented to
demonstrate the scale of the task and the need for fine sectoral division, following the contiguity
principle, in order to achieve better unification of the scalar dimensions of the processes of
exchange of signs by means of telecommunications.
The recommendation is as follows: derive from international standards ISO 31 and ISO 1000, of
1992, a scalar hierarchy of the sectors to be secured which provide parameters for the scientific
representation of the world in which telecommunication takes place, with the human component
also scalarized.
The advantages are considerable if the standard is applied consistently. ISO 31/ISO 1000 allow for
no oversights or shortcomings, and the consequences for the secure development of
telecommunications are massive.
The convergence of technologies implies that attention must be focused more closely on levels and
dimensions. Semio-anthropology and dermoscience, as applied to economics and safety standards,
provide a practical model that can be continually improved, according to the arithmetical logic of
infinites.
The emerging multimodality in the field of telebiometric interfaces must be considered.
Attached: a morphological model for multi-sensory technologies (for further details please see
also file model.zip)
ITU-T\SG_DOC\SG16\FEB02\GENERAL\GEN-005.DOC
12.02.16
-3-
A MORPHOLOGICAL MODEL FOR MULTI-SENSORY TECHNOLOGIES
By Haresh Lalvani
This work presents a generative morphological model for multi-sensorial interactions between two
or more entities - humans, machines or human-machine combinations. Though only classic human
senses are illustrated, the model is a general one and extends to any number of “senses” and
attributes of humans or machines. All multi-sensory states of a human and all interactions between
a human and a machine are encoded and mapped in higher-dimensional space in a systematic and
exhaustive manner. The method used here is an application of the technique outlined in author’s
doctoral work on transformational space structures1 and its systematic extensions to a larger variety
of geometric structures2. Applications of this method to other fields of knowledge was also begun
by the author, first, to dance and movement studies3 and early Indian knowledge systems4, and
subsequently to architectural form language5.
____________________
1
Lalvani, H. Multi-dimensional Arrangements of Transforming Space Structures, University
Microfilms, Ann Arbor, Michigan, 1981; based on author’s doctoral dissertation, University of
Pennsylvania, 1981, and self-published in a slightly extended form as Structures on Hyper-Structures,
Lalvani, New York, 1982.
2
Lalvani,H., Visual Morphology of Space Labyrinths: A Source for Architecture and Design, In :
Beyond the Cube, The Architecture of Space Frames by Francois Gabriel, John Wiley, 1998.
Lalvani, H., Higher-Dimensional Periodic Table of Regular and Semi-Regular Polytopes, In :
Morphology and Architecture, Guest. Ed. H. Lalvani, Space Structures, Vol. 11, Nos. 1 and 2, 1997.
Lalvani, H., Families of Multi-Directional Periodic Space Labyrinths, Structural Topology, 22, 1997,
Canada.
Lalvani, H., Continuous Transformations of Subdivided Periodic Surfaces, Space Structures (special
issue), Vol.5 Nos.3 and 4, Multi-Science, U.K. 1990.
3
Lalvani, H., Explorations in Hyper Space, LIMS Newsletter, Laban/Bartenieff Insitute for Movement
Studies, Dec. 1983; this publication included a diagram showing the 4-dimensional organization of Rudolf
Laban’s movement “efforts” characterized by space, time, weight and flow.
Lalvani, H., Patterns in Hyper-Spaces, Lalvani, New York, 1982. This visual catalog gives one
illustration showing the application to hand movements or hastamudras from Indian classical dance;
extension to human body movement and dance follows. Preliminary work on application of this method to
human emotions (based on the navarasa theory in Indian dance) was also begun by the author in 1982. This
work, besides its import for human communication, has natural implications for machines that “read” human
emotions, providing examples of telecommunication technologies of the future.
4
Lalvani,H., Knowledge Design in Vedic and Post-Vedic Thought, Seminar, New Delhi, 1992; a 6dimensional organization of the ayurvedic taste system was illustrated here. This ties in well with the current
paper and provides a “next level” organization of one of the human senses. Similar decompositions for all
other senses need to be systematically incorporated to extend the present model.
Lalvani, H., The Shape of Five in Early Hindu Thought, Fivefold Symmetry, World Scientific Publ.
Co., Singapore, 1992; though no higher-dimensional schemas were illustrated here due to the context of the
paper, the application of simple meta-modeling techniques to diverse phenomena is clearly demonstrated.
5
In progress, unpublished to date.
ITU-T\SG_DOC\SG16\FEB02\GENERAL\GEN-005.DOC
12.02.16
-4-
For n senses, the model maps the sensorial space of an individual in an n-dimensional cube where
each vertex represents a unique combination of senses. Each of the 2n sense combinations map on
to the 2n vertices of an n-cube. The states and interactions are encoded by their locations
(addresses) within this space and are represented by their Cartesian co-ordinates. For the examples
shown here, binary states suffice and the encoding is in combinations of 0's and 1's.
Figures 1-5 show various parts of a 6-dimensional model corresponding to the 6 classic human
senses (n=6), namely, SIGHT, HEARING, TOUCH, SPEECH, SMELL and TASTE. These senses
are arranged in an arbitrary sequence for now. There may be a way to re-arrange this sequence based
on a suitable selective criterion, e.g. evolution of senses, or their order or importance for human
activities. This re-arrangement will not alter the model and will preserve the inter-relationships
between the various states that will have altered co-ordinates.
Figures 6-9 show various subsets of a 10-dimensional model, 5 for a human (designated “I” or
“Me”) and 5 for a machine (“It”), for human-machine interactions (n = 5+5 = 10). In
communication, the HEARING-SPEECH complimentarity reduces the 6 senses to 5 for each,
leading to the 10 generators for this space. In this case, the number of human-machine interactions
equals 210. A subset space of 6 sense actions, three each for a human and machine (SIGHT,
HEARING, TOUCH) and two for a machine is illustrated as an example. It is represented in a 6dimensional cube in Fig.9, and is a subset of a 10-dimensional cube. Fig.10 corresponds to the
human-machine interactions in Fig.9 but is expressed in appropriate language for
telecommunication devices. The encoding is in two sets of co-ordinates, each within a bracket, with
the first bracket representing the human, and the second the machine. Various simple
telecommunication technologies (e.g. intercom or the telephone) are encoded within this
framework. For interactions between more than two entities, additional brackets can be added in a
running sequence.
The morphological space can be calibrated with appropriate sensorial metrics. The specific values
will vary for each sense and their associated vectors can be calibrated accordingly. This will
introduce co-ordinates that have values between 0 and 1, leading to a subdivided hyper-cubic space.
It will also introduce integers greater than 1, leading to a hyper-cubic lattice. This fine-tuning will
lead to very specific resolutions of the model. A more diverse extension of the model will lead to a
fractal model where each vector branches into a subset of vectors in a recursive manner.
The model also provides the possibility of mapping all transformations between senses. For
example, the primary vertices of the model space (determined by the location of the generator
senses or actions) define an n-simplex. The edges of the n-simplex define all bi-sensorial (twosense) interactions. This provides a model for bi-transformative inter-sensory technologies (e.g.
SPEECH-to-HEARING, SIGHT-to-HEARING, etc.). For 6 senses, the number of such technologies
equals 30, setting an upper limit to permissible technologies of this kind. Some of these are known,
and some new technologies are predicted.
The model presented here provides a systematic and unified approach for mapping
telecommunication technologies. Application to human communication (language, arts, alternative
modes of communication, etc.) provides a subject for further investigation. The mapping between
spoken language and the fundamental structure of telecommunication technologies appears
possible.
ITU-T\SG_DOC\SG16\FEB02\GENERAL\GEN-005.DOC
12.02.16
-5-
LIST OF ILLUSTRATIONS AND DESCRIPTION
1.
SIX classic human senses as generators of multi-sensorial space.
Vector representation is shown along with the 6-dimensional Cartesian co-ordinates for each sense.
The outer polygon represents the extent of the morphological space generated by the 6 vectors.
2.
(a) MORPHOLOGICAL MAPPING OF HUMAN MULTI-SENSORIAL STATES (50 of
64 states shown).
All multi-sensory states based on 6 classic human senses are mapped in a 6-dimensional cubic
space. Additional “senses” and human attributes could be added to extend this space in a similar
manner.
(b) MULTI-SENSORIAL STATES (Remaining 14 of 64 states shown).
3.
Morphological space of human receptive senses.
This shows five of the six classic senses, namely, SIGHT, HEARING, TOUCH, SMELL and
TASTE, arranged in a 5-dimensional cube. This space is a subset of the 6-cubic space in Fig.2.
4.
Multi-sensory states involving SIGHT.
This diagram, a 5-dimesnional cube, is also a subset of the space in Fig.2. Similar diagrams are
possible for each sense.
5.
SEE-HEAR-TOUCH-SPEAK SPACE OF A HUMAN.
All combination states involving SIGHT, HEARING, TOUCH and SPEECH arranged in a 4dimensional cube. This diagram is also a subset of the one in Fig.2.
6.
SENSORY ACTIONS OF A HUMAN WITH A MACHINE.
The 4-dimensional space shows the states of a human (“I”) acting on a machine (“It”) using SIGHT,
HEARING, TOUCH and SPEECH senses.
7.
SENSORY ACTIONS OF A MACHINE WITH A HUMAN.
The space shows the states of a machine (“It”) acting on a human (“Me”) using SIGHT, HEARING,
TOUCH and SPEECH senses.
8.
GENERATORS OF MULTI-SENSORIAL HUMAN-MACHINE INTERACTIONS.
The interactions between the 5 human and 5 machine receptive senses can be mapped in 10dimensional space. The HEARING-SPEECH complimentarity reduces the six senses to five
enabling the equality
“I HEAR It” = “It SPEAKS To Me”, and
ITU-T\SG_DOC\SG16\FEB02\GENERAL\GEN-005.DOC
12.02.16
-6“It HEARS Me” = “I SPEAK To It.”
The co-ordinates are shown in two rows for convenience; the first bracket represents the human, and
the second the machine.
9.
(a) GENERATORS OF SEE-HEAR-TOUCH HUMAN-MACHINE INTERACTIONS
USING HEAR-SPEAK COMPLIMENTARITY (Extent of Morphological space is shown).
The 6 generators used here are the subset of the 10 in Fig.8. The human and machine senses are
each restricted to three (SIGHT, HEARING and TOUCH). The co-ordinates are indicated in two
brackets (as in Fig.8) but each is reduced in digits corresponding to the senses being represented.
(b,c) SEE-HEAR-TOUCH HUMAN-MACHINE INTERACTION SPACE USING HEAR-SPEAK
COMPLIMENTARITY.
The 6-dimensional space illustrated here is generated by the 6 vectors of Fig.9a. Simple
telecommunication devices correspond to many of the interactions. For example, the location
(0,1,1)(0,1,0) - I HEAR It, I TOUCH It, It HEARS Me - represents the intercom or the walkie-talkie
device. Location (1,1,1)(0,1,0) represents the telephone - I SEE It, I HEAR It, I TOUCH It, It
HEARS Me – and so on.
(a) GENERATORS OF VIDEO-AUDIO-TANGO MODES OF MACHINES. The 6 generators
correspond to the ones in Fig.9a and are obtained by the following substitutions :
I SEE It = VIDEO Out
It SEES Me = VIDEO In
I HEAR It = AUDIO Out
It HEARS Me = AUDIO In
I TOUCH It = TANGO Out
It TOUCHES Me = TANGO In
(b.c) MORPHOLOGICAL SPACE OF VIDEO-AUDIO-TANGO MODES OF MACHINES.
The 64 states correspond to the ones in Fig.9b, c using the substitutions described above.
ITU-T\SG_DOC\SG16\FEB02\GENERAL\GEN-005.DOC
12.02.16