In parallel and complementarily, it is a question of analysing the information and emotional meanings of interactions between the communicating purposes, the humans , the activities and the systems, in order to validate models of generations of new forms enriched by communication which are sufficiently explicit and explanatory to make them effective, controllable and evolutionary in real time and in the direction of a better humanisation of the interfaces.
One is based on the modelling of activities artistic, by nature complex and strongly charged in significance and emotions while using a semantic analysis of significant type of positioning, gestures, words, moods .
There is an analytical field in any artistic form of expression in which the creator tries to define the role of his art to acquire freedom, determined by his gesture and decisions.
The plastics technician knows the laws of colour, architecture which can an present an image, the symbolic system of the forms and formats, etc; the type-setter knows the laws of harmony, the instruments, the musical structures, etc; the choreographer knows how to establish a partition by breaking up in a systematic way a sequence of movements which it characterises by the posture , intensity, trajectory, etc; the actor knows a range of gestures, types of displacement and modulation of the voice suitable to be useful for such or such expression.
Thus there is a semiology of visual signals, a semiology of the aural beeps, a semiology of the gestural field of expression, a semiology of scenography. The process of creation connects dialectic of the analytical field of expression based on semiology with an unspecified field of expression, in order to express a new relation. In other words, at a given time, a creator knows the tools for which it lays out their instructions. To organise and include/understand the data which it receives, a creative system must also have functions of semiological evaluation.
A second stage of analysis consists in working out a correspondence between the elementary physical qualities identified in each field of expression and emotional qualities which result from a combination of physical qualities. One will be able to consider for example that "tragic" emotional quality.
Constituent elements of sound
Intensity: measured in decibels: loud “soft
Pitch:from low to high pitched: it varies with frequency
Timbre:deep “sharp; compact “diffuse; coloured “coloureless; full “empty
Tempo: slow “fast
Constituent visual elements
Tint: the combination of colours; primary and secondary colours; hot “cold
Saturation: intensity of colour through rapport with its maximum intensity
Luminosity: greyness of colour: sombre “clear
Point, line, the plan.
Constituent elements of the choreograph
Posture: open “closed
Trajectory: slow “quick; regular “irregular; continuous “discontinuous
Tone: calm “agitated.
While transforming, for each quantitative value, the means of expression obtained starting from the sensors or the information processing system (quantity of energy, value of the colours, rate of travel, loudness, etc.) into comparable qualities (tragedy, peaceful, hot, cold, noisy , calm), we establish, for the various means of expression, a virtual common platform, a grid of reference. The role of scene setting will be then to establish, in reference to these comparable qualities, the rules of behaviour for the actors of the virtual platform and the human actor (Figure 23.8).
The performance of the dancer such as is perceived by the system and the answer which the system brings there are represented by the integral of the grids of the quality of the various superimposed fields of expression. If one considers this integral in the course of time, each field of expression can be looked at like a partition of an instrument, and all of the partitions like the partition of the whole orchestra. It will be interesting to try out the use of the formalisms of writing used in the contemporary music on the partitions of the grids, to imagine a temporal multimedia writing based on emotional partitions.
The below shows an example of a grid of reference, in which the lines correspond to the four forms of expression (body, musical, plastic, scenographic), and where the columns correspond to a succession of moments or phases of more or less long duration.
1 | 2 | 3 | 4 | 5 | ||
---|---|---|---|---|---|---|
| body expression | peaceful | peaceful | tragedy | tragedy | peaceful |
| musical expression | silencer, rhythmic | piano, rhythmic | mezzo-strong, asynchronous | strong, asynchronous | silencer, rhythmic |
| plastic expression | cold, statics | cold, dynamics, slow | heat, dynamics, slow | heat, dynamics, rapid | cold, statics |
| scenographic expression | calm, closed | calm | a little agitated | agitated | calm, closed |