United States Patent:

United States Patent	*5,644,363*
Mead	July 1, 1997

Apparatus for superimposing visual subliminal instructional materials on a video signal

Abstract

A subliminal video instructional device comprises circuitry for receiving an underlying video signal and presenting this signal to horizontal and vertical synchronization detection circuits, circuitry for generating a subliminal video message synchronized to the underlying video signal, and circuitry for adding the subliminal video message to the underlying video signal to create a combination video signal.

Inventors:	Mead; Talbert (Colorado Springs, CO)
Assignee:	The Advanced Learning Corp. (Colorado Springs, CO)
Appl. No.:	410275
Filed:	March 24, 1995

Current U.S. Class: 348/563; 348/473

Intern'l Class: H04N 005/445

Field of Search: 348/473,589,563,584,600,598,525,521

References Cited

U.S. Patent Documents

3278676	Oct., 1966	Becker.
3742125	Jun., 1973	Siegel	348/729.
4872054	Oct., 1989	Gray et al.	348/553.
5128765	Jul., 1992	Dingwall et al.	348/729.
5134484	Jul., 1992	Willson	348/564.
5221962	Jun., 1993	Backus et al.	348/563.
5227863	Jul., 1993	Bilbrey et al.	348/578.

Primary Examiner: Kostak; Victor R.
Attorney, Agent or Firm: Barton; Steven K.

Claims

I claim:

1. An apparatus for superimposing subliminal and non-subliminal video messages on a video signal to generate a combined video signal comprising:
a. circuitry for receiving a source video signal having horizontal and vertical synchronization information;
b. circuitry for generating sync signals by detecting said horizontal and vertical synchronization information from said video signal;
c. circuitry for generating said subliminal and non-subliminal video messages synchronized to said sync signals;
d. an analog adder for superimposing said subliminal video messages on said source video signal as received by the circuitry for receiving a source video signal, said adder further comprising a clamp circuit for superimposing said non-subliminal video messages on said source signal.

2. An apparatus for superimposing subliminal video messages on a video signal to generate a combined video signal comprising:
(a) circuitry for receiving a source video signal having horizontal and vertical synchronization information;
(b) circuitry for deriving at least one synchronization signal from said horizontal and vertical synchronization information of said video signal;
(c) a pulse width modulator for generating a pulse-width modulated signal;
(d) circuitry for generating a signal comprising said subliminal video messages synchronized to said at least one synchronization signal; and
(e) an analog adder for superimposing the subliminal video messages upon said source video signal by shifting a level of the source video signal by a subliminal signal having magnitude proportional to an integral of the pulse-width modulated signal and conveying an image of the subliminal video message signal.

3. The apparatus of claim 2 wherein during the beginning of a period in which a subliminal message is generated, a pulse width of the pulse-width modulator is ramped from a level such that the subliminal message is very weak in the combined video signal, to a level such that the subliminal message is stronger in the combined video signal.

4. The apparatus of claim 3 wherein during the end of a period in which a subliminal message is generated, a pulse width of the pulse-width modulator is ramped from a level such that the subliminal message is present in the combined video signal, to a level such that the subliminal message is weaker in the combined video signal.

Description

FIELD OF THE INVENTION

This invention relates to a system for generating subliminal instructional messages synchronized to an underlying television signal, and for superimposing these visual, and optionally aural, subliminal messages upon the underlying audiovisual television signal.

BACKGROUND OF THE INVENTION

Subliminal instructional messages are aural, symbolic, or textual messages presented with an often unrelated visual, aural, or audiovisual presentation (hereinafter the underlying video). These messages are presented in such a manner as to not be distracting to the viewer of the underlying video, which is frequently an entertainment oriented presentation. Subliminal messages are intended to be recognized by the viewer's subconscious mind, where they may eventually lead to behavioral modification.

Subliminal messages may be incorporated into a video signal for viewing on a television receiver. This may be done by substituting a frame or field of the video signal with the message, while the majority of fields or frames are those of the underlying video. Subliminal messages may also be presented by weakly modulating a visual characteristic, such as brightness, of the underlying video.

When a subliminal message is presented by weakly modulating a visual characteristic of the underlying video signal, it is important that superimposed subliminal messages be synchronized to the underlying video signal. If the superimposed message's frame and line rates differ greatly from those of the underlying video, the superimposed message may be become so broken up as to be illegible. Should the rates be closer, the message may wander, or roll, about the screen in such a way as to be distracting to the viewer.

Similarly audio subliminal messages can be superimposed upon an audio signal by mixing them with the underlying audio signal. It is, however, advantageous to increase the amplitude of the subliminal audio signal during those periods when the underlying audio signal is loud relative to the amplitude of the subliminal audio signal during those periods when the underlying audio signal is soft.

STATE OF THE ART

Systems for generating video subliminal instructional messages and superimposing them upon an underlying video signal have been described in the art. Most of these are not well suited for mass production at low cost. For example, U.S. Pat. No. 5,027,208 presents a system having a 256 by 256 "substitute frame memory" synchronously superimposed upon a video signal by means of a video mixer. While this 256.times.256 frame memory offers respectable capabilities for displaying graphic messages as well as textual messages, it also represents 8192 bytes of memory, a substantial chunk compared to the on chip memory of low cost single-chip microprocessors. The device of U.S. Pat. No. 5,027,208 also fails to provide means for on-screen programming of the device.

Similarly, U.S. Pat. No. 5,134,484 presents 18 drawing sheets detailing a method for dynamically decompressing an encoded graphical message. This message is synchronously generated and superimposed on a video signal. While the invention of U.S. Pat. No. 5,134,484 greatly reduces the required memory size for each frame, this comes at a cost of extensive logic not found on even those commercially available microprocessors which support the generating of synchronized video. Further, no provisions are made for on-screen programming or providing control over the modulation intensity of the subliminal messages. While U.S. Pat. No. 5,134,484 describes "additively" combining the subliminal signal in a "combiner," the disclosure is inadequate to determine exactly how the combining function is performed.

U.S. Pat. No. 5,221,962 describes a system that provides a manual video modulation-intensity control so that a user may consciously observe and validate the subliminal message. No on-screen programming of the subliminal message generator is described.

Many low cost control-oriented microprocessors now available include a pulse-width modulator. A pulse-width modulator comprises a few stages of latch and counter, thus inherently costs far less than the resistor-string and R-2R ladder digital to analog converters that are well known in the art. While a pulse width modulated signal may be used to communicate digital information, pulse width modulated signals are often used to drive electromechanical devices. Pulse-driven motor and lamp drivers can be of much higher efficiency than linear analog drivers, while mechanical, visual, or thermal inertia serves to integrate the mechanical impulses provided by the pulse stream.

A common prior-art approach to modulating a color video signal involves the three steps of 1) demodulating the color video signal into the three color signals Red, Green, and Blue; 2) adjusting each of the three color signals as desired; and 3) regenerating a composite video signal from the three adjusted color signals. This prior art technique is expensive in terms of the hardware required. Consider the hardware requirements of step 1 alone, the demodulating of a color signal: generally a phase-locked loop regenerates or picks off the color subcarrier; a crossover filter separates the chroma information from the luminance information; mixers combine the regenerated color subcarrier with the chroma information, producing baseband color difference signals; and finally the difference signals are combined with the luminance information to produce demodulated red, green, and blue signals.

SUMMARY OF THE INVENTION

The present invention comprises a low cost system for generating subliminal visual messages synchronized to a video signal, and superimposing those messages through a programmably variable modulation of brightness of another video signal. The subliminal messages are faded into view gradually so as to avoid distracting a viewer. The invention further comprises a combination video generation hardware that may generate both subliminal visual messages and messages associated with the on-screen programming of the system.

The stronger the modulation of a visual characteristic, or the greater the number of substituted frames, the greater the likelihood that the subliminal message will become distracting to the viewer, at which point the message ceases to be subliminal. Similarly, the weaker the modulation of the visual characteristic the less likely that the subliminal message will be perceived by the subconscious and result in a behavioral modification. It has been discovered that by fading a subliminal message onto the screen gradually, a greater degree of modulation is accepted as non-distracting to the viewer. Such a greater degree of modulation is expected to result in a greater likelihood that the viewer's subconscious will comprehend the message, and undertake a favorable behavioral modification.

The present invention also comprises a low cost method of impressing the subliminal message on the composite video signal.

BRIEF DESCRIPTION OF THE DRAWINGS

The best mode presently contemplated for carrying out the invention is illustrated in the accompanying drawings, in which:

FIG. 1 is a system block diagram wherein the present invention is used to superimpose a subliminal instructional message upon a video signal originating from a videotape recorder and being displayed on a television to a viewer;

FIG. 2 a block diagram of the subliminal message generator and superimposer of the present invention;

FIG. 3 a circuit diagram of the integrator, switch, scaler, and video adder of the present invention;

FIG. 4 is, a simplified block diagram of a portion of the 87C055 device used in the present preferred embodiment.

DETAILED DESCRIPTION OF THE INVENTION

In the presently preferred embodiment of the present invention, a videocassette recorder 10 (FIG. 1), is used to provide a source video signal 11 and a source audio signal 12. The videocassette recorder may derive this signal by playing a tape, from an antenna 13 by means of an integral tuner (not shown), from a videogame entertainment device (not shown), or from a cable television signal (not shown). The source video signal 11 and the source audio signal 12 are connected to the subliminal message generator and superimposer 14. The subliminal message generator and superimposer 14 is normally powered by a separate 12-volt D.C power supply (not shown).

An optional audio tape player 15 generates an optional second audio signal 16 which may also feed the subliminal message generator and superimposer 14. This second audio signal will be added to the source audio signal 12 to form either an audio output (not shown) or the audio component of an RF-modulated television signal output 18.

A program selection key cartridge 17 is inserted into the subliminal message generator. This key cartridge 17 contains information about the nature and sequence of the subliminal messages to be displayed; one key cartridge may contain messages such as "Quit Now--Feel Good" for smokers, another may contain messages such as "Exercise More--Feel Good" for viewers with weight problems. The subliminal message generator generates and superimposes subliminal messages upon the video signal from the VCR 10 to form either a video output (32 on FIGS. 2 and 3) or an the video component of an RF-modulated television signal output 18. The audio and video outputs, or the RF-modulated television signal 18, connect to a television receiver 19 (FIG. 1 ) or monitor (not shown) which presents both an underlying source program and the subliminal messages to a viewer (not shown).

FIG. 2 shows more detail of the subliminal message generator of the present invention. The first video input 11 connects to a synch separator 21 which extracts horizontal and vertical synchronization information from the video signal. This horizontal and vertical synchronization information is used to synchronize a video message generator 22 to the horizontal and vertical scan of the incoming video input signal 11.

The video message generator 22 data output 23 is connected to a control input of a highspeed switch 24. This switch selects either a constant 25 signal or the output of an integrator 26. When the constant 25 is selected the screen intensity of the television 20 will have a first value and when the integrator output is selected the screen intensity will have a second value dependent on the voltage output of the integrator 26. The integrator 26 output is a function of the width of a pulse-width modulated signal 29. A processor 27 drives a pulse-width modulator (PWM) 28 which produces the pulse-width modulated signal 29.

The highspeed switch 24 output is scaled by a scaler 30 and added by an adder 31 to the incoming video signal 11. The output of this adder 31 may be taken as a video output 32 for a monitor, VCR, or other device with a composite video input; or may be fed to an RF modulator 33 to generate a channel 3 or 4 television signal 18. The audio output 12 of the videocassette recorder may be attenuated by an attenuator (not shown) and mixed by a mixer 34 with an optional second audio input 16 to produce an audio output 35. This audio output 35 also serves as an audio input to the RF modulator 33, where the audio information is impressed upon the channel 3 or 4 television signal 18..

The source video signal may comply with the NTSC, SECAM, or PAL standards for composite video. While the presently contemplated initial manufactured version envisions a separately manufactured device for each of these standards, and for each language in which subliminal messages are generated, it is expected that later models of the subliminal message generator will recognize the video standard of the underlying video and automatically configure itself to the appropriate standard. Distinguishing between PAL and NTSC standards may be accomplished through timing the vertical synchronization signal extracted by the synch separator 21; as NTSC video comprises 60 fields per second while PAL comprises 50.

Revisiting the present preferred embodiment of the present invention, the pulse width modulator output 29 is available as an open-drain output of the microprocessor chip 40 (FIG. 3), where a potentiometer 41 is used to pull a logic "1" signal to a desired level. A fixed resistor may be added between this potentiometer 41 and the power supply to prevent destruction of the pulse-width modulator output 29 should the device be turned on with the wiper of potentiometer 41 turned all the way up. This pulse width modulator output is then integrated by a resistor 42 and a capacitor 43, the integral is buffered by an amplifier 44. The output of this amplifier 44 is an analog voltage that corresponds, after delays, to a digital value programmed into the pulse-width modulator 28 by the microprocessor (27 on FIG. 2)

The 87C055 video processor chip used in the presently preferred embodiment has three attribute lines on which the generated video signal 23 appears (FIG. 3), two of which are provided for non-subliminal video displays used during initialization and on-screen user programming of the system. The third of the generated video lines 23, the line on which subliminal video appears 45, is inverted and level shifted by transistor 46, resistor 47, and pull-up resistor 48. The inverted signal controls a switch comprising transistor 49 and resistor 50 which applies the buffered integral to an end of the scaling resistor 51, which feeds the summing node 52. It has been found that 10K is a suitable value for the scaling resistor 51. It has also been found that the circuit will provide an inverted but otherwise suitable superposition of the generated subliminal messages upon the underlying video signal if PNP transistor 49 is substituted with a NPN transistor, the collector-base junction of which acts as a diode to shift down (instead of the normal up) the node between resistors 50 and 51.

The video input signal 11 is buffered by an emitter-follower amplifier 53 and applied through summing resistor 54 to the summing node 52. It has been found that 511 ohms is a suitable value for the summing resistor 54. It is expected that other values may be used for the summing resistors 54 and sealing resistor 51, provided that an approximate resistance ratio of from 1 to 10 through 1 to 50 is maintained. The summed video on the summing node 52 is then buffered by an amplifier 55 to generate the video output signal 32. The operation of summing the incoming video with the switched integrator voltage effectively level shifts the underlying video signal by the subliminal message.

The non-subliminal generated video signals provided for on-screen programming enter the video switch through resistor 62 for light and resistor 56 for dark. Transistors 57 and 60, with resistors 58, 59, and 61, switch a current into summing node 52 when a dark background is desired, and transistors 63 and 66, together with resistors 62, 64, and 65 clamp the summing node 52 to a white level when a white letter or symbol is desired for on-screen programming or initialization displays. It is not necessary that the clamp circuits comprised of transistors 57, 60, 63, 66 and resistors 58, 59, 61, 62, 64, and 65 actually clamp the summing node voltage to a specific value, it is sufficient that they provide sufficient current to overwhelm the input video signal. The hardware of the present invention may be operated to provide dark letters and symbols on a white background, dark letters on an underlying video background, or white letters and symbols on an underlying video background.

The presently preferred embodiment utilizes two power supply voltages. The primary supply, known as VCC2 68, is approximately 10 volts and regulated down from a 12-volt standard wall-cube power supply. The second supply, VCC1 69, is approximately 5 volts as required for the microprocessor.

It has been found that a microprocessor with video message generator of the Phillips 83C053, 83C054, 83C055 and 87C055 family is suitable for use in the present invention. The 87C055 is preferred for prototype and low volume production, while the mask programed 83C055 is preferred for higher volume production. In the present preferred embodiment, a device of this family comprises the processor 27, the pulse-width modulator 28, and the video message generator 22 (FIG. 2). The ROM or EPROM memory of the processor contains suitable software which causes the processor 27 to perform the following functions involved in displaying a subliminal message:

a. Upon power up, the processor 27 must properly initialize the video message generator 22 for the video standard in use (NTSC or PAL are both supported by the 83C054) by the underlying video signal.

b. The system may optionally go through a welcome screen to the user to set maximum modulation levels for the subliminal messages.

c. For each message to be generated, the processor 27 sets the pulse width modulator 28 pulsewidth to zero for minimum modulation intensity.

d. The processor reads the key cartridge 17 (FIG. 2) for information regarding the message to be displayed, and formats this message in the memory of the video message generator 22. While some components of the messages are stored in the cartridge, many components such as words are stored in the ROM or EPROM memory of the processor; the cartridge need then only contain a pointer to each of these message components.

e. The pulsewidth of the pulsewidth modulator 28 is slowly increased until the desired maximum subliminal modulation level is reached. The slow increase in pulsewidth causes the message to fade into view on the television screen without distracting the viewer.

f. The message is allowed to remain on the screen for a given amount of time.

g. The pulsewidth of the pulsewidth modulator 28 is slowly decreased to zero to fade out the subliminal message.

h. Steps c through g repeat for each message to be displayed.

The video generation hardware of the 87C054/87C055 family comprises a 128 character display RAM 80 that contains a message to be displayed and four attribute bits for each character. These attribute bits determine a foreground character attribute code. These attribute codes are referred to as color codes in the 87C054/87C055 documentation. These attribute codes appear during each pixel time as a three bit binary code on the VID0, VID1, and VID2 outputs 23 (FIG. 3), of the device. The video generation hardware further comprises a character generator EPROM or ROM 81 which contains a pixel pattern for up to sixty letters and symbols that may be displayed.

In operation, a display character and foreground attribute is fetched from the display RAM 81 into a character latch 82. This character, together with a current line count within the present character row (from row counter 83), addresses a word in the character generator EPROM or ROM 81. The character generator word is placed in a parallel-load, serial output, shift register 84 and shifted each pixel time to produce a pixel signal. The pixel signal from the shift register is used to create the 3-bit attribute code output on VID0, VID1, and VID2 23 for each pixel of the generated image through selecting in a multiplexor 85 either the foreground attribute in the character latch 82 (which may be delayed 86 to compensate for the character generator cycle time) or a background attribute in a register 87. In the present preferred embodiment, a VID2-VID1-VID0 code of 111 produces unmodified underlying video, a code of 110 produces underlying video as modified for a pixel of a subliminal message, a code of 101 produces a dark pixel for non-subliminal on-screen programming use, and a code of 011 a white pixel for non-subliminal on-screen programming.

Whereas this invention is here illustrated and described with reference to embodiments thereof presently contemplated as the best mode of carrying out such invention in actual practice, it is to be understood that various changes may be made in adapting the invention to different embodiments without departing from the broader inventive concepts disclosed herein and comprehended by the claims that follow.

* * * * *

Top

( 1 of 1 )

United States Patent	*6,017,302*
Loos	January 25, 2000

Subliminal acoustic manipulation of nervous systems

Abstract

In human subjects, sensory resonances can be excited by subliminal atmospheric acoustic pulses that are tuned to the resonance frequency. The 1/2 Hz sensory resonance affects the autonomic nervous system and may cause relaxation, drowsiness, or sexual excitement, depending on the precise acoustic frequency near 1/2 Hz used. The effects of the 2.5 Hz resonance include slowing of certain cortical processes, sleepiness, and disorientation. For these effects to occur, the acoustic intensity must lie in a certain deeply subliminal range. Suitable apparatus consists of a portable battery-powered source of weak subaudio acoustic radiation. The method and apparatus can be used by the general public as an aid to relaxation, sleep, or sexual arousal, and clinically for the control and perhaps treatment of insomnia, tremors, epileptic seizures, and anxiety disorders. There is further application as a nonlethal weapon that can be used in law enforcement standoff situations, for causing drowsiness and disorientation in targeted subjects. It is then preferable to use venting acoustic monopoles in the form of a device that inhales and exhales air with subaudio frequency.

Inventors:	Loos; Hendricus G. (3019 Cresta Wy., Laguna Beach, CA 92651)
Appl. No.:	961907
Filed:	October 31, 1997

Current U.S. Class: 600/28

Intern'l Class: A61B 005/00

Field of Search: 600/26-28 128/897,898

References Cited

U.S. Patent Documents

4124022	Nov., 1978	Gross.
4335710	Jun., 1982	Williamson	600/28.
4573449	Mar., 1986	Warnke.
5076281	Dec., 1991	Gavish	600/28.
5123899	Jun., 1992	Gall	600/28.
5309411	May., 1994	Huang et al.	367/140.
5733240	Mar., 1998	De Visser	600/9.

Primary Examiner: Gilbert; Samuel

Claims

I claim:

1. Apparatus for manipulating the nervous system of a subject, the subject having an ear, comprising: generator means for generating voltage pulses; induction means, connected to the generator means and responsive to the voltage pulses, for inducing at the ear subliminal atmospheric acoustic pulses with a pulse frequency less than 15 Hz.

2. The apparatus according to claim 1, further comprising means for automatically controlling the voltage pulses.

3. The apparatus according to claim 1, further comprising means for monitoring the voltage pulses.

4. The apparatus according to claim 1, for exciting in the subject a sensory resonance that occurs at a resonance frequency less than 15 Hz, the apparatus further comprising tuning means for enabling a user to tune the pulse frequency to the resonance frequency.

5. The apparatus according to claim 4, further including a casing for containing the generator means, the induction means and the tuning means.

6. The apparatus according to claim 1, wherein said induction means comprise: means for generating in the atmosphere a gas jet, the latter having a momentum flux; and modulation means, connected to the generator means and responsive to said voltage pulses, for pulsing the momentum flux with a frequency less than 15 Hz; whereby subaudio acoustic pulses are induced in the atmosphere.

7. Apparatus for manipulating the nervous system of a subject, the subject having an ear, comprising: generator means for generating voltage pulses; a source of gas at a pressure different from the ambient atmospheric pressure; a conduit having an orifice open to the atmosphere for passing a gaseous flux; valve means, connected to the source of gas and the conduit to control the gaseous flux; means, connected to the generator means and responsive to said voltage pulses, for operating the valve means to provide an oscillation of the gaseous flux with a frequency less than 15 Hz.

8. The apparatus according to claim 7, further comprising vessel means for smoothing fluctuations of the gaseous flux caused by fluctuations in the pressure of the source of gas.

9. A method for manipulating the nervous system of a subject, the subject having an ear, comprising the steps of: generating voltage pulses; and inducing, in a manner responsive to the voltage pulses, at the ear subliminal atmospheric acoustic pulses with a pulse frequency less than 15 Hz.

10. The method according to claim 9, for exciting in the subject a sensory resonance that occurs at a resonance frequency less than 15 Hz, further comprising the step of tuning the pulse frequency to the resonance frequency.

11. The method according to claim 9, wherein said inducing comprises the steps of: generating in the atmosphere a gas jet, the latter having a momentum flux; and modulating the momentum flux in pulse-wise fashion in a manner responsive to the voltage pulses.

12. The method according to claim 11, further comprising the step of directing the gas jet at a material surface.

13. The method according to claim 9, wherein said inducing comprises the steps of: generating a gas flow through a conduit orifice that is open to the atmosphere; and modulating the gas flow to produce flow pulsations, in a manner responsive to the voltage pulses.

14. A method for remotely manipulating the nervous system of a subject in the course of law enforcement in a standoff situation, the subject having an ear, comprising the steps of: generating voltage pulses; generating, in a manner responsive to the voltage pulses, atmospheric acoustic signals at a plurality of locations remote from the subject for inducing at the ear subliminal atmospheric acoustic pulses with a pulse frequency less than 15 Hz, the signals having phase differences with respect to each other arranged to cause constructive acoustic wave interference at the subject.

15. A method for exciting in a subject a sensory resonance having a resonance frequency less than 15 Hz, the subject having an ear, comprising the steps of: generating voltage pulses; inducing, in a manner responsive to the voltage pulses, at the ear subliminal atmospheric acoustic pulses with a pulse frequency less than 15 Hz; tuning the pulse frequency to the resonance frequency; and also inducing audible audio-frequency atmospheric acoustic signals at the ear.

16. A method for controlling in a subject neurological disorders that involve pathological oscillatory activity of neural circuits, the subject having an ear, comprising the steps of: generating voltage pulses; inducing, in a manner responsive to the voltage pulses, at the ear subliminal atmospheric acoustic pulses with a pulse frequency less than 15 Hz; and arranging said pulse frequency to detune the pathological oscillatory activity.

17. A method for controlling in a subject epileptic seizures, the subject having an ear, comprising the steps of: generating voltage pulses; inducing in a manner responsive to the voltage pulses, at the ear subliminal atmospheric acoustic pulses with a pulse frequency less than 15 Hz; and initiating said inducing when a seizure precursor is felt by the subject.

Description

BACKGROUND OF THE INVENTION

The central nervous system can be manipulated via sensory pathways. Of interest here is a resonance method wherein periodic sensory stimulation evokes a physiological response that peaks at certain stimulus frequencies. This occurs for instance when rocking a baby, which typically provides relaxation at frequencies near 1/2 Hz. The peaking of the physiological response versus frequency suggests that one is dealing here with a resonance mechanism, wherein the periodic sensory signals evoke an excitation of oscillatory modes in certain neural circuits. The sensory pathway involved in the rocking example is the vestibular nerve. However, a similar relaxing response at much the same frequencies can be obtained by gently stroking a child's hair, or by administering weak heat pulses to the skin, as discussed in U.S. Pat. No. 5,800,481, Sep. 1, 1998. These three types of stimulation involve different sensory modalities, but the similarity in responses and effective frequencies suggests that the resonant neural circuitry is the same. Apparently, the resonance can be excited either via vestibular pathways or via cutaneous sensory pathways that carry tactile or temperature information.

Near 2.5 Hz another sensory resonance has been found that can be excited by weak heat pulses induced in the skin, as discussed in U.S. Pat. No. 5,800,481, Sep. 1, 1998. This sensory resonance brings on a slowing of certain cortical functions, as indicated by a pronounced increase in the time needed to silently count backward from 100 to 70 with the eyes closed. The effect is sharply dependent on frequency, as shown by a response peak a mere 0.13 Hz wide. The thermally excited 2.5 Hz resonance was found to also cause sleepiness, and after long exposure, dizziness and disorientation.

Other, more obscure types of stimulation in the form of weak magnetic fields or weak external electric fields can also cause the excitation of sensory resonances, as

SUMMARY OF THE INVENTION

Experiments have shown that atmospheric acoustic stimulation of deeply subliminal intensity can excite in a human subject the sensory resonances near 1/2 Hz and 2.5 Hz. The 1/2 Hz resonance is characterized by ptosis of the eyelids, relaxation, drowsiness, a tonic smile, tenseness, or sexual excitement, depending on the precise acoustic frequency near 1/2 Hz that is used. The observable effects of the 2.5 Hz resonance include a slowing of certain cortical functions, sleepiness, and, after long exposure, dizziness and disorientation. The finding that these sensory resonances can be excited by atmospheric acoustic signals of deeply subliminal intensity opens the way to an apparatus and method for acoustic manipulation of a subject's nervous system, wherein weak acoustic pulses are induced in the atmosphere at the subject's ears, and the pulse frequency is tuned to the resonance frequency of the selected sensory resonance. The method can be used by the general public for control of insomnia and anxiety, and for facilitation of relaxation and sexual arousal. Clinical use of the method includes the control and perhaps a treatment of anxiety disorders, tremors, and seizures. A suitable embodiment for these applications is a small portable battery-powered subaudio acoustic radiator which can be tuned to the resonance frequency of the selected sensory resonance.

There is an embodiment suitable for law enforcement operations in which a subject's nervous system is manipulated from a considerable distance, as in a standoff situation. Subliminal subaudio acoustic pulses at the subject's location may then be induced by acoustic waves radiating from a venting acoustic monopole, or by a pulsed air jet, especially when aimed at the subject or at another material surface, where the jet velocity fluctuations are wholly or partly converted into static pressure fluctuations.

The described physiological effects occur only if the intensity of the acoustic stimulation falls in a certain range, called the effective intensity window. This window has been measured in exploratory fashion for the 2.5 Hz resonance.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a preferred embodiment wherein a modulated air jet is used for inducing subliminal acoustic pulses in the atmosphere at the subject's ears, for the purpose of manipulating the subject's nervous system.

FIG. 2 shows an embodiment in which a pulsed air jet is produced by modulating the flow from a fan by a cylindrical sheet valve that is driven by a voice coil.

FIG. 3 shows schematically an acoustic monopole operated by a solenoid valve.

FIG. 4 shows the circuit of a simple generator for producing voltage pulses that drive a piezoelectric speaker.

FIG. 5 depicts a portable battery-powered device that contains the circuit and the piezoelectric speaker of FIG. 4.

FIG. 6 shows schematically a generator for chaotic pulses.

FIG. 7 depicts a circuit for generating a complex wave.

FIG. 8 illustrates an application in a law enforcement standoff situation.

FIG. 9 contains experimental data that show excitation of the sensory resonance near 2.5 Hz, and the effective intensity window.

FIG. 10 depicts experimental data showing that the sensory excitation occurs via the ear canal.

FIG. 11 shows the buildup of the physiological response to the acoustic stimulation.

FIG. 12 shows schematically an acoustic monopole operated by a rotating valve.

DETAILED DESCRIPTION OF THE INVENTION

It has been found in our laboratory that deeply subliminal atmospheric acoustic pulses with frequency near 1/2 Hz can evoke in a human subject a nervous system response that includes ptosis of the eyelids, relaxation, drowsiness, the feeling of pressure at a centered spot on the brow, seeing moving patterns of dark purple and greenish yellow with the eyes closed, a soft warm feeling in the stomach, a tonic smile, a "knot" in the stomach, sudden loose stool, and sexual excitement, depending on the precise acoustic frequency used. These responses show that this sensory resonance involves the autonomic nervous system.

The sharp peaking of the physiological effects with frequency is suggestive of a resonance mechanism, wherein the acoustic stimulation, although subliminal, causes excitation of a resonance in certain neural circuits. Since the frequencies and responses are similar to those for the 1/2 Hz sensory resonance discussed in the Background Section, it appears that the resonance excited by the described acoustic stimulation is indeed the 1/2 Hz sensory resonance. It has been found that the 2.5 Hz sensory resonance can be excited acoustically as well. This sensory resonance causes the slowing of certain cortical processes, sleepiness, and eventually dizziness and disorientation.

One can avoid the described physiological responses by wearing snugly fitting ear plugs. This shows that the excitation occurs via the external ear canal, so that the stimulation proceeds either through the auditory nerve or the vestibular nerve. Frequencies near 1/2 Hz or 2.5 Hz are far too low for stimulating the cochlear apparatus, but they are within the response range of hair cells in the vestibular end organ. Also, there exists a low-frequency acoustic path to the vestibular end organ by virtue of the ductus reuniens which provides a fluid connection between the cochlea and the vestibular organ. The narrow duct severely attenuates acoustic signals and acts as a low pass filter with a very low cutoff frequency. Subaudio acoustic signals, i.e., acoustic signals with frequencies up to 15 Hz, may perhaps penetrate to the vestibular organ with sufficient strength for stimulating the exquisitely sensitive vestibular hair cells.

For the 1/2 Hz and 2.5 Hz resonances, the described physiological responses are observed only if the acoustic intensity lies in a certain interval, called the effective intensity window. The acoustic intensity levels in this window are far below the human auditory threshold, so that exposed subjects do not sense the acoustic pulses in any other way than through the mentioned physiological effects. The upper limit of the effective intensity window is believed to be due to nuisance-guarding neural circuitry that blocks repeditive nuisance signals from higher processing.

The acoustic signals used for the excitation of sensory resonances have the nature of pulses. The pulses may be square, trapezoid, or triangle, or rounded versions of these shapes. However, depending on the pulse frequency, strong harmonics with frequencies in the audible range could stimulate the cochlear apparatus. This may be avoided by using sine waves or appropriately rounded other waves with low harmonic content.

The acoustic pulses occur in the atmosphere air; even when administered with earphones, the pulses at the subject's ear constitute pressure and flow pulses in the local atmospheric air.

The resonance frequencies of the 1/2 Hz and 2.5 Hz sensory resonances lie respectively near 1/2 and 2.5 Hz. The different physiological effects mentioned occur at slightly different frequencies. Thus, one can tune for drowsiness or sexual excitement, as desired. The precise resonance frequency is also expected to depend slightly on the subject and the state of the nervous and endocrine systems, but it can be measured readily by tuning the acoustic pulse frequency for maximum physiological effect. Besides the resonances near 1/2 and 2.5 Hz, other sensory resonances may perhaps be found, and those with resonance frequencies below 15 Hz are expected to be excitable acoustically via the vestibular nerve, since the vestibular hair cells are sensitive in this frequency range.

The finding that deeply subliminal subaudio acoustic stimulation can influence the central nervous system suggests a method and apparatus for manipulating the nervous system of a subject by inducing subliminal atmospheric acoustic pulses of subaudio frequency at the subject's ears. In doing so, one may in addition exploit the sensory resonance mechanism, but there are important applications where this is not done. For example, the subliminal acoustic manipulation of the nervous system may be used clinically for the control of tremors and seizures, by detuning the pathological oscillatory activity of neural circuits that occurs in these disorders. This may be done by choosing an acoustic frequency that is slightly different from the frequency of the pathological oscillation. The evoked neural signals then cause phase shifts which may diminish or quench the oscillation. Exploitation of the resonance mechanism by tuning the acoustic signals to the resonance frequency of a selected sensory resonance affords other forms of manipulation, such as control of insomnia and anxiety, or facilitation of sexual arousal.

For both types of manipulation, the required subliminal subaudio acoustic pulses may be induced at one or both of the subject's ears by earphones with a proper low-frequency response, acoustic waves generated by an acoustic source and propagated through the atmosphere, or by a pulsed jet of gas (which may be air), preferably directed at a material surface open to the atmosphere, such as a wall or the subject's skin or clothing. In the area of impact, especially where the surface is oriented substantially perpendicular to the jet, atmospheric pressure pulses are then generated by virtue of the ram effect, wherein flow velocity fluctuations are wholly or partly converted into static pressure fluctuations. If the material surface on which the jet impinges includes the subject's ears, then these pressure pulses cause direct stimulation of the subject, but the pulses also propagate through the atmosphere to the subject's ears by virtue of acoustic wave propagation along accessible paths.

The induction of atmospheric acoustic pulses by a pulsed air jet proceeding in the atmosphere and directed at a subject is shown in FIG. 1, where a blower 1, labeled "FAN", produces an air jet 2 that is directed at a subject 3. The fan is powered by a power supply 4, labelled "SUPPLY". At the fan, the supply voltage is modulated in pulsed fashion by a relay 5 controlled by the generator 6, labelled "GENERATOR", through voltage pulses 7 supplied to electromagnet windings 8. A user can adjust the frequency of the pulses with the tuning control 9. The pulsing of the voltage supplied to the fan causes the momentum flux 10 of the air jet to be modulated in a pulsed manner. Upon impinging on a material surface such as the skin of the subject 3, the pulsed jet induces acoustic pressure pulses at the ears 11 of the subject. The atmospheric acoustic effect of the jet is complicated by the fact that the region of the fan inlet undergoes a fluctuation of static pressure as the result of the modulation of jet momentum flux. There thus are two distinct acoustic monopoles, one at the fan inlet and the other in the area of impact of the jet on the material surface. The monopoles radiate with a phase difference that is determined by the jet velocity, the modulation frequency, and the distance between fan and impact area. The resulting sound pressure at the subject's ears can be analyzed with retarded potentials as discussed for instance by Morse and Feshbach (1953). Even a jet which does not impinge on a material surface radiates by virtue of the acoustic monopole at the fan inlet.

When skin of the subject is exposed to gas flow of the jet, or to the flow of atmospheric air entrained by the jet, the flow will fluctuate in pulsed fashion, so that a periodic heat flux occurs by convective transport and evaporation of sweat. The resulting periodic fluctuation of the skin temperature can excite a sensory resonance, as discussed in U.S. Pat. No. 5,800,481, Sep. 1, 1998. Hence, the apparatus of FIG. 1 can cause excitation of a sensory resonance via two separate sensory pathways, viz., the vestibular nerve and the afferents from cutaneous temperature receptors. The strength of the thermal stimulation depends on the skin area and type of skin exposed to the fluctuating flow. The face is particularly sensitive, especially the lips. The two-channel excitation of sensory resonances needs further investigation. In any particular situation, the vestibular channel can be blocked by using earplugs.

An air jet with pulsed momentum flux can also be obtained as illustrated in FIG. 2. Shown is a fan 1, labelled "FAN", which discharges into manifold 12. The air flow in the manifold can be partially obstructed by a sheet valve 13 in the form of a perforated cylindrical sheet. The sheet valve carries a voice coil 14 which is situated in the field of a permanent magnet 15, in the manner of conventional electromagnetic loudspeakers. When no current flows through the voice coil, the sheet valve is held in equilibrium position by springs 16. In this position, the perforation 17 in the sheet is lined up with the flow passage allowing essentially unimpeded flow through the manifold and out the exit 18, such as to form a jet 19 in the atmosphere. Sending a current pulse through the voice coil 14 causes the sheet valve to be displayed in the axial direction, thereby partially obstructing the air flow through the manifold. Owing to the low inertia of the sheet valve, the arrangement allows efficient pulse modulation of the jet momentum flux.

A somewhat different modulation system can be obtained with a rotating cylindrical sheet valve that has one or more holes along its periphery, and which is adjacent to a stationary cylindrical shroud that has corresponding holes, so that rotation of the valve causes modulation of the air flow through the holes. The valve is rotated by a stepper motor driven by voltage pulses. The latter are obtained from a generator that is controlled by a tuner.

One can also use direct acoustic wave propagation for inducing the required atmospheric acoustic pulses. It is then advantageous to employ as the source of the waves an acoustic monopole, since for these the acoustic pressure does not fall off as fast with increasing distance as for dipoles. Moreover, at the very low frequencies involved, acoustic pressure shorting across a conventional loudspeaker baffle is very severe. A sealed loudspeaker mounted in an airtight box eliminates this pressure shorting, and radiates acoustic waves with a relatively large monopole component.

An acoustic monopole may also be produced by having a source of pressurized gas vent through an orifice into the atmosphere in a pulsed fashion. The gas may be air. Alternatively, one may have a source of low-pressure air inhale atmospheric air through an orifice in pulsed fashion. These actions are easily achieved by an oscillating or rotating valve. For purposes of discussion it is convenient to introduce the concept of gaseous flux through the orifice, defined as the integral of the normal flow velocity component over an imagined surface that tightly caps the orifice, the normal component being perpendicular to the local surface element, and reckoned positive if the flow is directed into the ambient atmosphere. The gaseous flux has the dimension of m.sup.3 /s. For the case with a source of pressurized gas, the gaseous flux is positive and due to gas venting to the atmosphere. For the case with a source of vacuum, the gaseous flux is negative and due to atmospheric air entering the orifice. The strength of the acoustic monopole is expressed as the amplitude of the gaseous flux fluctuation, amplitude being defined as half the peak-to-peak variation. The concept of gaseous flux allows a unified discussion of venting acoustic monopoles that use a source of pressurized gas or a source of vacuum, or both.

The source of pressurized air could be a cylinder with pressurized gas, such as a CO.sub.2 cartridge. For personal use, such a cartridge may last a long time because only very small acoustic monopole strengths are needed for the induction of the required weak acoustic signals. For long term and long range operation, the exhaust port of an air pump may serve as a source of pressurized air, and the intake port could be used as a source of vacuum.

A simple venting acoustic monopole is shown in FIG. 12, where the source 63 of pressurized gas, which may be air, is connected to a conduit 69 which has an orifice 65 that is open to the atmosphere. A rotating valve 66 labelled "VALVE" controls the gaseous flux through the orifice. The valve is rotated by a stepper motor 67 labelled "MOTOR", driven by voltage pulses from the generator 68 labelled "GENERATOR". The motor speed is determined by the frequency of the voltage pulses. This frequency can be selected by the tuner 70, which therefore controls the frequency of the acoustic pulses emited by the orifice 65. For the simple orifice shown, boundary layer separation may occur in the outflow, so that the air pulses emerge in the form of jets. This causes dipole and higher multipole components in the radiated acoustic field. If desired, such radiation components can be avoided or diminished by placing a spherically or dome shaped fine mesh screen over the orifice 65. Instead of holding pressurized gas, the source 63 may hold a vacuum. In either case, the pulsing of the gaseous flux causes radiation of monopole-type acoustic waves. The source 63 may be replenished by a pump.

Push-pull operation can be achieved in the manner shown in FIG. 3. An air pump 20, labelled "PUMP", with flow ports 64, pressurizes the pressure vessel 21 while drawing a vacuum in the vacuum vessel 22. A valve 23 is operated by the solenoid 24 such as to alternately admit high and low pressure air to the conduit 26. The latter vents to the atmosphere through a screen 55 placed across an orifice 27 that is open to the atmosphere. The valve is controlled by an oscillator consisting of the solenoid 24, which is connected to the pulse generator 6, labelled "GENERATOR". The frequency of the electric current pulses through the solenoid is determined by the setting of the tuning control 9. This frequency is to be tuned to the resonance frequency of the sensory resonance that is to be excited. The tuning may be done manually by a user. The conduit 26 is structured as a diffuser in order to avoid boundary layer separation during the exhaust phase; the screen across the orifice 27 inhibits formation of a jet, thereby providing more nearly for a monopole type acoustic wave. During the intake phase the orifice acts as a sink; streamlines 28 of the resulting flow are illustrated. The vessels 21 and 22 smooth the flow fluctuations through the orifice that are due to the flow fluctuations through the pump; they are drawn at a relatively small scale for compactness sake. Instead of the oscillating valve 23, a rotating valve may be used, driven by a stepper motor powered by voltage pulses from a generator.

Conventional loudspeakers may be used as well as the source of acoustic radiation. An example is shown in FIG. 4, where the piezoelectric transducer 37 is driven by a simple battery-powered pulse generator built around two RC timers 30 and 31. Timer 30 (Intersil ICM7555, for instance) is hooked up for astable operation; it produces a square wave voltage with a frequency determined by capacitor 33 and the potentiometer 32, which serves as a tuner that may be operated by a user. The square wave voltage at output 34 drives the LED 35, and appears at one of the output terminals 36, after voltage division by potentiometer 71. The other output is connected to the negative supply. The output terminals 36 are connected to the piezoelectric speaker. Automatic shutoff of the voltage that powers the timer 30 at point 38 is provided by a second timer 31, hooked up for monostable operation. Shutoff occurs after a time interval determined by resistor 39 and capacitor 40. Timer 31 is powered by a 9 Volt battery 41, via a switch 42. Optional rounding of the square wave is done by an RC circuit consisting of a resistor 43 and capacitor 44. An optional airtight enclosure 29 may be used for the speaker 37, in order to enhance the monopole component of the radiated acoustic signal. Instead of a piezoelectric speaker one may use an electromagnetic loudspeaker with a voice coil. Because of the low impedance of the voice coil, a resistor must then be included in the output circuitry in order to keep the output currents to low values such as to allow battery powering of the device. Small voice coil currents are sufficient for the low acoustic powers required.

Low pulse frequencies can be monitored with the LED 35 of FIG. 3. The LED blinks on and off with the square wave, and it doubles as a power indicator. The pulse frequency can be determined by reading a clock and counting the LED light pulses. For higher frequencies a monitoring LED can still be used, if it is driven by a signal obtained by frequency division of the generator signal.

The automatic shutoff described above is an example for automatic control of the generated voltage; more sophisticated forms of control involve automatic frequency sequences. A computer that runs a simple timing program can be used for the generation of all sorts of square waves that can be made available at a computer port. An economic and compact version of such arrangement is provided by the Basic Stamp manufactured by Parallax Inc, Rocklin, Calif., which has an onboard EEPROM that can be programmed for the automatic control of the generated pulses, such as to provide desired on/off times, frequency schedules, or chaotic waves. The square waves can be rounded by RC circuits, and further smoothed by integration and filtering.

A compact packaging of the device such as shown of FIG. 4 is depicted in FIG. 5 where all circuit parts and the speaker, piezoelectric or voice-coil type, are contained in a small casing 62. Shown are the speaker 37, labelled "SPEAKER", driven by the generator 6, labeled "GENERATOR", with tuning control 9, LED 35, battery 41, and power switch 42. The LED doubles as a mark for the tuning control dial. With the circuit of FIG. 4, the device draws so little current that it can be used for several months as a sleeping aid, with a single 9 Volt battery.

For the purpose of thwarting habituation to the stimulation, irregular features may be introduced in the pulse train, such as small short-term variations of frequency of a chaotic or stochastic nature. Such chaotic or stochastic acoustic pulses can cause excitation of a sensory resonance, provided that the average pulse frequency is close to the appropriate sensory resonance frequency. A chaotic square wave can be generated simply by cross coupling of two timers. FIG. 6 shows such a hookup, where timers 72 and 73, each labeled "TIMER", have their output pins 74 and 75 connected crosswise to each other's control voltage pins 76 and 77, via resistors 78 and 79. The control voltage pins 76 and 75 have capacitors 80 and 81 to ground. If the timers are hooked up for astable operation with slightly different frequencies, and appropriate values are chosen for the coupling resistors and capacitors, the output of either timer is a chaotic square wave with an oval attractor. Example circuit parameters are: R.sub.78 =440K.OMEGA., R.sub.79 =700K.OMEGA., C.sub.80 =4.7 .mu.F, C.sub.81 =4.7 .mu.F, with (RC).sub.72 =0.83 s and (RC).sub.73 =1.1 s. For these parameters, the output 74 of timer 72 is a chaotic square wave with a power spectrum that has large peaks at 0.46 Hz and 0.59 Hz. The resulting chaotic wave is suitable for the excitation of the 1/2 Hz resonance.

A complex wave may be used for the joint excitation of two different sensory resonances. A simple generator of a complex wave, suitable for the joint excitation of the 1/2 Hz autonomic resonance and the 2.5 Hz cortical resonance, is shown in FIG. 7. Timers 82 and 83 are arranged to produce square waves of frequencies f.sub.1 and f.sub.2 respectively, where f.sub.1 is near 2.5 Hz, and f.sub.2 is near 1/2 Hz. The outputs 84 and 85 of the timers are connected to the inputs of an AND gate 86. The output 87 of the AND gate features a square wave of frequency f.sub.1, amplitude modulated by a square wave of frequency f.sub.2, as indicated by the pulse train 88.

The very low frequency waves needed for the acoustic stimulation of the vestibular nerve may also be provided by a sound system in which weak subaudio pulses are added to audible audio program material. This may be done in the customary manner way of adding the currents from these signals at the inverting input of an operational amplifier. The amplitude of the pulses is chosen such that the strength of the resulting acoustic pulses lies in the effective intensity window. Experiments in our laboratory have shown that the presence of audible signals, such as music or speech, does not interfere with the excitation of sensory resonances.

The invention can also be implemented as a sound tape or CD ROM which contains audible audio program material together with subliminal subaudio signals. The recording can be done by mixing the audio and subaudio signals in the usual manner. In choosing the subaudio signal level, one must compensate for the poor frequency response of the recorder and the electronics, at the ultra low subaudio frequencies used.

The pathological oscillatory neural activity involved in epileptic seizures and Parkinson's disease is influenced by the chemical milieu of the neural circuitry involved. Since the excitation of a sensory resonance may cause a shift in chemical milieu, the pathological oscillatory activity may be influenced by the resonance. Therefore, the acoustic excitation discussed may be useful for control and perhaps treatment of tremors and seizures. Frequent use of such control may afford a treatment of the disorders by virtue of facilitation and classical conditioning.

In this as well as in the detuning method discussed before, an epileptic patient can switch on the acoustic stimulation upon sensing a seizure precursor.

Since the autonomic nervous system is influenced by the 1/2 sensory resonance, the acoustic excitation of the resonance may be used for the control and perhaps the treatment of anxiety disorders.

The invention can be embodied as a nonlethal weapon that remotely induces disorientation and other discomfort in targeted subjects. Large acoustic power can be obtained easily with acoustic monopoles of the type depicted in FIG. 3 or FIG. 12. If considerable distance needs to be maintained to the subject, as in a law enforcement standoff situation illustrated in FIG. 8, several monopoles can be used, and it then may become important to have phase differences between the acoustic signals of the individual monopoles arranged in such a manner as to maximize the amplitude of the resultant acoustic signal at the location 52 of the subject. Shown are four squad cars 53, each equiped with an acoustic monopole capable of generating atmospheric pulses of a frequency appropriate for the excitation of sensory resonances. The relative phases of the emitted pulses are arranged such as to compensate for differences of acoustic path lengths 54, such that the pulses arrive at the subject location 52 with substantially the same phase, resulting in constructive interference of the local acoustic waves. Such arrangement can be achieved easily by using radio signals between the monopole units, with the target distances either dialed in manually or measured automatically with a range finder. The subaudio acoustic signals can easily penetrate into a house through an open window, a chimney, or a crack under a closed door.

Some of our experiments on acoustic excitation of sensory resonances which provide a basis for the present invention will be discussed presently. Of all the responses to the excitation of the 1/2 Hz resonance, ptosis of the eyelids stands out for distinctness, ease of detection, and sensitivity. When voluntary control of the eyelids is relinquished, the eyelid position is determined by the relative activities of the sympathetic and parasympathetic nervous systems. There are two ways in which ptosis can be used as an indicator that the autonomic system is being affected. In the first, the subject simply relaxes the control over the eyelids, and makes no effort to correct for any drooping. The more sensitive second method requires the subject to first close the eyes about half way. While holding this eyelid position, the eye are rolled upward, while giving up voluntary control of the eyelids. With the eyeballs turned up, ptosis will decrease the amount of light admitted to the eyes, and with full ptosis the light is completely cut off. The second method is very sensitive because the pressure excerted on the eyeballs by partially closed eyelids increases parasympathetic activity. As a result, the eyelid position becomes somewhat labile, exhibiting a slight flutter. The labile state is sensitive to small shifts in the activities of the sympathetic and parasympathetic systems. The method works best when the subject is lying flat on the back and is facing a moderately lit blank wall of light color.

The frequency at which ptosis is at a maximum is called the ptosis frequency. This frequency depends somewhat on the state of the nervous and endocrine systems, and it initially undergoes a downward drift, rapid at first and slowing over time. The ptosis frequency can be followed in its downward drift by manual frequency tracking aimed at keeping ptosis at a maximum. At a fixed frequency, the early ptosis can be maintained in approximately steady state by turning the acoustic stimulation off as soon as the ptosis starts to decrease, after which the ptosis goes through an increase followed by a decline. The acoustic stimulation is turned back on as soon as the decline is perceived, and the cycle is repeated.

At fixed frequencies near 1/2 Hz, the ptosis cycles slowly up and down with a period ranging upward from about 3 minutes, depending on the precise acoustic frequency used. The temporal behavior of the ptosis frequency is found to depend on the acoustic pulse intensity; the drift and cycle amplitude are smaller near the low end of the effective intensity window. This suggests that the drift and the cycling of the ptosis frequency is due to chemical modulation, wherein the chemical milieu of the neural circuits involved affects the resonance frequency of these circuits, while the milieu itself is influenced by the resonance in delayed fashion. Pertinent concentrations are affected by production, diffusion, and reuptake of the substances involved. Because of the rather long characteristic time of the ptosis frequency shift, as shown for instance by the cycle period lasting 3 minutes or longer, it is suspected that diffusion plays a rate-controlling role in the process.

The resonance frequencies for the different components of the 1/2 Hz sensory resonance have been measured, using acoustic sine waves with a sound pressure of 2.times.10.sup.-9 N/m.sup.2 at the subject's left ear. Ptosis reached a steady state at a frequency of 0.545 Hz. Sexual excitement occurred at two frequencies, 0.530 Hz and 0.597 Hz, respectively below and above the steady-state ptosis frequency. For frequencies of 0.480 Hz and 0.527 Hz the subject fell asleep, whereas tenseness was experienced in the range from 0.600 to 0.617 Hz.

The resonance near 2.5 Hz may be detected as a pronounced increase in the time needed to silently count backward from 100 to 70, with the eyes closed. The counting is done with the "silent voice" which involves motor activation of the larynx appropriate to the numbers to be uttered, but without passage of air or movement of mouth muscles. The motor activation causes a feedback in the form of a visceral stress sensation in the larynx. Counting with the silent voice is different from merely thinking of the numbers, which does not produce a stress sensation, and is not a sensitive detector of the resonant state. The larynx stress feedback constitutes a visceral input into the brain and may thus influence the amplitude of the resonance. This unwanted influence is kept to a minimum by using the count sparingly in experiment runs. Since counting is a cortical process, the 2.5 Hz resonance is called a cortical sensory resonance, in distinction with the autonomic resonance that occurs near 1/2 Hz. In addition to affecting the silent counting, the 2.5 Hz resonance is expected to influence other cortical processes as well. It has also been found to have a sleep inducing effect. Very long exposures cause dizziness and disorientation. The frequency of 2.5 Hz raises concerns about kindling of epileptic seizures; therefore, the general public should not use the 2.5 Hz resonance unless this concern has been laid to rest through further experiments.

The sensitivity and numerical nature of the silent count makes it a very suitable detector of the 2.5 Hz sensory resonance. It therefore has been used for experiments of frequency response and effective intensity window. In these experiments, rounded square wave acoustic pulses were produced with a frequency that was slowly diminished by computer, and the subject's 100-70 counting time was recorded for certain frequencies. The acoustic transducer was a small loudspeaker mounted in a sealed cabinet such as to provide acoustic monopole radiation. At fixed frequency, the acoustic monopole strenght in m.sup.3 /s varies linearly with the voice coil current, with a constant of proportionality that can be calculated from measured speaker dome excursions for given currents. The sound pressure level at the entrance of the subject's nearest external ear canal can be expressed in terms of the acoustic monopole strength and the distance from the loudspeaker. For each experiment run, the sound pressure level at the entrance of the subject's external ear canal can thus be calculated from the measured amplitude of the voice coil current and the pulse frequency. Since for the subaudio frequencies the distance from the acoustic radiator to the subject's ear is much smaller than the wavelength of the sound, the near-field approximation was used in this calculation. The sound pressure level was expressed in dB relative to the reference sound pressure of 2.times.10.sup.-5 N/m.sup.2. This reference pressure is traditionally used in the context of human hearing, and it represents about the normal minimum human hearing threshold at 1.8 KHz.

FIG. 9 shows the result of experiment runs at sound pressure levels of -67, -61, -55, and -49 dB. Plotted are the subject's 100-70 counting time versus pulse frequency in a narrow range near 2.5 Hz. Resonance is evident from the sharp peak 57 in the graph for the sound pressure level of -61 dB. The graphs also reveal the effective intensity window for the stimulation, as can be seen by comparing the magnitude of the peaks for the different sound pressure levels. For increasing intensity, the magnitude of the peak first increases but then decreases, and no significant peak shows up in the graph for the largest sound pressure of -49 dB; this can be seen better from the insert 58, which shows the graphs for -67 and -49 dB in a magnified scale. It follows that the effective intensity window extends approximately from -73 to -49 dB, in terms of the sound pressure level at the entrance of the subject's external ear canal.

The physiological response to the 2.5 Hz acoustic stimulation can be avoided by wearing earplugs. FIG. 10 is a plot of the 100-70 counting time versus acoustic pulse frequency, with and without earplugs. The sound pressure level at the entrance of the subject's external ear canal was -6 dB for both runs. Without earplugs the counting time has the peak 59, but no significant peak is seen in graph 60 for the run in which the subject used earplugs. Two conclusions can be reached from these results. First, in the experiments the 2.5 Hz resonance is essentially excited acoustically rather than through the magnetic field induced by the voice coil currents in the loudspeaker. Second, it follows that the exciting sound essentially propagates via the external ear canal, instead of through the skin and bones in the area of the ears, or via cutaneous mechanoreceptors in the skin at large.

To answer the question whether the acoustic excitation of the 2.5 Hz sensory resonance occurs perhaps through the cochlear nerve, one needs to consider the human auditory threshold curve such as shown, for instance, by Thomson (1967). The curve has a minimum near 1.8 KHz where the threshold sound pressure level is 0 dB, by definition. At 10 Hz the threshold is 105 dB. Hence, the pronounced acoustic excitation of the sensory resonance shown in FIG. 9 for a sound pressure level of -61 dB is 166 dB below the auditory threshold at 10 Hz. The excitation occurs near 2.5 Hz, and at that frequency, the auditory threshold is even higher than at 10 Hz. Although the curve in Thomson's book does not go below 10 Hz, linear extrapolation suggests the estimate of 135 dB for the threshold at 2.5 Hz, bringing the sound pressure level that is effective for acoustic excitation of the sensory resonance to 196 dB below the estimated threshold at the frequency near 2.5 Hz used. This result all but rules out excitation via the cochlear nerve.

Chemical modulation may be the cause for the small frequency difference for peaks 57 and 59 in FIGS. 9 and 10, for the sound pressure level of -61 dB; these peaks occur respectively at 2.516 and 2.553 Hz.

The physiological response to the excitation of the sensory resonances at a fixed stimulus frequency is not immediate but builds over time. An example is shown in FIG. 11, where the graph 61 depicts the measured 100-70 time plotted versus elapsed time, upon application of acoustic pulses of 2.558 Hz frequency and a sound pressure level of -61 dB. The graph shows that the response is initially delayed over about 5 minutes; thereafter it increases, and at about 22 minutes the slope is seen to decrease somewhat. Other experiments have shown a counting time that eventually settles on a plateau, or even starts on a decline. Chemical modulation and habituation could account for these features. The response curve depends strongly on initial conditions.

The method is expected to be effective also on certain animals, and applications to animal control are therefore envisioned. The nervous system of mammals is similar to that of humans, so that the sensory resonances are expected to exist, albeit with different frequencies. Accordingly, in the present invention subjects are mammals.

The described method and apparatus can be used beneficially by the general public and in clinical work. Unfortunately however, there is the possibility of mischievous use as well. For instance, with small modifications the method of FIG. 1 can be employed to imperceptibly modulate the air flow in air conditioning or heating systems that serve a home, office building, or embassy, for covert manipulation of the nervous systems of occupants.

The invention is not limited by the embodiments shown in the drawings and described in the specification, which are given by way of example and not of limitation, but only in accordance with the scope of the appended claims.

REFERENCES

P. M. Morse and H. Feshbach, METHODS OF THEORETICAL PHYSICS, McGraw-Hill, New York, 1953

R. F. Thomson, FOUNDATIONS OF PHYSIOLOGICAL PSYCHOLOGY, Harper & Row, New York 1967

* * * * *

Top

( 1 of 1 )

United States Patent	*6,122,322*
Jandel	September 19, 2000

Subliminal message protection

Abstract

The present invention relates to a method and to a system for detecting a first context change between two frames. When a second context change between a further two frames occurs within a predetermined time interval, the frames accommodated within the two context changes are defined as a subliminal message. An alarm is sent to an observer upon detection of a subliminal message.

Inventors:	Jandel; Magnus (Upplands Vasby, SE)
Assignee:	Telefonaktiebolaget LM Ericsson (Stockholm, SE)
Appl. No.:	310739
Filed:	May 13, 1999

Foreign Application Priority Data

Nov 19, 1996[SE]

9604241

Current U.S. Class: 375/240.13; 348/154; 348/473; 348/699; 358/908

Intern'l Class: H04N 005/14; H04N 009/64

Field of Search: 346/46,94 358/908 348/699,700,473,475,553,154,155

References Cited

U.S. Patent Documents

5099322	Mar., 1992	Gove	358/105.
5642174	Jun., 1997	Kazui et al.	348/700.
5644363	Jul., 1997	Mead	348/563.
5719643	Feb., 1998	Nakajima	348/700.
5751378	May., 1998	Chen et al.	348/700.
5801765	Sep., 1999	Gotoh et al.	348/155.
5929920	Oct., 1999	Sizer, II	348/473.
5969755	Oct., 1999	Courtney	348/155.
Foreign Patent Documents
4106246 C1	Mar., 1992	DE.
95/06985 A1	Mar., 1995	WO.

Primary Examiner: Britton; Howard
Assistant Examiner: Diep; Nhon T
Attorney, Agent or Firm: Nixon & Vanderhye, PC

Parent Case Text

This is a continuation of PCT application Ser. No. PCT/SE97/01909, filed Nov. 13, 1997.

Claims

What is claimed is:

1. A method of distinguishing between messages in a sequence of frames that include image information, the method comprising: detecting a first context change between a first and a second frame, detecting a second context change between a third and a fourth frame, comparing the time period between the first and the second context changes with a first threshold value, and indicating said message in dependence on said comparison.

2. A method according to claim 1, characterized in that relevant data related to the first and second context changes and data relating to the source of the frame sequence are stored in a memory.

3. A method according to claim 1, characterized in that a second message is indicated in dependence on whether a third context change between said first and said fourth frame is detected.

4. A method according to claim 1, characterized in that said first context change is detected by measuring the energy difference between said first and said second frames.

5. A method according to claim 1, characterized in that said second context change is detected by measuring the energy difference between said second and said third frames.

6. A method according to claim 4, characterized in that the energy is measured by calculating, for each frame point, the difference between the value of a frame point in a first frame and the value of the corresponding frame point in a second frame, calculating the square of the calculated difference, and forming the sum of the calculated square values for all frame points.

7. A method according to claim 1, characterized in that said first context change is detected by measuring the energy in a first displaced frame difference (DFD), and using the measured energy to calculate the second frame from the first frame.

8. A method according to claim 1, characterized in that said second context change is detected by measuring the energy in a second displaced frame difference (DFD), and using the measured energy to calculate the fourth frame from the third frame.

9. A method according to claim 7, characterized by comparing the energy in the displaced frame difference with a second threshold value, and indicating a context change in dependence on said comparison.

10. A method according to claim 8, characterized by comparing the energy in the displaced frame difference with a second threshold value, and indicating a context change in dependence on said comparison.

11. A method according to claim 7, characterized in that the energy in the displaced frame difference (DFD) is measured by calculating the square of the value in each frame point in the displaced frame difference and forming the sum of the calculated values for all frame points.

12. A method according to claim 7, characterized in that the energy in the displaced frame difference (DFD) is measured by calculating the absolute magnitude of the value in each frame point in the displaced frame difference and forming the sum of the calculated values for all frame points.

13. A method according to claim 1, characterized in that the first context change is indicated when an I-frame in an MPEG-stream is detected.

14. A method according to claim 1, characterized in that the second context change is indicated when an I-frame in an MPEG-stream is detected.

15. A method according to claim 1, characterized by comparing the second frame with a fifth frame stored in a frame library, and indicating the first message in dependence on said comparison.

16. A method according to claim 2, characterized by storing in said memory the frame sequence between the first and the second context change.

17. A method according to claim 2, characterized in that a user is able to examine the contents of said memory.

18. A method according to claim 1, characterized in that said second frame and said third frame are one and the same frame.

19. A system for automatically detecting subliminal messages in a frame sequence, the system comprising: means for measuring context changes between two frames in the frame sequence; means for initiating an alarm; means for storing a frame sequence; means for calculating a time difference between two context changes; means for comparing a measured time difference with a threshold value; and means for initiating an alarm in response to the outcome of said means for comparing.

Description

The present invention relates to a system and to a method for protecting an observer from subliminal messages.

BACKGROUND OF THE INVENTION

Subliminal messages are messages that are sent in a manner such as to be undetectable consciously by an observer. Subliminal messages are hidden suggestions that can only be perceived by the subconscious. In video communication, a subliminal message can be flashed so quickly that the viewer will not be aware of having seen the message. The viewer can, nevertheless, be influenced by the message content. Consider, for instance, the case of a subliminal advertisement that is sent while the viewer is studying the latest televised news from the stock market. The advertisement may inform the viewer that ACME chocolate is good to eat, but is flashed so quickly that the viewer is unaware that he/she has been subjected to an advertisement. Some viewers, however, can be influenced subconsciously by the advertisement, and later feel an unexplainable longing for ACME chocolate.

The ground-based transmission of television channels are subject to ethical and legal constraints that are aimed towards preventing the above type of advertising. However, it is not possible to guarantee the prevention of the transmission of subliminal messages in many of the international satellite-based television channels that do not obey local laws and regulations. The protection of an observer from such messages is more difficult to achieve in modern types of communications, such as Internet and videotelephony, for instance. Subliminal messages can be hidden not only in a video sequence, but also in still images, or what the observer considers to be still images, and also in audio sequences.

Two mutually sequential images of an image sequence are seldom exactly the same. The fundamental concept of mediating movement with the aid of a plurality of mutually sequential images is that each image will differ slightly from the preceding image. When the images are shown at speed, this is perceived by the eye as a movement and not as a presentation of individual images, by virtue of the eye having a certain degree of inertia. In the majority of cases, only a small part of the image frame is involved in the actual movement; compare a walking person against a stationary background in this regard. This feature is used for different types of image sequence compression, such as MPEG2, for instance. MPEG2 saves space in the image sequence, by sending, among other things, approximative information that describes those pixels that change. However, this results in the introduction of errors in the image sequence, making it necessary to synchronise the image at regular intervals. This is achieved with a so-called I-image that contains all information necessary to compile a complete image.

Image sequences also include a row of different frames in order to enable a moving image to be transmitted in the most effective manner possible. A frame contains image information that is presented on a medium, possibly together with further frames, to form an image or picture. For instance, an interlaced image is comprised of two frames. The term frame will be used consistently throughout the following description. By frame is meant information that is used to compile an image. A frame can itself include a complete image, or solely parts of an image, or information from which an image can be calculated An I-frame is a complete frame that includes image information. Because an I-frame contains a great deal of information, it is expensive to transfer. A new P-frame can be formed from an I-frame or from a P-frame. A P-frame, (prediction frame) is formed by transferring to the receiver side movement vectors and DFD (Displaced Frame Difference) related to the preceding frame. The movement vectors describe how objects in the preceding frame shall be moved to form the P-frame. When the new P-frame is formed, errors will occur due to rounding-up, for instance. DFD describes how the calculated P-frame differs from the original image. The difference between the values of each pixel in the calculated frame and in the original frame can be calculated with regard to black-white frames. A colour frame that uses RGB (Red, Green, Blue) can be transformed to a form in which one portion consists of a luminance part. The luminance part can be used to calculate the DFD, in this case. A P-frame is more cost-effective than an I-frame, since movement vectors plus DFD contain much less information than a corresponding I-frame would contain. Also included are B-frames which are calculated from preceding and succeeding P-frames.

The expression subliminal message is also used to describe a code where a number of encrypted messages are encoded within the same set of symbols. This has no relationship at all with the present invention.

Described in U.S. Pat. No. 5,151,788 is a system for identifying and eliminating advertisements in and from a video signal, by detecting blank images. The concept of this solution cannot be applied to subliminal messages, because subliminal messages are not normally preceded by a blank image.

Described in FR 2,622,077 is a system for detecting discontinuities between images, by analyzing an analogue video signal line-by-line. The concept is not applicable to the present invention, since subliminal messages do not differ from other signals when considered line-by-line.

SUMMARY OF THE INVENTION

The present invention addresses the aforesaid problems, by detecting subliminal messages and warning an observer of their presence.

The object of the present invention is thus to protect an observer against subliminal messages.

The aforesaid problems are solved by the present invention, by detecting subliminal messages and warning an observer of their presence, by detecting a context change between two frames.

More specifically, there is detected a first context change between two frames. When a second context change occurs between a further two frames within a predetermined time period, the frames accommodated within the two context changes are defined as an subliminal message. When a subliminal message has been detected, an alarm is sent to an observer.

A context change can be defined as a major change in the content of a frame; c.f. a scene change, for instance.

A frame point can be defined as a value in a point in an image that together with other frame points compiles said image.

The present invention provides the advantage of enabling subliminal messages to be detected and stored for later analysis.

Another advantage is that an observer can be protected against and warned of the presence of subliminal messages.

The invention will now be described in more detail with reference to preferred embodiments thereof and also with reference to the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is an overview of one embodiment according to the invention.

FIG. 2 is a flowchart illustrating one embodiment of the invention.

FIG. 3 is a flowchart illustrating another embodiment of the invention.

FIG. 4 is a flowchart illustrating the detection of a context change in accordance with one embodiment of the invention.

FIG. 5 is a flowchart illustrating the detection of a context change according to another embodiment of the invention.

FIG. 6 is a flowchart illustrating the detection of a context change in accordance with still another embodiment of the invention.

FIG. 7 is a flowchart illustrating the detection of a subliminal message.

FIG. 8 illustrates a subliminal protection module.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

FIG. 1 is an overview of one embodiment of the invention. Reference numeral 101 identifies an observer or viewer watching a film on a television 102. Although the term film and television are used in describing this embodiment, it will be understood that equivalent terms can be used instead, for instance such terms as MPEG-sequence and data terminal. The reference numeral 111 identifies a frame sequence sent to the television 102 from a source 110. The sequence of frames 111 arrives at the television 102 via an SMP-module 112 (Subliminal Message Protection). The SMP-module may alternatively be integrated with the video decoder. The source 110 may, for instance, be a cable-TV distributor, an SP (Service Provider) or a computer connected to Internet or Intranet. FIG. 1 shows part of a frame sequence 111, where reference 103 identifies a frame in the normal sequence. Reference 104 also identifies a frame in the normal sequence, although in the illustrated case the frame 104 constitutes the last frame that occurs in the normal sequence prior to the occurrence of a context change 105. A context change can be defined as a major change in the content of a frame; c.f. a scene change for instance. The context change 105 is followed by a series of frames which together constitute a subliminal message 106. The subliminal message 106 may be comprised of solely one frame or of several mutually sequential frames. Reference 107 identifies a context change which terminates the subliminal message and the normal frame sequence reappears. Reference 108 identifies the first frame in the normal frame sequence, while reference 109 identifies the next following frame. The SMP-module 112 detects the context changes 105 and 107. As soon as the context changes 105 and 107 occur within a specified time interval, an alarm is generated and the subliminal message 106 is stored and can be played back by the observer 101.

FIG. 2 is a flowchart illustrating one embodiment of the invention. Reference 205 identifies a frame sequence. Reference CC1 identifies a context change between the normal frame sequence N and those frames that constitute the subliminal message S. Reference CC2 identifies a context change between the subliminal message S and the normal frame sequence N. Each frame that arrives at an SMP-module (not shown) is compared with the last frame to arrive, and context changes are detected, in accordance with box 201. The time at which the two latest context changes occurred is saved. The time difference between the latest two context changes to take place is calculated in accordance with box 202. When the time difference is smaller than a threshold value Ts, a user alarm 203 is triggered and the image frozen, in accordance with box 204. The observer is then able to ascertain whether or not he/she has been subjected to a subliminal message and, if so, the nature of the message.

FIG. 3 is a flowchart illustrating another embodiment of the invention. Reference 301 identifies a frame sequence arriving at an SMP-module (not shown). Reference CC1 identifies a context change in the frame sequence. Reference N1 identifies the last frame in the normal frame sequence, while reference S1 identifies the first frame in the subliminal message. Reference S2 identifies the last frame in the subliminal message and reference CC2 identifies a context change between S2 and N2, where N2 identifies the first frame in the normal sequence after the context change CC2. The SMP-module (not shown) functions to detect context changes, and the time at which these changes occur is saved together with the frames N1, N2, S1 and S2, in accordance with box 302. If the time difference between the latest two context changes CC1 and CC2 is smaller than a given threshold value Ts, box 303, a preliminary alarm is triggered and relevant data logged, e.g. the subliminal message source, the message arrival time, and so on, in accordance with box 304. A test is then run to ascertain whether or not a context change exists between frames N1 and N2. If no context change exists between said frames, an alarm is triggered (box 306) and the frame sequence frozen (box 307). The observer is now able to evaluate consciously the context change that has occurred, through the medium of the frozen frames and the logging activity that has ensued.

Those occasions on which the entire frame has been drastically changed, such as in the case of a scene change, can be mediated with an I-frame in the frame sequence. When the transmission of a subliminal message is commenced, there will occur a scene change that causes a major part of the frame to be changed between two mutually sequential frames. Thus, a context change can occur when the receiver receives an I-frame. When two I-frames are received in succession within a short space of time, the transmission of a subliminal message can be suspected.

FIG. 4 is a flowchart that illustrates the detection of changes with the aid of I-frames in an MPEG-sequence. Reference 401 identifies a frame sequence that arrives at an SMP-module (not shown). The SMP-unit receives a frame, box 402, and ascertains whether or not the frame received is an I-frame, box 403. The receipt of an I-frame indicates a context change, box 404.

FIG. 5 is a flowchart that illustrates the detection of a context change, by numerically calculating a value of the change between two frames. The reference 501 identifies a frame sequence arriving at an SMP-unit (not shown). The SMP-unit (not shown) receives a frame N.sub.i, box 502. The frame N.sub.i is stored in a memory L.sub.2. Prior to this, the value of L.sub.2 is stored in a memory L.sub.1, box 503. A value E of the difference between the frames is then calculated, by summating an energy measurement of the difference between corresponding frame points in the frames L.sub.1 and L.sub.2, box 504. This energy measurement may, for instance, be x.sup.2, which would give the following formula:

E=.SIGMA.(I.sub.s -I'.sub.s).sup.2

s=all pixels

where I.sub.s is the value of the frame point s in the frame L.sub.2, and I'.sub.s is the value of the frame point s in the frame L.sub.1. A context change is indicated when E is greater than a threshold value T.sub.e, in accordance with boxes 506 and 506 respectively.

As illustrated in FIG. 6, a context change between two P-frames can be detected in a manner similar to that described above, by measuring the energy in the DFD. In FIG. 6, the reference numeral 601 identifies a frame sequence. The energy is calculated, box 603, for each DFD received, box 602. If the amount of energy contained by the DFD is greater than a threshold value 604, this indicates that a context change has taken place, box 605.

The SMP may include a library function that contains data relating to known subliminal messages, as shown in FIG. 7. The reference numeral 701 identifies a frame sequence. Each frame received, box 707, is compared with the frames stored in the library, box 703, and when sufficient similarity is noted, box 704, a user alarm is triggered, box 705. This comparison may be carried out by filtering each frame, so as to present a number of characteristic features. These characteristic features are then compared with the features stored in the library function. One advantage with this procedure is that computer power and memory space are saved.

FIG. 8 illustrates in greater detail an SMP-module 802 connected to a monitor 801. A frame sequence arrives at the SMP-unit 803. The frames pass a system 807 which functions to detect context changes. The system 807 includes a part 804 whose function is to measure the energy content of a frame, a part whose function is to compare the energy value with a threshold value 808, and a part whose function is to initiate an alarm. The SMP also includes means for storing a stream or sequence of frames 806.

It will be understood that the invention is not restricted to the aforedescribed and illustrated exemplifying embodiments thereof, and that modifications can be made within the scope of the following claims.

* * * * *

Top

( 1 of 1 )

United States Patent	*6,292,688*
Patton	September 18, 2001

Method and apparatus for analyzing neurological response to emotion-inducing stimuli

Abstract

A method of determining the extent of the emotional response of a test subject to stimului having a time-varying visual content, for example, an advertising presentation. The test subject is positioned to observe the presentation for a given duration, and a path of communication is established between the subject and a brain wave detector/analyzer. The intensity component of each of at least two different brain wave frequencies is measured during the exposure, and each frequency is associated with a particular emotion. While the subject views the presentation, periodic variations in the intensity component of the brain waves of each of the particular frequencies selected is measured. The change rates in the intensity at regular periods during the duration are also measured. The intensity change rates are then used to construct a graph of plural coordinate points, and these coordinate points graphically establish the composite emotional reaction of the subject as the presentation continues.

Inventors:	Patton; Richard E. (Colorado Springs, CO)
Assignee:	Advanced Neurotechnologies, Inc. (Colorado Springs, CO)
Appl. No.:	608440
Filed:	February 28, 1996

Current U.S. Class: 600/544; 600/300; 600/545

Intern'l Class: A61B 005/04

Field of Search: 128/731,732,630 600/544,545,300

References Cited

U.S. Patent Documents

Re34015	Aug., 1992	Duffy	128/731.
4649482	Mar., 1987	Raviv et al.	128/731.
4736307	Apr., 1988	Salb	128/731.
4744029	May., 1988	Raviv et al.	128/731.
4789235	Dec., 1988	Borah et al.
4794533	Dec., 1988	Cohen.
4815474	Mar., 1989	Duffy	128/731.
4862359	Aug., 1989	Trivedi et al.	128/731.
4955388	Sep., 1990	Silberstein.
5024235	Jun., 1991	Ayers.
5113870	May., 1992	Rossenfeld.
5137027	Aug., 1992	Rosenfeld.
5230346	Jul., 1993	Leuchter et al.
5243517	Sep., 1993	Schmidt et al.
5331969	Jul., 1994	Siberstein	128/731.
5339826	Aug., 1994	Schmidt et al.
5392788	Feb., 1995	Hudspeth.

Primary Examiner: Peffley; Michael
Attorney, Agent or Firm: Vedder Price Kaufman & Kammholz

Claims

What is claimed is:

1. A method of determining the extent of the emotional response of a test subject to stimuli in the form of a presentation having at least a time-varying visual content, said method comprising preparing a presentation having stimuli in the form of a time-varying visual content, positioning at least one test subject to observe said presentation including said stimuli for a given duration, establishing a path of communication between said at least one subject and a brain wave detector/analyzer capable of measuring at least an intensity component of each of at least two different brain wave frequencies, each of which is associated with a base emotion, permitting said at least one subject to view said presentation, recording periodic variations in said intensity component of said brain waves at each of the particular frequencies selected, recording the change rates in each of said intensity components periodically during said duration of the presentation, and using said intensity change rate data to construct a graph comprised of plural coordinate points each having a component along each of two axes, with all of said coordinate points graphically establishing the composite emotional state of said subject to said presentation.

2. A method of determining a correlation between a composite emotional state desired to be imparted to a test subject by making an audio visual presentation to said subject and the emotional state actually induced in said subject by making said presentation, said method comprising identifying at least two basic emotion scales, including a pleasure/displeasure scale and an arousal/indifference scale, determining an electroencephalographic brain wave frequency associated with each of said scales, making an audio/visual presentation to at least one test subject while said subject is connected to a brain wave detector/analyzer associated with an electroencephalographic brain wave pickup, noting a variation from time to time in an amplitude of brain waves at each characteristic frequency during the presentation, recording the change rates and directions of said amplitudes at a plurality of intervals during said presentation, and thereafter, using a plot of said amplitude change rates, creating a graph whose points represent coordinate points derived from said changes along a given axis for each of two basic emotion scales, said coordinate points thereby representing on a circumplex display the emotional states of the test subject from time to time.

3. A method of determining whether an advertising presentation affects a test subject exposed to said presentation, said method comprising presenting advertising material having a given content to a subject by way of an audio/visual presentation; selecting at least two frequencies, each characteristic of a measurable base emotion in a human subject and recording the intensity of an electroencephalographic signals having values generated by the subject over a number of sampling intervals during viewing of the presentation, by the subject, recording said values and change rates of said values on a plurality of scales, each corresponding to one of the selected frequencies, graphically determining a composite emotional state of said subject for each sub-interval of a plurality of sub-intervals wherein said presentation is being made, subsequently presenting to the subject advertising material having a content that is different from but is thematically related to the original advertising material; and subsequently recording and analyzing the emotional state of the subject subsequent to the presentation of the thematically related material during a time following said second presentation when portions only of said original presentation are brought to the attention of said subject.

4. A method of altering an advertising presentation having a given content, said method comprising selecting at least one test subject, placing the test subject in communication with an electroencephalographic pick up and brain wave detector/analyzer capable of recording and analyzing spectral data associated with the subject, constructing a composite emotional state profile of the subject using variations of at least two measurable base emotions in the subject, including the emotions of pleasure and arousal, determining whether the composite emotional state of the test subject corresponds to that intended to be imparted by the advertising presentation; noting where the subject has failed to attain the desired emotional state; revising the content of the advertising message in part and retesting the subject using the same methods to determine whether such content changes have succeeded in altering the composite emotional state of said test subject.

5. A method of determining the extent of an emotional response of a test subject to an advertising presentation having audio/visual content, said method comprising preparing a presentation having a time-varying audio/visual content and intended to elicit a particular overall emotional response in an audience to whom viewing said presentation will ultimately be made, positioning at least one test subject in a position to observe said presentation for a given duration, establishing a path of communication between said at least one subject and an electroencephalographic brain wave detector and a brain wave analyzer capable of measuring the intensity of brain wave signals of two different frequencies, a first frequency associated with the emotion of pleasure and a second frequency associated with the base emotion of arousal, permitting said at least one subject to view said presentation and recording the absolute values of brain wave intensity at plurality of intervals during the time when said subject is viewing said presentation, thereby subdividing said presentation into a plurality of sub intervals, thereafter determining the change of intensity and intensity change rates of both selected brain wave frequencies, using the changes of intensity of each point relative to a preceding point to establish values for each of said sub intervals, creating a two-axis, pleasure v. arousal graph having a plurality of coordinate points each representing a pair of the marginal values, one taken from each of said pleasure and arousal scales, and thereafter graphically determining the emotional state of the test subject at each sub interval of the presentation, and an emotional history of the subject during the presentation, and comparing the achieved emotional response of the test subject to the intended response to determine whether changes in the content of the presentation are indicated so as to increase the likelihood that the audience intended to view the presentation will display the intended emotional response.

6. A method as defined in claim 5, wherein said at least one test subject comprises a plurality of test subjects.

7. A method as defined in claim 5, wherein said at least one test subject comprises at least 10 test subjects, and wherein an emotional history of said subjects is determined by statistically analyzing all of said test subjects as a group.

8. A method as defined in claim 5, which further includes measuring the intensity of brain wave signals at a third frequency, said third frequency being associated with dominance, and which further includes creating two additional two-axis graphs, each of said graphs having four quadrants one comparing pleasure and dominance and the other comparing arousal and dominance, and said method also including determining said composite emotional state of said test subject by noting the quadrant in which coordinate points are located and comparing such coordinate points with a predetermined description of the content of such quadrant.

9. A method of determining the extent of an emotional response of a test subject to an advertising presentation, said method comprising preparing a presentation having a time-varying content and intended to elicit a particular overall emotional response in an audience to whom viewing said presentation will ultimately be made, positioning at least one test subject capable of capable of undergoing individual emotional responses each represented by a particular frequency and intensity in a position to observe said presentation for a given duration, establishing a path of communication between said at least one subject and an electroencephalographic brain wave detector and a brain wave analyzer capable of measuring an intensity characteristic of brain wave signals of a plurality of substantially exact but different frequencies, each of said frequencies being associated with a predetermined base emotion, permitting said at least one subject to view said presentation and recording the absolute values of said brain wave intensity characteristic at a plurality of intervals during said duration when said subject is viewing said presentation, thereby subdividing said duration into a plurality of individual time segments, thereafter determining the intensity characteristic changes and intensity characteristic change rates of said plurality of brain wave frequencies, using the changes of said intensity characteristic of each point relative to a preceding point to establish marginal values for each of said time segments, creating at least one two-axis graph, said graph having axes corresponding to two of said base emotions and including a plurality of coordinate points each representing a pair of the marginal values taken from a selected emotion scale, thereafter graphically determining the composite emotional state of the test subject at each segment of the presentation, and comparing the achieved emotional response of the test subject to the response intended to be achieved to determine whether changes in the content of the presentation are indicated so as to increase the likelihood that the audience intended to view the presentation will display the intended emotional response.

10. A method as defined in claim 1, wherein said advertising presentation is a television commercial.

11. A method as defined in claim 1, wherein said advertising presentation is an audio presentation.

12. A method as defined in claim 1, wherein said at least one test subject comprises a plurality of test subjects.

13. A method as defined in claim 1, wherein said at least one test subject comprises at least 10 test subjects.

14. A method as defined in claim 13, which further includes applying statistical analysis to the results of the test subjects.

15. A method as defined in claim 13, wherein a determination of the emotional state of each of said test subjects is made by determining the number and duration of quadrant visits of each of said subjects without precisely determining the emotional state of each of said test subjects.

16. A method as defined in claim 1, wherein said intensity characteristic of said brain wave signals comprises the amplitude of said brain wave signals.

17. A method as defined in claim 1, wherein said plurality of frequencies includes frequencies of 8 Hz, 16 Hz, and 26 Hz.

18. A method as defined in claim 1, wherein said predetermined base emotions are pleasure and arousal.

19. A method as defined in claim 1, wherein said plurality of different frequencies includes five frequencies, the base emotions relating to said frequencies being pleasure, arousal, dominance, comprehension and pictorial comprehension.

20. A method as defined in claim 1, wherein each of said individual time segments comprises a segment of not more than two seconds duration.

21. A method as defined in claim 1, wherein said presentation has a duration of from about 15 seconds to about 1 minute.

22. A method as defined in claim 1, which further includes determining the emotional response of the test subject during presentation and comparing said emotional response of the test subject to the content of the presentation as a method of further analyzing said presentation.

Description

BACKGROUND OF THE INVENTION

The present invention relates generally to methods and apparatus for neurological testing, and more particularly, to methods and apparatus for determining the emotional state of an individual over the period of time during which that individual is being exposed to time-varying stimuli. While in one respect the invention applies to determining the neurological, psychological, or emotional response of an individual to test stimuli, in many instances, the invention is applicable to using individuals to test a program containing certain stimuli, in order to determine whether such a program will subsequently create favorable responses in other individuals of similar sociocultural-economic makeup.

One of the most practical applications of the method and apparatus with which the invention is presently concerned is that of consumer response testing. Accordingly, this aspect of the method will be discussed immediately herein, while a discussion of other applications and purposes implicit in the invention will be set out elsewhere herein.

In the United States, and elsewhere throughout the world, advertising is heavily used to promote consumer, commercial and industrial products. It is almost universally accepted that, as between or among products which are generally similar to one another in content, price, or quality, successful advertising can help a particular product achieve much greater market penetration and financial success than an otherwise similar product. Advertising, and particularly consumer advertising, although a multi-billion dollar industry in the United States alone, is an area wherein workers find it extremely difficult to create and reproduce what prove to be consistently successful advertising campaigns, themes, or other materials. It is likewise accepted that while it is often easy to predict that response to a particular proposed advertisement or campaign will be unfavorable, it is not known how to create individual advertisements and/or campaigns which can virtually be assured of success on a consistent basis.

Moreover, while it is not always difficult to discover how to make advertising which may simply interest or amuse potential consumers, or to create advertising that consumers will remember, it is often quite another thing to create an advertisement or campaign which succeeds in actually motivating potential consumers to become actual consumers. There are numberless instances known to the advertising community wherein advertising for a particular product is well recognized, is associated with the product and creates a lasting and favorable impression on the consumer as regards the manner in which the advertisement is presented. Yet, as far as can be accurately measured, many such ads fail to impel viewers to use more of such product, or favor it over that of a competitor.

The advertising industry has also recognized that an advertisement must serve the functions referred to above and that this is normally done in individual stages. Thus, the agencies realize that the creative message must attract the user in some way, and preferably, convey a message or impression about the product as well as contain a command or "call to action." However, the particular emotion required to secure attention may defeat the purpose of the message or compromise the call to action portion. Likewise, a part of the message, in an attempt to be clever, may offend some viewers or, in an attempt to gain attention, may appear more frivolous than intended.

Hence, it is very difficult on a prospective basis to predict whether a viewer will see a commercial as imaginative and clever on the one hand or frivolous and incredible on the other, when the differences in such presentation are very slight. Similarly, an overly detailed message may appear to be too clinical or perhaps worse, condescending, while another message may be non-offensive but also non-informing. The differences in comprehensional and emotional states of advertising material viewers may be slight but extremely important.

Hence, among all the possible advertisements that might be produced in the hopes of generating a successful consumer response, even where a large number of efforts are summarily dismissed or weeded out, the persons preparing the advertising and the companies using the advertising for promotional purposes simply cannot be sure within narrow limits as to whether particular advertising material will be a success in the marketplace. Accordingly, it is common to find that long after decisions are made and expenditures incurred in pursuit of presenting a particular advertisement (or theme or campaign of advertisements), that such efforts have simply not been successful, in that the campaign failed to produce sales in amounts proportionate to the expenditure of effort and money.

It is believed that an ideal advertisement is one which can be comprehended by the viewer or listener, which contains an inherently credible message, and which contains an imperative or call to action which will stimulate the viewer or listener to purchase the product in question. The advertising industry has for decades accepted the principle that a simple presentation of an advertising message in cold, hard, clear and logical terms is usually insufficient to induce a prospective purchaser to buy a particular product.

Even if viewers were highly analytical, (and it is accepted that most consumers are not), there is still the problem of differentiation between products whose characteristics are either highly subjective or whose quantitative differences are very minute vis-a-vis those of a competitor. Thus, the flavor of a beer or a hamburger, or the appearance of an article of clothing, is simply incapable of being quantified and presented in analytical terms. Even if such were the case, the question of motivation to buy a selected product would still remain.

Consequently, it has come to be accepted that in a great majority of cases, with a few possible exceptions not pertinent here, the decision to buy products is an emotional one in one sense or another. The presence of such emotion does not imply that the choice is irrational, but merely that it meets a need that the subject perceives himself to have, or will have, at the time of purchase. Whether the emotional response is one of self-satisfaction, one of belief that an intelligent choice has been made or that the choice will create a favorable appearance, image or other response in the buyer is not particularly important. According to the invention, it is believed that discovering and qualitatively and quantitatively analyzing the actual emotional response of a subject is the key to correlation between an advertising presentation and a successful sale of the product.

Referring again to the subject of advertising response, it would be ideal if people preparing advertisements were able to put themselves in the shoes, so to speak, of the particular customer. However, while certain advertising agencies are able to use the talents of creative personnel who are successful more often than not, a high degree of correspondence between choosing and presenting a particular ad and achieving product sales is simply not available on a consistent basis.

Of course, for many years, efforts have been made to determine consumer reactions or consumer response to advertising by different methods of obtaining "feedback." These include many forms of interviewing or testing consumers, either individually or in groups. Programs which are commonly used consist of "focus groups" made up of subjects who are shown different materials and asked about their response to the materials. Other programs comprise telephone interviews with members of a selected group or universe. These efforts continue, but the results they obtain are often questionable in terms of value to the advertiser.

The industry, having accepted that the word of a person creating an ad is insufficient to insure success, and knowing that a product proprietor does not consistently hold the key to identifying and pursuing advertising successes, has relied significantly on focus groups and questionnaires, those research techniques, including the use of reaction surveys, which are now in common use.

The answers of persons who are questioned during response testing, however, are notoriously unreliable as an indicator of their true emotions. For years, workers in the field have realized that, for any number of reasons, test subjects tend not to recall, or to be indirect, evasive or simply inaccurate in describing their emotional response to a particular stimulus. Thus, even if these subjects were able to recall accurately their emotional state at the time of perceiving stimuli, the likelihood that they could recall and identify an exact emotional state or set of feelings, particularly where the emotions change rapidly, is very unlikely.

This is thought to be attributable to a number of causes, including inadequate vocabulary and possible protection of the ego of the test subject vis-a-vis the tester. Thus, many test subjects are reluctant to disclose that they are more emotional than seems prudent, particularly when disclosing such an emotional state to a virtual stranger. More important than the vagaries of recollection and characterization of emotions at a particular time is the comparatively recent realization that during an advertising presentation, (for example, a television commercial lasting 15 to 30 seconds), the subject undergoes a large number of emotional state changes. Therefore, asking the test subject to recall each such state and its comparative intensity is simply asking the impossible.

According to the present invention, tests have shown that a subject might undergo as many as 5, 10 or even 15 changes in emotional response while watching a commercial that lasts only 15 to 30 seconds. Because emotional states vary, and change with great rapidity in intensity and/or polarity, (or simply disappear altogether), it has been realized that a higher quality of emotional states analysis is required for response testing to achieve maximum effectiveness.

According to the present invention, it is believed that if a second-by-second recording could be made of the emotional state of a viewer of a television commercial, and if it could be shown how such emotional changes correspond to the exact subject being presented at any one increment of time, successful or improved commercials could be created with regularity. Thus, and referring to the previous discussion, if a particular subject were to report that he were "turned off" by a particular commercial, then a worker might consider that the commercial was a failure. However, it is at least possible if not likely that certain features of that exact same commercial might have had strong attraction for the viewer, and it was another aspect or portion of that same commercial that "turned off" the subject. If this were actually the case, then the attractive parts of any given presentation could be retained and unsatisfactory portions could be eliminated or modified. By the same token, subject matter creating a strong positive response could be utilized to the greatest possible extent and could be repeated and/or incorporated in other materials.

It has been established through medical research, including that carried out by the Naval Aerospace Medical Research Laboratory, that EEG recordings reflect the fact and manner of information processing by an individual in a general or global sense. Thoughts, feelings, perceptions, and instructions all are processed in the brain as information, the reflection of which processing is detectable using EEG methods.

According to now accepted principles, the electrical activity incident to brain function can be detected and measured. Electroencephalography ("EEG") is the science of measuring brain waves. Using research information which correlates brain wave activity of a particular frequency and character to a particular emotion makes it possible to discriminate among polar opposite emotions as well as closely allied emotions. In the present context, the primary emotions (and their polar opposites) with which the invention is concerned are those of pleasure, arousal, dominance, abstract comprehension and pictorial comprehension.

The emotion of pleasure is self-explanatory and relates to enjoyment of what is being perceived. Abstract and pictorial comprehension are essentially self-explanatory. Arousal refers to an awakening of interest in the subject matter and dominance, or its polar opposite, submissiveness, refers to receptivity or openness to ideas or suggestions. Thus, a person whose emotions are in a dominant state is not open to suggestion, and a person in a low state of arousal lacks interest in an idea.

Referring to the mechanics of measuring emotion, the invention utilizes what is termed a circumplex model for correlating neurophysiological manifestations to emotions. The circumplex model has a pair of orthogonal axes intersecting at an origin. The emotions are displayed as points arranged in a circle about the origin, with diametrically opposed points representing polar opposite emotions and adjacently displayed points representing emotions that differ from each other more by shading than by character. Graphs are made by plotting positions on the circumplex and the character of the subject emotion is established by mathematical modeling ("non-linear analysis") based on brain wave frequency and intensity.

Inasmuch as an important aspect of the invention concerns the emotional changes undergone by the subject in response to presentation and detection of stimuli, the graphical or mathematical models are utilized to establish emotional conditions at various times and track the history of the emotional changes in relation to the stimuli. These methods then enable a comparison to be made between presented subject matter and a true, objective emotional response in the test subject. In general, this "non-linear dynamic" method establishes the relationship or linkage between EEG data and brain function, and hence, emotion. Research workers can convert data taken during observation of stimuli by a subject into an accurate, second-by-second record of the emotional response of the test subject to the stimuli being presented. While the manner of analysis will be described in greater detail, the invention has been successfully practiced by measuring the amplitudes of EEG waves at up to five individual frequencies, including 8 Hz (cycles per second), 13 Hz, 16 Hz, 18 Hz and 26 Hz. At each given frequency, the amplitude of the signal is indicative of the strength of a particular emotional component.

Comparing the values of a given component on one scale to the value of a component taken on another scale enables the tester to establish an accurate, all-around emotional state at a given instant. The general state determined by comparing two values is then refined into an exact emotional profile using comparisons of other values as auxiliary or follow-on steps. The invention holds out the promise of correlating these measurements of emotional intensity and characterization to a series of exactly defined emotions and, equally important, the changes and change rates in these emotions as the subject is exposed to stimuli, typically one or more audio-visual presentations. These changes and rates are sometimes called "composite emotional forces."

In view of the failure of the prior art to provide an effective method of determining the emotional response of a test subject of the content of time-varying stimuli, it is an object of the present invention to provide a method and apparatus for this purpose.

Another object of the invention is to provide a test method which will enable a correlation to be established between the actual emotional state of a subject being measured and the content of a message or other stimulus being presented to the subject at any given time interval within the presentation.

Yet another object of the invention is to provide an improved method and apparatus for analyzing the effectiveness of actual or proposed advertising copy or other presentational material.

A further object of the invention is to provide a method for enabling emotions and emotional changes and change rates in a test subject to be determined by directly measuring several components of the emotion and plotting the components to characterize the emotion in an accurate way.

A still further object of the invention is to provide a method of charting a sequence of emotional response signals in graphically visible form so as to facilitate analysis of an overall emotional response to predetermined stimuli.

An additional object of the invention is to provide a method of classifying the acceptability of advertising content by predetermining its emotional impact on test subjects before determining the final form which such advertising will take.

Another object of the invention is to utilize a method of direct testing of emotional components in selected individuals as a way of measuring the anticipated response to a given advertisement by individuals in the general population, and hence to greatly increase the predictability that such advertisements will succeed.

Yet another object of the invention is to provide a method that will minimize or eliminate waste of advertising by preventing advertisers from presenting ads that are unlikely to succeed, based on predictions using direct emotional response test subjects.

A further object of the invention is to provide a series of correlational tools to associate individual emotional response components, both in character and intensity, with particular brain wave activities for the purpose of accurate emotional response testing.

The invention achieves the foregoing and other objects and advantages by positioning a test subject to observe the selected stimuli for a given duration, establishing a path of communication between the subject and a brain wave detector/analyzer, determining at least two frequencies at which brain waves corresponding to particular emotional component intended to be analyzed are generated, presenting stimuli to a test subject, recording the amplitudes of brain waves at particular frequencies and thereafter comparing the amplitude changes in the different brain wave frequency bands, over the duration of the presentation, and thereby determining the overall and particular emotional responses of the test subject to one or more of the various individual portions of the presentation containing the stimuli.

The invention also achieves its objects and advantages by providing a method of emotional analysis that includes determining which one or more emotional scales are important to the subject matter of a test or other analysis, determining the brain wave frequencies which characterize such one or more emotional scales and wherein the brain waves vary in intensity in relation to the degree of emotional response of a subject to input stimuli in the form of a given presentation, exposing the subject to a presentation having a particular, predetermined content, noting the ongoing variations in intensity of the brain waves of the subject at each of at least two measured frequencies, and thereafter calculating a characteristic actual multiscalar response of the individual to the content of the presentation for analyzing the response of the subject during or after a given presentation.

The manner in which the foregoing and other objects and advantages of the invention are achieved in practice will become more clearly apparent when reference is made to the following detailed description of the preferred embodiments of the invention set forth by way of example and shown in the accompanying drawings, charts and appendices wherein like reference numbers or legends indicate corresponding parts throughout.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic view of a part of the apparatus of the invention, showing the manner of acquiring and processing brain wave signals from a subject whose emotions are to be measured;

FIG. 2 is a graphic representation illustrating what is termed a circumplex of emotions, arranged about a graphic origin;

FIG. 3 is a plot of the marginal values of the emotion of pleasure (a frequency of 8 Hz) detected in a subject over a 10 second period, the values comprising such data being processable in accordance with the present invention;

FIG. 4 is a plot of the marginal values of the emotional state of arousal over the same 10 second time period, taken at 16 Hz and being processable in accordance with the invention;

FIG. 5 is a plot of the composite emotional force of the emotions taken at the same time and from the same subject from whom data were taken as reflected in FIGS. 3 and 4, with the plot of FIG. 5 representing the algebraic product of the values taken from the charts of FIGS. 3 and 4; and

FIG. 6 is a so-called phase plot showing the development of various emotions and emotional intensity over the same 10 second time period depicted in FIGS. 3-5, such plot corresponding to a graphic circumplex of emotions.

DESCRIPTION OF THE PREFERRED EMBODIMENTS OF THE INVENTION

Before referring to the particular form of data developed by the use of the inventive method, and the methods of displaying and analyzing such data, a brief description will be given of a typical electroencephalographic ("EEG") brain wave detector and analyzer of the type used with the invention. Thus, referring now to FIG. 1, there is shown in schematic form a detector-analyzer apparatus generally designated 10 of the invention positioned with pick up or test points positioned on the head portion generally designated 12 of a test subject.

According to the invention, left and right hand test points 14, 16 are selected, one on either side of the midline 18 of the scalp of the subject 12. The head is fitted with cup-type electrodes coated with an electrically conductive gel, as is conventional and known to those skilled in the art.

An electrical reference connection is selected, in this case on the right side ear lobe 20. Further in accordance with the invention, an operational amplifier receives and amplifies EEG signals that are transformed, analyzed and recorded and/or displayed. Accordingly, the output from one scalp point 14 and from the reference point are sent to the input terminals of a first operational amplifier 22 forming part of an operational amplifier bank 24. A second operational amplifier 26 receives signals from the other scalp point 16 and the reference 20. Each amplifier has a common feedback connection 30 which is grounded, as at 32.

The respective outputs 34, 36 of the amplifiers 22, 26 are fed to individual, high-gain biologic amplifiers 38, 40 within a biologic amplifier block 42, typically possessing a gain of 50,000 to 200,000 with suitable bandpass filters enabling signals of 0.3 to 45 Hz to be passed and the remainder to be blocked.

The respective outputs of the biologic amplifiers 38, 40 are passed to analog-to-digital (A/D) converters 46, 48 which are interfaced with a digital microcomputer such as a microcomputer made by Commodore or IBM, for example. The output signals emerging from the converters 46, 48 are seen in lines 50, 52.

Frequency information is calculated using transforms such as Fast Fourier Transforms ("FFT") or Hartley or Wavelet transforms. The presently preferred transforms are Wavelet transforms which minimize the informational loss sometimes associated with FFT transforms.

With the computer 58 being properly programmed by the operator, displays of and/or a recording can be made of the intensity or amplitude of ongoing brain wave activity at each of five selected frequencies, the reasons for the selection of which are discussed herein.

Bearing in mind that the inventive concept relates to making and refining electrical measurements that are indicative of emotional states, reference will now be made to classifications of various emotions in a manner whereby the identity of the emotion is determined by analyzing a series of graphs or charts having geometric characteristics. The invention uses an arrangement of the representation of various emotions in a form which is useful from the standpoint of creating models or representations for purposes of analysis.

Referring now to FIG. 2. for example, there is shown what is termed a "Circumplex of Emotions."

In the expression "circumplex" as used herein simply means a graph, chart or the like wherein emotions are displayed around a center point or origin, and lie along or between two orthogonally arranged axes. A particular emotion is given a position on the graph in keeping with the extent to which it is influenced by the presence of one other emotion. The axes denote polarity, in that opposite positions on the graph show generally opposite emotions. Moreover, there are two axes because the graph compares intensity on two scales simultaneously. In the case of FIG. 2, the X-axis shows the emotions of pleasure-displeasure, or pleasure/sadness, while the Y-axis denotes arousal or alarm and its polar opposite, sleepy, tired or bored.

The expression "multidimensional scaling" as applied to FIG. 2 simply means that the pleasure (or other) scale is compared to the arousal (or other) scale, and the extent to which both emotions are present or absent will graphically determine where the resultant data point is positioned on the graph. FIG. 2 is sometimes referred to as the Mehrabian-Russel Paradigm.

Bearing in mind that each primary emotion has a polar opposite, and that the amplitude of brain waves at any particular frequency is never zero or less than zero, the polar opposite of any particular primary or tested-for emotion is indicated by minimal (or zero) amplitude. For graphic purposes, therefore, the origin is a starting or "neutral" point that is usually a certain number of units above zero, i.e., halfway between zero and the maximum anticipated attainable value. The amplitude used in these graphs and charts therefore represents the degree to which the emotion in question exceeds or falls below a neutral level.

The value in relation to the neutral point or reference represents the intensity of the emotion. According to the invention, because an overall emotional state is a composite of many factors, numerous charts are made for a final graphic non-linear analysis. This is done by comparing readings on one scale to readings on another scale. Where a more complex profile is desired, several scales are used. In some cases, it is desired to use as many as all possible combinations of those scales, taken two at a time. For example, the amplitude at a given frequency representing one emotional scale is plotted against the amplitude at another frequency representing another scale. Using pleasure and arousal as examples, pleasure intensity at a given time is compared to arousal intensity at that time. Then, pleasure and dominance are used, etc. In many, if not most cases, readings are made at frequent intervals, for example, just one or two seconds apart. In other cases, as amplified below, longer intervals or epochs are selected. The use of the computer permits tracking and recording of five frequencies simultaneously.

Using the two selected frequencies of 8 Hz and 16 Hz as corresponding respectively to pleasure and arousal, by way of example, a first "X-Y" or two-dimensional plot is made. A resultant point derives from the intensity of values on these two scales. This plot point has an angular component that indicates its qualitative nature and a radial component indicating its intensity. The qualitative character is determined by comparison with a known angle/description or circumplex chart such as that described by Plutchik (noted below) in 1994.

The angle/description or circumplex chart presently uses a refined or extended and then modified version of the Mehrabian-Russel Paradigm, in this case what are termed "adjusted" Plutchik Placements. Referring now to Table 1, there are listed an entire population of emotion terms, each having a characteristic angle from the origin, as follows:

                             TABLE 1
       Angular Placement for a Population of Emotion Terms
                                           Angular
                Emotion                   Placement
                Accepting                     0.0
                Agreeable                     5.0
                Serene                       12.3
                Cheerful                     25.7
                Receptive                    32.3
                Calm                         37.0
                Patient                      39.7
                Obliging                     43.3
                Affectionate                 52.3
                Obedient                     57.7
                Timid                        65.0
                Scared                       66.7
                Panicky                      67.7
                Afraid                       70.3
                Shy                          72.0
                Submissive                   73.0
                Bashful                      74.7
                Embarrassed                  75.3
                Terrified                    75.7
                Pensive                      76.7
                Cautious                     77.7
                Anxious                      78.3
                Helpless                     80.0
                Apprehensive                 83.3
                Self-conscious                83.3
                Ashamed                      83.3
                Humiliated                   84.0
                Forlorn                      85.0
                Nervous                      86.0
                Lonely                       88.3
                Apathetic                    90.0
                Meek                         91.0
                Guilty                      102.3
                Sad                         108.5
                Sorrowful                   112.7
                Empty                       120.3
                Remorseful                  123.3
                Hopeless                    124.7
                Depressed                   125.3
                Worried                     126.0
                Disinterested               127.3
                Grief-stricken               127.3
                Unhappy                     129.0
                Gloomy                      132.7
                Despairing                  133.0
                Watchful                    133.3
                Hesitant                    134.0
                Indecisive                  134.0
                Rejected                    136.0
                Bored                       136.0
                Disappointed                136.7
                Vacillating                 137.3
                Discouraged                 138.0
                Puzzled                     138.3
                Uncertain                   139.3
                Bewildered                  140.3
                Confused                    141.3
                Perplexed                   142.3
                Ambivalent                  144.7
                Surprised                   146.7
                Astonished                  148.0
                Amazed                      152.0
                Awed                        156.7
                Envious                     160.3
                Disgusted                   161.3
                Unsympathetic               165.6
                Unreceptive                 170.0
                Indignant                   175.0
                Disagreeable                176.4
                Resentful                   176.7
                Revolted                    181.3
                Displeased                  181.5
                Suspicious                  182.7
                Dissatisfied                183.0
                Contrary                    184.3
                Jealous                     184.7
                Intolerant                  185.0
                Distrusful                  185.0
                Vengeful                    186.0
                Bitter                      186.0
                Unfriendly                  188.0
                Stubborn                    190.4
                Uncooperative               191.7
                Contemptuous                192.0
                Loathful                    193.0
                Critical                    193.7
                Annoyed                     200.6
                Irritated                   202.3
                Angry                       212.0
                Antagonist                  220.0
                Furious                     221.3
                Hostile                     222.0
                Outraged                    225.3
                Scornful                    227.0
                Unaffectionate               227.3
                Quarrelsome                 229.7
                Grouchy                     230.0
                Impatient                   230.3
                Defiant                     230.7
                Aggressive                  232.0
                Sarcastic                   235.3
                Rebellious                  237.0
                Exasperated                 239.7
                Disobedient                 242.7
                Demanding                   244.0
                Possessive                  247.7
                Greedy                      249.0
                Wondering                   249.7
                Impulsive                   255.0
                Anticipatory                257.0
                Boastful                    257.3
                Expectant                   257.3
                Daring                      260.1
                Curious                     261.0
                Reckless                    261.0
                Proud                       262.0
                Inquisitive                 267.7
                Planful                     269.7
                Adventurous                 270.7
                Ecstatic                    286.0
                Sociable                    296.7
                Hopeful                     298.0
                Gleeful                     307.0
                Elated                      311.0
                Eager                       311.0
                Enthusiastic                313.7
                Interested                  315.7
                Delighted                   318.6
                Amused                      321.0
                Attentive                   322.4
                Joyful                      323.4
                Happy                       323.7
                Self-controlled               326.3
                Satisfied                   326.7
                Pleased                     328.0
                Generous                    328.0
                Ready                       329.3
                Sympathetic                 331.3
                Content                     338.3
                Cooperative                 340.7
                Trusting                    345.3
                Tolerant                    350.7

Using the above angular placement chart (termed Plutchik Placements), a verbal or descriptive characteristic of each of scores of emotions can be assigned to a resultant point determined by the graphic method just described, i.e., a point arrived at by plotting the amplitudes of simultaneously measured signals on two selected frequencies. Maintaining the geometric analogy, angles 0-90.degree. comprise the First Quadrant, 91-180.degree. the Second Quadrant, etc. Please see FIG. 6 for an illustration of the quadrant locations.

Referring now to Tables 2 through 5 below, four tables are presented which contain the same subject matter as those in Table 1, except that the emotions that were once in Quadrant One are now in Quadrant Three. In other words, the former Plutchik values are "adjusted" by adding 180.degree. to them, and all have now become the "adjusted Plutchik Placements," each being two quadrants away from its former value:

                             TABLE 2
                   Adjusted Plutchik Placements
                            Quadrant 1
                         Angle (Degrees)
                   1.3               Revolted
                   1.5               Displeased
                   2.7               Suspicious
                   3.0               Dissatisfied
                   4.3               Contrary
                   4.7               Jealous
                   5.0               Distrustful
                   5.0               Intolerant
                   6.0               Vengeful
                   6.0               Bitter
                   8.0               Unfriendly
                  10.4               Stubborn
                  11.7               Uncooperative
                  12.0               Contemptuous
                  13.0               Loathful
                  13.7               Critical
                  20.6               Annoyed
                  22.3               Irrated
                  32.0               Angry
                  40.0               Antagonistic
                  41.3               Furious
                  42.0               Hostile
                  45.3               Outraged
                  47.0               Scornful
                  47.3               Unaffectionate
                  49.7               Quarrelsome
                  50.0               Grouchy
                  50.3               Impatient
                  50.7               Defiant
                  52.0               Aggressive
                  55.3               Sarcastic
                  57.0               Rebellious
                  59.7               Exasperated
                  62.7               Disobedient
                  64.0               Demanding
                  67.7               Possessive
                  69.0               Greedy
                  69.7               Wondering
                  75.0               Impulsive
                  77.0               Anticipatory
                  77.3               Boastful
                  77.3               Expectant
                  80.1               Daring
                  81.0               Curious
                  81.0               Reckless
                  82.0               Proud
                  87.7               Inquisitive
                  89.7               Planful
                  90.7               Adventurous


                         TABLE 2
                   Adjusted Plutchik Placements
                            Quadrant 1
                         Angle (Degrees)
                   1.3               Revolted
                   1.5               Displeased
                   2.7               Suspicious
                   3.0               Dissatisfied
                   4.3               Contrary
                   4.7               Jealous
                   5.0               Distrustful
                   5.0               Intolerant
                   6.0               Vengeful
                   6.0               Bitter
                   8.0               Unfriendly
                  10.4               Stubborn
                  11.7               Uncooperative
                  12.0               Contemptuous
                  13.0               Loathful
                  13.7               Critical
                  20.6               Annoyed
                  22.3               Irrated
                  32.0               Angry
                  40.0               Antagonistic
                  41.3               Furious
                  42.0               Hostile
                  45.3               Outraged
                  47.0               Scornful
                  47.3               Unaffectionate
                  49.7               Quarrelsome
                  50.0               Grouchy
                  50.3               Impatient
                  50.7               Defiant
                  52.0               Aggressive
                  55.3               Sarcastic
                  57.0               Rebellious
                  59.7               Exasperated
                  62.7               Disobedient
                  64.0               Demanding
                  67.7               Possessive
                  69.0               Greedy
                  69.7               Wondering
                  75.0               Impulsive
                  77.0               Anticipatory
                  77.3               Boastful
                  77.3               Expectant
                  80.1               Daring
                  81.0               Curious
                  81.0               Reckless
                  82.0               Proud
                  87.7               Inquisitive
                  89.7               Planful
                  90.7               Adventurous


                         TABLE 4
                   Adjusted Plutchik Placements
                            Quadrant 3
                         Angle (Degrees)
                 185.0               Agreeable
                 192.3               Serene
                 205.7               Cheerful
                 212.3               Receptive
                 217.0               Calm
                 219.7               Patient
                 223.3               Obliging
                 232.3               Affectionate
                 237.7               Obedient
                 245.0               Timid
                 246.7               Scared
                 247.7               Panicky
                 250.3               Afraid
                 252.0               Shy
                 253.0               Submissive
                 254.7               Bashful
                 255.3               Embarrassed
                 255.7               Terrified
                 256.7               Pensive
                 257.7               Cautious
                 258.3               Anxious
                 260.0               Helpless
                 263.3               Apprehensive
                 263.3               Self-conscious
                 263.3               Ashamed
                 264.0               Humiliated
                 265.0               Forlorn
                 266.0               Nervous
                 268.3               Lonely
                 270.0               Apathetic


                         TABLE 4
                   Adjusted Plutchik Placements
                            Quadrant 3
                         Angle (Degrees)
                 185.0               Agreeable
                 192.3               Serene
                 205.7               Cheerful
                 212.3               Receptive
                 217.0               Calm
                 219.7               Patient
                 223.3               Obliging
                 232.3               Affectionate
                 237.7               Obedient
                 245.0               Timid
                 246.7               Scared
                 247.7               Panicky
                 250.3               Afraid
                 252.0               Shy
                 253.0               Submissive
                 254.7               Bashful
                 255.3               Embarrassed
                 255.7               Terrified
                 256.7               Pensive
                 257.7               Cautious
                 258.3               Anxious
                 260.0               Helpless
                 263.3               Apprehensive
                 263.3               Self-conscious
                 263.3               Ashamed
                 264.0               Humiliated
                 265.0               Forlorn
                 266.0               Nervous
                 268.3               Lonely
                 270.0               Apathetic

By arranging these in the graphic manner of FIG. 2, it will be noted that "revolted" and "displeased" are displayed around zero degrees relative to the origin, with their polar opposites, "happy" or "pleased" being displayed at a 180.degree. location relative to the origin. "Adventurous" and "planful" are displayed near the 90.degree. portion of this circular scale whereas the opposites of arousal, for example, meek, appear near 270.degree., in a graphically opposite location.

Emotions that lie between the two sets of axes are considered a composite of two of the basic emotions forming the axis plots. Again using the graphic positioning analogy, the intensity of an emotion may be thought of as represented by its distance from the origin. Consequently, the angular location from the origin can indicate, in this convention, the nature of an emotion which is a composite taken from two scales then being compared, while the distance from the origin is taken to represent the intensity of that emotion.

According to the invention, emotional responses are typically measured on five separate scales, and each is then compared to every other response in a certain sequence. Each response is associated with a characteristic frequency detected by the EEG, namely, 8, 13, 16, 18 and 26 Hertz. The emotions (and their polar opposites) found to correspond to these frequencies respectively are pleasure, arousal, dominance, comprehension and pictorial comprehension. These five responses are sometimes collectively abbreviated "PADCPC". In one of the preferred examples described herein, the amplitude characteristics were taken from the left hemisphere electrode at the 8 Hz, 13 Hz, 16 Hz and 26 Hz frequencies, and at the right hemisphere pickup for 18 Hz signals. These pickup points have shown to provide the most reliable data for measuring the target frequencies which are believed associated with the desired emotional responses, i.e., the emotions of PADCPC.

In the description given herein, and in the claims, the expression "emotional" or words of like import are used to denote a reaction detectable by brain wave activity, without necessarily implying that these responses do not have a rational or intellectual content. Thus, pictorial comprehension and abstract comprehension may not always be properly described as "emotions"; however, for purposes of this invention and for the appended claims, the term "emotion" or the like is intended be broad enough to encompass all of these reactions, i.e., "feelings" as well as understanding.

In other words, for present purposes, a person having greater understanding would be considered to have a different "emotional" state than a person having less understanding, although comprehension or understanding are not often thought of as "emotions." The expression "emotion" as used herein is thus intended to encompass both rational activities, such as comprehension or understanding, and a state of "feelings" such as anger, sorrow, trepidation, etc.

Referring now to a working example of the invention, the apparatus of FIG. 1 was attached to a test subject and prechecked for proper operation. The computer was programmed so as to receive and analyze input from both sides of the scalp midline, feeding the inputs from the left pick up point 14 to the operational amplifier 22 and those from the right portions of the scalp to the amplifier 26. The information received relating to the electroencephalographic signals were fed to the analog-to-digital converters and fed to input ports at the computer. Pursuant to computer instructions, frequencies of 8, 13, 16 and 26 Hz were taken from the left side of the scalp and 18 Hz was monitored by the pick up point from the right side of the scalp.

    TABLE 6
                        Abstract                        Pictorial
             Pleasure    Compre-                         Compre-
            Displeasure  hension   Arousal   Dominance   hension
               Left       Left      Left       Left       Right
    Second     8 Hz       13 Hz     16 Hz      26 Hz      18 Hz
       1         3.18       7.98    4.19       2.19       8.13
       2         3.75       7.36    4.27       2.11       5.76
       3         2.06       7.87    4.35       2.37       4.02
       4         2.04       6.09    4.06       2.54       6.16
       5         2.79       6.17    4.74       2.01       4.18
       6         3.26       6.38    4.92       3.17       3.09
       7         6.17       5.96    4.68       3.90       3.29
       8         9.76       5.45    4.11       3.85       7.32
       9         9.23       9.16    3.98       4.10       8.92
      10         9.45       9.87    5.71       4.03       3.46
      11         9.67      10.11    6.04       3.09       4.13
      12         9.03      10.98    6.01       3.11       4.07
      13         8.54      11.67    6.02       3.28       4.05
      14         8.14      10.68    6.71       3.73       5.15
      15         9.03      10.59    6.01       2.67       5.45
      16         9.11      10.23    5.96       2.15       4.06
      17         9.01      10.11    5.43       2.20       4.02
      18         8.86      10.13    5.16       2.67       4.19
      19         8.06       9.89    4.13       2.98       3.09
      20         7.45       4.3     4.17       3.14       8.17
      21         6.08       6.73    4.16       3.27       7.69
      22         6.18       6.49    4.37       4.16       7.96
      23         6.01       6.15    4.92       4.98       8.27
      24         5.96       9.18    5.81       6.43       8.76
      25         4.32      10.12    5.86       5.01       8.01
      26        10.14       4.54    6.74       3.47       8.02
      27        10.17       4.16    7.31       3.44       8.47
      28        10.18       8.19    8.19       3.49       7.95
      29        10.25       8.72    9.01       3.07       7.67
      30         4.35       8.35    8.43       2.54       7.37

Utilizing the capacity of the computer, as shown in Table 2, a reading was made during each second of a thirty second audio-visual presentation. In the left hand column of Table 6, the seconds are consecutively numbered from top to bottom. The readings at each of the pick up points, represented as amplitude in micro-volts, were detected and recorded. Thus, merely for example and referring to the 8 Hz frequency activity at the left side scalp pick up point, the voltage varies, beginning with an initial value of 3.18, up to 3.75, down to 2.06 and 2.04, and then begins to rise, etc. as shown by the data, and vary throughout the entire recording period.

The other amplitudes are those set out in the Table. As noted in Table 6, the 8 Hz column relates to activity on the pleasure scale, the 13 Hz frequency to abstract comprehension brain activity, 16 Hz to activity on the arousal scale and dominance to the 26 Hz activity, and the 18 Hz activity representing pictorial comprehension. These values were obtained from a subject that was given an opportunity to see a television commercial that began the first second of time and continued through a 30 second interval.

According to the analysis method, two aspects of these measurements are highly significant. First, each of the frequencies represents a measurement of the target emotion on a numerical or intensity scale of strongly positive to strongly negative.

Some correlations may be thought of in this system as attended by a negative algebraic sign and some a positive sign. Thus, there is a negative correlation between the degree of pleasure and increasing amplitude. At any particular measurement interval, therefore, the lower the amplitude of output waves at 8 Hz, the greater the pleasure at that moment.

There is a positive correlation between signals from the left side of the brain at 13 Hz and comprehension. Thus, to the extent that the amplitude of 13 Hz brain waves at any particular time is high, the level of comprehension is high, with low amplitudes of 13 Hz activity implying a low or decreasing level of comprehension. The left electrode supplying 16 Hz waves produces a positive correlation between arousal and amplitude at that frequency. Thus, a high amplitude at any particular second of time indicates a high level of arousal at that particular instant while a low amplitude indicates a low arousal level. Regarding the 26 Hz activity from the left brain pickup site, the correlation between this amplitude and dominance is negative. However, this could be expressed as a positive correlation between amplitude openness or susceptibility. Thus, where there is high amplitude, the emotion of being open to external influence is great while the amplitude of the 26 Hz frequency is low, a sense of autonomy or self direction increases, such condition being indicative of low susceptibility to outside influence or direction.

Regarding signals from the right side of the brain at 18 Hz, there is a positive correlation between amplitudes of this signal and pictorial comprehension. Thus, as these amplitudes increase, the subjects are experiencing greater ease of visually comprehending the stimuli being instantaneously presented to them. As the amplitude of signals at this frequency decreases, the subject is finding it increasingly difficult to visually comprehend the stimuli being presented.

Inasmuch as considerable data are set out in Table 6, and because the principles of the invention may be illustrated by utilizing a more condensed example, the readings set out in the top third (or first 10 seconds) of Table 6 are reproduced in Table 7, as follows:

    TABLE 7
                        Abstract                        Pictorial
             Pleasure    Compre-                         Compre-
            Displeasure  hension   Arousal   Dominance   hension
               Left       Left      Left       Left       Right
    Second     8 Hz       13 Hz     16 Hz      26 Hz      18 Hz
       1       3.18       7.98      4.19       2.19       8.13
       2       3.75       7.36      4.27       2.11       5.76
       3       2.06       7.87      4.35       2.37       4.02
       4       2.04       6.09      4.06       2.54       6.16
       5       2.79       6.17      4.74       2.91       4.18
       6       3.26       6.38      4.92       3.17       3.09
       7       6.17       5.96      4.68       3.90       3.29
       8       9.76       5.45      4.11       3.85       7.32
       9       9.23       9.16      3.98       4.10       8.92
      10       9.45       9.87      5.71       4.03       3.46

Inasmuch as the apparatus and method of the invention are concerned as much with emotional change and change rate as with absolute values, the differences in measured amplitude readings between one second and the reading in the preceding second are termed "marginal values" and are set out in Table 8 as follows:

    TABLE 8
                        Abstract                        Pictorial
             Pleasure    Compre-                         Compre-
            Displeasure  hension   Arousal   Dominance   hension
               Left       Left      Left       Left       Right
    Second     8 Hz       13 Hz     16 Hz      26 Hz      18 Hz
       1         0.0        0.0       0.0        0.0        0.0
       2          .57       -.62       .08       -.08      -2.37
       3        -1.69      -1.18       .08        .26      -1.74
       4         -.02      -1.78      -.29        .37       2.14
       5          .75        .08       .68        .37      -1.98
       6          .47        .21       .18        .26      -1.09
       7         2.91       -.42      -.24        .73        .2
       8         3.59       -.51      -.57       -.05       4.03
       9         -.53       3.71      -.13        .25       1.6
      10          .22        .71      1.73       -.07      -5.46

The above Table 8 shows that, for example, all numbers in the Marginal Values chart begin with zero, since whatever initial reading appears in each column during the first second is considered a base line for purposes of determining marginal values. Subtracting each earlier reading from the immediately following reading in a series of steps gives these marginal values. Thus, where, in the 8 Hz column of Table 7, 3.18 is the micro-volt value of the initial reading, the second reading (3.75 micro-volts) is 0.57 units greater. This number is the marginal value at 8 Hz for second number 2, and therefore appears as the second entry in the left hand column of Table 8. From a value of 3.75, the micro-volt reading drops to 2.06, a difference of -1.69. This figure appears as the third entry in the marginal value table, in the left hand column, and so on for each of the five columns representing different emotional scales. The entire chart is constructed according to these principles.

Table 8, therefore, shows marginal values, over a period of time, for each of the five emotions detected at its characteristic frequency. According to the invention, the determination of an emotional state is made by graphically comparing values on one scale to values on another scale. More particularly, a comparison is made between the marginal or change rate values of one scale with those of another scale. This inventive concept is what is termed "composite emotional force." Composite emotional force, as is shown illustratively in Table 9, is a value that is the algebraic or arithmetic product of two marginal values being compared at a particular time. Thus, in Table 9 below, a value at any particular instant on one scale is multiplied by the value on another scale at that same instant, and the product, termed "composite emotional force," is shown in the right hand column. The "composite emotional force" numbers are rounded but represent the products of the numbers just referred to.

                             TABLE 9
       Composite Emotional Force History - Pleasure/Arousal
                                                   Product
                                                  (Composite
               Marginal X       Marginal Y     Emotional Force)
    Second   (8 Hz, Table 8)  (16 Hz, Table 8)     (rounded)
       1            0.0              0.0              0.0
       2             .57              .08              .04
       3           -1.69              .08             -.13
       4            -.02             -.29              .01
       5             .75              .68              .51
       6             .47              .18              .08
       7            2.91             -.24              .70
       8            3.59             -.57            -2.05
       9            -.53             -.13              .07
      10             .22             1.73              .38

FIGS. 3-5 in the drawings show charts of selected Marginal Values, namely, Pleasure and Arousal, and what is termed a Composite Emotional Force History based on these two scales. FIG. 3 of the drawings shows the marginal values appearing in the left hand or 8 Hz data column of Table 8. FIG. 4 shows the information appearing in the third data column of Table 8, i.e., the marginal values of "arousal" or 16 Hz values; and FIG. 5 shows what is termed "Composite Emotional Force," or the individual arithmetic products of the series of values shown in the charts of FIGS. 3 and 4. In this connection, reference is made back to Table 9, wherein the values from the first and second data columns of Table 8 are set out as "Marginal X" and "Marginal Y." "X" and "Y" here means that the particular scale is the X or Y axis on a plot of X (8 Hz) versus Y (16 Hz). The third column of Table 9 is entitled "Composite Emotional Force" and represents the arithmetic product of the other two columns, suitably rounded off to two or three significant figures. The algebraic signs of the values follow algebraic conventions, i.e., the products of two positive or two negative numbers creates a positive algebraic sign in the product. If one but not both of the multipliers are negative in algebraic sign, the product is negative.

Referring now to Table 10, there are set out below what is termed a "Composite Emotional Force History." The first row of this chart relates to the values taken from the "Marginal X" or 8 Hz column of Table 9. The largest positive number, 3.59, added to the largest negative number, -1.69, gives a total excursion of 5.3, to the nearest decimal place. Accordingly, the "Range" column of Table 10 shows the maximum excursion total at a given frequency and the "Scale" column shows the average or one-half that value, again to the nearest rounded tenths place number. The "mean" is always zero, since the scale is half the range.

                             TABLE 10
                Composite Emotional Force History
                     Scale         Mean          Range
          X           2.6            0            5.3
          Y           1.1            0            2.3
          V           1.3            0            2.6

Reference is now made to the manner in which these EEG-derived values are used in a non-linear analysis according to the invention. Thus, referring now to FIG. 6 and Tables 9 and 11, which are to be taken together, FIG. 6 represents a so-called "phase plot" of points for the 10 seconds of time just described. The graph of FIG. 6 shows a two-axis display of X and Y marginal values where X is pleasure and Y is arousal. The absolute values of pleasure/arousal are set out in Table 6; the marginal values or changes from one second to the next are different from the absolute values. The marginal values are used in FIG. 6, which shows a numbered series of points, each lying in a particular quadrant and each point being located from the marginal data of Table 9.

From the location of these points, it will be noted that there is an almost random distribution, showing significant emotional differences on the pleasure/arousal scales, which are those being measured during the 10 second interval in question. Some of the points wherein there is a significant excursion from a prior value include point 3, wherein X is strongly negative and Y very slightly positive. only points 5 and 10 show significant positive Y values, while points 5, 7 and 8 show significant positive X values, and point 3 shows a significant negative X value.

As shown in FIG. 6, there are nine plotted points, (2 through 10) each of which by definition falls in one of the four quadrants. The points illustrated are for a 10 second time series, and represent a "phase plot" of pleasure versus arousal, with such emotions undergoing the changes indicated in the graph.

Table 11 identifies each of points 2 through 10 in terms of an angle from the origin, whereas Table 9 identifies the same points in terms of X-Y (Cartesian) coordinates.

          TABLE 11
                     Angle of Data Point
                         From Origin         Corresponding
          Second          (degrees)          Emotion
             2                10             Stubborn
             3               178             Accepting
             4               155             Content
             5                42             Hostile
             6                25             Irritated
             7               355             Indignant
             8               348             Unsympathetic
             9               198             Serene
            10                83             Proud

Referring now to Table 12, there is shown what is termed an "aggregate emotional profile" of the type wherein a number of subjects are exposed to stimuli and a statistical analysis is made of their response. Thus, in Table 12, time is shown as extending from left to right with there being a column for each of seconds 1 through 10. The vertical column indicates subjects A through J, totalling 10 different subjects, each of whom is subjected to a test observation and data recording in keeping with the invention. Here, the expression "quad visit" relates to the particular quadrant in which a data point is found for that subject at the particular second of time in question.

                             TABLE 12
                   Aggregate Emotional Profile
    Seconds         1    2   3    4    5   6    7    8   9   10
    Subject A       0    1   2    3    1   1    4    4   3    1
    quad visit
    Subject B       0    1   4    3    1   1    2    1   3    2
    quad visit
    Subject C       0    2   2    3    1   1    4    2   3    2
    quad visit
    Subject D       0    1   2    4    2   1    4    4   2    2
    quad visit
    Subject E       0    3   4    3    1   4    2    4   3    3
    quad visit
    Subject F       0    1   2    4    1   2    4    4   1    1
    quad visit
    Subject G       0    4   2    3    4   1    3    4   3    4
    quad visit
    Subject H       0    1   2    3    3   1    4    4   2    2
    quad visit
    Subject I       0    3   2    3    1   2    4    3   3    2
    quad visit
    Subject J       0    1   3    2    1   1    4    3   4    2
    quad visit
    Most Frequent   0    1   2    3    1   1    4    4   3    2
    quad visits
    Cumulative      0    1   2    3    1   1    4    4   3    2
    Profile

The quadrants referred to in this table are those found in a graph of the Pleasure/Arousal scale, as was illustrated for example in FIG. 6 and in Tables 9 and 11. The numbers displayed beneath each of the seconds for each subject indicate the particular quadrant wherein the marginal value characterizing the response for that subject was found. Thus, subject "A", in successive time intervals starting with second No. 2, moves to Quadrant 1, then Quadrant 2, Quadrant 3, back to Quadrant for 2 seconds and then spends 2 more seconds in Quadrant 4 before returning through Quadrant 3 to Quadrant 1. Each test subject, A, B, etc. has a counterpart history of having his/her emotions visiting a particular quadrant at a particular time; each subject was, however, viewing identical material over an identical period of time.

A tabulation is then made of the most frequently visited quadrant at each particular second of time as illustrated in the second last line of Table 11. Thus, most of the subjects were in the first quadrant during the second time interval; most were in the second quadrant during the third time interval, etc. The term "aggregate emotional profile" is given to the cumulative responses of all test subjects.

From the use of plurality of subjects, such as 10 or more, the influence of unusual individuals on the response may be tempered or eliminated. Thus, if the test method is utilized to determine the reaction of a particular individual, only that individual need be tested. However, if the purpose of the test is to determine an average, median, or other value with statistically valid frequency measurements, then a number of individuals are tested and the data are analyzed accordingly.

Referring now to the depth of emotional profile available through the use of the invention, inasmuch as each of five different frequencies is used to sample amplitude values, it is possible to create as many as 10 phase plots. In other words, with five variables taken two at a time, 10 combinations are available. For the purpose of most analyses, such as an analysis of advertising matter, it is not necessary to compare all available characteristics, even though it is theoretically possible to do so.

Normally, pleasure, arousal, and dominance are the emotions which are most significant for emotional analysis. Thus, comprehension generally and pictorial comprehension may be valuable analytical tools but are not often in issue with the normally anticipated use of the test material with which the invention is concerned. However, there are specialty applications, such as testing for military or scientific purposes wherein these abilities may be required to be analyzed.

However, by using three scales, and comparing pleasure to arousal, pleasure to dominance, and dominance to arousal, an emotional profile of a subject can be obtained which is quite valuable. Thus, referring to Tables 13, 14 and 15, these characteristics are compared by the methodology just described. Thus, amplitude values are taken at 8 Hz, 16 Hz, and 26 Hz, all from the left side of the head of the test subject.

Comparing dominance and arousal, one compares the amplitude values at 26 and 16 Hz respectively, and the pleasure/dominance phase plots are made comparing the values at 8 Hz to those at 26 Hz. Tables 13-22 do not contain the 100-plus emotions found in the earlier charts, but are concerned only with a more gross or general response of the subject. For this purpose, only the emotions associated with a particular quadrant need to be known. Tables 13-15 shows the dominant emotional character of a subject whose brain waves place him in the illustrated quadrant.

                             TABLE 13
                 Pleasure (8 Hz)/Arousal (16 Hz)
                    Interpretation by Quadrant
    Quadrant I    This period is marked by a reaction of alarm, hostility,
                  annoyance, disgust, and distrust. Tension is a factor.
                  Arousal is high.
    Quadrant II   A sense of curiosity and playfulness is present. Energy is
                  increasing along with delight, happiness, and joy.
    Quadrant III  The response is charactcrized by a calm, relaxed serenity.
                  Pleasant cheerfulness is creating an agreeable reaction.
    Quadrant IV   Confusion, bewilderment, and uncertainty mark this
                  periold. Gloomy hopelessness is resulting in boredom.
                  Energy is low.


                         TABLE 13
                 Pleasure (8 Hz)/Arousal (16 Hz)
                    Interpretation by Quadrant
    Quadrant I    This period is marked by a reaction of alarm, hostility,
                  annoyance, disgust, and distrust. Tension is a factor.
                  Arousal is high.
    Quadrant II   A sense of curiosity and playfulness is present. Energy is
                  increasing along with delight, happiness, and joy.
    Quadrant III  The response is charactcrized by a calm, relaxed serenity.
                  Pleasant cheerfulness is creating an agreeable reaction.
    Quadrant IV   Confusion, bewilderment, and uncertainty mark this
                  periold. Gloomy hopelessness is resulting in boredom.
                  Energy is low.


                         TABLE 15
                Pleasure (8 Hz)/Dominance (26 Hz)
                    Interpretation by Quadrant
    Quadrant I  Although annoyed, distressed, and resentful the response is
                submissive to external control. The moment is threatening.
    Quadrant II Joyful delight is factoring into an expectancy of being
                positively influenced. The message is eliciting an agreeable
                response.
    Quadrant III The moment is experienced as cheerfully under control.
                There is a sense of enthusiasm for expressing influence and
                control.
    Quadrant IV There is an experience of intolerant frustration and anger
                that is being defiantly expressed in an autonomous
                dominating need to be in control.

Tables 16-22 show other combinations which may be made using other frequencies. Each of the Tables 16 through 22 lists the general qualities of the emotions to be found for any particular quadrant when graphically comparing two particular phases.

                             TABLE 16
          Arousal (16 Hz)/Abstract Comprehension (13 Hz)
                    Interpretation by Quadrant
    Quadrant I  The moment is being experienced as easily comprehendible
                and arousing. It is likely that the message is conceived of as
                astonishing and/or exciting.
    Quadrant II While the message is taken as fully comprehended it has
                evoked a calm, content, and receptive state.
    Quadrant III The message is poorly comprehended. It is received with a
                low level of energy and a sense of caution.
    Quadrant IV The message illicits dissatisfaction, is poorly understood
                and is resulting in increased tension and arousal.


                         TABLE 17
         Dominance (26 Hz)/Abstract Comprehension (13 Hz)
                    Interpretation by Quadrant
    Quadrant I  The moment is perceived as well understood. There is a
                submissive, open to influence, response to the message.
    Quadrant II The moment is perceived as well understood. It evokes a
                need to resist external influence and exert self-control.
    Quadrant III The message is poorly comprehended. It is perceived as
                confusing. This state of low comprehension evokes a strong
                sense of independence and resistance to external control.
    Quadrant IV The message is poorly comprehended, confusing, and
                bewildering. This has evoked a sense of dependency on
                external influence and a willingness to be guided.


                         TABLE 17
         Dominance (26 Hz)/Abstract Comprehension (13 Hz)
                    Interpretation by Quadrant
    Quadrant I  The moment is perceived as well understood. There is a
                submissive, open to influence, response to the message.
    Quadrant II The moment is perceived as well understood. It evokes a
                need to resist external influence and exert self-control.
    Quadrant III The message is poorly comprehended. It is perceived as
                confusing. This state of low comprehension evokes a strong
                sense of independence and resistance to external control.
    Quadrant IV The message is poorly comprehended, confusing, and
                bewildering. This has evoked a sense of dependency on
                external influence and a willingness to be guided.


                         TABLE 19
         Pleasure (8 Hz)/Pictorial Comprehension (18 Hz)
                    Interpretation by Quadrant
    Quadrant I  What is seen is clearly understood. The visual presentation
                evokes anger, hostility, and disgust.
    Quadrant II What is visually perceived is well understood and evokes a
                strong sense of pleasure and expectation of delight.
    Quadrant III The visual panorama is poorly comprehended. Nonetheless
                there is a sense of calm, ease, and pleasure.
    Quadrant IV The current visual picture is confusing. There is a sense of
                hopelessness and gloom about what is being visually
                perceived.


                         TABLE 19
         Pleasure (8 Hz)/Pictorial Comprehension (18 Hz)
                    Interpretation by Quadrant
    Quadrant I  What is seen is clearly understood. The visual presentation
                evokes anger, hostility, and disgust.
    Quadrant II What is visually perceived is well understood and evokes a
                strong sense of pleasure and expectation of delight.
    Quadrant III The visual panorama is poorly comprehended. Nonetheless
                there is a sense of calm, ease, and pleasure.
    Quadrant IV The current visual picture is confusing. There is a sense of
                hopelessness and gloom about what is being visually
                perceived.


                         TABLE 21
        Dominance (26 Hz)/Pictorial Comprehension (18 Hz)
                    Interpretation by Quadrant
    Quadrant I  What is being visually perceived is clearly understood. It
                evokes a submissive openness to external influence or
                control.
    Quadrant II The visual stimuli is clear and well understood. It provokes
                an autonomous response that is not open to external
                influence but it rather encourages self-direction.
    Quadrant III While visual stimuli is confusing and not clear it has
                evoked a desire to be influenced by external events and
                experience self-control. There is no openness to the
                message.
    Quadrant IV The visual stimuli is confusing, perplexing, and poorly
                comprehended. There is a desire for external influence and
                guidance.


                         TABLE 21
        Dominance (26 Hz)/Pictorial Comprehension (18 Hz)
                    Interpretation by Quadrant
    Quadrant I  What is being visually perceived is clearly understood. It
                evokes a submissive openness to external influence or
                control.
    Quadrant II The visual stimuli is clear and well understood. It provokes
                an autonomous response that is not open to external
                influence but it rather encourages self-direction.
    Quadrant III While visual stimuli is confusing and not clear it has
                evoked a desire to be influenced by external events and
                experience self-control. There is no openness to the
                message.
    Quadrant IV The visual stimuli is confusing, perplexing, and poorly
                comprehended. There is a desire for external influence and
                guidance.

In connection with the invention, therefore, it will be understood that the invention makes it possible to analyze the emotions of test subjects either in relatively great depth, or in a more sweeping, generalized manner.

In analyzing the emotional reaction of subjects to advertising material, for example, it may only be necessary to determine the particular quadrant in which the emotional response is located, especially if the emotional component is one other than pleasure, arousal or dominance. By determining the quadrant wherein the greatest time is spent in any given duration of emotional response, or in which quadrant the greatest emotional intensity can be found, a correlation between one or more aspects of the subject matter being apprehended and the general nature of that emotion can be established. Thus, the invention makes it possible to determine emotional states with whatever degree of precision is desired for the purpose of observing that particular emotion.

Where more than two or three quadrants are being analyzed, multi-scale analysis will yield a more complex emotional profile then comparing only two scales, and it is always possible for somewhat conflicting emotions to be present. The presence of such emotions and their analysis will rarely if ever involve outright contradiction, but there will be found significant correlation. The concept of multiple phase plots adds depth to the analysis without compromising its overall effectiveness.

A major portion of the foregoing discussion has been directed to describing how an overall emotional profile can be established for one or more subjects who have viewed advertising material. The description illustrates the potential for noting and evaluating the nature and extent of various changes in the emotional state or condition of the subjects as the stimuli are presented to them over a given duration.

The emotional profile that is described in the greatest detail involves, for example, comparisons of the pleasure scale with the arousal scale. Use of these scales is indicated where the tester desires the emotion to be measured to appear in a definite place on the Plutchik circumplex. One reason for using Plutchik's "placements" is reflected in the reference work,.sup.1 which states that the angular placements, each corresponding to a described emotion, are culture-free, reliable, valid descriptors of emotional states. Thus, according to the reference, if the brain wave activity of a person has a certain value at a given instant, then that person is then experiencing the emotion indicated by the chart, regardless of the cultural, economic, ethnic, racial or other character of that particular subject.

The Psychology and Biology of Emotion by Robert Plutchik, 1994, pp. 68, 69.

The pleasure/arousal scale and the pleasure/dominance scale are the most commonly used for analyzing things such as television commercials or other materials intended to provide commercial/economic/emotional understanding, response and motivation. However, the use of other frequencies and the making of other comparisons may be indicated depending upon the desires of the tester and the nature of the subject matter being viewed or listened to. Where such inquiries reflect the use of other frequencies, as described, the test material can be used to round out existing profiles, or develop information in entirely different areas.

The material shown to a subject may call for utilizing one or several other scales, however. By way of example, an architect may wish to explore the relation between pictorial comprehension of structures (or renderings of structures) and dominance with respect to a particular design. In other words, comparing just these two scales could indicate whether the subject understands the various aspects of the building design which he is observing and the extent to which he is receptive to such a design.

Contractors, builders, or even product managers may wish to use this approach in what may be termed "packaging" in the broadest sense. In other words, various acceptable forms of housing may be inquired into, as might be the packaging of a consumer product, especially a product that displays a picture of the article to be sold, displays the article itself, as in see-through or "shadow" packaging, or the like.

In the case of a print advertising campaign, the proprietor may choose to examine subjects to determine the extent to which the subject is experiencing abstract comprehension and pleasure. A subject who is capable of identifying headlines, tag lines, or even the content of the entire message, and display a favorable pleasure scale response would indicate that the message has been understood and that it has created a favorable response. Where an advertiser or manufacturer attempts to determine how various subjects experience all or any particular aspect of the content of the intended message in any given medium, measurements are made using comprehension or other appropriate scales. If the proprietor intends to determine whether the content of his message is understood, either in the abstract or in its graphic or pictorial aspects and whether the subject is open to suggestion, a particular emotional scale may be selected for comparison with another scale so that the pairs considered are likely to develop this information.

In the foregoing example set out in the greatest detail, the period or epoch of measurement is described as being one second for short video commercials. The same period or epoch may be appropriate for short audio messages such as radio commercials. For other kinds of content, however, the response interval or epoch may be 3, 5, 10, 15 or 30 seconds or more. If the content being studied is written material, and each of a plurality of paragraphs might reasonably require 15 seconds for reading, then such epochs of a similar duration might be selected. Of course, there may be value changes during this time; however, the values are simply averaged in such a case. For example, if 15 seconds is allocated for the subject to read a paragraph, measuring of the particular emotional scales continues during this whole time and is recorded for analysis; readings applicable to the next increment of the presentation would be made in a subsequent period, usually for an equal duration. Analysis would enable the tester to compare responses to each of the paragraphs or segments.

By way of another example, in vehicle training, including auto and aircraft management, the manufacturer may be interested in the reaction of the respondent to the seating and control panel of the vehicle. An epoch of measurement longer than just a second or two might be indicated because of the length of an acquaintance, orientation or familiarity period. Thus, comprehension could be measured during a comparatively longer duration as the subject successively views the individual element of an instrument panel. Several different forms of panels, each presenting information needed to operate the vehicle, could be viewed in succession, and the maker could then choose the display that was most rapidly comprehended and/or created approval or pleasure in the test subject.

Using a very short span, epoch or duration of measurement might be indicated in the case of an arcade game, for example. Depending on the complexity of the game and/or the interaction between the respondent and the game, the comprehensional analysis might be required to be made from data collected every second or perhaps even in fractions of a second.

A further aspect of the invention involves the possibility of feedback or program variation initiated by he subject, directly or indirectly. Thus, the subject might be required or permitted to use his response to certain stimuli to alter the content of a subsequent portion of the message or other aspect of the presentation being made. This may be considered analogous to, but a much more sophisticated version of, computer-presented information used in other teaching machines or the like wherein the machine questions the subject and determines whether he has given a correct answer, and if so, allows him to proceed to the next operating sequence; if not, he is given more information and asked to try again. The nature of the feedback, according to the present invention, might instead be determined in real time, and the detected emotional component could be arranged to directly control a follow-on presentation or other response without the need to interrogate the subject.

Another application of the inventive principles involves that of making a presentation with the test apparatus positioned on the subject, then making a subsequent presentation, followed by a subsequent test using the equipment in question. Thus, for example, the subject could be exposed for a predetermined time to one or more company names and/or logos, during which time the various components corresponding to different brain wave frequencies would be recorded. Thereafter, such as several hours, days or weeks later, the apparatus is again used on the subject, who is shown the original name or logo. The recall and emotional content of the second test is then compared to the first to determine whether the intervening event changed the perceptions or feelings of the subject.

Using this procedure, by way of example, the subject could be analyzed during the time that a presentation is made identifying the Acme Oil Company and its corporate logo. The response of the subject could be measured while this name and logo are shown, perhaps with other names and logos of competitive companies. The responses of the subject to each of the presentations would be carefully noted, particularly as to comprehension and pleasure.

Subsequently, such as a week or more later, the subject could be given information of a laudatory character describing the cleanliness of restrooms in Acme Service Stations and the courteous service afforded by the company. Subsequent to presentation of that message, during which time the subject's responses would not be monitored, the subject would again be tested merely by showing him the logos and names of one or more of the companies. If for example, the subject were to display a more favorable reaction to the Acme name and logo that was more favorable than that originally elicited simply by showing him the Acme logo without any additional message, the tester could properly assume that the advertising in the intervening time had created a favorable impact on the subject. The test would, in effect, validate the proposition that the advertising had served to create the necessary association between the name and/or logo and the subsequent message that the name and/or logo stood for desirable products or services. If this were true, the tester would know that the advertising was successful.

In most instances, the invention is best utilized to analyze emotional information pertaining to visual presentations, most or all of which customarily include an audio portion. However, the invention is also useful with presentations which have an audio character only, or which may contain relatively abstract information such as a printed word, for example. Thus, "time varying stimuli" or words of like import are sometimes used to describe the most general form of presentation.

In the presently preferred form of apparatus, it is the amplitude of a brain wave signal at a particular frequency that is measured, and the so-called marginal values of these components are determined from changes in these amplitudes or intensities. However, the same or other apparatus may sample similar or different parameters or characteristics of brain waves at a particular frequency, such as power, phase angle, or the like. In any case, the desired parameter is selected so as to be indicative of the intensity or strength of the emotion at the target frequency. Accordingly, as used herein, the expression "amplitude" is to be taken in its general or non-limiting sense, i.e., as indicative of the intensity or strength of a signal of a given frequency at the time in question. The terms "intensity" or "strength" are therefore also sometimes used in the claims.

In the above illustrations, five frequencies were identified and the characteristic set of emotions associated with each such frequency was described. These emotions are sometimes referred to herein and in the claims as "base emotions" or "measurable base emotions" or words of like import, i.e., they are emotions that can be measured as to their presence, absence, and intensity, (including the presence of a polar opposite emotion) by the amplitude or intensity of a brain wave signal at that frequency. The measurable base emotions described included pleasure, arousal, dominance, and pictorial and abstract comprehension.

The more complex emotions able to be experienced by a subject are of concern in the instant method, and the more complex, overall emotional state of a subject that is sought to be determined is referred to herein and in the claims as a "composite emotional state." This state, at any one time, is represented by a coordinate point on a two-axis graph wherein one axis corresponds to one base emotion and the other axis to the other base emotion. Whereas more than two base emotions can be and are measured at one time, the comparisons of the two states or levels are always made two at a time. Points on any such two-axis graph are referred to as "coordinate points," and these points trace the composite emotional state of the subject from time to time.

Of course, the identity of any one graphically determined composite emotion depends on which base emotions are being compared graphically. Although subjects are capable of experiencing many more than the 100 separate emotions identified and referred to, for example, on the "Plutchik Placement" charts, for most purposes, knowledge of the quadrant wherein the coordinate point is located is sufficient to identify a composite emotion. The present invention identifies and/or measures composite emotional states of the subject by using values taken from base emotion measurements, namely those associated with a characteristic frequency. A series of composite emotional states therefore appears as a succession of points on the graph, each individual point lying generally within a certain quadrant on that graph and more particularly, lying a certain distance and direction from the origin.

It will thus be seen the present invention provides new improved methods and apparatus for analyzing neurological response to emotion-inducing stimuli having a number of advantages and characteristics, including those pointed out herein and others which are inherent in the invention. Several preferred methods of practicing the invention having been described by way of illustration, it is anticipated that modifications to the described methods will occur to those skilled in the art and that such modification and changes may be made without departing from the spirit of the invention or the scope of the appended claims.

* * * * *

Top

Home Archives News Resources Victims

Conferences Search Web Ring Contact

Our Disclaimer Fair Use

Current U.S. Class:	348/563; 348/473
Intern'l Class:	H04N 005/445
Field of Search:	348/473,589,563,584,600,598,525,521

Current U.S. Class:	600/28
Intern'l Class:	A61B 005/00
Field of Search:	600/26-28 128/897,898

Current U.S. Class:	375/240.13; 348/154; 348/473; 348/699; 358/908
Intern'l Class:	H04N 005/14; H04N 009/64
Field of Search:	346/46,94 358/908 348/699,700,473,475,553,154,155

Current U.S. Class:	600/544; 600/300; 600/545
Intern'l Class:	A61B 005/04
Field of Search:	128/731,732,630 600/544,545,300