Adaptation to relative and uniform motion

We compared the discriminability of motion direction with a relative motion stimulus after prolonged exposure to relative or uniform motion. Experiment 1 showed that the velocity threshold for the relative motion test after relative motion exposure was higher than that after uniform motion exposure, whereas no such difference was found when we tested with a uniform motion stimulus. Experiment 2 showed that prolonged exposure to relative motion decreased the discriminability of speed differences more than exposure to uniform motion. These results suggest that the visual system's pathway for relative motion signals is different from that for uniform motion signals.     

Differences in temporal frequency tuning between the two binocular mechanisms for seeing motion in depth

There are two types of binocular cues available for perception of motion in depth. One is the binocular disparity change in time and the other is the velocity difference between the left and the right retinal images (inter-ocular velocity differences). We measured the luminance contrast threshold for seeing motion in depth while isolating either of the cues at various temporal modulations of velocity in the stimulus. To isolate disparity cues, dynamic random-dot stereograms were used (the disparity condition) while binocularly uncorrelated random-dot kinematograms were used to isolate velocity cues (the velocity condition). Results showed that sensitivity peaked at a temporal frequency (approximately 1 cps) in the velocity condition while the peak in the disparity condition was at the lowest frequency (0.35 cps) or at least at a frequency lower than that in the velocity condition. This suggests that the visual system has different temporal frequency properties for the velocity and disparity cues for motion in depth.     

Elevation of Vernier thresholds during image motion depends on target configuration

Previously we showed that thresholds for abutting Vernier targets are unaffected by motion, as long as the targets are processed by the same spatial-frequency channel at each velocity and remain equally detectable [Invest. Ophthalmol. Visual Sci. (Suppl.) 37, S734 (1996)]. In this study we compared Vernier thresholds for stationary and moving abutting and nonabutting targets (gaps = 0, 18, and 36 arc min) for velocities of 0-16 deg/s. The Vernier targets were spatially filtered vertical lines (peak spatial frequency = 3.3 or 6.6 c/deg), presented at contrast levels of two, four, and eight times the detection threshold of each component line. Unlike the results for abutting targets, Vernier thresholds for nonabutting targets worsen with velocity as well as gap size. The results for abutting Vernier targets are consistent with the hypothesis that thresholds are mediated by oriented spatial filters, whose responses increase proportionally with the stimulus contrast. The velocity-dependent thresholds found for nonabutting Vernier targets can be explained on the basis of local-sign comparisons if the comparison process is assumed to include a small amount of temporal noise.     

Spatiotemporal interpolation and quality of apparent motion.

We investigate the conditions under which stimuli in apparent (sampled) motion are indistinguishable from those in smooth motion and compare this discrimination with the precision achieved by the visual system in interpolating apparent motion. In an initial experiment, observers were required to discriminate smooth from apparent motion, at variable step sizes, contrasts, velocities, and stimulus types (broadband line or bar stimuli and grating patches of different spatial frequency). Thresholds for discriminating smooth from sampled motion were approximately 40 arc min under optimal conditions, corresponding to the diameter of foveal photoreceptors. The tolerated step size between stations increased with velocity, more so for low- than for high-spatial-frequency stimuli. Tolerated step size decreased with presentation duration and with stimulus contrast. A separate experiment examined precision of interpolation. Vernier offsets were produced through temporal delays along the trajectory of an apparent motion, and thresholds for the discrimination of direction of offset were measured as a function of speed of motion and of distance between stations of apparent motion. Perfect interpolation was achieved for distances between stations of approximately 2 arc min. A model based on spatiotemporal filtering at an early stage of processing accounts well for the results of both types of experiments.     

Interaction of first- and second-order direction in motion-defined motion

Motion-defined motion can play a special role in the discussion of whether one or two separate systems are required to process first- and second-order information because, in contrast to other second-order stimuli, such as contrast-modulated contours, motion detection cannot be explained by a simple input nonlinearity but requires preprocessing by motion detectors. Furthermore, the perceptual quality that defines an object (motion on the object surface) is identical to that which is attributed to the object as an emergent feature (motion of the object), raising the question of how these two object properties are linked. The interaction of first- and second-order information in such stimuli has been analyzed previously in a direction-discrimination task, revealing some cooperativity. Because any comprehensive integration of these two types of motion information should be reflected in the most fundamental property of a moving object, i.e., the direction in which it moves, we now investigate how motion direction is estimated in motion-defined objects. Observers had to report the direction of moving objects that were defined by luminance contrast or in random-dot kinematograms by differences in the spatiotemporal properties between the object region and the random-noise background. When the dots were moving coherently with the object (Fourier motion), direction sensitivity resembled that for luminance-defined objects, but performance deteriorated when the dots in the object region were static (drift-balanced motion). When the dots on the object surface were moving diagonally relative to the object direction (theta motion), the general level of accuracy declined further, and the perceived direction was intermediate between the veridical object motion direction and the direction of dot motion, indicating that the first- and second-order velocity vectors are somehow pooled. The inability to separate first- and second-order directional information suggests that the two corresponding subsystems of motion processing are not producing independent percepts and provides clues for possible implementations of the two-layer motion-processing network.     

An ideal observer with channels versus feature-independent processing of spatial frequency and orientation in visual search performance

An influential assumption for the front end of models in vision, visual search, and object recognition is an analysis of independent features that correspond to basic image properties, such as motion, shape, and color. Empirically, one common test of independent features (a cue-summation study) measures performance with increasing available cues or features, with improving performance leading to conclusions of summation across independent features. In a study by Shimozaki et al. [J. Vision 2, 354-370 (2002)], both ideal and human observers showed no summation with large stimulus differences, in contrast to independent-feature models and suggesting that stimulus information (as assessed by an ideal observer) might affect cue-summation studies. Extending the previous summation study, observers performed a visual search of four Gabors differing in only orientation, only spatial frequency, or both orientation and spatial frequency, across a range of target-distractor differences. An ideal observer underpredicted human summation for small differences, whereas the independent-orientation and spatial-frequency feature models overpredicted human summation for large differences. An ideal observer with channels jointly tuned to spatial frequency and orientation predicted human performance across both small and large target-distractor differences.     

Dynamical use of different sources of information in heading judgments from retinal flow.

The optic flow arising in the eyes of an observer during self-motion is influenced by the occurrence of eye movements. The determination of heading during eye movements may be based on the pattern of retinal image motion (the retinal flow) or on an additional use of an extraretinal eye-movement signal. Previous research has presented support for either of these hypotheses, depending on the movement geometry and the layout of the visual scene. A special situation in which all previous studies unequivocally have agreed that an extra-retinal signal is required occurs when the visual scene consists of a single frontoparallel plane. In this situation eye movements shift the center of expansion on the retina to a location that does not correspond to the direction of self-movement. Without extraretinal input, human observers confuse the center of expansion with their heading and show a systematical heading estimation error. We reexamined and further investigated this situation. We presented retinal flow stimuli on a large projection screen in the absence of extra-retinal input and varied stimulus size, presentation duration, and orientation of the plane. In contrast to previous studies we found that in the case of a perpendicular approach toward the plane, heading judgments can be accurate. Accurate judgments were observed when the field of view was large (90 degrees x 90 degrees) and the stimulus duration was short (< or = 0.5 s). For a small field of view or a prolonged stimulus presentation, a systematic and previously described error appeared that is related to the radial structure of the flow field and the location of the center of expansion. An oblique approach toward the plane results in an ambiguous flow field with two mathematically possible solutions for heading. In this situation, when the stimulus duration was short, subjects reported a perceived heading midway between these two solutions. For longer flow sequences, subjects again chose the center of expansion. Our results suggest a dynamical change in the analysis or interpretation of retinal flow during heading perception.     

Role of eye movements in chromatic induction

There exist large interindividual differences in the amount of chromatic induction [Vis. Res. 49, 2261 (2009)]. One possible reason for these differences between subjects could be differences in subjects' eye movements. In experiment 1, subjects either had to look exclusively at the background or at the adjustable disk while they set the disk to a neutral gray as their eye position was being recorded. We found a significant difference in the amount of induction between the two viewing conditions. In a second experiment, subjects were freely looking at the display. We found no correlation between subjects' eye movements and the amount of induction. We conclude that eye movements only play a role under artificial (forced looking) viewing conditions and that eye movements do not seem to play a large role for chromatic induction under natural viewing conditions.     

First-order and second-order signals combine to improve perceptual accuracy

The question of whether first-order (luminance-defined) and second-order (contrast-defined) stimuli can be combined in order to improve perceptual accuracy was examined in the context of two suprathreshold discrimination experiments, one spatial and the other temporal. The stimuli were either gratings of one type of image alone or else the sum of two gratings of the same orientation, spatial frequency, temporal frequency, and phase, but of different types. For both spatial frequency discrimination (static gratings) and speed discrimination (1-c/deg drifting gratings), performance was markedly better for a combined grating stimulus than predicted on the basis of independent processing of the two types of stimulus. But this was true only for stimuli of low contrast. Facilitation of discrimination performance occurred only in the contrast range where discrimination performance is contrast dependent. At higher contrasts, where performance has reached an asymptote for each type of pattern alone, there was no facilitation. The results suggest that first- and second-order stimuli, although believed by most researchers to be detected separately, can subsequently be combined in order to improve perceptual accuracy in conditions of low visibility.     

Psychophysical estimation of speed discrimination. I. Methodology

Thresholds were assessed for a speed discrimination task with a pair of luminance-defined drifting gratings. The design and results of a series of experiments dealing in general with speed discrimination are described. Results show that for a speed discrimination task using drifting gratings, simultaneous presentation of the pair of gratings (spatially separated) was preferred over sequential presentation (temporally separated) in order to minimize the effects of eye movements and tracking. An interstimulus interval of at least 1000 ms was necessary to prevent motion aftereffects on subsequently viewed stimuli. For the two reference speeds tested of 2 and 8 deg/s using identical spatial frequency or randomizing spatial frequency for the pair of gratings did not affect speed discrimination thresholds. Implementing a staircase method of estimating thresholds was preferred over the method of constant stimuli or the method of limits. The results of these experiments were used to define the methodology for an investigation of aging and motion perception. These results will be of interest and use to psychophysicists designing and implementing speed discrimination paradigms.     

Pursuit eye movements to second-order motion targets

We studied smooth-pursuit eye movements elicited by first- and second-order motion stimuli. Stimuli were random dot fields whose contrast was modulated by a Gaussian window with a space constant of 0.5 degrees. For the first-order stimuli, the random dots simply moved across the screen at the same speed as the window; for the second-order stimuli the window moved across stationary or randomly flickering dots. Additional stimuli which combined first- and second-order motion cues were used to determine the degree and type of interaction found between the two types of motion stimuli. Measurements were made at slow (1 degrees/s) and moderate (6 degrees/s) target speeds. At a velocity of 1 degrees/s the initiation, transition, and steady-state phases of smooth pursuit in response to second-order motion targets are severely affected when compared with the smooth pursuit of first-order motion targets. At a velocity of 6 degrees/s there is a small but significant deficit in steady-state pursuit of second-order motion targets but not much effect on pursuit initiation.     

Spatial frequency masking in human vision: binocular interactions.

Binocular contrast interactions in human vision were studied psychophysically. Thresholds were obtained for sinewave grating stimulation of the right eye in the presence of simultaneous masking gratings presented to the right eye (monocular masking) or left eye (dichoptic masking). In the first experiment, thresholds were measured at 0.25, 1.0, 4.0, and 16.0 cycle per degree (cpd) as a function of the contrast of masking gratings of identical frequency and phase. Thresholds rose nonmonotonically with masking contrast. At medium and high contrast levels, dichoptic masking was more effective in elevating contrast thresholds than monocular masking, and approached Weber's Law behavior. In the second experiment, spatial frequency tuning functions were obtained for test gratings at five spatial frequencies, by measuring threshold elevation as a function of the spatial frequency of constant-contrast masking gratings. At 1.0, 4.0, and 16.0 cpd, the tuning functions peaked at the test frequencies. The dichoptic tuning functions had a bandwidth of about 1 octave between half-maximum points, narrower than +/- 1 octave bandwidths of the monocular tuning functions. At 0.125 and 0.25 cpd, the tuning functions were broader and exhibited a shift in peak masking to frequencies above the test frequencies.     

Orientation gradient detection exhibits variable coupling between first- and second-stage filtering mechanisms

We investigated sensitivity to orientation modulation using visual stimuli with bandpass filtered noise carriers. We characterized the relationship between the spatial parameters of the modulator and the carrier using a 2-AFC detection task. The relationship between these two parameters is potentially informative of the underlying coupling between first- and second-stage filtering mechanisms, which, in turn, may bear on the interrelationship between striate and extrastriate cortical processing. Our previous experiments on analogous motion stimuli found an optimum sensitivity when the ratio of the carrier and modulator spatial frequency parameters (r) was approximately ten. The current results do not exhibit an optimum sensitivity at a given value of the ratio r. Previous experiments involving second-order modulation sensitivity show an inconsistent range of estimates of optimum sensitivity at values of r between 5 and 50. Our results, using a complementary approach, confirm these discrepancies, demonstrating that the coupling between carrier and modulator frequency parameters depends on a number of stimulus-specific factors, such as contrast sensitivity, stimulus eccentricity, and absolute values of the carrier and modulator spatial frequency parameters. We show that these observations are true for a stimulus limited in eccentricity and that this orientation-modulated stimulus does not exhibit scale invariance. Such processing can not be modeled by a generic filter-rectify-filter model.     

Role of synchrony in contour binding: some transient doubts sustained

The temporal correlation hypothesis proposes that neurons signal mutual inclusion in complex features, such as extended contours, by phase-locking their firing [C. M. Gray and W. Singer, Proc. Nat]. Acad. Sci. USA 86, 1698 (1989)]. Although this hypothesis remains controversial, a number of recent psychophysical studies have suggested that temporal correlation among features can indeed promote perceptual grouping. In particular, subjects are better at detecting extended visual contours embedded within a field of distractor elements when a small delay is present between a cycling presentation of the contour and the background [Nature 394, 179 (1988)]. We have replicated this finding and examined three potentially confounding factors. First, we controlled local density and used more curved contours composed of bandpass elements to confirm that the effect was associated with contour integration and not with the operation of coarse-scale spatial filters. Second, we minimized the effects of saccadic eye movements (which could combine with the flicker of the asynchronous display to introduce motion cues at the contour location) both by using a fixation marker that was visible only when observers made a saccade (allowing them to reject these trials) and by retinally stabilizing the stimulus. We report that eye movements contribute to the effect. Third, we asked if either visible persistence or transients at the onset and the offset of the asynchronous stimuli might contribute to the effect. We report that the effect is largely abolished by the inclusion of prestimulus and poststimulus masks and is entirely abolished by ramping the contrast of the stimulus on and off. Neither ramping, masking, nor stabilization should specifically disrupt a contour-binding scheme based on temporal synchrony, and we conclude that it is the transient component at the onset and the offset of these stimuli that is responsible for the reported advantage for asynchronous presentation.     

Motion perception at scotopic light levels

Although the spatial and temporal properties of rod-mediated vision have been extensively characterized, little is known about scotopic motion perception. To provide such information, we determined thresholds for the detection and identification of the direction of motion of sinusoidal grating patches moving at speeds from 1 to 32 deg/s, under scotopic light levels, in four different types of observers: three normals, a rod monochromat (who lacks all cone vision), an S-cone monochromat (who lacks M- and L-cone vision), and four deuteranopes (who lack M-cone vision). The deuteranopes, whose motion perception does not differ from that of normals, allowed us to measure rod and L-cone thresholds under silent substitution conditions and to compare directly the perceived velocity for moving stimuli detected by either rod or cone vision at the same light level. We find, for rod as for cone vision, that the direction of motion can be reliably identified very near to detection threshold. In contrast, the perceived velocity of rod-mediated stimuli is reduced by approximately 20% relative to cone-mediated stimuli at temporal frequencies below 4 Hz and at all intensity levels investigated (0.92 to -1.12 log cd m(-2)). Most likely, the difference in velocity perception is distal in origin because rod and cone signals converge in the retina and further processing of their combined signals in the visual cortex is presumably identical. To account for the difference, we propose a model of velocity, in which the greater temporal averaging of rod signals in the retina leads to an attenuation of the motion signal in the detectors tuned to high velocities.     

Role of phase information and eye pursuit in the detection of moving objects in noise

As part of an ongoing study that uses objective image quality measures to optimize medical imaging x-ray fluoroscopy, we investigated two basic features of the detection of moving cylinders that mimic arteries, catheters, and guide wires. First, we compared detection with and without a phase cue consisting of a nearby alternating light and dark square. Depending on object size and velocity, phase cuing improved detection from 1% to 15% and gave an average of 6%, an effect much smaller than the 38% predicted from a Monte Carlo simulation of the ideal observer. Evidently, humans were limited in their ability to incorporate knowledge of the phase cue. Second, we evaluated the effect of eye pursuit of a fixation point that moved with the target. In general, motion at the highest velocity degraded (74%) and enhanced (68%) detection of small and large objects, respectively. With eye pursuit, both effects were substantially reduced in a manner consistent with a reduced retinal velocity. Our data compared favorably with a human observer model that included a spatiotemporal contrast sensitivity response and smooth-pursuit eye movements with a gain of 0.8. These mechanisms of perception are thought to be present in coronary artery x-ray fluoroscopy imaging, where phase information is available from the moving heart and where motion markers are available from x-ray opaque markers incorporated in thin catheters and guide wires.     

Adaptation of spatiotemporal mechanisms by increment and decrement stimuli

Sawtooth modulation has been used in the past to examine visual sensitivity to luminance increments and decrements. The threshold elevation caused by adaptation depends on the spatial profile of the stimulus field and the polarities of the adaptation and test stimuli. We hypothesized that the adaptation effects reflect a change in the sensitivity of the spatiotemporal channels that detect the stimuli. We used a 2-deg disk centered in a larger surround field. Five levels of contrast between the test field and surround were investigated: equiluminant, three intermediate levels, and dark. At each contrast, observers adapted for 5 s to 2-Hz sawtooth modulation (rapid-on or rapid-off). Immediately after adaptation, thresholds were measured for detection of a single cycle of either a rapid-on or a rapid-off waveform. Varying the contrast of the surround affected observers' sensitivity to the polarity of the sawtooth stimulus to the extent that the pattern of sensitivity with the equiluminant surround was the opposite of that with the dark surround. To examine temporal factors, we measured thresholds for slow (500-ms ramps) and fast (8.3-ms pulses) test stimuli. The adaptation effect was preserved with the ramp stimuli but not with the pulse stimuli. Blurring the edge between the test and surround fields in the equiluminant surround condition raised thresholds for all sawtooth test stimuli, suggesting that spatiotemporal channels sensitive to high spatial frequencies and low temporal frequencies facilitate detection in that condition. These findings suggest that adaptation to sawtooth modulation can differentially effect the sensitivity of ON and OFF pathways, but the relative desensitization of each pathway depends on an interaction with the adaptation state of spatiotemporal channels that are involved in detection.     

Visual sensitivity in the presence of a patterned background

The sensitivity of the visual system depends on ambient illumination: Sensitivity is reduced in the presence of a bright, uniform background. We asked how sensitivity is adjusted when the background is spatially detailed and therefore contains both luminance peaks and troughs in the neighborhood of a foreground object. A test flash was superimposed on a static sinusoidal grating. As the grating's spatial frequency increased, sensitivity for flash detection declined, regardless of whether the flash was superimposed on a peak or a trough of the grating. We studied the mechanisms underlying this loss of sensitivity by delivering the test stimulus through one eye and the background through the other. The conclusion is that three mechanisms are involved. Luminance adaptation and a masking process adjust sensitivity at low- and mid-range spatial frequencies, respectively. The third mechanism, a contrast gain control, is localized (it occurs at spatial frequencies approaching the limit for resolution) and fast (complete in half a second), and it results from early processing in the visual pathway (it is absent during dichoptic viewing). This local adjustment of sensitivity may help to protect the clarity of even the smallest details in the visual scene.     

Luminance spatial scale facilitates stereoscopic depth segmentation

Are differences in luminance spatial frequency between surfaces that overlap in depth useful for surface segmentation? We examined this question, using a novel stimulus termed a dual-surface disparity grating. The dual-surface grating was made from Gabor micropatterns and consisted of two superimposed sinusoidal disparity gratings of identical disparity-modulation spatial frequency and orientation but of opposite spatial phase. Corrugation amplitude thresholds for discrimination of the orientation of the dual-surface grating were obtained as a function of the difference in Gabor (luminance) spatial frequency between the two surfaces. When the Gabor micropatterns on the two surfaces were identical in spatial frequency, thresholds were very high and in some instances impossible to obtain. However, with as little as a 1-octave difference in spatial frequency between the surfaces, thresholds fell sharply to near-asymptotic levels. The fall in thresholds paralleled a change in the appearance of the stimulus from one of irregular depth to stereo transparency. The most parsimonious explanation for this finding is that the introduction of a between-surface luminance spatial-frequency difference reduces the number of spurious cross-surface binocular matches, thus helping to reveal the three-dimensional structure of the stimulus.     

Finger motion and contact by a second finger influence the tactile perception of electrovibration

Electrovibration holds great potential for creating vivid and realistic haptic sensations on touchscreens. Ideally, a designer should be able to control what users feel independent of the number of fingers they use, the movements they make, and how hard they press. We sought to understand the perception and physics of such interactions by determining the smallest 125 Hz electrovibration voltage that 15 participants could reliably feel when performing four different touch interactions at two normal forces. The results proved for the first time that both finger motion and contact by a second finger significantly affect what the user feels. At a given voltage, a single moving finger experiences much larger fluctuating electrovibration forces than a single stationary finger, making electrovibration much easier to feel during interactions involving finger movement. Indeed, only about 30% of participants could detect the stimulus without motion. Part of this difference comes from the fact that relative motion greatly increases the electrical impedance between a finger and the screen, as shown via detailed measurements from one individual. By contrast, threshold-level electrovibration did not significantly affect the coefficient of kinetic friction in any conditions. These findings help lay the groundwork for delivering consistent haptic feedback via electrovibration.