Social interactions have important consequences for individual fitness. Collective actions, however, are notoriously context-dependent and identifying how animals rapidly weigh the actions of others despite environmental uncertainty remains a fundamental challenge in biology. By exposing zebrafish (Danio rerio) to virtual fish silhouettes in a maze we isolated how the relative strength of a visual feature guides individual directional decisions and, subsequently, tunes social influence. We varied the relative speed and coherency with which a portion of silhouettes adopted a direction (leader/distractor ratio) and established that solitary zebrafish display a robust optomotor response to follow leader silhouettes that moved much faster than their distractors, regardless of stimulus coherency. Although recruitment time decreased as a power law of zebrafish group size, individual decision times retained a speed-accuracy trade-off, suggesting a benefit to smaller group sizes in collective decision-making. Directional accuracy improved regardless of group size in the presence of the faster moving leader silhouettes, but without these stimuli zebrafish directional decisions followed a democratic majority rule. Our results show that a large difference in movement speeds can guide directional decisions within groups, thereby providing individuals with a rapid and adaptive means of evaluating social information in the face of uncertainty.