A capacitor is a component that stores electric charge. The size of a capacitor is measured in farads, and in synth circuits it is usually in the microfarad to picofarad range.
Capacitors set the timing of oscillators, envelopes, and LFOs, determine the cutoff of filters, and smooth the power supply. Changing a capacitor is a common way to change how a module behaves.