Pillows retain odors due to the accumulation of body oils, night sweats, and mold or mildew. Pillows should be deep cleaned as soon as there is an odor, and especially if there is yellowing or stains.