EPS is the original vector file: full quality, scalable, editable in Illustrator.
SVG is a vector file with a transparent background.
JPG has no transparency, so the background is white.
Background options apply only to transparent EPS vectors. If the EPS already has a solid colour, the background is hidden behind it and nothing changes.
This EPS has a solid colour background, so the background option makes no visible change.