Quick answer
Remove the fitted garment the moment you remember. If you did it forgetfully or out of ignorance, no fidya is due. If you wore it knowingly, fidya is required: feed six poor people, fast three days, or sacrifice a sheep.
A man who knowingly wears fitted/tailored garments shaped to the body or limbs in Ihram must pay fidya. If forgetful or ignorant, remove it as soon as you remember — no expiation is due.
Remove the fitted garment the moment you remember. If you did it forgetfully or out of ignorance, no fidya is due. If you wore it knowingly, fidya is required: feed six poor people, fast three days, or sacrifice a sheep.
Men in Ihram wear wraps (izar + rida) and avoid fitted/tailored garments shaped to the body or limbs; stitching itself is not prohibited. Wearing a shirt, underwear, trousers or a head-cover violates a restriction.
Allah says: "There is no blame on you concerning that wherein you erred, but only in what your hearts deliberately intended." (Qur’an 33:5) Forgetfulness, ignorance and compulsion lift sin.
Where scholars differ, we note the position of each madhhab. Always consult a qualified local scholar for personal rulings.