It’s because stress is an immune system suppressant, like allergy medicine. When you’re mildly sick and stressed your body suppresses your immune response so you can keep doing what you need to survive, even though you’d be better off convalescing.

When you take a vacation suddenly you relax and your body says “oh now that you’re not stressed, you were actually sort of sick… But now we can turn all the symptoms back on”