Yes, cold air can come in through the termination cap when the stove is off. A little is normal, but if you notice strong drafts, it usually points to a sealing issue at the appliance or wall penetration rather than the cap itself.