Are you only using "unsubscribe from all" for your emails? You can offer email recipients the option to unsubscribe from some types of emails. So you don't lose the contact forever.
Create email lists to segment your audiences and reduce your email churn rate.