You are the one who goes to sleep with your thoughts. No one else does that for you, therefore we must do what we want to do, and what we are aligned with first.  We will always have people who have a problem with what you're doing, but if you feel good about your choices, you're good.