He cares. When you tell him you are going to stop, stop. Not only for you, but also for him. He loves you.