I completely feel your pain. I hate the word lazy, loathe it so so so very much.
It is hard enough for us to think we are being lazy, feel guilt about taking it easy while we are clearly exhausted (with or with no reason). Our inner battles are hell already. Then the outside world calls us lazy....that is when things really really break inside of us.
To let you know that you are not the only one, here is a personal story - on my birthdays, my mom and sister know that I allow myself to do anything and everything I like which usually includes going to a movie + lots of food. I rarely go out to cafes, but on my birthday we always do. The rest of the day, I eat crisps, chocolates, sweets etc. Also because I have no friends, I celebrate my birthday with animals. We have lots of stray animals so I go out and feed them extra yummy food, spend time with them, cuddle with them etc. This has been my traditional for the last 10 years. But on my last birthday, I was so exhausted after the movie that I did not want to go out for lunch, or do take-away, so we went home and I went into bed, resting most of the day. I was in bed crying because I wanted to do fun things, spend time with animals, eat bad food, but I could not even get out of my bed. Then I hear my mom on the phone to my aunt, 'she is in bed, being lazy'. I was so so so heartbroken. How can they not see that this is not being lazy. I confronted her the next day, she just shrugged her shoulders and said 'I did not want to worry your aunt'. But this was a lie because they were not worried about me whatsoever that day. They did not even bring me a cup of tea, or made me any food. They did not even come in to ask me whether I was feeling ok.
I am heartbroken and honestly I am also very angry at them. But I also noticed how I am not the only one. My online buddies from a social anxiety forum share the same sentiments as well. Often the people we expect understanding from do not understand us whatsoever. They, in fact, do not know us at all. In my case, though I love love love my mom, I am also trying to accept the fact that she is simply not a caring mother. If I asked her now what my illness is, she would not be able to say fibromyalgia or depression or borderline personality disorder or social anxiety, even though I have told her a thousand times.... So yeah...in her eyes, I am just being lazy....or weak.