Yes, why on earth not?
I get annoyed when non disabled and people with full health are surprised when I mention a holiday!!
Not that we have a lot of holidays, we had 4 days earlier this year and none last year.
I feel that I am entitled to breaks (when health allows) as much as anyone.
I asked a neighbour why she was surprised (me thinking maybe this is about money) and she replied that she knew I was often laid up and struggle to go out. I explained that if I'm going to be laid up anyhow I may as well be laid up in a b and b.

A break's as good as a rest.
So it's not about money, it seems to be the idea that I actually need a holiday or can manage one.
Has anyone else come across this strange opinion?