Shorts?

I'm visiting Nakijin castle, and have read that apparently it's frowned up to wear shorts to temples and religious sites.

Does Nakijin castle fall under that category?

Also, I'm a 28 year old man, so they won't be absurdly revealing shorts by any means.