With Japanese Labor Day (Nov 23) being on a Saturday this year, which day do people actually celebrate this holiday?

Do people end up getting the 22nd off work instead? We will be in Japan over this period and have heard that the 23rd can be particularly crowded at tourist attractions due to the influx of local tourists, so we are trying to plan accordingly for the busy day. Any hints on how this will actually go down are appreciated!