Question about leaving Japan for a few weeks on working holiday visa via smaller airports/ports

Do I need to get the paid re-entry permit from an immigration office beforehand, or do they have those cards at all airports and seaports?

I know variants of this have been asked before, but I'm not sure if the cards are only available at the major airports. Do they have the cards at smaller airports like Naha, or at the Fukuoka port if I went via ferry to Busan?

I just want to make sure I get all my ducks in a row before traveling!

EDIT: By "cards", I mean the ones you fill out to say you're returning later.