Will audio books help?

Hello! I am a very beginner Japanese learner who is around the mid N4 level.

In addition to my other studying, do you think that audiobooks and passive listening will be helpful to me? I’d say I understand maybe 20% of anything I listen to without subtitles 🙁

Is it too early to dedicate to immersion listening?

Thanks all