I don’t understand why I hear ご as も depending on the word

When I hear natives say thing like すごく or 仕事, depending on the person speaking I hear ご as も, as in すもく or しもと. Due to context I and experience it doesn’t mess up my comprehension but it still bothers me that I keep hearing it as も. I think it’s only if the も is in the middle of the word. Things like ごはん or 日本語 I hear it as ご. Is there any way to “practice” hearing the ご properly? Anyone else have any experience with this?