Is natural silk controversial?

I’ve heard somewhere that Japanese people are not so fond of silk anymore cause they’re worried abt silkworms or something… does anyone know if this is true?