Can I use a plastic container to make ume syrup?

All the recipes seem to use glass containers, but there's nothing I can find specifically saying plastic containers shouldn't be used.