I don't like to use plastic around mine... I would worry all the time that they could chew a sharp piece of it and hurt their crop, throat, etc or get it stuck somewhere inside and create an occlusion.
I do use bottle caps but only under supervision, I don't allow them to chew.I would possibly use bottles on the same basis but would depend on the type and if it had any glue residue