You could have a brightly colored object with no <collision> that is on a linear/prismatic actuator that retracts inside another object that hides it when off, then is set to protrude out and become visible when the valve is on.
You might also consider only putting visual indicators of this sort in rviz visualizations (a Marker could change color from red to green very easily in rviz) instead of gazebo.