Does the bleed screw need to be tightened after use?

Yes, the bleed screw must be tightened after you have finished using it.

The air vent allows air into the machine, if you do not close off the vent it allows moisture to enter into the machine as it cools down.