The term invisible men refers to the many men doing essential work to keep society functioning.
Most of us are only independent within the constraints of an industrialised society. In order to survive we rely on a large number of people we will never meet. Those people are overwhelmingly men. We call them the 'invisible men' because so many people apparently can't see them.