Seems I have forgotten to also add our SSH configuration to our monitoring systems :(
This fixes that.