Do I pay the Nanny directly or does their pay go via the agency?

You pay the Nanny directly.