fix(controller): Move v4 client instantiation to reconcileDelete #1897

Job	Run time
build-container	7m 32s
e2e (scaling) / e2e-test	28m 22s
e2e (capx-feature-test) / e2e-test	1h 32m 27s
e2e (clusterclass) / e2e-test	30m 3s
e2e (clusterctl-upgrade) / e2e-test	24m 15s
	3h 2m 39s

Provide feedback