finufft: cast float to numpy for adjoint

Otherwise the interface crashes
16 jobs for backport_finufft_fix in 15 minutes and 10 seconds (queued for 3 seconds)