Reintroduce dtype inference

12 jobs for fix_jacobian_test in 13 minutes and 44 seconds (queued for 2 seconds)