test_refine.py: Cut down the number of tests

26 jobs for test_speed in 43 minutes and 32 seconds (queued for 3 seconds)