Possible bug-causing typo? Or intended?
Is there a reason for the escape character after machine_rank
below?
# OTHER LAUNCHERS CAN BE USED HERE
export LAUNCHER="accelerate launch \
--config_file fsdp_config.yaml \
--main_process_ip $MASTER_ADDR \
--main_process_port $MASTER_PORT \
--machine_rank \$SLURM_PROCID \
--num_processes $NUM_PROCESSES \
--num_machines $NNODES \