According to the department, more than five million borrowers are in default and four million more could be in the same position in a few months.