Banks need to stop being "fair weather friends" and start working with dairy farmers says Damien O'Connor.