Graham Williams and Douglas Adams rewrote The Doctor's confrontation with The Black Guardian. In the original script, the Doctor simply decided that he did not trust the White Guardian with the Key, and consequently scattered the six segments again to prevent anyone from controlling it.
The Black Guardian originally didn't appear in the script.