training steps for gans

Issues in Training: Generator Diminished Gradient: Discriminator gets too successful that the generator gradient vanishes and learns nothing. As seen earlier the training of a GAN is typically alternating between Gradient Ascent on Discriminator and Gradient Descent on Generator. But optimizing GD on generator doesn’t work well. Consider the above Read more…