Winning tickets at times even outperform the original networks, which could have implications for our understanding of and the style of architectures and their initializations.