GTNs allow researchers to quickly evaluate the learning potential of a newly proposed candidate architecture that catalyzes the search for new and powerful neural network architectures.