Activity perturbation can learn MNIST-level problems reasonably fast, and can learn CIFAR-10 if you're very determined, but imagenet with millions of images is just too slow to scale activity perturbation learning to large networks.