ModularM
Modular14mo ago
11 replies
Dasor

MNIST slower on MAX than on Pytorch

Hi everyone, I'm getting started with all this promising stuff you guys are developing so I took a look at the tutorial to get started with MAX Graph: https://docs.modular.com/max/tutorials/get-started-with-max-graph/

I have been playing with the code it provides and I measured the time the python MNIST implementation takes to do inference which in my CPU is around 1.3 seconds and I did the same with the Mojo/MAX implemetation which takes around 5.5 seconds. My question is: shouldn't MAX be faster or at least the same as python? I'm not sure if this being a toy example does not really show the potential speedups you can get with MAX or If I'm getting something wrong in terms of the goal of MAX.

Thanks in advance!
Learn how to build a model graph with our Mojo API for inference with MAX Engine.
Get started with MAX Graph | Modular Docs
Was this page helpful?