M

Modular•2y ago

geauxeric

Implement and benchmark Softmax algorithms in Mojo

I gave my first try at Mojo, and really love its design.

Did a weekend project on implementing online normalizer calculation of softmax, and made a vlog:
https://youtu.be/5JdP_YAH-iE?si=q7oJgu4ZZ87kv26J

YouTubeMachine Minds

Implement and benchmark Softmax algorithms in Mojo

This video about online normalizer calculation for softmax (https://arxiv.org/abs/1806.02867).
We use Mojo lang to implement two softmax algorithms: safe softmax and safe softmax with online normalizer calculation.

Along the way, we will learn about some intersting aspects of the Mojo lang, such as
- How to implement constructor with move sema...