8 Advanced parallelization - Deep Learning with JAX

Using easy-to-revise parallelism with xmap() · Compiling and automatically partitioning functions with pjit() · Using tensor sharding to achieve parallelization with XLA · Running code in multi-host configurations

JAX: accelerated machine learning research via composable function

Energies, Free Full-Text

Model Parallelism

Learn JAX in 2023: Part 2 - grad, jit, vmap, and pmap

Learn JAX in 2023: Part 2 - grad, jit, vmap, and pmap

The State of Machine Learning Frameworks in 2019

Why You Should (or Shouldn't) be Using Google's JAX in 2023

Machine Learning in Python: Main developments and technology

Grigory Sapunov on LinkedIn: Deep Learning with JAX