Trends in the Dollar Training Cost of Machine Learning Systems – Epoch

I combine training compute and GPU price-performance data to estimate the cost of compute in US dollars for the final training run of 124 machine learning systems published between 2009 and 2022, and find that the cost has grown by approximately 0.5 orders of magnitude per year.

The Economic Case for Generative AI and Foundation Models

Projecting Compute Trends in Machine Learning – Epoch

Moore No More – (Part IV – Computing Epochs) – —– Thinking Path ——

Computational Power and AI - AI Now Institute

A systematic evaluation of machine learning on serverless

AI Trends – Epoch

Llama 2 Scaling Laws : r/LocalLLaMA

The Best GPUs for Deep Learning in 2023 — An In-depth Analysis

Training cost function over 500 epochs

Jaime Sevilla on Trends in Machine Learning - Hear This Idea

Steve Blank Innovation and Entrepreneurship

Trends in the Dollar Training Cost of Machine Learning Systems – Epoch

Mathematics, Free Full-Text

JRFM, Free Full-Text