Memory Calculator: Estimate LLM Memory

The tip links to the Hugging Face Space derek-thomas/transformer_calculator (https://huggingface.co/spaces/derek-thomas/transformer_calculator), embedded directly on the page via iframe (https://derek-thomas-transformer-calculator.hf.space). You just enter the model (or its parameters) and the tool estimates the memory required to run it, no install or manual math needed.

The derek-thomas Space breaks down memory for both inference and training (weights, activations, gradients and optimizer states), so you can use it both to check whether a model fits your GPU for serving and to plan how much VRAM you'll need for fine-tuning.