The largest component of our daily energy budget is resting metabolic rate. The direct effects of physical activity are relatively small compared to how many calories we expend just living and breathing. Now, during something like training for the US Army’s Special Ops or climbing a four-mile-high mountain, we may burn 4,000 calories a day.