It’s not even that much of a sacrifice. There are some modern 600 mm primes that weigh less than a 70-200/2.8 does. Granted, they’re on the darker side, but if you have the light (supposedly you will during a hike), you don’t always need an f/4.