I think you underestimate the psychological factor in weight training. If you're the type that goes in and hits the machines for 20 minutes, then you're right. But if you're serious about it, it is just as psychologically challenging as golf (I used to play a lot of golf also). If you don't focus, then you will not progress. Also, if you lose focus by looking a the cute girl that just walked in, you're going to end up with a couple hundred pounds on your neck. Just as with golf, your results are determined by what you put into it. If you go to the gym or course just to goof off, your score (or progress) will be poor. But if you focus and concentrate, you'll improve. Just like trading.
How long do you stay up per flight?? I usually go up within an hour of close and stay up till after sunset. There is no time change in AZ for the seasons. With no chute and a ceiling of 12K I am good for several pound loss per flight. I stay under 5 G's as well.