Too much of a good thing can be a bad thing. Leisure implies lazy activities that don't take much thought, so I would guess the brain would get soggy and useless after too much...
disadvantages of leisure activities?
If you are in sports to eat your leisure time then its not a disadvantage of leisure time.
The leisure time may cause drug abuse for an depressed person.