At our school if we get a good athlete introduced to the sport by 7th grade or sooner I feel there's a good chance that kids goes to semi state or state as long as they wrestle during season. Most of those kids have at least wrestled in the spring.
The kids we've had that have placed, or maybe not placed, but have been capable and right at that level made it a decision to wrestle during season, spring, summer, and make some fall wrestling workouts around their fall sport.
So, there's no right answer, but to be a placer or champ, you at least need to be wrestling 9 months out of the year is my opinion. Taking a season off to do a sport is never a bad thing, but I don't think you can completely forget about wrestling during those 3 months. During those 3 months I think you should still be able to do a light drill to stay current.