Getting bored and actually having worse grades for these students is a real thing. Especially in classes that need effort and not intellect. On the other hand, forcing intellectual challenging activities (like solving math puzzles, playing chess or building robots) isn't fun for a lot of people that do not like to challenge their brain for fun.
Personally my school grades skyrocketed from slightly above average to the 95% percentile in the last two school years, which was at the same time as I was allowed to participate in a junior student program and was spending one day per week at campus instead of school. I wasn't doing more for school, based on attendance actually less, I was just more inclined to listen and interested in learning, while I was being challenged by my university lectures (basic algorithms, data structures, databases and data modeling).
I think you're right about the need to support the specially gifted kids and that generally means treating them differently as you suggest. However I think there is scope for altering the current system to make it more interesting for the rest of the kids and possibly stir up/inspire/awaken whatever more limited "giftedness" they might have. If the aim is solely to prepare kids for the the boredom and rigidity of ordinary work I'd say we're not getting value for money. This is particularly so in places high percentage of people graduating with Bachelors or even Masters degrees.
Many (most) parents don't have the resources to do that. If we don't make adequate provisions for the exceptionally gifted, we're squandering a lot of valuable talent. Nobody would tolerate a child with an IQ of 55 being made to sit in a mainstream classroom, because it's obvious that they wouldn't get anything vaguely resembling an education; we should be equally outraged about a child with an IQ of 145 in that mainstream classroom.
Further, if the teacher at school with their class of 30 did nothing but tutor the students, each student would get 10 minutes (in a 5-hour school day). You as a parent can beat that the 1st 11 minutes of your home-school day. That leaves you hours of the day for moving ahead of the classroom.
I agree with your general point that normal education could be made much more interesting as well. Although it would partially defeat the purpose of education to not prepare students for the boredom and rigid schedule of ordinary work early on.