I am a racing fan but, swore off going to them long ago.
You would likely be OK but, remember you will be placing yourself in the middle of thousands of people; a significant percentage of which are in the process of (or have completed) embalming themselves. Some come to see a race, others to be "festive" and likely don't even remember anything about a "race".
I've not been to Texas Motor Speedway, so I can't speak from experience. I am a former LEO who had the pleasure of of working the riot team back in the haydays of the Indy 500 "snakepit". My views may be a bit jaundiced by these pleasant memories

. I do understand that the race crowds have become a bit more subued over the years and the NASCAR crowd is a bit more behaved.
So, my opinion is.....I don't know what to advise...other than, if you do go, take some hearing/ear protection (espescially for the little one). If memory serves, TMS is a mile and and a half oval and it will be plenty loud with 43 cars on the track. Good luck!