You could find a tumbling class for him, but don't call it gymnastics! Treat whatever you do for your two year old as an activity, not a sport. Just get him into a class, and if he likes it, keep sending him, and if not, try again in a few years. At this point it is just about fun.
Work out World Reviews