Joining a second jamaat in the masjid

As you are aware, in Gulf countries, in the Masjid after the main congregation is over, there are many second and third small congregation/jamaat prayers going on in the masjid with 5 people or 6 people or 10 people ,and so forth. As far as I know, in Hanafi Fiqh, it is not considered okay to make second jamaat in the masjid. As a Hanafi, what should a tourist visiting a Gulf country or a resident of a Gulf country do if he misses the main congregation and he sees the second smaller congregations of a handful people going on? Should he join it or should he pray the fardh separately?