What is claimed is:1. A radio communication device comprising:a communication processor that connects to one or more first radio terminals through radio communication using beam forming;an information sharer that acquires first connection information on the number of one or more second radio terminals connected to a second radio communication device different from the radio communication device;a switch determiner that determines, based on the first connection information, whether or not to switch a connection destination of the one or more first radio terminals from the radio communication device to the second radio communication device; anda connection switcher that, when the switch determiner determines to switch the connection destination, switches the connection destination of the one or more first radio terminals from the radio communication device to the second radio communication device.2. The radio communication device according to claim 1, whereinwhen the switch determiner determines to switch the connection destination, the connection switcher causes the second radio communication device to perform a beam forming protocol for the one or more first radio terminals and, after the beam forming protocol succeeds, switches the connection destination of the one or more first radio terminals from the radio communication device to the second radio communication device.3. The radio communication device according to claim 1, whereinthe information sharer acquires second connection information on the number of the one or more first radio terminals connected to the radio communication device, andthe switch determiner determines, based on the second connection information, whether or not to switch the connection destination of the one or more first radio terminals from the radio communication device to the second radio communication device.4. The radio communication device according to claim 3, whereinthe first connection information indicates communication quality between the second radio communication device and the one or more second radio terminals, andthe second connection information indicates communication quality between the radio communication device and the one or more first radio terminals.5. The radio communication device according to claim 3, whereinthe second connection information further indicates communication quality between the radio communication device and the one or more first radio terminals, andthe switch determiner determines to switch the connection destination of one of the first radio terminals that is lowest in the communication quality of the one or more first radio terminals.6. The radio communication device according to claim 3, whereinthe information sharer transmits the second connection information to the second radio communication device.7. The radio communication device according to claim 1, whereinthe information sharer acquires third connection information on the number of one or more third radio terminals connected to a third radio communication device,the switch determiner determines, based on the first connection information and the third connection information, whether or not to switch the connection destination of the one or more first radio terminals from the radio communication device to the second radio communication device or the third radio communication device, andwhen the switch determiner determines to switch the connection destination, the connection switcher switches the connection destination of the one or more first radio terminals from the radio communication device to the second radio communication device or the third radio communication device.8. The radio communication device according to claim 7, whereinwhen the switch determiner determines to switch the connection destination and the number of the one or more second radio terminals is smaller than the number of the one or more third radio terminals, the switch determiner determines to switch the connection destination from the radio communication device to the second radio communication device, andwhen the switch determiner determines to switch the connection destination and the number of the one or more third radio terminals is smaller than the number of the one or more second radio terminals, the switch determiner determines to switch the connection destination from the radio communication device to the third radio communication device.9. A communication control method of a radio communication device that connects to one or more first radio terminals through radio communication using beam forming, the method comprising:acquiring first connection information on the number of one or more second radio terminals connected to a second radio communication device different from the radio communication device;determining, based on the first connection information, whether or not to switch a connection destination of the one or more first radio terminals from the radio communication device to the second radio communication device; andwhen determining to switch the connection destination, switching the connection destination of the one or more first radio terminals from the radio communication device to the second radio communication device.