Checking the cluster status

1. Log into the primary FortiController CLI and enter the following command to view the system status of the primary FortiController.

   get system status
   Version: FortiController-5103B v5.0,build0024,140815
   Branch Point: 0024
   Serial-Number: FT513B3912000029
   BIOS version: 04000009
   System Part-Number: P08442-04
   Hostname: ch1-slot1
   Current HA mode: dual, master
   System time: Mon Sep 15 10:11:48 2014
   Daylight Time Saving: Yes
   Time Zone: (GMT-8:00)Pacific Time(US&Canada)

2. Enter the following command to view the load balance status of the primary FortiController and its workers. The command output shows the workers in slots 3, 4, and 5, and status information about each one.

   get load-balance status
     ELBC Master Blade: slot-3
     Confsync Master Blade: slot-3
     Blades:
        Working:  3 [  3 Active  0 Standby]
        Ready:    0 [  0 Active  0 Standby]
        Dead:     0 [  0 Active  0 Standby]
       Total:     3 [  3 Active  0 Standby]
        Slot  3: Status:Working   Function:Active 
          Link:      Base: Up          Fabric: Up  
          Heartbeat: Management: Good   Data: Good  
          Status Message:"Running"
        Slot  4: Status:Working   Function:Active
          Link:      Base: Up          Fabric: Up 
          Heartbeat: Management: Good   Data: Good  
          Status Message:"Running"
        Slot  5: Status:Working   Function:Active 
          Link:      Base: Up          Fabric: Up  
          Heartbeat: Management: Good   Data: Good  
          Status Message:"Running"
       Heartbeat: Management: Good  Data: Good
      Status Message:"Running"

3. Enter the following command from the primary FortiController to show the HA status of the FortiControllers.

   The command output shows a lot of information about the cluster including the host names and chassis and slot locations of the FortiControllers, the number of sessions each FortiController is processing (in this case 0 for each FortiController) the number of failed workers (0 of 3 for each FortiController), the number of FortiController front panel interfaces that are connected (2 for each FortiController) and so on. The final two lines of output also show that the B1 interfaces are connected (status=alive) and the B2 interfaces are not (status=dead). The cluster can still operate with a single heartbeat connection, but redundant heartbeat interfaces are recommended.

   diagnose system ha status
   mode: dual
   minimize chassis failover: 1
   ch1-slot1(FT513B3912000029), Master(priority=0), ip=169.254.128.201, uptime=1517.38, chassis=1(1)
       slot: 1
       sync: conf_sync=1, elbc_sync=1
       session: total=0,  session_sync=in sync
       state: worker_failure=0/3, intf_state=(port up:)=0
    force-state(0:none)    hbdevs: local_interface=        b1 best=yes
               local_interface=        b2 best=no
   
   ch2-slot1(FT513B3912000051), Slave(priority=2), ip=169.254.128.203, uptime=1490.50, chassis=2(1)
       slot: 1
       sync: conf_sync=1, elbc_sync=1, conn=3(connected)
       session: total=0,  session_sync=in sync
       state: worker_failure=0/3, intf_state=(port up:)=0
    force-state(0:none)    hbdevs: local_interface=        b1 last_hb_time=82192.16   status=alive
               local_interface=        b2 last_hb_time=    0.00   status=dead
   
   ch2-slot2(FT513B3913000168), Slave(priority=3), ip=169.254.128.204, uptime=1476.37, chassis=2(1)
       slot: 2
       sync: conf_sync=1, elbc_sync=1, conn=3(connected)
       session: total=0,  session_sync=in sync
       state: worker_failure=0/3, intf_state=(port up:)=0
    force-state(0:none)    hbdevs: local_interface=        b1 last_hb_time=82192.27   status=alive
               local_interface=        b2 last_hb_time=    0.00   status=dead
   
   ch1-slot2(FT513B3914000006), Slave(priority=1), ip=169.254.128.202, uptime=1504.58, chassis=1(1)
       slot: 2
       sync: conf_sync=1, elbc_sync=1, conn=3(connected)
       session: total=0,  session_sync=in sync
       state: worker_failure=0/3, intf_state=(port up:)=0
    force-state(0:none)    hbdevs: local_interface=        b1 last_hb_time=82192.16   status=alive
               local_interface=        b2 last_hb_time=    0.00   status=dead

4. Log into the chassis 1 slot 2 FortiController CLI and enter this command to view the status of this secondary FortiController.

   get system status
   Version: FortiController-5103B
   v5.0,build0024,140815
   Branch Point: 0024
   Serial-Number: FT513B3914000006
   BIOS version: 04000010
   System Part-Number: P08442-04
   Hostname: ch1-slot2
   Current HA mode: dual, backup
   System time: Mon Sep 15 10:14:53 2014
   Daylight Time Saving: Yes
   Time Zone: (GMT-8:00)Pacific Time(US&Canada)

5. Enter the following command to view the status of this secondary FortiController and its workers.

   get load-balance status
     ELBC Master Blade: slot-3
     Confsync Master Blade: slot-3
     Blades:
        Working:  3 [  3 Active  0 Standby]
        Ready:    0 [  0 Active  0 Standby]
        Dead:     0 [  0 Active  0 Standby]
       Total:     3 [  3 Active  0 Standby]
        Slot  3: Status:Working   Function:Active 
          Link:      Base: Down        Fabric: Up  
          Heartbeat: Management: Good   Data: Good  
          Status Message:"Running"
        Slot  4: Status:Working   Function:Active 
          Link:      Base: Down        Fabric: Up  
          Heartbeat: Management: Good   Data: Good  
          Status Message:"Running"
        Slot  5: Status:Working   Function:Active 
          Link:      Base: Down        Fabric: Up  
          Heartbeat: Management: Good   Data: Good  
          Status Message:"Running"

6. Enter the following command from the FortiController in chassis 1 slot 2 to show the HA status of the FortiControllers. Notice that the FortiController in chassis 1 slot 2 is shown first.

   diagnose system ha status
   mode: dual
   minimize chassis failover: 1
   ch1-slot2(FT513B3914000006), Slave(priority=1), ip=169.254.128.202, uptime=1647.44, chassis=1(1)
       slot: 2
       sync: conf_sync=1, elbc_sync=1
       session: total=0,  session_sync=in sync
       state: worker_failure=0/3, intf_state=(port up:)=0
    force-state(0:none)    hbdevs: local_interface=        b1 best=yes
               local_interface=        b2 best=no
   
   
   ch1-slot1(FT513B3912000029), Master(priority=0), ip=169.254.128.201, uptime=1660.17, chassis=1(1)
       slot: 1
       sync: conf_sync=1, elbc_sync=1, conn=3(connected)
       session: total=0,  session_sync=in sync
       state: worker_failure=0/3, intf_state=(port up:)=0
    force-state(0:none)    hbdevs: local_interface=        b1 last_hb_time=82305.93   status=alive
               local_interface=        b2 last_hb_time=    0.00   status=dead
   
   ch2-slot1(FT513B3912000051), Slave(priority=2), ip=169.254.128.203, uptime=1633.27, chassis=2(1)
       slot: 1
       sync: conf_sync=1, elbc_sync=1, conn=3(connected)
       session: total=0,  session_sync=in sync
       state: worker_failure=0/3, intf_state=(port up:)=0
    force-state(0:none)    hbdevs: local_interface=        b1 last_hb_time=82305.83   status=alive
               local_interface=        b2 last_hb_time=    0.00   status=dead
   
   ch2-slot2(FT513B3913000168), Slave(priority=3), ip=169.254.128.204, uptime=1619.12, chassis=2(1)
       slot: 2
       sync: conf_sync=1, elbc_sync=1, conn=3(connected)
       session: total=0,  session_sync=in sync
       state: worker_failure=0/3, intf_state=(port up:)=0
    force-state(0:none)    hbdevs: local_interface=        b1 last_hb_time=82305.93   status=alive
               local_interface=        b2 last_hb_time=    0.00   status=dead

7. Log into the chassis 2 slot 1 FortiController CLI and enter the following command to view the status of this secondary FortiController.

   get system status
   Version: FortiController-5103B v5.0,build0024,140815
   Branch Point: 0024
   Serial-Number: FT513B3912000051
   BIOS version: 04000009
   System Part-Number: P08442-04
   Hostname: ch2-slot1
   Current HA mode: dual, backup
   System time: Mon Sep 15 10:17:10 2014
   Daylight Time Saving: Yes
   Time Zone: (GMT-8:00)Pacific Time(US&Canada))

8. Enter the following command to view the status of this secondary FortiController and its workers.

   get load-balance status
     ELBC Master Blade: slot-3
     Confsync Master Blade: N/A
     Blades:
        Working:  3 [  3 Active  0 Standby]
        Ready:    0 [  0 Active  0 Standby]
        Dead:     0 [  0 Active  0 Standby]
       Total:     3 [  3 Active  0 Standby]
        Slot  3: Status:Working   Function:Active 
          Link:      Base: Up          Fabric: Up  
          Heartbeat: Management: Good   Data: Good  
          Status Message:"Running"
        Slot  4: Status:Working   Function:Active 
          Link:      Base: Up          Fabric: Up  
          Heartbeat: Management: Good   Data: Good  
          Status Message:"Running"
        Slot  5: Status:Working   Function:Active 
          Link:      Base: Up          Fabric: Up  
          Heartbeat: Management: Good   Data: Good  
          Status Message:"Running"

9. Enter the following command from the FortiController in chassis 2 slot 1 to show the HA status of the FortiControllers. Notice that the FortiController in chassis 2 slot 1 is shown first.

   diagnose system ha status
   mode: dual
   minimize chassis failover: 1
   ch2-slot1(FT513B3912000051), Slave(priority=2), ip=169.254.128.203, uptime=1785.61, chassis=2(1)
       slot: 1
       sync: conf_sync=1, elbc_sync=1
       session: total=0,  session_sync=in sync
       state: worker_failure=0/3, intf_state=(port up:)=0
    force-state(0:none)    hbdevs: local_interface=        b1 best=yes
               local_interface=        b2 best=no
   
   ch1-slot1(FT513B3912000029), Master(priority=0), ip=169.254.128.201, uptime=1812.38, chassis=1(1)
       slot: 1
       sync: conf_sync=1, elbc_sync=1, conn=3(connected)
       session: total=0,  session_sync=in sync
       state: worker_failure=0/3, intf_state=(port up:)=0
    force-state(0:none)    hbdevs: local_interface=        b1 last_hb_time=79145.95   status=alive
               local_interface=        b2 last_hb_time=    0.00   status=dead
   
   ch2-slot2(FT513B3913000168), Slave(priority=3), ip=169.254.128.204, uptime=1771.36, chassis=2(1)
       slot: 2
       sync: conf_sync=1, elbc_sync=1, conn=3(connected)
       session: total=0,  session_sync=in sync
       state: worker_failure=0/3, intf_state=(port up:)=0
    force-state(0:none)    hbdevs: local_interface=        b1 last_hb_time=79145.99   status=alive
               local_interface=        b2 last_hb_time=    0.00   status=dead
   
   ch1-slot2(FT513B3914000006), Slave(priority=1), ip=169.254.128.202, uptime=1799.56, chassis=1(1)
       slot: 2
       sync: conf_sync=1, elbc_sync=1, conn=3(connected)
       session: total=0,  session_sync=in sync
       state: worker_failure=0/3, intf_state=(port up:)=0
    force-state(0:none)    hbdevs: local_interface=        b1 last_hb_time=79145.86   status=alive
               local_interface=        b2 last_hb_time=    0.00   status=dead

10. Log into the chassis 2 slot 2 FortiController CLI and enter the following command to view the status of this secondary FortiController.

    get system status
    Version: FortiController-5103B v5.0,build0024,140815
    Branch Point: 0024
    Serial-Number: FT513B3913000168
    BIOS version: 04000010
    System Part-Number: P08442-04
    Hostname: ch2-slot2
    Current HA mode: dual, backup
    System time: Mon Sep 15 10:20:00 2014
    Daylight Time Saving: Yes
    Time Zone: (GMT-8:00)Pacific Time(US&Canada)

11. Enter this command to view the status of this secondary FortiController and its workers.

    get load-balance status
      ELBC Master Blade: slot-3
      Confsync Master Blade: N/A
      Blades:
         Working:  3 [  3 Active  0 Standby]
         Ready:    0 [  0 Active  0 Standby]
         Dead:     0 [  0 Active  0 Standby]
        Total:     3 [  3 Active  0 Standby]
         Slot  3: Status:Working   Function:Active 
           Link:      Base: Down        Fabric: Up  
           Heartbeat: Management: Good   Data: Good  
           Status Message:"Running"
         Slot  4: Status:Working   Function:Active 
           Link:      Base: Down        Fabric: Up  
           Heartbeat: Management: Good   Data: Good  
           Status Message:"Running"
         Slot  5: Status:Working   Function:Active 
           Link:      Base: Down        Fabric: Up  
           Heartbeat: Management: Good   Data: Good  
           Status Message:"Running"

12. Enter the following command from the FortiController in chassis 2 slot 2 to show the HA status of the FortiControllers. Notice that the FortiController in chassis 2 slot 2 is shown first.

    diagnose system ha status
    mode: dual
    minimize chassis failover: 1
    ch2-slot2(FT513B3913000168), Slave(priority=3), ip=169.254.128.204, uptime=1874.39, chassis=2(1)
        slot: 2
        sync: conf_sync=1, elbc_sync=1
        session: total=0,  session_sync=in sync
        state: worker_failure=0/3, intf_state=(port up:)=0
     force-state(0:none)    hbdevs: local_interface=        b1 best=yes
                local_interface=        b2 best=no
    
    ch1-slot1(FT513B3912000029), Master(priority=0), ip=169.254.128.201, uptime=1915.59, chassis=1(1)
        slot: 1
        sync: conf_sync=1, elbc_sync=1, conn=3(connected)
        session: total=0,  session_sync=in sync
        state: worker_failure=0/3, intf_state=(port up:)=0
     force-state(0:none)    hbdevs: local_interface=        b1 last_hb_time=78273.86   status=alive
                local_interface=        b2 last_hb_time=    0.00   status=dead
    
    ch2-slot1(FT513B3912000051), Slave(priority=2), ip=169.254.128.203, uptime=1888.78, chassis=2(1)
        slot: 1
        sync: conf_sync=1, elbc_sync=1, conn=3(connected)
        session: total=0,  session_sync=in sync
        state: worker_failure=0/3, intf_state=(port up:)=0
     force-state(0:none)    hbdevs: local_interface=        b1 last_hb_time=78273.85   status=alive
                local_interface=        b2 last_hb_time=    0.00   status=dead
    
    ch1-slot2(FT513B3914000006), Slave(priority=1), ip=169.254.128.202, uptime=1902.72, chassis=1(1)
        slot: 2
        sync: conf_sync=1, elbc_sync=1, conn=3(connected)
        session: total=0,  session_sync=in sync
        state: worker_failure=0/3, intf_state=(port up:)=0
     force-state(0:none)    hbdevs: local_interface=        b1 last_hb_time=78273.72   status=alive
                local_interface=        b2 last_hb_time=    0.00   status=dead