LLT does not work with Linux NIC bonded interfaces during initial startup of symantec cluster

Here goes the Solution…

We can configure Linux NIC bonds as private links under LLT. LLT treats each bonded NIC as single link. So, we must configure these NICs that form the bond in such a way that the NICs are connected to the same switch or hub.

In order to properly configure a linux bond interface to use as an LLT link it MUST be defined as follows in the /etc/llttab: 

 # cat /etc/llttab

set-node 10.10.11.111

set-cluster 11

set-verbose 1

link eth2 eth-00:04:23:c5:d4:78 - ether - -

link eth3 eth-00:04:23:C5:D4:79 - ether - -

link-lowpri bond0 bond0 - ether - -

Now the Issue with installsfrac

Due to this reason it might cause problem during the installation of SFRAC (installsfrac). The installation will be interrupted because LLT fails to start and might give you error messages

    

If you want installsfrac to configure the SFCFS service groups automatically, then you need to manually fix the /etc/llttab in the middle of the installation process.  

Below are the steps:

a)   Use the following instructions so that during SFCFSRAC configuration LLT link can start up successfully and VCS engine (HA Daemon) and other related modules like ODM and Fencing can come up with no issues:

During SFCFSRAC configuration, CPI creates /etc/llttab and other configuration files for VCS. Don’t do anything here.

Veritas Storage Foundation Cluster File System for Oracle RAC 5.0MP3 Configuration Program

Veritas Volume Manager default disk group name configuration:

Many Veritas Volume Manager commands affect the contents or configuration of a disk group. Such commands require that the user specify a disk group.This is accomplished by using the -g option of a command or setting the VXVM_DEFAULTDG environment variable.  An alternative to these two methods for some commands is to configure the name of the default disk group of a system.

Do you want to set up a default disk group for each system? [y,n,q,?] (y) n

   Creating Veritas Storage Foundation Cluster File System for Oracle RAC configuration files .................................................. Done

   Copying configuration files to vcslxnode1 ..................................................................................................... Done

   Copying configuration files to vcslxnode2 ..................................................................................................... Done

When below line appears, edit /etc/llttab file on all the nodes BEFORE answering the following question

    Is the fully qualified hostname of system "vcslxnode1" = " vcslxnode1.domain.com"? [y,n,q,?] (y)

as shown below.

Caution: Don't take any action before editing /etc/llttab on all the nodes, otherwise the LLT links may not come up successfully.

 Veritas Storage Foundation Cluster File System for Oracle RAC 5.0MP3 Configuration Program

Verifying the install systems fully qualified hostnames.

    Querying fully qualified domain name of host "vcslxnode1" ....................................................................................... ok

Is the fully qualified hostname of system "vcslxnode1" = "vcslxnode1.domain.com"? [y,n,q,?] (y)

Howto edit /etc/llttab:

Edit /etc/llttab (from another terminal) to change all the eth- entries for bonded links with the corresponding bonded link name.

eg.

Replace entries like this:

link bond1 eth-a0:b1:c2:d3:e4:f5 - ether - -

link-lowpri bond0 eth- a0:b1:c2:d3:e4:f6 - ether - -

With this:

link bond1 bond1 - ether - -

link-lowpri bond0 bond0 - ether - -

and guess what.. you are done

All the Best ........ :)
Cheers!