In this post, let us discuss the Veritas Cluster Installation procedure including I/O fencing.Now we are going to see installation of VXSFCFSHA (Veritas Storage Foundation Cluster Filesystem with High Availability) .
Version : VXSFHA 6.1
Cluster : 2 node
Unzip the cluster software and start the installation :
root@solaris:/tmp/dvd1-sol_sparc/sol11_sparc#
root@solaris:/tmp/dvd1-sol_sparc/sol11_sparc# ./installer
Symantec Storage Foundation and High Availability Solutions 6.1 Install Program
Copyright (c) 2013 Symantec Corporation. All rights reserved. Symantec, the Symantec Logo are trademarks or registered trademarks of Symantec Corporation or its affiliates in the U.S. and other countries. Other names may be trademarks of their respective owners.
The Licensed Software and Documentation are deemed to be "commercial computer software" and "commercial computer software documentation" as defined in FAR Sections 12.212 and DFARS Section 227.7202.
Logs are being written to /var/tmp/installer-201405031548hnG while installer is in progress.
Symantec Storage Foundation and High Availability Solutions 6.1 Install Program
Symantec Product Version Installed on solaris Licensed
=======================================================================
Symantec Licensing Utilities (VRTSvlic) are not installed due to which products and licenses are not discovered. Use the menu below to continue.
Task Menu:
P) Perform a Pre-Installation Check I) Install a Product
C) Configure an Installed Product G) Upgrade a Product
O) Perform a Post-Installation Check U) Uninstall a Product
L) License a Product S) Start a Product
D) View Product Descriptions X) Stop a Product
R) View Product Requirements ?) Help
Enter a Task: [P,I,C,G,O,U,L,S,D,X,R,?] i
Symantec Storage Foundation and High Availability Solutions 6.1 Install Program
1) Symantec Dynamic Multi-Pathing (DMP)
2) Symantec Cluster Server (VCS)
3) Symantec Storage Foundation (SF)
4) Symantec Storage Foundation and High Availability (SFHA)
5) Symantec Storage Foundation Cluster File System HA (SFCFSHA)
6) Symantec Storage Foundation for Oracle RAC (SF Oracle RAC)
b) Back to previous menu
Select a product to install: [1-6,b,q] 5
This Symantec product may contain open source and other third party materials that are subject to a separate license. See the applicable Third-Party Notice at http://www.symantec.com/about/profile/policies/eulas
Do you agree with the terms of the End User License Agreement as specified in the
storage_foundation_cluster_file_system_ha/EULA/en/EULA_SFHA_Ux_6.1.pdf file present on media? [y,n,q,?] y
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
1) Install minimal required packages - 661 MB required
2) Install recommended packages - 800 MB required
3) Install all packages - 829 MB required
4) Display packages to be installed for each option
Select the packages to be installed on all systems? [1-4,q,?] (2) 3
Enter the Solaris 11 Sparc system names separated by spaces: [q,?] solaris solaris2
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
Logs are being written to /var/tmp/installer-201405031548hnG while installer is in progress
Verifying systems: 100%
Estimated time remaining: (mm:ss) 0:00 8 of 8
Checking system communication ............................................................................... Done
Checking release compatibility .............................................................................. Done
Checking installed product .................................................................................. Done
Checking prerequisite patches and packages .................................................................. Done
Checking platform version ................................................................................... Done
Checking file system free space ............................................................................. Done
Checking product licensing .................................................................................. Done
Performing product prechecks ................................................................................ Done
System verification checks completed successfully
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
The following Symantec Storage Foundation Cluster File System HA packages will be installed on all systems:
Package Version Package Description
VRTSllt 6.1.0.0 Low Latency Transport
VRTSgab 6.1.0.0 Group Membership and Atomic Broadcast
VRTSvxfen 6.1.0.0 I/O Fencing
VRTSamf 6.1.0.0 Asynchronous Monitoring Framework
VRTSvcs 6.1.0.0 Cluster Server
VRTScps 6.1.0.0 Cluster Server - Coordination Point Server
VRTSvcsag 6.1.0.0 Cluster Server Bundled Agents
VRTSvcsea 6.1.0.0 Cluster Server Enterprise Agents
VRTSglm 6.1.0.0 Group Lock Manager
VRTScavf 6.1.0.0 Cluster Server Agents for Cluster File System
VRTSgms 6.1.0.0 Group Messaging Services
VRTSvbs 6.1.0.0 Virtual Business Service
VRTSvcswiz 6.1.0.0 Cluster Server Wizards
The following Symantec Storage Foundation Cluster File System HA packages will be installed on solaris:
Package Version Package Description
VRTSperl 5.16.1.6 Perl Redistribution
VRTSvlic 3.2.61.10 Licensing
VRTSsfcpi61 6.1.0.0 Storage Foundation Installer
VRTSspt 6.1.0.0 Software Support Tools
VRTSvxvm 6.1.0.0 Volume Manager Binaries
VRTSaslapm 6.1.0.0 Volume Manager - ASL/APM
VRTSsfmh 6.0.0.0 Storage Foundation Managed Host
VRTSvxfs 6.1.0.0 File System
VRTSfsadv 6.1.0.0 File System Advanced Solutions
VRTSfssdk 6.1.0.0 File System Software Developer Kit
VRTSdbed 6.1.0.0 Storage Foundation Databases
Press [Enter] to continue:
VRTSodm 6.1.0.0 Oracle Disk Manager
Press [Enter] to continue:
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
Logs are being written to /var/tmp/installer-201405031548hnG while installer is in progress
Installing SFCFSHA: 100%
Estimated time remaining: (mm:ss) 0:00 3 of 3
Performing SFCFSHA preinstall tasks ......................................................................... Done
Installing SFCFSHA packages ................................................................................. Done
Performing SFCFSHA postinstall tasks ........................................................................ Done
Symantec Storage Foundation Cluster File System HA Install completed successfully
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
To comply with the terms of Symantec's End User License Agreement, you have 60 days to either:
* Enter a valid license key matching the functionality in use on the systems
* Enable keyless licensing and manage the systems with a Management Server. For more details visit http://go.symantec.com/sfhakeyless. The product is fully functional during these 60 days.
1) Enter a valid license key
2) Enable keyless licensing and complete system licensing later
How would you like to license the systems? [1-2,q] (2) 1
Checking system licensing
SFCFSHA is not licensed on solaris
SFCFSHA is not licensed on solaris2
SFCFSHA is unlicensed on all systems
Enter a SFCFSHA license key: [b,q,?] AJDE-WVQC-NP2Z-FDTB-GTJZ-8APH-R680-404C-P
Storage Foundation for Cluster File System successfully registered on solaris
File System successfully registered on solaris2
Storage Foundation for Cluster File System successfully registered on solaris2
Do you wish to enter additional licenses? [y,n,q,b] (n) n
Would you like to configure SFCFSHA on solaris solaris2? [y,n,q] (n) y
I/O Fencing
It needs to be determined at this time if you plan to configure I/O Fencing in enabled or disabled mode, as well as help in determining the number of network interconnects (NICS) required on your systems. If you configure I/O Fencing in enabled mode, only a single NIC is required, though at least two are recommended.
A split brain can occur if servers within the cluster become unable to communicate for any number of reasons. If I/O Fencing is not enabled, you run the risk of data corruption should a split brain occur. Therefore, to avoid data corruption due to split brain in CFS environments, I/O Fencing has to be enabled.
If you do not enable I/O Fencing, you do so at your own risk
See the Administrator's Guide for more information on I/O Fencing
Do you want to configure I/O Fencing in enabled mode? [y,n,q,?] (y) y
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
To configure VCS, answer the set of questions on the next screen.
When [b] is presented after a question, 'b' may be entered to go back to the first question of the configuration set.
When [?] is presented after a question, '?' may be entered for help or additional information about the question.
Following each set of questions, the information you have entered will be presented for confirmation. To repeat the set of questions and correct any previous errors, enter 'n' at the confirmation prompt.
No configuration changes are made to the systems until all configuration questions are completed and confirmed.
Press [Enter] to continue:
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
To configure VCS for SFCFSHA the following information is required:
A unique cluster name
Two or more NICs per system used for heartbeat links
A unique cluster ID number between 0-65535
One or more heartbeat links are configured as private links
You can configure one heartbeat link as a low-priority link
All systems are being configured to create one cluster.
Enter the unique cluster name: [q,?] MYSOL
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
1) Configure the heartbeat links using LLT over Ethernet
2) Configure the heartbeat links using LLT over UDP
3) Automatically detect configuration for LLT over Ethernet
b) Back to previous menu
How would you like to configure heartbeat links? [1-3,b,q,?] (3) 1
Discovering NICs on solaris ............................................. Discovered net0 net1 net2 net3 net4
Enter the NIC for the first private heartbeat link on solaris: [b,q,?] (net0) net3
Would you like to configure a second private heartbeat link? [y,n,q,b,?] (n) y
Enter the NIC for the second private heartbeat link on solaris: [b,q,?] (net0) net4
Would you like to configure a third private heartbeat link? [y,n,q,b,?] (n)
Do you want to configure an additional low-priority heartbeat link? [y,n,q,b,?] (n) y
Enter the NIC for the low-priority heartbeat link on solaris: [b,q,?] (net2) net0
Are you using the same NICs for private heartbeat links on all systems? [y,n,q,b,?] (y)
Checking media speed for net3 on solaris .............................. Not Applicable (Virtual Device)
Checking media speed for net4 on solaris .............................. Not Applicable (Virtual Device)
Checking media speed for net3 on solaris2 ............................ Not Applicable (Virtual Device)
Checking media speed for net4 on solaris2 ............................ Not Applicable (Virtual Device)
Enter a unique cluster ID number between 0-65535: [b,q,?] (50864) 64325
The cluster cannot be configured if the cluster ID 64325 is in use by another cluster. Installer can perform a check to determine if the cluster ID is duplicate. The check will take less than a minute to complete.
Would you like to check if the cluster ID is in use by another cluster? [y,n,q] (y) y
Checking cluster ID ......................................................................................... Done
Duplicated cluster ID detection passed. The cluster ID 64325 can be used for the cluster.
Press [Enter] to continue:
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
Cluster information verification:
Cluster Name: MYSOL
Cluster ID Number: 64325
Private Heartbeat NICs for solaris:
link1=net0
Low-Priority Heartbeat NIC for solaris:
link-lowpri1=net1
Private Heartbeat NICs for solaris2:
link1=net4
Low-Priority Heartbeat NIC for solaris2:
link-lowpri1=net2
Is this information correct? [y,n,q,?] (y) y
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
The following data is required to configure the Virtual IP of the Cluster:
A public NIC used by each system in the cluster
A Virtual IP address and netmask
Do you want to configure the Virtual IP? [y,n,q,?] (n) n
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
Symantec Cluster Server can be configured in secure mode
Running VCS in Secure Mode guarantees that all inter-system communication is encrypted, and users are verified with security credentials.
When running VCS in Secure Mode, NIS and system usernames and passwords are used to verify identity. VCS usernames and passwords are no longer utilized when a cluster is running in Secure Mode.
Would you like to configure the VCS cluster in secure mode? [y,n,q,?] (n) n
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
The following information is required to add VCS users:
A user name
A password for the user
User privileges (Administrator, Operator, or Guest)
Do you wish to accept the default cluster credentials of 'admin/password'? [y,n,q] (y) y
Do you want to add another user to the cluster? [y,n,q] (n) n
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
VCS User verification:
User: admin Privilege: Administrators
Passwords are not displayed
Is this information correct? [y,n,q] (y) y
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
The following information is required to configure SMTP notification:
The domain-based hostname of the SMTP server
The email address of each SMTP recipient
A minimum severity level of messages to send to each recipient
Do you want to configure SMTP notification? [y,n,q,?] (n) n
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
The following information is required to configure SNMP notification:
System names of SNMP consoles to receive VCS trap messages
SNMP trap daemon port numbers for each console
A minimum severity level of messages to send to each console
Do you want to configure SNMP notification? [y,n,q,?] (n) n
All SFCFSHA processes that are currently running must be stopped
Do you want to stop SFCFSHA processes now? [y,n,q,?] (y) y
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
Logs are being written to /var/tmp/installer-201405031548hnG while installer is in progress
Stopping SFCFSHA: 100%
Estimated time remaining: (mm:ss) 0:00 10 of 10
Performing SFCFSHA prestop tasks ............................................................................ Done
Stopping vxgms .............................................................................................. Done
Stopping vxglm .............................................................................................. Done
Stopping vxcpserv ........................................................................................... Done
Stopping had ................................................................................................ Done
Stopping CmdServer .......................................................................................... Done
Stopping amf ................................................................................................ Done
Stopping vxfen .............................................................................................. Done
Stopping gab ................................................................................................ Done
Stopping llt ................................................................................................ Done
Symantec Storage Foundation Cluster File System HA Shutdown completed successfully
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
Logs are being written to /var/tmp/installer-201405031548hnG while installer is in progress
Starting SFCFSHA: 100%
Estimated time remaining: (mm:ss) 0:00 23 of 23
Starting vxio ............................................................................................... Done
Starting vxspec ............................................................................................. Done
Starting vxconfigd .......................................................................................... Done
Starting vxesd .............................................................................................. Done
Starting vxrelocd ........................................................................................... Done
Starting vxcached ........................................................................................... Done
Starting vxconfigbackupd .................................................................................... Done
Starting vxattachd .......................................................................................... Done
Starting vxportal ........................................................................................... Done
Starting fdd ................................................................................................ Done
Starting llt ................................................................................................ Done
Starting gab ................................................................................................ Done
Starting vxfen .............................................................................................. Done
Starting amf ................................................................................................ Done
Starting vxglm .............................................................................................. Done
Starting had ................................................................................................ Done
Starting CmdServer .......................................................................................... Done
Starting vxdbd .............................................................................................. Done
Starting vxgms .............................................................................................. Done
Starting odm ................................................................................................ Done
Performing SFCFSHA poststart tasks .......................................................................... Done
Symantec Storage Foundation Cluster File System HA Startup completed successfully
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
Fencing configuration
1) Configure Coordination Point client based fencing
2) Configure disk based fencing
Select the fencing mechanism to be configured in this Application Cluster: [1-2,q,?] 2
This I/O fencing configuration option requires a restart of VCS. Installer will stop VCS at a later stage in this run. Note that the service groups will be online only on the systems that are in the 'AutoStartList' after restarting VCS. Do you want to continue? [y,n,q,b,?] y
Do you have SCSI3 PR enabled disks? [y,n,q,b,?] (y)
Since you have selected to configure disk based fencing, you need to provide the existing disk group to be used as coordinator or create a new disk group for it.
Select one of the options below for fencing disk group:
1) Create a new disk group
2) Using an existing disk group
b) Back to previous menu
Enter the choice for a disk group: [1-2,b,q] 1
List of available disks to create a new disk group
A new disk group cannot be created as the number of available free VxVM CDS disks is 0 which is less than three. If there are disks available which are not under VxVM control, use the command vxdisksetup or use the installer to initialize them as VxVM disks.
Do you want to initialize more disks as VxVM disks? [y,n,q,b] (y)
List of disks which can be initialized as VxVM disks:
1) c3d0s2
2) c3d1s2
3) emc0_1b47
4) emc0_1b48
5) emc0_1b49
b) Back to previous menu
Enter the disk options, separated by spaces: [1-5,b,q] 3 4 5
Intializing disk emc0_1b47 on solaris ................................................................. Done
Intializing disk emc0_1b48 on solaris ................................................................. Done
Intializing disk emc0_1b49 on solaris ................................................................. Done
1) emc0_1b47
2) emc0_1b48
3) emc0_1b49
b) Back to previous menu
Select odd number of disks and at least three disks to form a disk group. Enter the disk options, separated by spaces: [1-3,b,q] 1 2 3
Enter the new disk group name: [b] TEST_QUORUM
Created disk group TEST_QUORUM
Before you continue with configuration, Symantec recommends that you run the vxfentsthdw utility (I/O fencing test hardware utility), in a separate console, to test whether the shared storage supports I/O fencing. You can access the utility at '/opt/VRTSvcs/vxfen/bin/vxfentsthdw'.
As per the 'vxfentsthdw' run you performed, do you want to continue with this disk group? [y,n,q] (y) May 5 16:05:05 QA10 sendmail[26588]: [ID 702911 mail.alert] daemon MTA: problem creating SMTP socket
May 5 16:05:55 QA10 last message repeated 10 times
May 5 16:05:55 QA10 sendmail[26588]: [ID 801593 mail.alert] NOQUEUE: SYSERR(root): opendaemonsocket: daemon MTA: server SMTP socket wedged: exiting
Using disk group TEST_QUORUM
Enter disk policy for the disk(s) (raw/dmp): [b,q,?] raw
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
I/O fencing configuration verification
Disk Group: TEST_QUORUM
Fencing disk policy: raw
Is this information correct? [y,n,q] (y)
Installer will stop VCS before applying fencing configuration. To make sure VCS shuts down successfully, unfreeze any frozen service group and unmount the mounted filesystems in the cluster.
Are you ready to stop VCS and apply fencing configuration on all nodes at this time? [y,n,q] (y)
Stopping VCS on solaris2 ............................................................................... Done
Stopping Fencing on solaris2 .......................................................................... Done
Stopping VCS on solaris ................................................................................. Done
Stopping Fencing on solaris ............................................................................ Done
Starting Fencing on solaris ............................................................................. Done
Starting Fencing on solaris2 ........................................................................... Done
Updating main.cf with fencing ........................................................................ Done
Starting VCS on solaris .................................................................................. Done
Starting VCS on solaris2 ................................................................................ Done
The Coordination Point Agent monitors the registrations on the coordination points.
Do you want to configure Coordination Point Agent on the client cluster? [y,n,q] (y)
Enter a non-existing name for the service group for Coordination Point Agent: [b] (vxfen)
Additionally the Coordination Point Agent can also monitor changes to the Coordinator Disk Group constitution such as a disk being accidently deleted from the Coordinator Disk Group. The frequency of this detailed monitoring can be tuned with the LevelTwoMonitorFreq attribute.
For example, if you set this attribute to 5, the agent will monitor the Coordinator Disk Group constitution every five monitor cycles. If LevelTwoMonitorFreq attribute is not set, the agent will not monitor any changes to the Coordinator Disk Group.
Do you want to set LevelTwoMonitorFreq? [y,n,q] (y)
Enter the value of the LevelTwoMonitorFreq attribute(0 to 65535): [b,q,?] (5) 50
Adding Coordination Point Agent via solaris ........................................................... Done
I/O Fencing configuration ......................................................................................... Done
I/O Fencing configuration completed successfully
The updates to VRTSaslapm package are released via the Symantec SORT web page: https://sort.symantec.com/asl. To make sure you have the latest version of VRTSaslapm
(for up to date ASLs and APMs), download and install the latest package from the SORT web page.
Checking online updates for Symantec Storage Foundation Cluster File System HA 6.1
A connection attempt to https://sort.symantec.com to check for product updates failed.
Visit https://sort.symantec.com to check for available product updates and information.
installer log files, summary file, and response file are saved at:
/opt/VRTS/install/logs/installer-201405051543ein
Would you like to view the summary file? [y,n,q] (n)
root@solaris:/tmp/dvd1-sol_sparc/sol11_sparc#
root@solaris:/tmp/dvd1-sol_sparc/sol11_sparc#
root@solaris:/tmp/dvd1-sol_sparc/sol11_sparc#
root@solaris:/tmp/dvd1-sol_sparc/sol11_sparc#
root@solaris:/tmp/dvd1-sol_sparc/sol11_sparc# pkg info VRTSvcs
Name: VRTSvcs
Summary: Veritas Cluster Server by Symantec
Description: The package contains Veritas Cluster Server by Symantec
Category: Applications/System Utilities
State: Installed
Publisher: Symantec
Version: 6.1.0.0
Build Release: 5.11
Branch: None
Packaging Date: October 21, 2013 08:38:13 PM
Size: 236.57 MB
FMRI: pkg://Symantec/VRTSvcs@6.1.0.0,5.11:20131021T203813Z
root@solaris:/tmp/dvd1-sol_sparc/sol11_sparc#
By this we completed the installation of Cluster Software and now it is time to rock n roll with Cluster configuration in Veritas Cluster Console (VCC), GUI.
Version : VXSFHA 6.1
Cluster : 2 node
Unzip the cluster software and start the installation :
root@solaris:/tmp/dvd1-sol_sparc/sol11_sparc#
root@solaris:/tmp/dvd1-sol_sparc/sol11_sparc# ./installer
Symantec Storage Foundation and High Availability Solutions 6.1 Install Program
Copyright (c) 2013 Symantec Corporation. All rights reserved. Symantec, the Symantec Logo are trademarks or registered trademarks of Symantec Corporation or its affiliates in the U.S. and other countries. Other names may be trademarks of their respective owners.
The Licensed Software and Documentation are deemed to be "commercial computer software" and "commercial computer software documentation" as defined in FAR Sections 12.212 and DFARS Section 227.7202.
Logs are being written to /var/tmp/installer-201405031548hnG while installer is in progress.
Symantec Storage Foundation and High Availability Solutions 6.1 Install Program
Symantec Product Version Installed on solaris Licensed
=======================================================================
Symantec Licensing Utilities (VRTSvlic) are not installed due to which products and licenses are not discovered. Use the menu below to continue.
Task Menu:
P) Perform a Pre-Installation Check I) Install a Product
C) Configure an Installed Product G) Upgrade a Product
O) Perform a Post-Installation Check U) Uninstall a Product
L) License a Product S) Start a Product
D) View Product Descriptions X) Stop a Product
R) View Product Requirements ?) Help
Enter a Task: [P,I,C,G,O,U,L,S,D,X,R,?] i
Symantec Storage Foundation and High Availability Solutions 6.1 Install Program
1) Symantec Dynamic Multi-Pathing (DMP)
2) Symantec Cluster Server (VCS)
3) Symantec Storage Foundation (SF)
4) Symantec Storage Foundation and High Availability (SFHA)
5) Symantec Storage Foundation Cluster File System HA (SFCFSHA)
6) Symantec Storage Foundation for Oracle RAC (SF Oracle RAC)
b) Back to previous menu
Select a product to install: [1-6,b,q] 5
This Symantec product may contain open source and other third party materials that are subject to a separate license. See the applicable Third-Party Notice at http://www.symantec.com/about/profile/policies/eulas
Do you agree with the terms of the End User License Agreement as specified in the
storage_foundation_cluster_file_system_ha/EULA/en/EULA_SFHA_Ux_6.1.pdf file present on media? [y,n,q,?] y
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
1) Install minimal required packages - 661 MB required
2) Install recommended packages - 800 MB required
3) Install all packages - 829 MB required
4) Display packages to be installed for each option
Select the packages to be installed on all systems? [1-4,q,?] (2) 3
Enter the Solaris 11 Sparc system names separated by spaces: [q,?] solaris solaris2
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
Logs are being written to /var/tmp/installer-201405031548hnG while installer is in progress
Verifying systems: 100%
Estimated time remaining: (mm:ss) 0:00 8 of 8
Checking system communication ............................................................................... Done
Checking release compatibility .............................................................................. Done
Checking installed product .................................................................................. Done
Checking prerequisite patches and packages .................................................................. Done
Checking platform version ................................................................................... Done
Checking file system free space ............................................................................. Done
Checking product licensing .................................................................................. Done
Performing product prechecks ................................................................................ Done
System verification checks completed successfully
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
The following Symantec Storage Foundation Cluster File System HA packages will be installed on all systems:
Package Version Package Description
VRTSllt 6.1.0.0 Low Latency Transport
VRTSgab 6.1.0.0 Group Membership and Atomic Broadcast
VRTSvxfen 6.1.0.0 I/O Fencing
VRTSamf 6.1.0.0 Asynchronous Monitoring Framework
VRTSvcs 6.1.0.0 Cluster Server
VRTScps 6.1.0.0 Cluster Server - Coordination Point Server
VRTSvcsag 6.1.0.0 Cluster Server Bundled Agents
VRTSvcsea 6.1.0.0 Cluster Server Enterprise Agents
VRTSglm 6.1.0.0 Group Lock Manager
VRTScavf 6.1.0.0 Cluster Server Agents for Cluster File System
VRTSgms 6.1.0.0 Group Messaging Services
VRTSvbs 6.1.0.0 Virtual Business Service
VRTSvcswiz 6.1.0.0 Cluster Server Wizards
The following Symantec Storage Foundation Cluster File System HA packages will be installed on solaris:
Package Version Package Description
VRTSperl 5.16.1.6 Perl Redistribution
VRTSvlic 3.2.61.10 Licensing
VRTSsfcpi61 6.1.0.0 Storage Foundation Installer
VRTSspt 6.1.0.0 Software Support Tools
VRTSvxvm 6.1.0.0 Volume Manager Binaries
VRTSaslapm 6.1.0.0 Volume Manager - ASL/APM
VRTSsfmh 6.0.0.0 Storage Foundation Managed Host
VRTSvxfs 6.1.0.0 File System
VRTSfsadv 6.1.0.0 File System Advanced Solutions
VRTSfssdk 6.1.0.0 File System Software Developer Kit
VRTSdbed 6.1.0.0 Storage Foundation Databases
Press [Enter] to continue:
VRTSodm 6.1.0.0 Oracle Disk Manager
Press [Enter] to continue:
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
Logs are being written to /var/tmp/installer-201405031548hnG while installer is in progress
Installing SFCFSHA: 100%
Estimated time remaining: (mm:ss) 0:00 3 of 3
Performing SFCFSHA preinstall tasks ......................................................................... Done
Installing SFCFSHA packages ................................................................................. Done
Performing SFCFSHA postinstall tasks ........................................................................ Done
Symantec Storage Foundation Cluster File System HA Install completed successfully
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
To comply with the terms of Symantec's End User License Agreement, you have 60 days to either:
* Enter a valid license key matching the functionality in use on the systems
* Enable keyless licensing and manage the systems with a Management Server. For more details visit http://go.symantec.com/sfhakeyless. The product is fully functional during these 60 days.
1) Enter a valid license key
2) Enable keyless licensing and complete system licensing later
How would you like to license the systems? [1-2,q] (2) 1
Checking system licensing
SFCFSHA is not licensed on solaris
SFCFSHA is not licensed on solaris2
SFCFSHA is unlicensed on all systems
Enter a SFCFSHA license key: [b,q,?] AJDE-WVQC-NP2Z-FDTB-GTJZ-8APH-R680-404C-P
Storage Foundation for Cluster File System successfully registered on solaris
File System successfully registered on solaris2
Storage Foundation for Cluster File System successfully registered on solaris2
Do you wish to enter additional licenses? [y,n,q,b] (n) n
Would you like to configure SFCFSHA on solaris solaris2? [y,n,q] (n) y
I/O Fencing
It needs to be determined at this time if you plan to configure I/O Fencing in enabled or disabled mode, as well as help in determining the number of network interconnects (NICS) required on your systems. If you configure I/O Fencing in enabled mode, only a single NIC is required, though at least two are recommended.
A split brain can occur if servers within the cluster become unable to communicate for any number of reasons. If I/O Fencing is not enabled, you run the risk of data corruption should a split brain occur. Therefore, to avoid data corruption due to split brain in CFS environments, I/O Fencing has to be enabled.
If you do not enable I/O Fencing, you do so at your own risk
See the Administrator's Guide for more information on I/O Fencing
Do you want to configure I/O Fencing in enabled mode? [y,n,q,?] (y) y
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
To configure VCS, answer the set of questions on the next screen.
When [b] is presented after a question, 'b' may be entered to go back to the first question of the configuration set.
When [?] is presented after a question, '?' may be entered for help or additional information about the question.
Following each set of questions, the information you have entered will be presented for confirmation. To repeat the set of questions and correct any previous errors, enter 'n' at the confirmation prompt.
No configuration changes are made to the systems until all configuration questions are completed and confirmed.
Press [Enter] to continue:
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
To configure VCS for SFCFSHA the following information is required:
A unique cluster name
Two or more NICs per system used for heartbeat links
A unique cluster ID number between 0-65535
One or more heartbeat links are configured as private links
You can configure one heartbeat link as a low-priority link
All systems are being configured to create one cluster.
Enter the unique cluster name: [q,?] MYSOL
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
1) Configure the heartbeat links using LLT over Ethernet
2) Configure the heartbeat links using LLT over UDP
3) Automatically detect configuration for LLT over Ethernet
b) Back to previous menu
How would you like to configure heartbeat links? [1-3,b,q,?] (3) 1
Discovering NICs on solaris ............................................. Discovered net0 net1 net2 net3 net4
Enter the NIC for the first private heartbeat link on solaris: [b,q,?] (net0) net3
Would you like to configure a second private heartbeat link? [y,n,q,b,?] (n) y
Enter the NIC for the second private heartbeat link on solaris: [b,q,?] (net0) net4
Would you like to configure a third private heartbeat link? [y,n,q,b,?] (n)
Do you want to configure an additional low-priority heartbeat link? [y,n,q,b,?] (n) y
Enter the NIC for the low-priority heartbeat link on solaris: [b,q,?] (net2) net0
Are you using the same NICs for private heartbeat links on all systems? [y,n,q,b,?] (y)
Checking media speed for net3 on solaris .............................. Not Applicable (Virtual Device)
Checking media speed for net4 on solaris .............................. Not Applicable (Virtual Device)
Checking media speed for net3 on solaris2 ............................ Not Applicable (Virtual Device)
Checking media speed for net4 on solaris2 ............................ Not Applicable (Virtual Device)
Enter a unique cluster ID number between 0-65535: [b,q,?] (50864) 64325
The cluster cannot be configured if the cluster ID 64325 is in use by another cluster. Installer can perform a check to determine if the cluster ID is duplicate. The check will take less than a minute to complete.
Would you like to check if the cluster ID is in use by another cluster? [y,n,q] (y) y
Checking cluster ID ......................................................................................... Done
Duplicated cluster ID detection passed. The cluster ID 64325 can be used for the cluster.
Press [Enter] to continue:
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
Cluster information verification:
Cluster Name: MYSOL
Cluster ID Number: 64325
Private Heartbeat NICs for solaris:
link1=net0
Low-Priority Heartbeat NIC for solaris:
link-lowpri1=net1
Private Heartbeat NICs for solaris2:
link1=net4
Low-Priority Heartbeat NIC for solaris2:
link-lowpri1=net2
Is this information correct? [y,n,q,?] (y) y
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
The following data is required to configure the Virtual IP of the Cluster:
A public NIC used by each system in the cluster
A Virtual IP address and netmask
Do you want to configure the Virtual IP? [y,n,q,?] (n) n
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
Symantec Cluster Server can be configured in secure mode
Running VCS in Secure Mode guarantees that all inter-system communication is encrypted, and users are verified with security credentials.
When running VCS in Secure Mode, NIS and system usernames and passwords are used to verify identity. VCS usernames and passwords are no longer utilized when a cluster is running in Secure Mode.
Would you like to configure the VCS cluster in secure mode? [y,n,q,?] (n) n
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
The following information is required to add VCS users:
A user name
A password for the user
User privileges (Administrator, Operator, or Guest)
Do you wish to accept the default cluster credentials of 'admin/password'? [y,n,q] (y) y
Do you want to add another user to the cluster? [y,n,q] (n) n
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
VCS User verification:
User: admin Privilege: Administrators
Passwords are not displayed
Is this information correct? [y,n,q] (y) y
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
The following information is required to configure SMTP notification:
The domain-based hostname of the SMTP server
The email address of each SMTP recipient
A minimum severity level of messages to send to each recipient
Do you want to configure SMTP notification? [y,n,q,?] (n) n
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
The following information is required to configure SNMP notification:
System names of SNMP consoles to receive VCS trap messages
SNMP trap daemon port numbers for each console
A minimum severity level of messages to send to each console
Do you want to configure SNMP notification? [y,n,q,?] (n) n
All SFCFSHA processes that are currently running must be stopped
Do you want to stop SFCFSHA processes now? [y,n,q,?] (y) y
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
Logs are being written to /var/tmp/installer-201405031548hnG while installer is in progress
Stopping SFCFSHA: 100%
Estimated time remaining: (mm:ss) 0:00 10 of 10
Performing SFCFSHA prestop tasks ............................................................................ Done
Stopping vxgms .............................................................................................. Done
Stopping vxglm .............................................................................................. Done
Stopping vxcpserv ........................................................................................... Done
Stopping had ................................................................................................ Done
Stopping CmdServer .......................................................................................... Done
Stopping amf ................................................................................................ Done
Stopping vxfen .............................................................................................. Done
Stopping gab ................................................................................................ Done
Stopping llt ................................................................................................ Done
Symantec Storage Foundation Cluster File System HA Shutdown completed successfully
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
Logs are being written to /var/tmp/installer-201405031548hnG while installer is in progress
Starting SFCFSHA: 100%
Estimated time remaining: (mm:ss) 0:00 23 of 23
Starting vxio ............................................................................................... Done
Starting vxspec ............................................................................................. Done
Starting vxconfigd .......................................................................................... Done
Starting vxesd .............................................................................................. Done
Starting vxrelocd ........................................................................................... Done
Starting vxcached ........................................................................................... Done
Starting vxconfigbackupd .................................................................................... Done
Starting vxattachd .......................................................................................... Done
Starting vxportal ........................................................................................... Done
Starting fdd ................................................................................................ Done
Starting llt ................................................................................................ Done
Starting gab ................................................................................................ Done
Starting vxfen .............................................................................................. Done
Starting amf ................................................................................................ Done
Starting vxglm .............................................................................................. Done
Starting had ................................................................................................ Done
Starting CmdServer .......................................................................................... Done
Starting vxdbd .............................................................................................. Done
Starting vxgms .............................................................................................. Done
Starting odm ................................................................................................ Done
Performing SFCFSHA poststart tasks .......................................................................... Done
Symantec Storage Foundation Cluster File System HA Startup completed successfully
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
Fencing configuration
1) Configure Coordination Point client based fencing
2) Configure disk based fencing
Select the fencing mechanism to be configured in this Application Cluster: [1-2,q,?] 2
This I/O fencing configuration option requires a restart of VCS. Installer will stop VCS at a later stage in this run. Note that the service groups will be online only on the systems that are in the 'AutoStartList' after restarting VCS. Do you want to continue? [y,n,q,b,?] y
Do you have SCSI3 PR enabled disks? [y,n,q,b,?] (y)
Since you have selected to configure disk based fencing, you need to provide the existing disk group to be used as coordinator or create a new disk group for it.
Select one of the options below for fencing disk group:
1) Create a new disk group
2) Using an existing disk group
b) Back to previous menu
Enter the choice for a disk group: [1-2,b,q] 1
List of available disks to create a new disk group
A new disk group cannot be created as the number of available free VxVM CDS disks is 0 which is less than three. If there are disks available which are not under VxVM control, use the command vxdisksetup or use the installer to initialize them as VxVM disks.
Do you want to initialize more disks as VxVM disks? [y,n,q,b] (y)
List of disks which can be initialized as VxVM disks:
1) c3d0s2
2) c3d1s2
3) emc0_1b47
4) emc0_1b48
5) emc0_1b49
b) Back to previous menu
Enter the disk options, separated by spaces: [1-5,b,q] 3 4 5
Intializing disk emc0_1b47 on solaris ................................................................. Done
Intializing disk emc0_1b48 on solaris ................................................................. Done
Intializing disk emc0_1b49 on solaris ................................................................. Done
1) emc0_1b47
2) emc0_1b48
3) emc0_1b49
b) Back to previous menu
Select odd number of disks and at least three disks to form a disk group. Enter the disk options, separated by spaces: [1-3,b,q] 1 2 3
Enter the new disk group name: [b] TEST_QUORUM
Created disk group TEST_QUORUM
Before you continue with configuration, Symantec recommends that you run the vxfentsthdw utility (I/O fencing test hardware utility), in a separate console, to test whether the shared storage supports I/O fencing. You can access the utility at '/opt/VRTSvcs/vxfen/bin/vxfentsthdw'.
As per the 'vxfentsthdw' run you performed, do you want to continue with this disk group? [y,n,q] (y) May 5 16:05:05 QA10 sendmail[26588]: [ID 702911 mail.alert] daemon MTA: problem creating SMTP socket
May 5 16:05:55 QA10 last message repeated 10 times
May 5 16:05:55 QA10 sendmail[26588]: [ID 801593 mail.alert] NOQUEUE: SYSERR(root): opendaemonsocket: daemon MTA: server SMTP socket wedged: exiting
Using disk group TEST_QUORUM
Enter disk policy for the disk(s) (raw/dmp): [b,q,?] raw
Symantec Storage Foundation Cluster File System HA 6.1 Install Program
solaris solaris2
I/O fencing configuration verification
Disk Group: TEST_QUORUM
Fencing disk policy: raw
Is this information correct? [y,n,q] (y)
Installer will stop VCS before applying fencing configuration. To make sure VCS shuts down successfully, unfreeze any frozen service group and unmount the mounted filesystems in the cluster.
Are you ready to stop VCS and apply fencing configuration on all nodes at this time? [y,n,q] (y)
Stopping VCS on solaris2 ............................................................................... Done
Stopping Fencing on solaris2 .......................................................................... Done
Stopping VCS on solaris ................................................................................. Done
Stopping Fencing on solaris ............................................................................ Done
Starting Fencing on solaris ............................................................................. Done
Starting Fencing on solaris2 ........................................................................... Done
Updating main.cf with fencing ........................................................................ Done
Starting VCS on solaris .................................................................................. Done
Starting VCS on solaris2 ................................................................................ Done
The Coordination Point Agent monitors the registrations on the coordination points.
Do you want to configure Coordination Point Agent on the client cluster? [y,n,q] (y)
Enter a non-existing name for the service group for Coordination Point Agent: [b] (vxfen)
Additionally the Coordination Point Agent can also monitor changes to the Coordinator Disk Group constitution such as a disk being accidently deleted from the Coordinator Disk Group. The frequency of this detailed monitoring can be tuned with the LevelTwoMonitorFreq attribute.
For example, if you set this attribute to 5, the agent will monitor the Coordinator Disk Group constitution every five monitor cycles. If LevelTwoMonitorFreq attribute is not set, the agent will not monitor any changes to the Coordinator Disk Group.
Do you want to set LevelTwoMonitorFreq? [y,n,q] (y)
Enter the value of the LevelTwoMonitorFreq attribute(0 to 65535): [b,q,?] (5) 50
Adding Coordination Point Agent via solaris ........................................................... Done
I/O Fencing configuration ......................................................................................... Done
I/O Fencing configuration completed successfully
The updates to VRTSaslapm package are released via the Symantec SORT web page: https://sort.symantec.com/asl. To make sure you have the latest version of VRTSaslapm
(for up to date ASLs and APMs), download and install the latest package from the SORT web page.
Checking online updates for Symantec Storage Foundation Cluster File System HA 6.1
A connection attempt to https://sort.symantec.com to check for product updates failed.
Visit https://sort.symantec.com to check for available product updates and information.
installer log files, summary file, and response file are saved at:
/opt/VRTS/install/logs/installer-201405051543ein
Would you like to view the summary file? [y,n,q] (n)
root@solaris:/tmp/dvd1-sol_sparc/sol11_sparc#
root@solaris:/tmp/dvd1-sol_sparc/sol11_sparc#
root@solaris:/tmp/dvd1-sol_sparc/sol11_sparc#
root@solaris:/tmp/dvd1-sol_sparc/sol11_sparc#
root@solaris:/tmp/dvd1-sol_sparc/sol11_sparc# pkg info VRTSvcs
Name: VRTSvcs
Summary: Veritas Cluster Server by Symantec
Description: The package contains Veritas Cluster Server by Symantec
Category: Applications/System Utilities
State: Installed
Publisher: Symantec
Version: 6.1.0.0
Build Release: 5.11
Branch: None
Packaging Date: October 21, 2013 08:38:13 PM
Size: 236.57 MB
FMRI: pkg://Symantec/VRTSvcs@6.1.0.0,5.11:20131021T203813Z
root@solaris:/tmp/dvd1-sol_sparc/sol11_sparc#
By this we completed the installation of Cluster Software and now it is time to rock n roll with Cluster configuration in Veritas Cluster Console (VCC), GUI.
###############################################################################
Hey I don't have scsi3 disks.I have only non-scsi3 disk please tell me procedure to add disks for io fencing....
ReplyDelete