Step by Step Screenshots upgrading 12.1.0.1 to 12.1.0.2

oracle@solaris:/u01/stage/database$ export ORACLE_HOME=/u01/app/oracle/product/12.1.0.2/dbhome_1

oracle@solaris:/u01/stage/database$ export PATH=/u01/app/oracle/product/12.1.0.2/dbhome_1/bin:/usr/bin:/usr/sbin:/usr/local/bin

oracle@solaris:/u01/stage/database$ which dbua

/u01/app/oracle/product/12.1.0.2/dbhome_1/bin/dbua

oracle@solaris:/u01/stage/database$ dbua

Step by Step screenshots for 12.1.0.2 Installation (12c Release 1 Patchset 1)

Oracle Database 12c Release 1 Patchset 1 (12.1.0.2) is being released only as Enterprise Edition at this time (Doc ID 1905806.1)

 

Noticed that standard edition is grey out, after further research, found below note:

Oracle Database 12c Release 1 Patchset 1 (12.1.0.2) is being released only as Enterprise Edition at this time. At some later date, we expect to release 12.1.0.2 Standard Edition and Standard Edition One. The Installer in the initial release will only offer the option of installing as Enterprise Edition, and licensed use will require an Enterprise Edition license.

How to move OCR to new diskgroup

[oracle@rac1 trace]$ crsctl check crs
CRS-4638: Oracle High Availability Services is online
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online

[oracle@rac1 trace]$ ocrcheck
Status of Oracle Cluster Registry is as follows :
         Version                  :          3
         Total space (kbytes)     :     262120
         Used space (kbytes)      :       2920
         Available space (kbytes) :     259200
         ID                       : 1238456451
         Device/File Name         :  +OCRVOTE
                                    Device/File integrity check succeeded

                                    Device/File not configured

                                    Device/File not configured

                                    Device/File not configured

                                    Device/File not configured

         Cluster registry integrity check succeeded

         Logical corruption check bypassed due to non-privileged user

[oracle@rac1 trace]$ ocrconfig -replace +OCRVOTE -replacement +OCR_VOTE
PROT-20: Insufficient permission to proceed. Require privileged user

[root@rac1 ~]# ocrconfig -replace +OCRVOTE -replacement +OCR_VOTE
PROT-28: Cannot delete or replace the only configured Oracle Cluster Registry location

[root@rac1 ~]# ocrconfig -add +OCR_VOTE

[root@rac1 ~]# ocrconfig -delete +OCRVOTE

[root@rac1 ~]# ocrcheck
Status of Oracle Cluster Registry is as follows :
         Version                  :          3
         Total space (kbytes)     :     262120
         Used space (kbytes)      :       2920
         Available space (kbytes) :     259200
         ID                       : 1238456451
         Device/File Name         : +OCR_VOTE
                                    Device/File integrity check succeeded

                                    Device/File not configured

                                    Device/File not configured

                                    Device/File not configured

                                    Device/File not configured

         Cluster registry integrity check succeeded

         Logical corruption check succeeded

Possible root causes of “crsctl replace votedisk failure” “CRS-4000”

 

Symptom:

[oracle@rac1 grid]$ crsctl replace votedisk +ocr_vote;
Failed to create voting files on disk group ocr_vote.
Change to configuration failed, but was successfully rolled back.
CRS-4000: Command Replace failed, or completed with errors.

Cause 1: compatible.asm  is default and less than 11.2.0.0.0

Sun Jul 27 01:56:20 2014
NOTE: Creating voting files in diskgroup OCR_VOTE
Sun Jul 27 01:56:20 2014
NOTE: Voting File refresh pending for group 3/0x6e9432c (OCR_VOTE)
NOTE: Attempting voting file creation in diskgroup OCR_VOTE
ERROR: Voting file allocation failed for group OCR_VOTE
Errors in file /u01/app/oracle/diag/asm/+asm/+ASM1/trace/+ASM1_ora_5279.trc:
ORA-15221: ASM operation requires compatible.asm of 11.2.0.0.0 or higher
NOTE: Attempting voting file refresh on diskgroup OCR_VOTE
NOTE: Refresh completed on diskgroup OCR_VOTE. No voting file found.

Cause 2: not enough failgroups to support required copy for redundancy

Sun Jul 27 02:06:52 2014
NOTE: Creating voting files in diskgroup OCR_VOTE
Sun Jul 27 02:06:52 2014
NOTE: Voting File refresh pending for group 3/0x71294335 (OCR_VOTE)
NOTE: Attempting voting file creation in diskgroup OCR_VOTE
NOTE: voting file allocation on grp 3 disk OCR_VOTE_0000
NOTE: voting file allocation on grp 3 disk OCR_VOTE_0001
ERROR: Voting file allocation failed for group OCR_VOTE
Errors in file /u01/app/oracle/diag/asm/+asm/+ASM1/trace/+ASM1_ora_6738.trc:
ORA-15274: Not enough failgroups (3) to create voting files
NOTE: Attempting voting file refresh on diskgroup OCR_VOTE
NOTE: Refresh completed on diskgroup OCR_VOTE. No voting file found.
NOTE: Voting file relocation is required in diskgroup OCR_VOTE
NOTE: Attempting voting file relocation on diskgroup OCR_VOTE
NOTE: voting file deletion on grp 3 disk OCR_VOTE_0000
NOTE: voting file deletion on grp 3 disk OCR_VOTE_0001
NOTE: No voting file found on diskgroup OCR_VOTE

Recovery from lost majority of voting disk (CRS-1705)

Error message from /u01/app/11.2.0/grid/log/rac1/alertrac1.log

2014-07-27 00:39:04.870:
[cssd(2446)]CRS-1637:Unable to locate configured voting file with ID a24090f0-28f84f0b-bff82d38-9fbfc140; details at (:CSSNM00020:) in /u01/app/11.2.0/grid/log/rac1/cssd/ocssd.log
2014-07-27 00:39:04.870:
[cssd(2446)]CRS-1637:Unable to locate configured voting file with ID a1ef7dd3-57064f85-bf6a11cb-f508ebb6; details at (:CSSNM00020:) in /u01/app/11.2.0/grid/log/rac1/cssd/ocssd.log
2014-07-27 00:39:04.870:
[cssd(2446)]CRS-1705:Found 1 configured voting files but 2 voting files are required, terminating to ensure data integrity; details at (:CSSNM00021:) in /u01/app/11.2.0/grid/log/rac1/cssd/ocssd.log
2014-07-27 00:39:04.870:
[cssd(2446)]CRS-1656:The CSS daemon is terminating due to a fatal error; Details at (:CSSSC00012:) in /u01/app/11.2.0/grid/log/rac1/cssd/ocssd.log
2014-07-27 00:39:04.910:
[cssd(2446)]CRS-1603:CSSD on node rac1 shutdown by user.

 

Error message from /u01/app/11.2.0/grid/log/rac1/cssd/ocssd.log

2014-07-27 00:39:12.734: [    CSSD][3380029184]clssnmvDiskVerify: discovered a potential voting file
2014-07-27 00:39:12.734: [   SKGFD][3380029184]Handle 0x7f5ab40967a0 from lib :UFS:: for disk :/dev/sde1:

2014-07-27 00:39:12.738: [    CSSD][3380029184]clssnmvDiskVerify: Successful discovery for disk /dev/sde1, UID 24fd0190-4c504f7c-bf4d8478-a37d15b9, Pending CIN 0:1406391959:
0, Committed CIN 0:1406391959:0
2014-07-27 00:39:12.738: [   SKGFD][3380029184]Lib :UFS:: closing handle 0x7f5ab40967a0 for disk :/dev/sde1:

2014-07-27 00:39:12.738: [    CSSD][3380029184]clssnmvDiskVerify: Successful discovery of 1 disks
2014-07-27 00:39:12.738: [    CSSD][3380029184]clssnmCompleteInitVFDiscovery: Completing initial voting file discovery
2014-07-27 00:39:12.738: [    CSSD][3380029184]clssnmCompleteVFDiscovery: Completing voting file discovery
2014-07-27 00:39:12.738: [    CSSD][3380029184]clssnmvDiskStateChange: state from discovered to pending disk /dev/sde1
2014-07-27 00:39:12.738: [    CSSD][3380029184]clssnmvDiskStateChange: state from pending to configured disk /dev/sde1
2014-07-27 00:39:12.738: [    CSSD][3380029184]clssnmvVerifyCommittedConfigVFs: Insufficient voting files found, found 1 of 3 configured, needed 2 voting files
2014-07-27 00:39:12.738: [    CSSD][3380029184](:CSSNM00020:)clssnmvVerifyCommittedConfigVFs: voting file 0, id a24090f0-28f84f0b-bff82d38-9fbfc140 not found
2014-07-27 00:39:12.738: [    CSSD][3380029184](:CSSNM00020:)clssnmvVerifyCommittedConfigVFs: voting file 2, id a1ef7dd3-57064f85-bf6a11cb-f508ebb6 not found
2014-07-27 00:39:12.738: [    CSSD][3380029184]ASSERT clssnm1.c 3336
2014-07-27 00:39:12.738: [    CSSD][3380029184](:CSSNM00021:)clssnmCompleteVFDiscovery: Found 1 voting files, but 2 are required.  Terminating due to insufficient configured
voting files
2014-07-27 00:39:12.738: [    CSSD][3380029184]###################################
2014-07-27 00:39:12.738: [    CSSD][3380029184]clssscExit: CSSD aborting from thread clssnmvDDiscThread
2014-07-27 00:39:12.738: [    CSSD][3380029184]###################################
2014-07-27 00:39:12.738: [    CSSD][3380029184](:CSSSC00012:)clssscExit: A fatal error occurred and the CSS daemon is terminating abnormally

 

How to fix it:

[root@rac1 ~]# crsctl stop crs -f
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac1'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac1'
CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'rac1'
CRS-2673: Attempting to stop 'ora.crf' on 'rac1'
CRS-2677: Stop of 'ora.cssdmonitor' on 'rac1' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'rac1' succeeded
CRS-2677: Stop of 'ora.crf' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'rac1'
CRS-2677: Stop of 'ora.gipcd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac1'
CRS-2677: Stop of 'ora.gpnpd' on 'rac1' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac1' has completed
CRS-4133: Oracle High Availability Services has been stopped.

[root@rac1 ~]# crsctl start crs -excl
CRS-4123: Oracle High Availability Services has been started.
CRS-2672: Attempting to start 'ora.mdnsd' on 'rac1'
CRS-2676: Start of 'ora.mdnsd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'rac1'
CRS-2676: Start of 'ora.gpnpd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac1'
CRS-2672: Attempting to start 'ora.gipcd' on 'rac1'
CRS-2676: Start of 'ora.cssdmonitor' on 'rac1' succeeded
CRS-2676: Start of 'ora.gipcd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'rac1'
CRS-2672: Attempting to start 'ora.diskmon' on 'rac1'
CRS-2676: Start of 'ora.diskmon' on 'rac1' succeeded
CRS-2676: Start of 'ora.cssd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'rac1'
CRS-2679: Attempting to clean 'ora.cluster_interconnect.haip' on 'rac1'
CRS-2681: Clean of 'ora.cluster_interconnect.haip' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'rac1'
CRS-2676: Start of 'ora.ctssd' on 'rac1' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'rac1'
CRS-2676: Start of 'ora.asm' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'rac1'
CRS-2676: Start of 'ora.crsd' on 'rac1' succeeded

[root@rac1 ~]# crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
1. OFFLINE  a24090f028f84f0bbff82d389fbfc140 () []
2. ONLINE   24fd01904c504f7cbf4d8478a37d15b9 (/dev/sde1) [OCR_VOTE]
3. OFFLINE  a1ef7dd357064f85bf6a11cbf508ebb6 () []
Located 3 voting disk(s).

[root@rac1 ~]#  kfod op=groups
--------------------------------------------------------------------------------
Group          Size          Free Redundancy Name
================================================================================
   1:       1023 Mb        659 Mb     EXTERN OCRVOTE
   2:      30719 Mb      28516 Mb     EXTERN DATA
  

[root@rac1 ~]# crsctl replace votedisk +OCRVOTE
Successful addition of voting disk 6d1dc365ec824f94bfa7fc18f8e3f6b0.
Successful deletion of voting disk a24090f028f84f0bbff82d389fbfc140.
Successful deletion of voting disk 24fd01904c504f7cbf4d8478a37d15b9.
Successful deletion of voting disk a1ef7dd357064f85bf6a11cbf508ebb6.
Successfully replaced voting disk group with +OCRVOTE.
CRS-4266: Voting file(s) successfully replaced
 

[root@rac1 ~]# crsctl stop crs -f
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac1'
CRS-2673: Attempting to stop 'ora.crsd' on 'rac1'
CRS-2677: Stop of 'ora.crsd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac1'
CRS-2673: Attempting to stop 'ora.ctssd' on 'rac1'
CRS-2673: Attempting to stop 'ora.asm' on 'rac1'
CRS-2677: Stop of 'ora.mdnsd' on 'rac1' succeeded
CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac1'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac1' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'rac1'
CRS-2677: Stop of 'ora.cssd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'rac1'
CRS-2677: Stop of 'ora.gipcd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac1'
CRS-2677: Stop of 'ora.gpnpd' on 'rac1' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac1' has completed
CRS-4133: Oracle High Availability Services has been stopped.

[root@rac1 ~]# crsctl start crs

CRS-4123: Oracle High Availability Services has been started.

[root@rac1 ~]# crsctl stat res -t
--------------------------------------------------------------------------------
NAME           TARGET  STATE        SERVER                   STATE_DETAILS
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.DATA.dg
               ONLINE  ONLINE       rac1
ora.LISTENER.lsnr
               ONLINE  ONLINE       rac1
ora.OCRVOTE.dg
               ONLINE  ONLINE       rac1
ora.OCR_VOTE.dg
               ONLINE  OFFLINE      rac1
ora.asm
               ONLINE  ONLINE       rac1                     Started
ora.gsd
               OFFLINE OFFLINE      rac1
ora.net1.network
               ONLINE  ONLINE       rac1
ora.ons
               ONLINE  ONLINE       rac1
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       rac1
ora.cvu
      1        ONLINE  ONLINE       rac1
ora.oc4j
      1        ONLINE  ONLINE       rac1
ora.orcl.db
      1        ONLINE  ONLINE       rac1                     Open
      2        ONLINE  OFFLINE
ora.rac1.vip
      1        ONLINE  ONLINE       rac1
ora.rac2.vip
      1        ONLINE  INTERMEDIATE rac1                     FAILED OVER
ora.scan1.vip
      1        ONLINE  ONLINE       rac1

Relocate voting disk to different diskgroup

[oracle@rac1 ~]$ crsctl replace -h
Usage:
  crsctl replace {discoverystring <ds_string>| votedisk [<+diskgroup>|<vdisk> ... <vdisk>]}
where
    ds_string   comma-separated voting file paths without spaces and enclosed in quotes
    diskgroup   diskgroup where the voting files will be located in ASM
    vdisk       location of the voting files outside of ASM separated by space

SQL> select * from v$version;

BANNER
--------------------------------------------------------------------------------
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
PL/SQL Release 11.2.0.4.0 - Production
CORE    11.2.0.4.0      Production
TNS for Linux: Version 11.2.0.4.0 - Production
NLSRTL Version 11.2.0.4.0 - Production

[oracle@rac1 ~]$ crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
1. ONLINE   5df885510a334fe3bfb7716a32bc0511 (/dev/sdb1) [OCRVOTE]
Located 1 voting disk(s).

SQL> create diskgroup ocr_vote normal redundancy
  2  failgroup site1 disk '/dev/sde1'
  3  failgroup site2 disk '/dev/sdf1'
  4  quorum failgroup site3 disk '/dev/sdg1'
  5  attribute 'compatible.asm' = '11.2.0.0.0';

Diskgroup created.

[oracle@rac1 ~]$ crsctl replace votedisk +ocr_vote
Successful addition of voting disk a24090f028f84f0bbff82d389fbfc140.
Successful addition of voting disk 24fd01904c504f7cbf4d8478a37d15b9.
Successful addition of voting disk a1ef7dd357064f85bf6a11cbf508ebb6.
Successful deletion of voting disk 5df885510a334fe3bfb7716a32bc0511.
Successfully replaced voting disk group with +ocr_vote.
CRS-4266: Voting file(s) successfully replaced

[oracle@rac1 ~]$ crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
1. ONLINE   a24090f028f84f0bbff82d389fbfc140 (/dev/sdg1) [OCR_VOTE]
2. ONLINE   24fd01904c504f7cbf4d8478a37d15b9 (/dev/sde1) [OCR_VOTE]
3. ONLINE   a1ef7dd357064f85bf6a11cbf508ebb6 (/dev/sdf1) [OCR_VOTE]
Located 3 voting disk(s).