Thursday, December 17, 2020

Steps To Shutdown(stop)/Startup(start) CRS, OHAS, ASM, RDBMS & ACFS Services in Cluster Environment.

 Steps To Shutdown(stop)/Startup(start) CRS, OHAS, ASM, RDBMS & ACFS Services in Cluster Environment.


How to startup the Cluster process :

On Node1 Check 

[root@rac1 ~]# ps -ef|grep d.bin

root     20574  2808  0 08:46 pts/0    00:00:00 grep --color=auto d.bin

[root@rac1 ~]#  /u002/app/oracle/product/12.1.0/grid/bin/crsctl status resource -t
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4000: Command Status failed, or completed with errors.

[root@rac1 ~]#  /u002/app/oracle/product/12.1.0/grid/bin/crsctl check cluster
CRS-4639: Could not contact Oracle High Availability Services
CRS-4000: Command Check failed, or completed with errors.

Repeat  the above same command on Node2.

Now to its time to startup the Cluster all process.

Start the Oracle High Availability Services daemon (OHASD) and the Clusterware service stack together on the local server only using ==>crsctl start crs

crsctl startup commands require the root privilege on Linux/Unix to run. The 'crsctl start crs' command.


The crsctl utility also provides similar commands to stop the Oracle Clusterware manually. It also requires root privilege on Linux/Unix to stop the clusterware manually.



[root@rac1 ~]#  /u002/app/oracle/product/12.1.0/grid/bin/crsctl start crs
CRS-4123: Oracle High Availability Services has been started.

[root@rac2 ~]# /u002/app/oracle/product/12.1.0/grid/bin/crsctl start crs
CRS-4123: Oracle High Availability Services has been started.
[root@rac2 ~]#


To Check the Cluster resources on both Node.

===> ps -ef|grep d.bin
===> Crsctl check crs
===>crsctl stat res -t -init ====> Great command during troubleshoot.
====>crsctl stat res -t
====>crsctl check cluster -all




[root@rac1 ~]# ps -ef|grep d.bin
root      1668     1  1 19:39 ?        00:00:18 /u002/app/oracle/product/12.1.0/grid/bin/ohasd.bin reboot
grid      2580     1  0 19:39 ?        00:00:03 /u002/app/oracle/product/12.1.0/grid/bin/oraagent.bin
grid      2591     1  0 19:39 ?        00:00:02 /u002/app/oracle/product/12.1.0/grid/bin/mdnsd.bin
grid      2596     1  0 19:39 ?        00:00:06 /u002/app/oracle/product/12.1.0/grid/bin/evmd.bin
grid      2613     1  0 19:39 ?        00:00:01 /u002/app/oracle/product/12.1.0/grid/bin/gpnpd.bin
grid      2625  2596  0 19:39 ?        00:00:01 /u002/app/oracle/product/12.1.0/grid/bin/evmlogger.bin -o /u002/app/oracle/product/12.1.0/grid/log/[HOSTNAME]/evmd/evmlogger.info -l /u002/app/oracle/product/12.1.0/grid/log/[HOSTNAME]/evmd/evmlogger.log
grid      2632     1  1 19:39 ?        00:00:18 /u002/app/oracle/product/12.1.0/grid/bin/gipcd.bin
root      2682     1  0 19:39 ?        00:00:02 /u002/app/oracle/product/12.1.0/grid/bin/cssdmonitor
root      2696     1  0 19:39 ?        00:00:01 /u002/app/oracle/product/12.1.0/grid/bin/cssdagent
grid      2720     1  1 19:39 ?        00:00:15 /u002/app/oracle/product/12.1.0/grid/bin/ocssd.bin
root      2952     1  0 19:40 ?        00:00:08 /u002/app/oracle/product/12.1.0/grid/bin/orarootagent.bin
root      2965     1  0 19:40 ?        00:00:04 /u002/app/oracle/product/12.1.0/grid/bin/octssd.bin reboot
root      3240     1  0 19:41 ?        00:00:07 /u002/app/oracle/product/12.1.0/grid/bin/osysmond.bin
root      3248     1  0 19:41 ?        00:00:10 /u002/app/oracle/product/12.1.0/grid/bin/crsd.bin reboot
root      3330     1  0 19:41 ?        00:00:06 /u002/app/oracle/product/12.1.0/grid/bin/orarootagent.bin
grid      3688     1  0 19:41 ?        00:00:05 /u002/app/oracle/product/12.1.0/grid/bin/oraagent.bin
grid      3713     1  0 19:41 ?        00:00:00 /u002/app/oracle/product/12.1.0/grid/bin/tnslsnr ASMNET1LSNR_ASM -no_crs_notify -inherit
grid      3891     1  0 19:41 ?        00:00:00 /u002/app/oracle/product/12.1.0/grid/bin/tnslsnr LISTENER -no_crs_notify -inherit
grid      3995     1  0 19:41 ?        00:00:00 /u002/app/oracle/product/12.1.0/grid/bin/tnslsnr LISTENER_SCAN1 -no_crs_notify -inherit
oracle   18731     1  0 19:54 ?        00:00:01 /u002/app/oracle/product/12.1.0/grid/bin/oraagent.bin
root     20351 17046  0 20:01 pts/0    00:00:00 grep --color=auto d.bin
[root@rac1 ~]#

======================================================================
[root@rac2 ~]# ps -ef|grep d.bin
root      1644     1  0 19:39 ?        00:00:12 /u002/app/oracle/product/12.1.0/grid/bin/ohasd.bin reboot
grid      2445     1  0 19:39 ?        00:00:05 /u002/app/oracle/product/12.1.0/grid/bin/oraagent.bin
grid      2457     1  0 19:39 ?        00:00:02 /u002/app/oracle/product/12.1.0/grid/bin/mdnsd.bin
grid      2461     1  0 19:39 ?        00:00:07 /u002/app/oracle/product/12.1.0/grid/bin/evmd.bin
grid      2479     1  0 19:39 ?        00:00:02 /u002/app/oracle/product/12.1.0/grid/bin/gpnpd.bin
grid      2491  2461  0 19:39 ?        00:00:02 /u002/app/oracle/product/12.1.0/grid/bin/evmlogger.bin -o /u002/app/oracle/product/12.1.0/grid/log/[HOSTNAME]/evmd/evmlogger.info -l /u002/app/oracle/product/12.1.0/grid/log/[HOSTNAME]/evmd/evmlogger.log
grid      2499     1  1 19:39 ?        00:00:19 /u002/app/oracle/product/12.1.0/grid/bin/gipcd.bin
root      2536     1  0 19:39 ?        00:00:02 /u002/app/oracle/product/12.1.0/grid/bin/cssdmonitor
root      2549     1  0 19:40 ?        00:00:02 /u002/app/oracle/product/12.1.0/grid/bin/cssdagent
grid      2572     1  1 19:40 ?        00:00:16 /u002/app/oracle/product/12.1.0/grid/bin/ocssd.bin
root      2801     1  0 19:40 ?        00:00:03 /u002/app/oracle/product/12.1.0/grid/bin/orarootagent.bin
root      2814     1  0 19:40 ?        00:00:04 /u002/app/oracle/product/12.1.0/grid/bin/octssd.bin reboot
root      3082     1  0 19:41 ?        00:00:08 /u002/app/oracle/product/12.1.0/grid/bin/osysmond.bin
root      3090     1  1 19:41 ?        00:00:15 /u002/app/oracle/product/12.1.0/grid/bin/crsd.bin reboot
root      3103     1  0 19:41 ?        00:00:07 /u002/app/oracle/product/12.1.0/grid/bin/ologgerd -M -d /u002/app/oracle/product/12.1.0/grid/crf/db/rac2
grid      3210     1  0 19:41 ?        00:00:08 /u002/app/oracle/product/12.1.0/grid/bin/oraagent.bin
root      3228     1  0 19:41 ?        00:00:08 /u002/app/oracle/product/12.1.0/grid/bin/orarootagent.bin
grid      3315     1  0 19:41 ?        00:00:02 /u002/app/oracle/product/12.1.0/grid/bin/scriptagent.bin
grid      3322     1  0 19:41 ?        00:00:00 /u002/app/oracle/product/12.1.0/grid/bin/tnslsnr MGMTLSNR -no_crs_notify -inherit
grid      3337     1  0 19:41 ?        00:00:00 /u002/app/oracle/product/12.1.0/grid/bin/tnslsnr ASMNET1LSNR_ASM -no_crs_notify -inherit
grid      3441     1  0 19:41 ?        00:00:00 /u002/app/oracle/product/12.1.0/grid/bin/tnslsnr LISTENER -no_crs_notify -inherit
grid      3464     1  0 19:41 ?        00:00:00 /u002/app/oracle/product/12.1.0/grid/bin/tnslsnr LISTENER_SCAN3 -no_crs_notify -inherit
grid      3475     1  0 19:41 ?        00:00:00 /u002/app/oracle/product/12.1.0/grid/bin/tnslsnr LISTENER_SCAN2 -no_crs_notify -inherit
oracle    3550     1  0 19:41 ?        00:00:03 /u002/app/oracle/product/12.1.0/grid/bin/oraagent.bin

========================================================================

Crsctl check crs ====>

[root@rac1 ~]#  /u002/app/oracle/product/12.1.0/grid/bin/crsctl check crs
CRS-4638: Oracle High Availability Services is online
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
[root@rac1 ~]#


Node2:- 
[root@rac2 ~]# /u002/app/oracle/product/12.1.0/grid/bin/crsctl check crs
CRS-4638: Oracle High Availability Services is online
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
[root@rac2 ~]#

========================================================================
crsctl stat res -t -init =====> Generally use during troubleshoot.


[root@rac1 ~]#  /u002/app/oracle/product/12.1.0/grid/bin/crsctl stat res -t -init
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
      1        ONLINE  ONLINE       rac1                     STABLE
ora.cluster_interconnect.haip
      1        ONLINE  ONLINE       rac1                     STABLE
ora.crf
      1        ONLINE  ONLINE       rac1                     STABLE
ora.crsd
      1        ONLINE  ONLINE       rac1                     STABLE
ora.cssd
      1        ONLINE  ONLINE       rac1                     STABLE
ora.cssdmonitor
      1        ONLINE  ONLINE       rac1                     STABLE
ora.ctssd
      1        ONLINE  ONLINE       rac1                     ACTIVE:600,STABLE
ora.diskmon
      1        OFFLINE OFFLINE                               STABLE
ora.evmd
      1        ONLINE  ONLINE       rac1                     STABLE
ora.gipcd
      1        ONLINE  ONLINE       rac1                     STABLE
ora.gpnpd
      1        ONLINE  ONLINE       rac1                     STABLE
ora.mdnsd
      1        ONLINE  ONLINE       rac1                     STABLE
ora.storage
      1        ONLINE  ONLINE       rac1                     STABLE
--------------------------------------------------------------------------------
[root@rac1 ~]#

On Node2:

[root@rac2 ~]# /u002/app/oracle/product/12.1.0/grid/bin/crsctl stat res -t -init
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
      1        ONLINE  ONLINE       rac2                     Started,STABLE
ora.cluster_interconnect.haip
      1        ONLINE  ONLINE       rac2                     STABLE
ora.crf
      1        ONLINE  ONLINE       rac2                     STABLE
ora.crsd
      1        ONLINE  ONLINE       rac2                     STABLE
ora.cssd
      1        ONLINE  ONLINE       rac2                     STABLE
ora.cssdmonitor
      1        ONLINE  ONLINE       rac2                     STABLE
ora.ctssd
      1        ONLINE  ONLINE       rac2                     ACTIVE:0,STABLE
ora.diskmon
      1        OFFLINE OFFLINE                               STABLE
ora.evmd
      1        ONLINE  ONLINE       rac2                     STABLE
ora.gipcd
      1        ONLINE  ONLINE       rac2                     STABLE
ora.gpnpd
      1        ONLINE  ONLINE       rac2                     STABLE
ora.mdnsd
      1        ONLINE  ONLINE       rac2                     STABLE
ora.storage
      1        ONLINE  ONLINE       rac2                     STABLE
=========================================================================

crsctl stat res -t ==========> 


[root@rac1 ~]#  /u002/app/oracle/product/12.1.0/grid/bin/crsctl stat res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr
               ONLINE  ONLINE       rac1                     STABLE
               ONLINE  ONLINE       rac2                     STABLE
ora.LISTENER.lsnr
               ONLINE  ONLINE       rac1                     STABLE
               ONLINE  ONLINE       rac2                     STABLE
ora.OCRVD.dg
               ONLINE  ONLINE       rac1                     STABLE
               ONLINE  ONLINE       rac2                     STABLE
ora.ORADATA.dg
               ONLINE  ONLINE       rac1                     STABLE
               ONLINE  ONLINE       rac2                     STABLE
ora.net1.network
               ONLINE  ONLINE       rac1                     STABLE
               ONLINE  ONLINE       rac2                     STABLE
ora.ons
               ONLINE  ONLINE       rac1                     STABLE
               ONLINE  ONLINE       rac2                     STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       rac1                     STABLE
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE       rac2                     STABLE
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE       rac2                     STABLE
ora.MGMTLSNR
      1        ONLINE  ONLINE       rac2                     169.254.96.86 172.16
                                                             8.56.20,STABLE
ora.asm
      1        ONLINE  ONLINE       rac1                     Started,STABLE
      2        ONLINE  ONLINE       rac2                     Started,STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.cvu
      1        ONLINE  ONLINE       rac2                     STABLE
ora.mgmtdb
      1        ONLINE  ONLINE       rac2                     Open,STABLE
ora.oc4j
      1        ONLINE  ONLINE       rac2                     STABLE
ora.rac1.vip
      1        ONLINE  ONLINE       rac1                     STABLE
ora.rac2.vip
      1        ONLINE  ONLINE       rac2                     STABLE
ora.racdb.db
      1        OFFLINE OFFLINE                               STABLE
      2        OFFLINE OFFLINE                               STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       rac1                     STABLE
ora.scan2.vip
      1        ONLINE  ONLINE       rac2                     STABLE
ora.scan3.vip
      1        ONLINE  ONLINE       rac2                     STABLE
ora.test.db
      1        ONLINE  ONLINE       rac1                     Open,STABLE
      2        ONLINE  ONLINE       rac2                     Open,STABLE
--------------------------------------------------------------------------------
[root@rac1 ~]#

On Node2:-

[root@rac2 ~]# /u002/app/oracle/product/12.1.0/grid/bin/crsctl stat res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr
               ONLINE  ONLINE       rac1                     STABLE
               ONLINE  ONLINE       rac2                     STABLE
ora.LISTENER.lsnr
               ONLINE  ONLINE       rac1                     STABLE
               ONLINE  ONLINE       rac2                     STABLE
ora.OCRVD.dg
               ONLINE  ONLINE       rac1                     STABLE
               ONLINE  ONLINE       rac2                     STABLE
ora.ORADATA.dg
               ONLINE  ONLINE       rac1                     STABLE
               ONLINE  ONLINE       rac2                     STABLE
ora.net1.network
               ONLINE  ONLINE       rac1                     STABLE
               ONLINE  ONLINE       rac2                     STABLE
ora.ons
               ONLINE  ONLINE       rac1                     STABLE
               ONLINE  ONLINE       rac2                     STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       rac1                     STABLE
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE       rac2                     STABLE
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE       rac2                     STABLE
ora.MGMTLSNR
      1        ONLINE  ONLINE       rac2                     169.254.96.86 172.16
                                                             8.56.20,STABLE
ora.asm
      1        ONLINE  ONLINE       rac1                     Started,STABLE
      2        ONLINE  ONLINE       rac2                     Started,STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.cvu
      1        ONLINE  ONLINE       rac2                     STABLE
ora.mgmtdb
      1        ONLINE  ONLINE       rac2                     Open,STABLE
ora.oc4j
      1        ONLINE  ONLINE       rac2                     STABLE
ora.rac1.vip
      1        ONLINE  ONLINE       rac1                     STABLE
ora.rac2.vip
      1        ONLINE  ONLINE       rac2                     STABLE
ora.racdb.db
      1        OFFLINE OFFLINE                               STABLE
      2        OFFLINE OFFLINE                               STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       rac1                     STABLE
ora.scan2.vip
      1        ONLINE  ONLINE       rac2                     STABLE
ora.scan3.vip
      1        ONLINE  ONLINE       rac2                     STABLE
ora.test.db
      1        ONLINE  ONLINE       rac1                     Open,STABLE
      2        ONLINE  ONLINE       rac2                     Open,STABLE
--------------------------------------------------------------------------------
[root@rac2 ~]#

=========================================================================

crsctl check cluster -all =====> Display resource status from all cluster Node.


[root@rac2 ~]# /u002/app/oracle/product/12.1.0/grid/bin/crsctl check cluster -all
**************************************************************
rac1:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
rac2:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
[root@rac2 ~]#


[oracle@rac1 ~]$ su - grid  -c "/u002/app/oracle/product/12.1.0/grid/bin/crs_stat -t -v"
Password:
Name           Type           R/RA   F/FT   Target    State     Host
----------------------------------------------------------------------
ora....SM.lsnr ora....er.type 0/5    0/     ONLINE    ONLINE    rac1
ora....ER.lsnr ora....er.type 0/5    0/     ONLINE    ONLINE    rac1
ora....N1.lsnr ora....er.type 0/5    0/0    ONLINE    ONLINE    rac1
ora....N2.lsnr ora....er.type 0/5    0/0    ONLINE    ONLINE    rac1
ora....N3.lsnr ora....er.type 0/5    0/0    ONLINE    ONLINE    rac1
ora.MGMTLSNR   ora....nr.type 0/0    0/0    ONLINE    ONLINE    rac1
ora.OCRVD.dg   ora....up.type 3/5    0/     ONLINE    ONLINE    rac1
ora.ORADATA.dg ora....up.type 3/5    0/     ONLINE    ONLINE    rac1
ora.asm        ora.asm.type   2/5    0/0    ONLINE    ONLINE    rac1
ora.cvu        ora.cvu.type   0/5    0/0    ONLINE    ONLINE    rac1
ora.mgmtdb     ora....db.type 0/2    0/1    ONLINE    ONLINE    rac1
ora....network ora....rk.type 0/5    0/     ONLINE    ONLINE    rac1
ora.oc4j       ora.oc4j.type  0/1    0/2    ONLINE    ONLINE    rac1
ora.ons        ora.ons.type   0/3    0/     ONLINE    ONLINE    rac1
ora....C1.lsnr application    0/5    0/0    ONLINE    ONLINE    rac1
ora.rac1.ons   application    0/3    0/0    ONLINE    ONLINE    rac1
ora.rac1.vip   ora....t1.type 0/0    0/0    ONLINE    ONLINE    rac1
ora.rac2.vip   ora....t1.type 0/0    0/0    ONLINE    ONLINE    rac1
ora.racdb.db   ora....se.type 0/2    0/1    OFFLINE   OFFLINE
ora.scan1.vip  ora....ip.type 0/0    0/0    ONLINE    ONLINE    rac1
ora.scan2.vip  ora....ip.type 0/0    0/0    ONLINE    ONLINE    rac1
ora.scan3.vip  ora....ip.type 0/0    0/0    ONLINE    ONLINE    rac1
ora.test.db    ora....se.type 1/2    0/1    ONLINE    ONLINE    rac1


To shut down ACFS filesystem in cluster.

Step 1] Dismount all ACFS filesystem running in the   cluster.

 srvctl stop filesystem -d volume_device_name [-n node_name] [-f]  

Where: -d  <volume_device_name>  :The Oracle ACFS volume device name.

 -n  <node_name>  : The name of a node If you do not specify this option, then the utility stops the volume resource on all active nodes in the cluster.

-f  : This option stops the file system and also stops any databases or other resources that depend on this file system. 

[root@asmgrid1 ~]# df -k | grep asm 
/dev/asm/volnil_rac1  14680064    159700  14520364   2% /u08/acfsnil_dg1
 
/dev/asm/volnil_rac2 35651584   4590104  31061480  13% /u09/acfsnil_dg2


 srvctl stop filesystem -d  /dev/asm/volnil_rac1  -f # 


 srvctl stop filesystem -d  /dev/asm/volnil_rac2   -f


After that please verify  with below  command.

df -k | grep asm.


To start up  ACFS filesystem in cluster.

 srvctl start filesystem -d volume_device_name [-n node_name]



How to stop the Cluster process :


crsctl stop crs =====> Login as root user and shut down the cluster stack process using this command.

Then verify using resource using this four below command.

===> ps -ef|grep d.bin
===> Crsctl check crs
===>crsctl stat res -t -init ====> Great command during troubleshoot.
====>crsctl stat res -t
====>crsctl check cluster -all


[root@rac1 ~]# /u002/app/oracle/product/12.1.0/grid/bin/crsctl stop crs

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac1'
CRS-2673: Attempting to stop 'ora.crsd' on 'rac1'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'rac1'
CRS-2673: Attempting to stop 'ora.mgmtdb' on 'rac1'
CRS-2673: Attempting to stop 'ora.test.db' on 'rac1'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN3.lsnr' on 'rac1'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'rac1'
CRS-2673: Attempting to stop 'ora.rac2.vip' on 'rac1'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN2.lsnr' on 'rac1'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'rac1'
CRS-2673: Attempting to stop 'ora.oc4j' on 'rac1'
CRS-2673: Attempting to stop 'ora.cvu' on 'rac1'
CRS-2677: Stop of 'ora.cvu' on 'rac1' succeeded
CRS-2677: Stop of 'ora.LISTENER_SCAN3.lsnr' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.scan3.vip' on 'rac1'
CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.scan1.vip' on 'rac1'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'rac1' succeeded
CRS-2677: Stop of 'ora.LISTENER_SCAN2.lsnr' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.scan2.vip' on 'rac1'
CRS-2677: Stop of 'ora.rac2.vip' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.rac1.vip' on 'rac1'
CRS-2677: Stop of 'ora.scan2.vip' on 'rac1' succeeded
CRS-2677: Stop of 'ora.test.db' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.ORADATA.dg' on 'rac1'
CRS-2677: Stop of 'ora.ORADATA.dg' on 'rac1' succeeded
CRS-2677: Stop of 'ora.scan1.vip' on 'rac1' succeeded
CRS-2677: Stop of 'ora.mgmtdb' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.OCRVD.dg' on 'rac1'
CRS-2673: Attempting to stop 'ora.MGMTLSNR' on 'rac1'
CRS-2677: Stop of 'ora.OCRVD.dg' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'rac1'
CRS-2677: Stop of 'ora.scan3.vip' on 'rac1' succeeded
CRS-2677: Stop of 'ora.MGMTLSNR' on 'rac1' succeeded
CRS-2677: Stop of 'ora.oc4j' on 'rac1' succeeded
CRS-2677: Stop of 'ora.rac1.vip' on 'rac1' succeeded
CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.ASMNET1LSNR_ASM.lsnr' on 'rac1'
CRS-2677: Stop of 'ora.ASMNET1LSNR_ASM.lsnr' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'rac1'
CRS-2677: Stop of 'ora.ons' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'rac1'
CRS-2677: Stop of 'ora.net1.network' on 'rac1' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac1' has completed
CRS-2677: Stop of 'ora.crsd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.storage' on 'rac1'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac1'
CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac1'
CRS-2677: Stop of 'ora.storage' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.crf' on 'rac1'
CRS-2673: Attempting to stop 'ora.ctssd' on 'rac1'
CRS-2673: Attempting to stop 'ora.evmd' on 'rac1'
CRS-2673: Attempting to stop 'ora.asm' on 'rac1'
CRS-2677: Stop of 'ora.gpnpd' on 'rac1' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'rac1' succeeded
CRS-2677: Stop of 'ora.crf' on 'rac1' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'rac1' succeeded
CRS-2677: Stop of 'ora.evmd' on 'rac1' succeeded
CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac1'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'rac1'
CRS-2677: Stop of 'ora.cssd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'rac1'
CRS-2677: Stop of 'ora.gipcd' on 'rac1' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac1' has completed
CRS-4133: Oracle High Availability Services has been stopped.

[root@rac1 ~]# ps -ef|grep d.bin
root      7074  6010  0 09:52 pts/0    00:00:00 grep --color=auto d.bin

[root@rac1 ~]# /u002/app/oracle/product/12.1.0/grid/bin/crsctl check cluster -all
CRS-4639: Could not contact Oracle High Availability Services
CRS-4000: Command Check failed, or completed with errors.
[root@rac1 ~]#

[root@rac1 ~]# /u002/app/oracle/product/12.1.0/grid/bin/crsctl check crs
CRS-4639: Could not contact Oracle High Availability Services
[root@rac1 ~]#

[root@rac1 ~]# /u002/app/oracle/product/12.1.0/grid/bin/crsctl stat res -t
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4000: Command Status failed, or completed with errors.
[root@rac1 ~]#


Node Node2:-

[oracle@rac2 ~]$ ps -ef|grep d.bin
oracle   14817 24655  0 09:57 pts/0    00:00:00 grep --color=auto d.bin

[root@rac2 ~]# /u002/app/oracle/product/12.1.0/grid/bin/crsctl check cluster -all
CRS-4639: Could not contact Oracle High Availability Services
CRS-4000: Command Check failed, or completed with errors.
[root@rac2 ~]#


[root@rac2 ~]# /u002/app/oracle/product/12.1.0/grid/bin/crsctl check crs
CRS-4639: Could not contact Oracle High Availability Services
[root@rac2 ~]#


[root@rac2 ~]# /u002/app/oracle/product/12.1.0/grid/bin/crsctl stat res -t -init
CRS-4639: Could not contact Oracle High Availability Services
CRS-4000: Command Status failed, or completed with errors.
[root@rac2 ~]#




No comments:

Post a Comment