Redhat 6.4 comes with supporting ASM

Exciting with This new feature in Redhat 6.4. I decide to give a test.

Oracle ASMLib Availability and Support

Oracle ASM (Automated Storage Management) is a data volume manager for Oracle databases. ASMLib is an optional utility that can be used on Linux systems to manage Oracle ASM devices. ASMLib consists of the following components:

• kmod-oracleasm (open-source (GPL) kernel module package)
• oracleasm-support (open-source (GPL) utilities package)
• oracleasmlib (proprietary library package)

ASM features and functionality are available without ASMLib. The use of ASMLib does not affect database performance. The ASMLib kernel module package is now available in the Red Hat Enterprise Linux 6 Supplementary RHN channel. Red Hat Enterprise Linux 6 customers who use ASMLib can obtain the other two components using the instructions in the following KnowledgeBase article:

https://access.redhat.com/knowledge/solutions/315643

1. Download and install the three packages.

With external help , I managed to download the above saying 3 packages from

https://access.redhat.com/site/solutions/315643

note that:

a.) they can't be found in the supplementary disc(iso file), a bit strange to me, as I thought redhat's document seems quite nice .
b.) only oracleasmlib can be downloaded in Oracle Unbreakable Linux 6, as the rest two are already pre-built into the OS.
c.) It seems no 32bit packages.

For installation, I encoutered no error in CentOS 6.4


[root@localhost Desktop]# ls -lrt *.rpm
-rw-r--r--. 1 root root  35044 Apr 20 01:00 kmod-oracleasm-2.0.6.rh1-2.el6.x86_64.rpm
-rw-r--r--. 1 root root  74984 Apr 20 01:00 oracleasm-support-2.1.8-1.el6.x86_64.rpm
-rw-r--r--. 1 root root  13300 Apr 20 01:00 oracleasmlib-2.0.4-1.el6.x86_64.rpm
[root@localhost Desktop]# rpm -qa |grep oracleasm
[root@localhost Desktop]# rpm -i kmod-oracleasm-2.0.6.rh1-2.el6.x86_64.rpm
warning: kmod-oracleasm-2.0.6.rh1-2.el6.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID fd431d51: NOKEY
[root@localhost Desktop]# rpm -i oracleasm-support-2.1.8-1.el6.x86_64.rpm
warning: oracleasm-support-2.1.8-1.el6.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID ec551f03: NOKEY
[root@localhost Desktop]# rpm -i oracleasmlib-2.0.4-1.el6.x86_64.rpm
warning: oracleasmlib-2.0.4-1.el6.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID ec551f03: NOKEY


2.  Some basic verification, looks fine.

[root@localhost Desktop]# uname -a
Linux localhost.localdomain 2.6.32-358.el6.x86_64 #1 SMP Fri Feb 22 00:31:26 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux
[root@localhost Desktop]# which oracleasm
/usr/sbin/oracleasm
[root@localhost Desktop]# oracleasm listdisks
[root@localhost Desktop]# oracleasm -V
oracleasm version 2.1.8


For comparing purpose , here is more info for Linux 5.6  ASMLib provided by Oracle.

[root@rac1 ~]# uname -a
Linux rac1.localdomain 2.6.18-238.el5 #1 SMP Tue Jan 4 15:24:05 EST 2011 i686 i686 i386 GNU/Linux
[root@rac1 ~]# which oracleasm
/usr/sbin/oracleasm
[root@rac1 ~]# oracleasm -V
oracleasm version 2.1.4

3. Now add a disk for testing.

3.1 fdisk info before add a new disk.
[root@localhost Desktop]#  fdisk -l

Disk /dev/sda: 34.6 GB, 34625028096 bytes
255 heads, 63 sectors/track, 4209 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x0000bdcd

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *           1          64      512000   83  Linux
Partition 1 does not end on cylinder boundary.
/dev/sda2              64        4210    33300480   8e  Linux LVM

Disk /dev/mapper/VolGroup-lv_root: 31.6 GB, 31578914816 bytes
255 heads, 63 sectors/track, 3839 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000


Disk /dev/mapper/VolGroup-lv_swap: 2516 MB, 2516582400 bytes
255 heads, 63 sectors/track, 305 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000

[root@localhost Desktop]# shutdown -h now


--after reboot the new disk is /dev/sdb


[root@localhost ~]# fdisk -l

Disk /dev/sda: 34.6 GB, 34625028096 bytes
255 heads, 63 sectors/track, 4209 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x0000bdcd

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *           1          64      512000   83  Linux
Partition 1 does not end on cylinder boundary.
/dev/sda2              64        4210    33300480   8e  Linux LVM

Disk /dev/sdb: 8589 MB, 8589934592 bytes
255 heads, 63 sectors/track, 1044 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000


Disk /dev/mapper/VolGroup-lv_root: 31.6 GB, 31578914816 bytes
255 heads, 63 sectors/track, 3839 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000


Disk /dev/mapper/VolGroup-lv_swap: 2516 MB, 2516582400 bytes
255 heads, 63 sectors/track, 305 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000

[root@localhost ~]# ls -l /dev/oracleasm
ls: cannot access /dev/oracleasm: No such file or directory
[root@localhost ~]# fdisk /dev/sdb
Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel
Building a new DOS disklabel with disk identifier 0xb9020b75.
Changes will remain in memory only, until you decide to write them.
After that, of course, the previous content won't be recoverable.

Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)

WARNING: DOS-compatible mode is deprecated. It's strongly recommended to
         switch off the mode (command 'c') and change display units to
         sectors (command 'u').

Command (m for help): p

Disk /dev/sdb: 8589 MB, 8589934592 bytes
255 heads, 63 sectors/track, 1044 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0xb9020b75

   Device Boot      Start         End      Blocks   Id  System

Command (m for help): m
Command action
   a   toggle a bootable flag
   b   edit bsd disklabel
   c   toggle the dos compatibility flag
   d   delete a partition
   l   list known partition types
   m   print this menu
   n   add a new partition
   o   create a new empty DOS partition table
   p   print the partition table
   q   quit without saving changes
   s   create a new empty Sun disklabel
   t   change a partition's system id
   u   change display/entry units
   v   verify the partition table
   w   write table to disk and exit
   x   extra functionality (experts only)

Command (m for help): n
Command action
   e   extended
   p   primary partition (1-4)
p
Partition number (1-4): 1
First cylinder (1-1044, default 1):
Using default value 1
Last cylinder, +cylinders or +size{K,M,G} (1-1044, default 1044):
Using default value 1044

Command (m for help): w
The partition table has been altered!

Calling ioctl() to re-read partition table.
Syncing disks.
[root@localhost ~]# fdisk -l /dev/sdb

Disk /dev/sdb: 8589 MB, 8589934592 bytes
255 heads, 63 sectors/track, 1044 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0xb9020b75

   Device Boot      Start         End      Blocks   Id  System
/dev/sdb1               1        1044     8385898+  83  Linux


4. Things before proper configure and load the asmlib

[root@localhost ~]# oracleasm listdisks


[root@localhost ~]# oracleasm createdisk -help
Usage: oracleasm-createdisk [-l ] [-v]
[root@localhost ~]# oracleasm createdisk TestVol1 /dev/sdb1
Writing disk header: done
Instantiating disk: failed
Clearing disk header: done
[root@localhost ~]# oracleasm scandisks
Reloading disk partitions: done
Cleaning any stale ASM disks...
Scanning system for ASM disks...
[root@localhost ~]# oracleasm listdisks
[root@localhost ~]# ls -l /dev/oracleasm
ls: cannot access /dev/oracleasm: No such file or directory
[root@localhost ~]# oracleasm-createdisk TestVol1 /dev/sdb1
bash: oracleasm-createdisk: command not found
[root@localhost ~]# which oracleasm
/usr/sbin/oracleasm

[root@localhost ~]# cd /
[root@localhost /]# find ./ -name oracleasm-createdisk
./usr/lib/oracleasm/oracleasm-createdisk


[root@localhost ~]# ls -l /usr/lib/oracleasm/oracleasm*
-rwxr-xr-x. 1 root root  9840 Feb  9 06:46 /usr/lib/oracleasm/oracleasm-candidate-p
-rwxr-xr-x. 1 root root  9920 Feb  9 06:46 /usr/lib/oracleasm/oracleasm-clean-disk
-rwxr-xr-x. 1 root root 10006 Feb  9 06:44 /usr/lib/oracleasm/oracleasm-configure
-rwxr-xr-x. 1 root root  2964 Feb  9 06:44 /usr/lib/oracleasm/oracleasm-createdisk
-rwxr-xr-x. 1 root root  2676 Feb  9 06:44 /usr/lib/oracleasm/oracleasm_debug_link
-rwxr-xr-x. 1 root root  3785 Feb  9 06:44 /usr/lib/oracleasm/oracleasm-deletedisk
-rwxr-xr-x. 1 root root  2039 Feb  9 06:44 /usr/lib/oracleasm/oracleasm-dropdisks
-rwxr-xr-x. 1 root root  2142 Feb  9 06:44 /usr/lib/oracleasm/oracleasm-exit
-rwxr-xr-x. 1 root root  2796 Feb  9 06:44 /usr/lib/oracleasm/oracleasm-get-driver
-rwxr-xr-x. 1 root root  3543 Feb  9 06:44 /usr/lib/oracleasm/oracleasm-init
-rwxr-xr-x. 1 root root  9928 Feb  9 06:46 /usr/lib/oracleasm/oracleasm-instantiate-disk
-rwxr-xr-x. 1 root root   812 Feb  9 06:44 /usr/lib/oracleasm/oracleasm-listdisks
-rwxr-xr-x. 1 root root  3862 Feb  9 06:44 /usr/lib/oracleasm/oracleasm-querydisk
-rwxr-xr-x. 1 root root 12352 Feb  9 06:46 /usr/lib/oracleasm/oracleasm-read-label
-rwxr-xr-x. 1 root root  7016 Feb  9 06:46 /usr/lib/oracleasm/oracleasm-reload-partitions
-rwxr-xr-x. 1 root root  6081 Feb  9 06:44 /usr/lib/oracleasm/oracleasm-renamedisk
-rwxr-xr-x. 1 root root  3506 Feb  9 06:44 /usr/lib/oracleasm/oracleasm-scandisks
-rwxr-xr-x. 1 root root  9480 Feb  9 06:46 /usr/lib/oracleasm/oracleasm-scan-partitions
-rwxr-xr-x. 1 root root  1143 Feb  9 06:44 /usr/lib/oracleasm/oracleasm-status
-rwxr-xr-x. 1 root root  2865 Feb  9 06:44 /usr/lib/oracleasm/oracleasm-update-driver
-rwxr-xr-x. 1 root root  6794 Feb  9 06:44 /usr/lib/oracleasm/oracleasm-update-driver-otn
-rwxr-xr-x. 1 root root  2480 Feb  9 06:44 /usr/lib/oracleasm/oracleasm-update-driver-uln
-rwxr-xr-x. 1 root root 12352 Feb  9 06:46 /usr/lib/oracleasm/oracleasm-write-label
-rwxr-xr-x. 1 root root  3768 Feb  9 06:44 /usr/lib/oracleasm/oracleasm-Xshlib
[root@localhost ~]#  /usr/lib/oracleasm/oracleasm-createdisk TestVOL1 /dev/sdb1
/usr/lib/oracleasm/oracleasm-createdisk: line 52: oracleasm-Xshlib: No such file or directory
/usr/lib/oracleasm/oracleasm-createdisk: line 160: upper_disk: command not found


5. Then realized , need to configure and load the ASMLib first.

[root@localhost Desktop]# oracleasm configure
ORACLEASM_ENABLED=false
ORACLEASM_UID=
ORACLEASM_GID=
ORACLEASM_SCANBOOT=true
ORACLEASM_SCANORDER=""
ORACLEASM_SCANEXCLUDE=""
ORACLEASM_USE_LOGICAL_BLOCK_SIZE="false"
[root@localhost Desktop]#  /usr/lib/oracleasm/oracleasm-createdisk TestVOL1 /dev/sdb1
/usr/lib/oracleasm/oracleasm-createdisk: line 52: oracleasm-Xshlib: No such file or directory
/usr/lib/oracleasm/oracleasm-createdisk: line 160: upper_disk: command not found
[root@localhost Desktop]# ps -ef |grep asm
root      2485  2454  0 22:29 pts/0    00:00:00 grep asm
[root@localhost Desktop]# oracleasm status
Checking if ASM is loaded: no
Checking if /dev/oracleasm is mounted: no
[root@localhost Desktop]# oracleasm init
Creating /dev/oracleasm mount point: /dev/oracleasm
Loading module "oracleasm": oracleasm
Mounting ASMlib driver filesystem: /dev/oracleasm
[root@localhost Desktop]# ps -ef |grep asm
root      2552  2454  0 22:29 pts/0    00:00:00 grep asm
[root@localhost Desktop]# oracleasm status
Checking if ASM is loaded: yes
Checking if /dev/oracleasm is mounted: yes


6. still encounter error.

[root@localhost Desktop]# oracleasm createdisk TestVol1 /dev/sdb1Writing disk header: done
Instantiating disk: failed
Clearing disk header: done
[root@localhost Desktop]# oracleasm listdisks
[root@localhost Desktop]# oracleasm scandisks
Reloading disk partitions: done
Cleaning any stale ASM disks...
Scanning system for ASM disks...


[root@localhost Desktop]# cd /etc/init.d
[root@localhost init.d]# ls oracle*
oracleasm
[root@localhost init.d]# ls -l oracle*
-rwxr-xr-x. 1 root root 7124 Feb  9 06:44 oracleasm
[root@localhost init.d]# ./oracleasm createdisk TestVol1 /dev/sdb1
Marking disk "TestVol1" as an ASM disk:                    [FAILED]
[root@localhost init.d]# echo $?
1
[root@localhost init.d]#  /usr/lib/oracleasm/oracleasm-createdisk TestVOL1 /dev/sdb1
/usr/lib/oracleasm/oracleasm-createdisk: line 52: oracleasm-Xshlib: No such file or directory
/usr/lib/oracleasm/oracleasm-createdisk: line 160: upper_disk: command not found
[root@localhost init.d]#

7. then I google for racleasm-Xshlib , and I found it is inside oracleasm-support package.

[root@localhost Desktop]# rpm -ql oracleasm-support-2.1.8-1.el6.x86_64.rpm
package oracleasm-support-2.1.8-1.el6.x86_64.rpm is not installed
[root@localhost Desktop]# rpm -ql oracleasm-support-2.1.8-1.el6.x86_64
/etc/init.d/oracleasm
/etc/sysconfig/oracleasm
/usr/lib/oracleasm
/usr/lib/oracleasm/oracleasm-Xshlib
/usr/lib/oracleasm/oracleasm-candidate-p
/usr/lib/oracleasm/oracleasm-clean-disk
/usr/lib/oracleasm/oracleasm-configure
/usr/lib/oracleasm/oracleasm-createdisk
/usr/lib/oracleasm/oracleasm-deletedisk
/usr/lib/oracleasm/oracleasm-dropdisks
/usr/lib/oracleasm/oracleasm-exit
/usr/lib/oracleasm/oracleasm-get-driver
/usr/lib/oracleasm/oracleasm-init
/usr/lib/oracleasm/oracleasm-instantiate-disk
/usr/lib/oracleasm/oracleasm-listdisks
/usr/lib/oracleasm/oracleasm-querydisk
/usr/lib/oracleasm/oracleasm-read-label
/usr/lib/oracleasm/oracleasm-reload-partitions
/usr/lib/oracleasm/oracleasm-renamedisk
/usr/lib/oracleasm/oracleasm-scan-partitions
/usr/lib/oracleasm/oracleasm-scandisks
/usr/lib/oracleasm/oracleasm-status
/usr/lib/oracleasm/oracleasm-update-driver
/usr/lib/oracleasm/oracleasm-update-driver-otn
/usr/lib/oracleasm/oracleasm-update-driver-uln
/usr/lib/oracleasm/oracleasm-write-label
/usr/lib/oracleasm/oracleasm_debug_link
/usr/sbin/asmscan
/usr/sbin/asmtool
/usr/sbin/oracleasm
/usr/share/doc/oracleasm-support-2.1.8
/usr/share/doc/oracleasm-support-2.1.8/ReleaseNotes
/usr/share/man
/usr/share/man/man8
/usr/share/man/man8/oracleasm-configure.8.gz
/usr/share/man/man8/oracleasm-createdisk.8.gz
/usr/share/man/man8/oracleasm-deletedisk.8.gz
/usr/share/man/man8/oracleasm-dropdisks.8.gz
/usr/share/man/man8/oracleasm-exit.8.gz
/usr/share/man/man8/oracleasm-help.8.gz
/usr/share/man/man8/oracleasm-init.8.gz
/usr/share/man/man8/oracleasm-listdisks.8.gz
/usr/share/man/man8/oracleasm-querydisk.8.gz
/usr/share/man/man8/oracleasm-renamedisk.8.gz
/usr/share/man/man8/oracleasm-scandisks.8.gz
/usr/share/man/man8/oracleasm-status.8.gz
/usr/share/man/man8/oracleasm-update-driver-otn.8.gz
/usr/share/man/man8/oracleasm-update-driver-uln.8.gz
/usr/share/man/man8/oracleasm-update-driver.8.gz
/usr/share/man/man8/oracleasm.8.gz
/usr/share/man/man8/oracleasm.init.8.gz

8. but why oracleasm-createdisk can't find it?! even I execute in the /usr/lib/oracleasm, evenmore I include "./" to $PATH.

[root@localhost oracleasm]# ls -l *Xshlib
-rwxr-xr-x. 1 root root 3768 Feb  9 06:44 oracleasm-Xshlib
[root@localhost oracleasm]#  /usr/lib/oracleasm/oracleasm-createdisk -v TestVOL1 /dev/sdb1
line 76: oracleasm-candidate-p: command not found
[root@localhost oracleasm]# ls -l *candi*
-rwxr-xr-x. 1 root root 9840 Feb  9 06:46 oracleasm-candidate-p
-rwxr-xr-x. 1 root root 3506 Feb  9 06:44 oracleasm-scandisks
[root@localhost oracleasm]# ./oracleasm-createdisk -v TestVOL1 /dev/sdb1line 76: oracleasm-candidate-p: command not found
[root@localhost oracleasm]# ehoc $PATH
bash: ehoc: command not found
[root@localhost oracleasm]# echo $PATH
/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/sbin:/sbin:/usr/local/bin:/usr/bin:/bin:/root/bin
[root@localhost oracleasm]# export PATH=./:$PATH
[root@localhost oracleasm]# ./oracleasm-createdisk -v TestVOL1 /dev/sdb1
Disk "TESTVOL1" does not exist or is not instantiated
Writing disk header: done
Instantiating disk: oracleasm-instantiate-disk: Unable to create ASM disk "TESTVOL1": Permission denied
failed
Clearing disk header: done


9. Now I get a new error message, goolged again for Instantiating disk: oracleasm-instantiate-disk: Unable to create ASM disk "TESTVOL1": Permission denied.

Although I am running as root, still compared the permission of /dev/oracleasm and subdirectories, which is same my another vm of CentOS 5.6.

By luck, I found the following two links, which is saying caused by SELINUX.

http://dbaforums.org/oracle/index.php?showtopic=21688
http://www.dba-oracle.com/t_asm_disk_does_not_exist_or_is_not_instantiated.htm





10. now follow the instruciton to disable SELINUX.

[root@localhost oracleasm]# cat /etc/sysconfig/selinux

# This file controls the state of SELinux on the system.
# SELINUX= can take one of these three values:
#     enforcing - SELinux security policy is enforced.
#     permissive - SELinux prints warnings instead of enforcing.
#     disabled - No SELinux policy is loaded.
SELINUX=enforcing
# SELINUXTYPE= can take one of these two values:
#     targeted - Targeted processes are protected,
#     mls - Multi Level Security protection.
SELINUXTYPE=targeted


[root@localhost oracleasm]# vi /etc/sysconfig/selinux
[root@localhost oracleasm]# cat /etc/sysconfig/selinux

# This file controls the state of SELinux on the system.
# SELINUX= can take one of these three values:
#     enforcing - SELinux security policy is enforced.
#     permissive - SELinux prints warnings instead of enforcing.
#     disabled - No SELinux policy is loaded.
#SELINUX=enforcing
SELINUX=disabled
# SELINUXTYPE= can take one of these two values:
#     targeted - Targeted processes are protected,
#     mls - Multi Level Security protection.
SELINUXTYPE=targeted

--after reboot

[root@localhost ~]# which getenforce
/usr/sbin/getenforce
[root@localhost ~]# getenforce Disabled
Disabled
[root@localhost ~]# ps -ef |grep -i asm
root      2620  2604  0 23:28 pts/0    00:00:00 grep -i asm
[root@localhost ~]# cd /etc/init.d
[root@localhost init.d]# ./oracleasm status
Checking if ASM is loaded: yes
Checking if /dev/oracleasm is mounted: yes

11. Cheers!

[root@localhost ~]# oracleasm createdisk TestVOL1 /dev/sdb1
Writing disk header: done
Instantiating disk: done
[root@localhost ~]# oracleasm listdisks
TESTVOL1
[root@localhost ~]# oracleasm querydisk Testvol1
Disk "TESTVOL1" is a valid ASM disk

[root@localhost ~]# oracleasm querydisk -p Testvol1
Disk "TESTVOL1" is a valid ASM disk
/dev/sdb1: LABEL="TESTVOL1" TYPE="oracleasm"


oot@localhost ~]# cd /etc/init.d
[root@localhost init.d]# ls -ld /dev/oracleasm
drwxr-xr-x 4 root root 0 Apr 22 23:21 /dev/oracleasm
[root@localhost init.d]# ls -ld /dev/oracleasm/
drwxr-xr-x 4 root root 0 Apr 22 23:21 /dev/oracleasm/
[root@localhost init.d]# ls -l /dev/oracleasm/
total 0
drwxr-xr-x 1 root   root   0 Apr 22 23:21 disks
drwxrwx--- 1 oracle oracle 0 Apr 22 23:21 iid
[root@localhost init.d]# ls -l /dev/oracleasm/disks
total 0
brw-rw---- 1 oracle oracle 8, 17 Apr 22 23:30 TESTVOL1
[root@localhost init.d]# ls -l /dev/oracleasm/iid
total 0



12. Thought

So what will happen to ASMLib next (from competing of Oracle and RedHat)?

Extend existing ASM Diskgroup

1. The application error message

orarac2poc:ORCL2:/u01/app/oracle/oms12c/gc_inst/user_projects/domains/GCDomain/servers/EMGC_OMS1/logs> tail -100 EMGC_OMS1.out
...

Internal Exception: weblogic.jdbc.extensions.ConnectionDeadSQLException: weblogic.common.resourcepool.ResourceDeadException: 0:weblogic.common.ResourceException: Could not create pool connection. The DBMS driver exception was: ORA-00604: error occurred at recursive SQL level 1
ORA-01653: unable to extend table SYS.AUD$ by 128 in tablespace SYSTEM
ORA-02002: error while writing to audit trail
ORA-00604: error occurred at recursive SQL level 1
ORA-01653: unable to extend table SYS.AUD$ by 128 in tablespace SYSTEM

Error Code: 0.>


2. Confirm the error at database side


orarac2poc:RCAT:/home/oracle/scripts/performance> bdump
orarac2poc:RCAT:/u01/app/oracle/diag/rdbms/rcat/RCAT/trace> tail -100 alert_RCAT.log
ORA-1653: unable to extend table SYS.AUD$ by 128 in                 tablespace SYSTEM
ORA-1653: unable to extend table SYS.AUD$ by 128 in                 tablespace SYSTEM
ORA-1653: unable to extend table SYS.AUD$ by 128 in                 tablespace SYSTEM
Wed Apr 10 09:47:47 2013



orarac2poc:ORCL2:/u01/app/oracle/oms12c/gc_inst/user_projects/domains/GCDomain/servers/EMGC_OMS1/logs> rcat

Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options
orarac2poc:RCAT:/u01/app/oracle/oms12c/gc_inst/user_projects/domains/GCDomain/servers/EMGC_OMS1/logs> perf
orarac2poc:RCAT:/home/oracle/scripts/performance> sqlplus / as sysdba

SQL*Plus: Release 11.2.0.2.0 Production on Wed Apr 10 09:22:39 2013

Copyright (c) 1982, 2010, Oracle.  All rights reserved.


Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options

SYS@RCAT> @space_info
MGMT_AD4J_TS                   ,                   198.4375 ,                      200 ,  99.2188
UNDOTBS1                       ,                   536.4375 ,                      590 ,  90.9216
RMAN_TBS                       ,                      88.25 ,                      100 ,  88.2500
USERS                          ,                          4 ,                        5 ,  80.0000
TTS1                           ,                         11 ,                       20 ,  55.0000
MGMT_TABLESPACE                ,                        147 ,                     4950 ,   2.9697
SYSAUX                         ,                    38.6875 ,                     1480 ,   2.6140
SYSTEM                         ,                       .125 ,                      870 ,    .0144
MGMT_ECM_DEPOT_TS              ,                      .0625 ,                      640 ,    .0098

SYS@RCAT> select * from dba_data_files ;
+DGRCAT/rcat/datafile/mgmt_ecm_depot_ts.273.804790907
         6 MGMT_ECM_DEPOT_TS               671088640      81920 AVAILABLE            6 YES 3.4360E+10    4194302      2560  670040064       81792 ONLINE

+DGRCAT/rcat/datafile/mgmt_tablespace.272.804790907
         7 MGMT_TABLESPACE                5190451200     633600 AVAILABLE            7 YES 3.4360E+10    4194302      6400 5189402624      633472 ONLINE

+DGRCAT/rcat/datafile/mgmt_ad4j_ts.271.804790909
         8 MGMT_AD4J_TS                    209715200      25600 AVAILABLE            8 YES 3.4360E+10    4194302      6400  208666624       25472 ONLINE

+DGRCAT/rcat/datafile/system.261.803153779
         1 SYSTEM                          912261120     111360 AVAILABLE            1 YES 3.4360E+10    4194302      1280  911212544      111232 SYSTEM

+DGRCAT/rcat/datafile/sysaux.262.803153789
         2 SYSAUX                         1551892480     189440 AVAILABLE            2 YES 3.4360E+10    4194302      1280 1550843904      189312 ONLINE

+DGRCAT/rcat/datafile/undotbs1.263.803153795
         3 UNDOTBS1                        618659840      75520 AVAILABLE            3 YES 3.4360E+10    4194302       640  617611264       75392 ONLINE

+DGRCAT/rcat/datafile/users.265.803153807
         4 USERS                             5242880        640 AVAILABLE            4 YES 3.4360E+10    4194302       160    4194304         512 ONLINE

+DGRCAT/rcat/datafile/rman_tbs01.dbf
         5 RMAN_TBS                        104857600      12800 AVAILABLE            5 NO           0          0         0  103809024       12672 ONLINE

+DGRCAT/rcat/datafile/tts1_01.dbf
         9 TTS1                             20971520       2560 AVAILABLE            5 NO           0          0         0   19922944        2432 ONLINE

SYS@RCAT> alter database datafile '+DGRCAT/rcat/datafile/mgmt_ecm_depot_ts.273.804790907' resize 700m;
alter database datafile '+DGRCAT/rcat/datafile/mgmt_ecm_depot_ts.273.804790907' resize 700m
*
ERROR at line 1:
ORA-01237: cannot extend datafile 6
ORA-01110: data file 6: '+DGRCAT/rcat/datafile/mgmt_ecm_depot_ts.273.804790907'
ORA-17505: ksfdrsz:1 Failed to resize file to size 89600 blocks
ORA-15041: diskgroup "DGRCAT" space exhausted


SYS@RCAT> alter database datafile '+DGRCAT/rcat/datafile/system.261.803153779' resize 880m;
alter database datafile '+DGRCAT/rcat/datafile/system.261.803153779' resize 880m
*
ERROR at line 1:
ORA-01237: cannot extend datafile 1
ORA-01110: data file 1: '+DGRCAT/rcat/datafile/system.261.803153779'
ORA-17505: ksfdrsz:1 Failed to resize file to size 112640 blocks
ORA-15041: diskgroup "DGRCAT" space exhausted


SYS@RCAT> exit




orarac2poc:DGS:/home/oracle/scripts/performance> su - grid
Password:
[grid@orarac2poc ~]$ sqlplus / as sysasm

SQL*Plus: Release 11.2.0.2.0 Production on Wed Apr 10 09:30:42 2013

Copyright (c) 1982, 2010, Oracle.  All rights reserved.


Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options




SQL> select name, total_mb, free_mb from v$asm_diskgroup;

NAME                             TOTAL_MB    FREE_MB
------------------------------ ---------- ----------
DGDATA                              10239       7049
DGFRA                               10239       5314
OCR                                  2046       1650
DGRCAT                              10239          0

SQL> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options


2. Attemp to fix using asmca, but asmca can only create new diskgroup.  Can't use it to add new disk to diskgroup, this is out of surprise to me.  Hope more functions can be introduced in future version.

[grid@orarac2poc ~]$ which asmca
/u01/app/11.2.0/grid/bin/asmca



3. Create ASM disk first.

[grid@orarac2poc ~]$ su -
Password:
[root@orarac2poc ~]# which oracleasm
/usr/sbin/oracleasm
[root@orarac2poc ~]# oracleasm listdisks
OCRVOL
RACDATA
RCATV01
RFRA01
[root@orarac2poc ~]# fdisk -l

Disk /dev/sda: 21.4 GB, 21474836480 bytes
255 heads, 63 sectors/track, 2610 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *           1          13      104391   83  Linux
/dev/sda2              14        2610    20860402+  8e  Linux LVM

Disk /dev/sdb: 37.5 GB, 37580963840 bytes
255 heads, 63 sectors/track, 4568 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sdb1               1        4568    36692428+  83  Linux

Disk /dev/sdc: 10.7 GB, 10737418240 bytes
64 heads, 32 sectors/track, 10240 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sdc1               1       10240    10485744   83  Linux

Disk /dev/sdd: 10.7 GB, 10737418240 bytes
64 heads, 32 sectors/track, 10240 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sdd1               1       10240    10485744   83  Linux

Disk /dev/sde: 10.7 GB, 10737418240 bytes
64 heads, 32 sectors/track, 10240 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sde1               1       10240    10485744   83  Linux

Disk /dev/sdf: 10.7 GB, 10737418240 bytes
64 heads, 32 sectors/track, 10240 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sdf1               1       10240    10485744   83  Linux

Disk /dev/sdg: 10.7 GB, 10737418240 bytes
64 heads, 32 sectors/track, 10240 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sdg1               1       10240    10485744   83  Linux

Disk /dev/sdh: 2147 MB, 2147483648 bytes
67 heads, 62 sectors/track, 1009 cylinders
Units = cylinders of 4154 * 512 = 2126848 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sdh1               1        1009     2095662   83  Linux


-- check my document, so I know which disk is still not in use.

[grid@orarac2poc ~]$ su -
Password:
[root@orarac2poc ~]# oracleasm listdisks
OCRVOL
RACDATA
RCATV01
RFRA01

--to double check to ensure my document is update-to-date.
[root@orarac2poc ~]# oracleasm querydisk -d RCATV01
Disk "RCATV01" is a valid ASM disk on device /dev/sde1[8,65]
[root@orarac2poc ~]# oracleasm querydisk -d OCRVOL
Disk "OCRVOL" is a valid ASM disk on device /dev/sdh1[8,113]
[root@orarac2poc ~]# oracleasm querydisk -d RACDATA
Disk "RACDATA" is a valid ASM disk on device /dev/sdc1[8,33]
[root@orarac2poc ~]# oracleasm querydisk -d RFRA01
Disk "RFRA01" is a valid ASM disk on device /dev/sdd1[8,49]
[root@orarac2poc ~]# exit
logout

-- see what happens if we don't create ASM disk first.

[grid@orarac2poc ~]$ sqlplus / as sysasm

SQL*Plus: Release 11.2.0.2.0 Production on Wed Apr 10 09:40:27 2013

Copyright (c) 1982, 2010, Oracle.  All rights reserved.


Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options

SQL> alter diskgroup DGRCAT add disk '/dev/sdf1';
alter diskgroup DGRCAT add disk '/dev/sdf1'
*
ERROR at line 1:
ORA-15032: not all alterations performed
ORA-15031: disk specification '/dev/sdf1' matches no disks
ORA-15025: could not open disk "/dev/sdf1"
ORA-15056: additional error message
Linux-x86_64 Error: 13: Permission denied
Additional information: 42
Additional information: 1962056608
Additional information: 1962056896


SQL> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options
[grid@orarac2poc ~]$ sqlplus / as sysasm

SQL*Plus: Release 11.2.0.2.0 Production on Wed Apr 10 09:42:28 2013

Copyright (c) 1982, 2010, Oracle.  All rights reserved.


Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options



SQL> select GROUP_NUMBER,name from v$asm_diskgroup;

GROUP_NUMBER NAME
------------ ------------------------------
           1 DGDATA
           2 DGFRA
           3 OCR
           4 DGRCAT

SQL> select name, label, path from v$asm_disk where GROUP_NUMBER=4;

NAME                           LABEL
------------------------------ -------------------------------
PATH
--------------------------------------------------------------------------------
RCATV01                        RCATV01
ORCL:RCATV01


SQL> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options


-- seems we need to use oracleasm to create it first.

[grid@orarac2poc ~]$ su -
Password:

[root@orarac2poc ~]# oracleasm createdisk RCATV02 /dev/sdf1
Writing disk header: done
Instantiating disk: done

[root@orarac2poc ~]# oracleasm listdisks
OCRVOL
RACDATA
RCATV01
RCATV02
RFRA01
[root@orarac2poc ~]# ls -l /dev/oracleasm/
total 0
drwxr-xr-x 1 root root   0 Feb 28 01:03 disks
drwxrwx--- 1 grid asmdba 0 Feb 28 01:03 iid
[root@orarac2poc ~]# ls -l /dev/oracleasm/disks/
total 0
brw-rw---- 1 grid asmdba 8, 113 Feb 28 01:03 OCRVOL
brw-rw---- 1 grid asmdba 8,  33 Feb 28 01:03 RACDATA
brw-rw---- 1 grid asmdba 8,  65 Feb 28 01:03 RCATV01
brw-rw---- 1 grid asmdba 8,  81 Apr 10 09:45 RCATV02
brw-rw---- 1 grid asmdba 8,  49 Feb 28 01:03 RFRA01
[root@orarac2poc ~]# exit
logout


4. Now add the new disk to diskgroup

[grid@orarac2poc ~]$ sqlplus / as sysasm

SQL*Plus: Release 11.2.0.2.0 Production on Wed Apr 10 09:47:39 2013

Copyright (c) 1982, 2010, Oracle.  All rights reserved.


Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options

SQL> alter diskgroup DGRCAT add disk 'ORCL:RCATV02';

Diskgroup altered.

SQL> select name, label, path from v$asm_disk where GROUP_NUMBER=4;

NAME                           LABEL
------------------------------ -------------------------------
PATH
--------------------------------------------------------------------------------
RCATV01                        RCATV01
ORCL:RCATV01

RCATV02                        RCATV02
ORCL:RCATV02


SQL> select name, total_mb, free_mb from v$asm_diskgroup;

NAME                             TOTAL_MB    FREE_MB
------------------------------ ---------- ----------
DGDATA                              10239       7049
DGFRA                               10239       5314
OCR                                  2046       1650
DGRCAT                              20478      10207

SQL> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options

[grid@orarac2poc ~]$ exit
logout
orarac2poc:DGS:/home/oracle/scripts/performance> rcat
orarac2poc:RCAT:/home/oracle/scripts/performance> sqlplus / as sysdba

SQL*Plus: Release 11.2.0.2.0 Production on Wed Apr 10 09:48:53 2013

Copyright (c) 1982, 2010, Oracle.  All rights reserved.


Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options

SYS@RCAT> @space_info
MGMT_AD4J_TS                   ,                   198.4375 ,                      200 ,  99.2188
RMAN_TBS                       ,                      88.25 ,                      100 ,  88.2500
UNDOTBS1                       ,                    513.375 ,                      590 ,  87.0127
USERS                          ,                          4 ,                        5 ,  80.0000
TTS1                           ,                         11 ,                       20 ,  55.0000
MGMT_TABLESPACE                ,                     138.75 ,                     4950 ,   2.8030
SYSAUX                         ,                    38.6875 ,                     1480 ,   2.6140
MGMT_ECM_DEPOT_TS              ,                         12 ,                      660 ,   1.8182
SYSTEM                         ,                      9.125 ,                      880 ,   1.0369
SYS@RCAT> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options



Wed Apr 10 09:48:03 2013
SQL> alter diskgroup DGRCAT add disk 'ORCL:RCATV02'
NOTE: Assigning number (4,1) to disk (ORCL:RCATV02)
NOTE: requesting all-instance membership refresh for group=4
NOTE: initializing header on grp 4 disk RCATV02
NOTE: requesting all-instance disk validation for group=4
Wed Apr 10 09:48:05 2013
NOTE: skipping rediscovery for group 4/0xad3178ac (DGRCAT) on local instance.
NOTE: requesting all-instance disk validation for group=4
NOTE: skipping rediscovery for group 4/0xad3178ac (DGRCAT) on local instance.
NOTE: initiating PST update: grp = 4
Wed Apr 10 09:48:05 2013
GMON updating group 4 at 14 for pid 35, osid 26052
NOTE: PST update grp = 4 completed successfully
NOTE: membership refresh pending for group 4/0xad3178ac (DGRCAT)
GMON querying group 4 at 15 for pid 18, osid 16512
NOTE: cache opening disk 1 of grp 4: RCATV02 label:RCATV02
GMON querying group 4 at 16 for pid 18, osid 16512
SUCCESS: refreshed membership for 4/0xad3178ac (DGRCAT)
SUCCESS: alter diskgroup DGRCAT add disk 'ORCL:RCATV02'



5. Rebalancing after a while (5 minutes).



SQL> select group_number , name,path, total_mb,free_mb from v$asm_disk where group_number=4;

GROUP_NUMBER NAME
------------ ------------------------------
PATH
--------------------------------------------------------------------------------
  TOTAL_MB    FREE_MB
---------- ----------
           4 RCATV01
ORCL:RCATV01
     10239       4961

           4 RCATV02
ORCL:RCATV02
     10239       4966



NOTE: starting rebalance of group 4/0xad3178ac (DGRCAT) at power 1
Starting background process ARB0
Wed Apr 10 09:48:08 2013
ARB0 started with pid=38, OS id=26115
NOTE: assigning ARB0 to group 4/0xad3178ac (DGRCAT) with 1 parallel I/O
NOTE: Attempting voting file refresh on diskgroup DGRCAT
Wed Apr 10 09:51:07 2013
NOTE: GroupBlock outside rolling migration privileged region
NOTE: requesting all-instance membership refresh for group=4
Wed Apr 10 09:51:10 2013
NOTE: membership refresh pending for group 4/0xad3178ac (DGRCAT)
Wed Apr 10 09:51:13 2013
GMON querying group 4 at 17 for pid 18, osid 16512
SUCCESS: refreshed membership for 4/0xad3178ac (DGRCAT)
NOTE: Attempting voting file refresh on diskgroup DGRCAT
Wed Apr 10 09:52:58 2013
NOTE: stopping process ARB0
SUCCESS: rebalance completed for group 4/0xad3178ac (DGRCAT)

Configuring ASM Targets for Monitoring

According to 

G Configuring Database and ASM Targets for Monitoring

1. Set the monitoring credentials for Oracle ASM. To do so, follow these steps:
   
   1. In Grid Control, click Targets and then Databases.
      
   2. On the Databases page, find and select the Oracle ASM target and click Monitoring Configuration.
      
   3. On the Properties page, specify the password for the ASMSYS user in the Password field. To verify the monitoring credentials, click Test Connection.
      
   4. If the connection is successful, click Next, then click Submit.
      

I  found the solution for EM 12c Cloud Control to monitor RAC ASM instances.

[grid@orarac2poc admin]$ cat tnsnames.ora
+ASM2 =
  (DESCRIPTION =
    (ADDRESS = (PROTOCOL = TCP)(HOST = orarac2poc)(PORT = 1521))
    (CONNECT_DATA =
      (SERVER = DEDICATED)
      (SERVICE_NAME = +ASM)
      (INSTANCE_NAME=+ASM2)(UR=A)
    )
  )




[grid@orarac2poc admin]$ lsnrctl service LISTENER

LSNRCTL for Linux: Version 11.2.0.2.0 - Production on 17-JAN-2013 15:00:55

Copyright (c) 1991, 2010, Oracle.  All rights reserved.

Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=IPC)(KEY=LISTENER)))
Services Summary...
Service "+ASM" has 1 instance(s).
  Instance "+ASM2", status READY, has 1 handler(s) for this service...
    Handler(s):
      "DEDICATED" established:0 refused:0 state:ready
         LOCAL SERVER
Service "DGS.POC" has 1 instance(s).
  Instance "DGS", status READY, has 1 handler(s) for this service...
    Handler(s):
      "DEDICATED" established:19 refused:0 state:ready
         LOCAL SERVER
Service "DGS_DGB.POC" has 1 instance(s).
  Instance "DGS", status READY, has 1 handler(s) for this service...
    Handler(s):
      "DEDICATED" established:19 refused:0 state:ready
         LOCAL SERVER
Service "DGS_DGMGRL.POC" has 1 instance(s).
  Instance "DGS", status UNKNOWN, has 1 handler(s) for this service...
    Handler(s):
      "DEDICATED" established:0 refused:0
         LOCAL SERVER
Service "DGXDB.POC" has 1 instance(s).
  Instance "DGS", status READY, has 1 handler(s) for this service...
    Handler(s):
      "D000" established:0 refused:0 current:0 max:1022 state:ready
         DISPATCHER
         (ADDRESS=(PROTOCOL=tcp)(HOST=orarac2poc)(PORT=16735))
Service "ORCL" has 1 instance(s).
  Instance "ORCL2", status READY, has 1 handler(s) for this service...
    Handler(s):
      "DEDICATED" established:90 refused:0 state:ready
         LOCAL SERVER
Service "ORCLXDB" has 1 instance(s).
  Instance "ORCL2", status READY, has 1 handler(s) for this service...
    Handler(s):
      "D000" established:0 refused:0 current:0 max:1022 state:ready
         DISPATCHER
         (ADDRESS=(PROTOCOL=tcp)(HOST=orarac2poc)(PORT=65288))
Service "RCAT" has 1 instance(s).
  Instance "RCAT", status READY, has 1 handler(s) for this service...
    Handler(s):
      "DEDICATED" established:1327 refused:0 state:ready
         LOCAL SERVER
Service "RCATXDB" has 1 instance(s).
  Instance "RCAT", status READY, has 1 handler(s) for this service...
    Handler(s):
      "D000" established:0 refused:0 current:0 max:1022 state:ready
         DISPATCHER
         (ADDRESS=(PROTOCOL=tcp)(HOST=orarac2poc)(PORT=16926))
The command completed successfully


[grid@orarac2poc ~]$ sqlplus / as sysasm

SQL*Plus: Release 11.2.0.2.0 Production on Thu Jan 17 14:54:18 2013

Copyright (c) 1982, 2010, Oracle.  All rights reserved.


Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options

SQL> select * from v$pwfile_users;

USERNAME                       SYSDB SYSOP SYSAS
------------------------------ ----- ----- -----
SYS                            TRUE  TRUE  TRUE
ASMSNMP                        TRUE  FALSE FALSE

SQL> alter user asmsnmp identified by oracle123;

User altered.

SQL> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options




Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options
[grid@orarac2poc admin]$ sqlplus asmsnmp/oracle123@+ASM2  as sysasm

SQL*Plus: Release 11.2.0.2.0 Production on Thu Jan 17 15:04:08 2013

Copyright (c) 1982, 2010, Oracle.  All rights reserved.

ERROR:
ORA-01031: insufficient privileges


Enter user-name:
[grid@orarac2poc admin]$ sqlplus asmsnmp/oracle123@+ASM2  as sysdba

SQL*Plus: Release 11.2.0.2.0 Production on Thu Jan 17 15:04:12 2013

Copyright (c) 1982, 2010, Oracle.  All rights reserved.


Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options

SQL> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options