Wednesday, January 20, 2010

RMI Server Port number self-conflict

Due to some unknown reason, RMI port may look self-conflict. The workaround for us is to re-configure ports number.


Steps:


1. Choose a new RMI port number.


-- Check all instances' ports number from /software/oradas/product/10.2.0/oc4j/j2ee/OC4J_DBConsole_hpdasdb_DASP/config/cat rmi.xml.


-- use "netstat -an |grep " to verify.


2. Get the sys password (save it before change), retain the password of SYSMAN/DBSNMP.


3. Stop agent and dbcontrol :


3.1 emctl stop dbconsole; emctl stop agent


3.2 kill the dangling process: ps -efx|grep oradas |grep dbconsole


4. Deconfig dbcontrol : emca -deconfig dbcontrol db

5. Reconfig port numbers : emca -config dbcontrol db -DBCONTROL_HTTP_PORT 5506 -RMI_PORT 5527 -AGENT_PORT 3939



The Details:

The ERROR message

from emdb.nohup (? , anyway it is under /software/oradas/product/10.2.0/hpdasdb_DASP/sysman/log , use ls -lrt to search latest logfile)

----- Thu Jan 14 08:46:01 2010::DBConsole exited at Thu Jan 14 08:46:01 2010 with return value 7. -----
----- Thu Jan 14 08:46:01 2010::Restarting DBConsole. -----
----- Thu Jan 14 08:46:01 2010::Console Launched with PID 13175 at time Thu Jan 14 08:46:01 2010 -----
10/01/14 08:46:03 Error starting ORMI-Server. Unable to bind socket: Address already in use (errno:226)


dbsvr25:DASP:/software/oradas/product/10.2.0/hpdasdb_DASP/sysman/log> tail emdctl.trc
2010-01-14 09:31:52 Thread-1 ERROR ssl: nzos_Handshake failed, ret=29024
2010-01-14 09:31:52 Thread-1 ERROR http: 6: Unable to initialize ssl connection with server, aborting connection attempt
2010-01-14 09:31:56 Thread-1 ERROR ssl: nzos_Handshake failed, ret=29024
2010-01-14 09:31:56 Thread-1 ERROR http: 6: Unable to initialize ssl connection with server, aborting connection attempt
2010-01-14 09:32:01 Thread-1 ERROR ssl: nzos_Handshake failed, ret=29024
2010-01-14 09:32:01 Thread-1 ERROR http: 6: Unable to initialize ssl connection with server, aborting connection attempt
2010-01-14 09:32:05 Thread-1 ERROR ssl: nzos_Handshake failed, ret=29024
2010-01-14 09:32:05 Thread-1 ERROR http: 6: Unable to initialize ssl connection with server, aborting connection attempt
2010-01-14 09:32:09 Thread-1 ERROR ssl: nzos_Handshake failed, ret=29024
2010-01-14 09:32:09 Thread-1 ERROR http: 6: Unable to initialize ssl connection with server, aborting connection attempt



dbsvr25:DASP:/software/oradas/product/10.2.0/hpdasdb_DASP/sysman/log> tail emagent.trc
2010-01-14 09:32:44 Thread-32 ERROR upload: Error in uploadXMLFiles. Trying again in 211.00 seconds.
2010-01-14 09:32:44 Thread-33 ERROR ssl: nzos_Handshake failed, ret=29024
2010-01-14 09:32:44 Thread-33 ERROR http: 13: Unable to initialize ssl connection with server, aborting connection attempt
2010-01-14 09:32:44 Thread-33 ERROR pingManager: nmepm_pingReposURL: Cannot connect to https://hpdasdb:5506/em/upload/: retStatus=-1
2010-01-14 09:33:14 Thread-34 ERROR ssl: nzos_Handshake failed, ret=29024
2010-01-14 09:33:14 Thread-34 ERROR http: 12: Unable to initialize ssl connection with server, aborting connection attempt
2010-01-14 09:33:14 Thread-34 ERROR pingManager: nmepm_pingReposURL: Cannot connect to https://hpdasdb:5506/em/upload/: retStatus=-1
2010-01-14 09:33:14 Thread-34 ERROR ssl: nzos_Handshake failed, ret=29024
2010-01-14 09:33:14 Thread-34 ERROR http: 12: Unable to initialize ssl connection with server, aborting connection attempt
2010-01-14 09:33:14 Thread-34 ERROR pingManager: nmepm_pingReposURL: Cannot connect to https://hpdasdb:5506/em/upload/: retStatus=-1

Commands:


> emca -deconfig dbcontrol db

> emca -config dbcontrol db -DBCONTROL_HTTP_PORT 5506 -RMI_PORT 5527 -AGENT_PORT 3939

command to check if port already occupied: netstat -an |grep


dbsvr25:DASP:/software/oradas> emca -config dbcontrol db -DBCONTROL_HTTP_PORT 5506 -RMI_PORT 5527 -AGENT_PORT 3939

STARTED EMCA at Jan 14, 2010 10:07:52 AM
EM Configuration Assistant, Version 10.2.0.1.0 Production
Copyright (c) 2003, 2005, Oracle. All rights reserved.

Enter the following information:
Database SID: DASP
Listener port number: 1550
Password for SYS user:
Password for DBSNMP user:
Password for SYSMAN user:
Email address for notifications (optional): dba_support@xxxxx.com.sg
Outgoing Mail (SMTP) server for notifications (optional): smtpxxx
-----------------------------------------------------------------

You have specified the following settings

Database ORACLE_HOME ................ /software/oradas/product/10.2.0

Database hostname ................ hpdasdb
Listener port number ................ 1550
Database SID ................ DASP
Email address for notifications ............... dba_support@m1.com.sg
Outgoing Mail (SMTP) server for notifications ............... mocexb02

-----------------------------------------------------------------
Do you wish to continue? [yes(Y)/no(N)]: y
Jan 14, 2010 10:08:28 AM oracle.sysman.emcp.EMConfig perform
INFO: This operation is being logged at /software/oradas/product/10.2.0/cfgtoollogs/emca/DASP/emca_2010-01-14_10-07-52-AM.log.
Jan 14, 2010 10:08:29 AM oracle.sysman.emcp.util.PortManager isPortInUse
WARNING: Specified port 5506 is already in use.
Jan 14, 2010 10:08:29 AM oracle.sysman.emcp.util.PortManager isPortInUse
WARNING: Specified port 3939 is already in use.
Jan 14, 2010 10:08:32 AM oracle.sysman.emcp.util.DBControlUtil secureDBConsole
INFO: Securing Database Control (this may take a while) ...
Jan 14, 2010 10:09:04 AM oracle.sysman.emcp.util.DBControlUtil secureDBConsole
INFO: Database Control secured successfully.
Jan 14, 2010 10:09:04 AM oracle.sysman.emcp.util.DBControlUtil startOMS
INFO: Starting Database Control (this may take a while) ...
Jan 14, 2010 10:10:45 AM oracle.sysman.emcp.EMDBPostConfig performConfiguration
INFO: Database Control started successfully
Jan 14, 2010 10:10:45 AM oracle.sysman.emcp.EMDBPostConfig performConfiguration
INFO: >>>>>>>>>>> The Database Control URL is https://hpdasdb:5506/em <<<<<<<<<<<
Enterprise Manager configuration completed successfully
FINISHED EMCA at Jan 14, 2010 10:10:45 AM



dbsvr25:DASP:/software/oradas> netstat -an |egrep "5527|5506|3939"
tcp 0 0 .5527 .* LISTEN
tcp 0 0 .3939 .* LISTEN
tcp 0 0 .5506 .* LISTEN

#LISTEN means occupied