1.) In my first test, the recovery time is too close (8 seconds) to the INSERT statement, "hence" after recovery the last inserted row is not recovered back.
This maybe explained in untilClause below.
Note: The granularity of time-based recovery is dependent on time stamps in the redo log. For example, suppose that you specify the following command:
RECOVER DATABASE UNTIL TIME '2007-07-26 17:45:00';If no redo was written with a time stamp of
17:45:00, then recovery proceeds until it finds the next redo time stamp that is higher. For example, the next redo time stamp may be 17:45:04. You can check for the nearest time for a specific SCN by querying the FIRST_TIME and FIRST_CHANGE# columns in V$LOG_HISTORY TABLE.But I am still thinking 8 seconds interval should be sufficient for point-in-time recovery. I event issued COMMIT command and provided CURRENT online redo logs, but they seems being ignored.
2.) In the second test, I enlarge the interval and found back the last inserted record. Seems recovering up using SCN is the best choice, but this maybe require more effort and a a bit impractical.
3.) In part 2 test, I purposely invoke "open read only" command, From the error message when using current controlfile for recovery, which tells us the wrong step/information written in student guide of 11g backup and recovery. This is explained in case 1 of [ID 316154.1] . I am sad to see the quality of the student guide.
5.Test 1
1. Insert the record and backup archived log . Note the INSERT and Exiting SQL*PLUS time
orarac2poc:TTS:/u02/oradata/TTS> sqlplus / as sysdba
SQL*Plus: Release 11.2.0.2.0 Production on Mon Apr 8 10:03:45 2013
Copyright (c) 1982, 2010, Oracle. All rights reserved.
Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
10:03:45 SYS@TTS> select * from liqy.incr_changes;
C1 CHANGES
---------- --------------------
3 some changes
4 some more changes
5 change no apply
6 last change
9 using bakctrlfile2
10 change before drop
1 init backup copy
2 change before crash
7 after PITR
8 using bakctrlfile
7 no online redo
11 change2 before drop
12 rows selected.
10:03:52 SYS@TTS> select * from v$log;
GROUP# THREAD# SEQUENCE# BYTES BLOCKSIZE MEMBERS ARC STATUS FIRST_CHANGE# FIRST_TIM NEXT_CHANGE#
---------- ---------- ---------- ---------- ---------- ---------- --- ---------------- ------------- --------- ------------
NEXT_TIME
---------
1 1 4 52428800 512 1 YES INACTIVE 1498569 07-APR-13 1514223
08-APR-13
2 1 5 52428800 512 1 YES INACTIVE 1514223 08-APR-13 1520444
08-APR-13
3 1 6 52428800 512 1 NO CURRENT 1520444 08-APR-13 2.8147E+14
10:06:03 SYS@TTS> insert into liqy.incr_changes values (12,'bf delete');
1 row created.
10:06:08 SYS@TTS> commit;
Commit complete.
10:06:11 SYS@TTS> exit
orarac2poc:TTS:/u02/oradata/TTS> rman target /
Recovery Manager: Release 11.2.0.2.0 - Production on Mon Apr 8 10:06:20 2013
Copyright (c) 1982, 2009, Oracle and/or its affiliates. All rights reserved.
connected to target database: TTS (DBID=1769654909)
RMAN> backup as backupset archivelog all not backed up delete all input;
Starting backup at Apr 08 2013 10:09:25
current log archived
using target database control file instead of recovery catalog
allocated channel: ORA_DISK_1
channel ORA_DISK_1: SID=29 device type=DISK
channel ORA_DISK_1: starting archived log backup set
channel ORA_DISK_1: specifying archived log(s) in backup set
input archived log thread=1 sequence=6 RECID=78 STAMP=812196565
channel ORA_DISK_1: starting piece 1 at Apr 08 2013 10:09:26
channel ORA_DISK_1: finished piece 1 at Apr 08 2013 10:09:27
piece handle=/u02/oradata/TTS/FRA/TTS/backupset/2013_04_08/o1_mf_annnn_TAG20130408T100926_8p49pps2_.bkp tag=TAG20130408T100926 comment=NONE
channel ORA_DISK_1: backup set complete, elapsed time: 00:00:01
channel ORA_DISK_1: deleting archived log(s)
archived log file name=/u02/oradata/TTS/FRA/TTS/archivelog/2013_04_08/o1_mf_1_6_8p49pog9_.arc RECID=78 STAMP=812196565
Finished backup at Apr 08 2013 10:09:27
Starting Control File and SPFILE Autobackup at Apr 08 2013 10:09:27
piece handle=/u02/oradata/TTS/FRA/TTS/autobackup/2013_04_08/o1_mf_s_812196568_8p49pr7x_.bkp comment=NONE
Finished Control File and SPFILE Autobackup at Apr 08 2013 10:09:28
RMAN> exit
2. Create problem by delete all records
orarac2poc:TTS:/u02/oradata/TTS> sqlplus / as sysdba
SQL*Plus: Release 11.2.0.2.0 Production on Mon Apr 8 10:09:43 2013
Copyright (c) 1982, 2010, Oracle. All rights reserved.
Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
10:09:44 SYS@TTS> select current_scn from v$database;
CURRENT_SCN
-----------
1520961
10:09:54 SYS@TTS> select controlfile_change# from v$database;
CONTROLFILE_CHANGE#
-------------------
1520955
10:10:09 SYS@TTS> select file#, CHECKPOINT_CHANGE# from V$DATAFILE_HEADER;
FILE# CHECKPOINT_CHANGE#
---------- ------------------
1 1520444
2 1520444
3 1520444
4 1520444
5 1520444
6 1520444
6 rows selected.
10:10:12 SYS@TTS> select * from v$database_incarnation;
INCARNATION# RESETLOGS_CHANGE# RESETLOGS PRIOR_RESETLOGS_CHANGE# PRIOR_RES STATUS RESETLOGS_ID PRIOR_INCARNATION#
------------ ----------------- --------- ----------------------- --------- ------- ------------ ------------------
FLASHBACK_DATABASE_ALLOWED
--------------------------
1 1 20-MAR-13 0 PARENT 810578493 0
NO
2 721427 21-MAR-13 1 20-MAR-13 PARENT 810655966 1
NO
3 1009055 27-MAR-13 721427 21-MAR-13 PARENT 811158253 2
NO
4 1019618 27-MAR-13 1009055 27-MAR-13 PARENT 811177908 3
NO
5 1021343 27-MAR-13 1019618 27-MAR-13 PARENT 811179783 4
NO
6 1147625 28-MAR-13 1021343 27-MAR-13 PARENT 811272921 5
NO
7 1368073 04-APR-13 1147625 28-MAR-13 PARENT 811860423 6
NO
8 1371062 04-APR-13 1368073 04-APR-13 PARENT 811866469 7
NO
9 1335171 02-APR-13 1147625 28-MAR-13 ORPHAN 811678623 6
NO
10 1372570 04-APR-13 1371062 04-APR-13 PARENT 811874482 8
NO
11 1411967 05-APR-13 1372570 04-APR-13 CURRENT 811962267 10
NO
11 rows selected.
10:10:32 SYS@TTS> select * from liqy.incr_changes;
C1 CHANGES
---------- --------------------
3 some changes
4 some more changes
5 change no apply
6 last change
9 using bakctrlfile2
10 change before drop
12 bf delete
1 init backup copy
2 change before crash
7 after PITR
8 using bakctrlfile
7 no online redo
11 change2 before drop
13 rows selected.
10:14:57 SYS@TTS> select * from v$log;
GROUP# THREAD# SEQUENCE# BYTES BLOCKSIZE MEMBERS ARC STATUS FIRST_CHANGE# FIRST_TIM NEXT_CHANGE#
---------- ---------- ---------- ---------- ---------- ---------- --- ---------------- ------------- --------- ------------
NEXT_TIME
---------
1 1 7 52428800 512 1 NO CURRENT 1520929 08-APR-13 2.8147E+14
2 1 5 52428800 512 1 YES INACTIVE 1514223 08-APR-13 1520444
08-APR-13
3 1 6 52428800 512 1 YES INACTIVE 1520444 08-APR-13 1520929
08-APR-13
10:18:37 SYS@TTS> delete from liqy.incr_changes;
13 rows deleted.
10:18:50 SYS@TTS> commit;
Commit complete.
10:18:53 SYS@TTS> alter system switch logfile;
System altered.
10:19:14 SYS@TTS> select * from v$log;
GROUP# THREAD# SEQUENCE# BYTES BLOCKSIZE MEMBERS ARC STATUS FIRST_CHANGE# FIRST_TIM NEXT_CHANGE#
---------- ---------- ---------- ---------- ---------- ---------- --- ---------------- ------------- --------- ------------
NEXT_TIME
---------
1 1 7 52428800 512 1 YES ACTIVE 1520929 08-APR-13 1521260
08-APR-13
2 1 8 52428800 512 1 NO CURRENT 1521260 08-APR-13 2.8147E+14
3 1 6 52428800 512 1 YES INACTIVE 1520444 08-APR-13 1520929
08-APR-13
10:21:11 SYS@TTS> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
orarac2poc:TTS:/u02/oradata/TTS> sqlplus / as sysdba
SQL*Plus: Release 11.2.0.2.0 Production on Mon Apr 8 10:21:42 2013
Copyright (c) 1982, 2010, Oracle. All rights reserved.
Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
10:21:42 SYS@TTS> shutdown immediate
Database closed.
Database dismounted.
ORACLE instance shut down.
10:24:16 SYS@TTS> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
3. What were logged in alert.log
Mon Apr 08 10:00:30 2013
Deleted Oracle managed file /u02/oradata/TTS/FRA/TTS/autobackup/2013_04_08/o1_mf_s_812195898_8p491tg1_.bkp
Deleted Oracle managed file /u02/oradata/TTS/FRA/TTS/backupset/2013_04_05/o1_mf_nnnd1_DAILY_INCR_8owyj4qv_.bkp
Deleted Oracle managed file /u02/oradata/TTS/FRA/TTS/backupset/2013_04_05/o1_mf_annnn_TAG20130405T151850_8owypv46_.bkp
Mon Apr 08 10:09:25 2013
ALTER SYSTEM ARCHIVE LOG
Mon Apr 08 10:09:25 2013
Thread 1 advanced to log sequence 7 (LGWR switch)
Current log# 1 seq# 7 mem# 0: /u02/oradata/TTS/redo01.log
Mon Apr 08 10:09:25 2013
Archived Log entry 78 added for thread 1 sequence 6 ID 0x698fe77b dest 1:
Mon Apr 08 10:19:14 2013
Thread 1 advanced to log sequence 8 (LGWR switch)
Current log# 2 seq# 8 mem# 0: /u02/oradata/TTS/redo02.log
Mon Apr 08 10:19:14 2013
Archived Log entry 79 added for thread 1 sequence 7 ID 0x698fe77b dest 1:
4. Backup existing database and using current controlfile and online redo logs for recovery.
orarac2poc:TTS:/u02/oradata/TTS> ls -l
total 1922112
drwxr-xr-x 2 oracle oinstall 4096 Apr 5 15:05 bak
-rw-r----- 1 oracle asmadmin 10010624 Apr 8 10:23 control01.ctl
-rw-r----- 1 oracle asmadmin 10010624 Apr 8 10:23 control02.ctl
drwxr-xr-x 3 oracle oinstall 4096 Mar 27 09:33 FRA
-rw-r--r-- 1 oracle oinstall 12 Apr 5 14:51 login.sql
-rw-r--r-- 1 oracle oinstall 394 Apr 4 16:25 manual_copy.sh
-rw-r----- 1 oracle asmadmin 52429312 Apr 8 10:19 redo01.log
-rw-r----- 1 oracle asmadmin 52429312 Apr 8 10:22 redo02.log
-rw-r----- 1 oracle asmadmin 52429312 Apr 8 10:09 redo03.log
-rw-r----- 1 oracle asmadmin 629153792 Apr 8 10:22 sysaux01.dbf
-rw-r----- 1 oracle asmadmin 734011392 Apr 8 10:22 system01.dbf
-rw-r----- 1 oracle asmadmin 20979712 Apr 5 18:00 temp01.dbf
-rw-r----- 1 oracle asmadmin 10493952 Apr 8 10:22 testtbs1.dbf
-rw-r----- 1 oracle asmadmin 20979712 Apr 8 10:22 tts1_01.bdf
-rw-r----- 1 oracle asmadmin 387981312 Apr 8 10:22 undotbs01.dbf
-rw-r----- 1 oracle asmadmin 5251072 Apr 8 10:22 users01.dbf
orarac2poc:TTS:/u02/oradata/TTS> gzip *.*
orarac2poc:TTS:/u02/oradata/TTS> ls -l con*
-rw-r----- 1 oracle oinstall 59332 Apr 8 10:23 control01.ctl.gz
-rw-r----- 1 oracle oinstall 59332 Apr 8 10:23 control02.ctl.gz
orarac2poc:TTS:/u02/oradata/TTS> cp -p control01.ctl.gz control01.ctl.gz.bak
orarac2poc:TTS:/u02/oradata/TTS> gunzip control01.ctl.gz control02.ctl.gz
orarac2poc:TTS:/u02/oradata/TTS> ls -l con*
-rw-r----- 1 oracle oinstall 10010624 Apr 8 10:23 control01.ctl
-rw-r----- 1 oracle oinstall 59332 Apr 8 10:23 control01.ctl.gz.bak
-rw-r----- 1 oracle oinstall 10010624 Apr 8 10:23 control02.ctl
orarac2poc:TTS:/u02/oradata/TTS> ls -l redo*
-rw-r----- 1 oracle oinstall 8828994 Apr 8 10:19 redo01.log.gz
-rw-r----- 1 oracle oinstall 10438390 Apr 8 10:22 redo02.log.gz
-rw-r----- 1 oracle oinstall 9217773 Apr 8 10:09 redo03.log.gz
orarac2poc:TTS:/u02/oradata/TTS> gunzip redo*
orarac2poc:TTS:/u02/oradata/TTS> mkdir redo
orarac2poc:TTS:/u02/oradata/TTS> cp -p redo*.log ./redo
orarac2poc:TTS:/u02/oradata/TTS> ls -l
total 380572
drwxr-xr-x 2 oracle oinstall 4096 Apr 5 15:05 bak
-rw-r----- 1 oracle oinstall 10010624 Apr 8 10:39 control01.ctl
-rw-r----- 1 oracle oinstall 59332 Apr 8 10:23 control01.ctl.gz.bak
-rw-r----- 1 oracle oinstall 10010624 Apr 8 10:39 control02.ctl
drwxr-xr-x 3 oracle oinstall 4096 Mar 27 09:33 FRA
-rw-r--r-- 1 oracle oinstall 42 Apr 5 14:51 login.sql.gz
-rw-r--r-- 1 oracle oinstall 180 Apr 4 16:25 manual_copy.sh.gz
-rw-r----- 1 oracle oinstall 52429312 Apr 8 10:19 redo01.log
-rw-r----- 1 oracle oinstall 52429312 Apr 8 10:22 redo02.log
-rw-r----- 1 oracle oinstall 52429312 Apr 8 10:09 redo03.log
-rw-r----- 1 oracle oinstall 76447992 Apr 8 10:22 sysaux01.dbf.gz
-rw-r----- 1 oracle oinstall 127971383 Apr 8 10:22 system01.dbf.gz
-rw-r----- 1 oracle oinstall 22531 Apr 5 18:00 temp01.dbf.gz
-rw-r----- 1 oracle oinstall 24336 Apr 8 10:22 testtbs1.dbf.gz
-rw-r----- 1 oracle oinstall 1137520 Apr 8 10:22 tts1_01.bdf.gz
-rw-r----- 1 oracle oinstall 6234453 Apr 8 10:22 undotbs01.dbf.gz
-rw-r----- 1 oracle oinstall 13891 Apr 8 10:22 users01.dbf.gz
5. Recover the database, but can not find the last inserted row. BTW, Note that NLS_DATE_FORMAT and to_date format can be different.
orarac2poc:TTS:/u02/oradata/TTS> env |grep NLS
NLS_DATE_FORMAT=Mon DD YYYY HH24:MI:SS
orarac2poc:TTS:/u02/oradata/TTS> rman target /
Recovery Manager: Release 11.2.0.2.0 - Production on Mon Apr 8 10:35:19 2013
Copyright (c) 1982, 2009, Oracle and/or its affiliates. All rights reserved.
connected to target database (not started)
RMAN> startup mount
Oracle instance started
database mounted
Total System Global Area 663908352 bytes
Fixed Size 2229440 bytes
Variable Size 281021248 bytes
Database Buffers 373293056 bytes
Redo Buffers 7364608 bytes
RMAN> restore database until time "to_date('2013-04-08:10:06:11','YYYY-MM-DD:HH24:MI:SS')";
Starting restore at 2013-04-08 11:11:51
using target database control file instead of recovery catalog
allocated channel: ORA_DISK_1
channel ORA_DISK_1: SID=62 device type=DISK
channel ORA_DISK_1: restoring datafile 00001
input datafile copy RECID=144 STAMP=812196024 file name=/u02/oradata/TTS/FRA/TTS/datafile/o1_mf_system_8owwc247_.dbf
destination for restore of datafile 00001: /u02/oradata/TTS/system01.dbf
channel ORA_DISK_1: copied datafile copy of datafile 00001
output file name=/u02/oradata/TTS/system01.dbf RECID=0 STAMP=0
channel ORA_DISK_1: restoring datafile 00002
input datafile copy RECID=143 STAMP=812196024 file name=/u02/oradata/TTS/FRA/TTS/datafile/o1_mf_sysaux_8owwd7fd_.dbf
destination for restore of datafile 00002: /u02/oradata/TTS/sysaux01.dbf
channel ORA_DISK_1: copied datafile copy of datafile 00002
output file name=/u02/oradata/TTS/sysaux01.dbf RECID=0 STAMP=0
channel ORA_DISK_1: restoring datafile 00003
input datafile copy RECID=142 STAMP=812196019 file name=/u02/oradata/TTS/FRA/TTS/datafile/o1_mf_undotbs1_8owwfbql_.dbf
destination for restore of datafile 00003: /u02/oradata/TTS/undotbs01.dbf
channel ORA_DISK_1: copied datafile copy of datafile 00003
output file name=/u02/oradata/TTS/undotbs01.dbf RECID=0 STAMP=0
channel ORA_DISK_1: restoring datafile 00004
input datafile copy RECID=139 STAMP=812196015 file name=/u02/oradata/TTS/FRA/TTS/datafile/o1_mf_users_8owwfwm8_.dbf
destination for restore of datafile 00004: /u02/oradata/TTS/users01.dbf
channel ORA_DISK_1: copied datafile copy of datafile 00004
output file name=/u02/oradata/TTS/users01.dbf RECID=0 STAMP=0
channel ORA_DISK_1: restoring datafile 00005
input datafile copy RECID=141 STAMP=812196016 file name=/u02/oradata/TTS/FRA/TTS/datafile/o1_mf_tts1_8owwft1v_.dbf
destination for restore of datafile 00005: /u02/oradata/TTS/tts1_01.bdf
channel ORA_DISK_1: copied datafile copy of datafile 00005
output file name=/u02/oradata/TTS/tts1_01.bdf RECID=0 STAMP=0
channel ORA_DISK_1: restoring datafile 00006
input datafile copy RECID=140 STAMP=812196015 file name=/u02/oradata/TTS/FRA/TTS/datafile/o1_mf_testtbs_8owwfv98_.dbf
destination for restore of datafile 00006: /u02/oradata/TTS/testtbs1.dbf
channel ORA_DISK_1: copied datafile copy of datafile 00006
output file name=/u02/oradata/TTS/testtbs1.dbf RECID=0 STAMP=0
Finished restore at 2013-04-08 11:13:22
RMAN> recover database until time "to_date('2013-04-08:10:06:11','YYYY-MM-DD:HH24:MI:SS')";
Starting recover at 2013-04-08 11:13:34
using channel ORA_DISK_1
starting media recovery
channel ORA_DISK_1: starting archived log restore to default destination
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=5
channel ORA_DISK_1: reading from backup piece /u02/oradata/TTS/FRA/TTS/backupset/2013_04_08/o1_mf_annnn_TAG20130408T095918_8p493q99_.bkp
channel ORA_DISK_1: piece handle=/u02/oradata/TTS/FRA/TTS/backupset/2013_04_08/o1_mf_annnn_TAG20130408T095918_8p493q99_.bkp tag=TAG20130408T095918
channel ORA_DISK_1: restored backup piece 1
channel ORA_DISK_1: restore complete, elapsed time: 00:00:01
archived log file name=/u02/oradata/TTS/FRA/TTS/archivelog/2013_04_08/o1_mf_1_5_8p4fh1n8_.arc thread=1 sequence=5
channel default: deleting archived log(s)
archived log file name=/u02/oradata/TTS/FRA/TTS/archivelog/2013_04_08/o1_mf_1_5_8p4fh1n8_.arc RECID=80 STAMP=812200418
media recovery complete, elapsed time: 00:00:03
channel ORA_DISK_1: starting archived log restore to default destination
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=6
channel ORA_DISK_1: reading from backup piece /u02/oradata/TTS/FRA/TTS/backupset/2013_04_08/o1_mf_annnn_TAG20130408T100926_8p49pps2_.bkp
channel ORA_DISK_1: piece handle=/u02/oradata/TTS/FRA/TTS/backupset/2013_04_08/o1_mf_annnn_TAG20130408T100926_8p49pps2_.bkp tag=TAG20130408T100926
channel ORA_DISK_1: restored backup piece 1
channel ORA_DISK_1: restore complete, elapsed time: 00:00:01
channel default: deleting archived log(s)
archived log file name=/u02/oradata/TTS/FRA/TTS/archivelog/2013_04_08/o1_mf_1_6_8p4fh57j_.arc RECID=81 STAMP=812200421
Finished recover at 2013-04-08 11:13:42
RMAN> exit
Recovery Manager complete.
orarac2poc:TTS:/u02/oradata/TTS> sqlplus / as sysdba
SQL*Plus: Release 11.2.0.2.0 Production on Mon Apr 8 11:14:13 2013
Copyright (c) 1982, 2010, Oracle. All rights reserved.
Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
SYS@TTS> select file#, CHECKPOINT_CHANGE# from V$DATAFILE_HEADER;
FILE# CHECKPOINT_CHANGE#
---------- ------------------
1 1520849
2 1520849
3 1520849
4 1520849
5 1520849
6 1520849
6 rows selected.
SYS@TTS> select controlfile_change# from v$database;
CONTROLFILE_CHANGE#
-------------------
1521335
SYS@TTS> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
orarac2poc:TTS:/u02/oradata/TTS> rman target /
Recovery Manager: Release 11.2.0.2.0 - Production on Mon Apr 8 11:14:54 2013
Copyright (c) 1982, 2009, Oracle and/or its affiliates. All rights reserved.
connected to target database: TTS (DBID=1769654909, not open)
RMAN> sql ' alter database open read only';
using target database control file instead of recovery catalog
sql statement: alter database open read only
RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-03009: failure of sql command on default channel at 04/08/2013 11:15:05
RMAN-11003: failure during parse/execution of SQL statement: alter database open read only
ORA-16005: database requires recovery
RMAN> exit
Recovery Manager complete.
orarac2poc:TTS:/u02/oradata/TTS> sqlplus / as sysdba
SQL*Plus: Release 11.2.0.2.0 Production on Mon Apr 8 11:15:10 2013
Copyright (c) 1982, 2010, Oracle. All rights reserved.
Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
SYS@TTS> alter database open read only ;
alter database open read only
*
ERROR at line 1:
ORA-16005: database requires recovery
SYS@TTS> alter database open resetlogs ;
Database altered.
SYS@TTS> select * from liqy.incr_changes;
C1 CHANGES
---------- --------------------
3 some changes
4 some more changes
5 change no apply
6 last change
9 using bakctrlfile2
10 change before drop
1 init backup copy
2 change before crash
7 after PITR
8 using bakctrlfile
7 no online redo
11 change2 before drop
12 rows selected.
SYS@TTS> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
6. Verify that disk copy are still valid after open resetlogs , for next attemp of restoration and recovery.
orarac2poc:TTS:/u02/oradata/TTS> rman target /
Recovery Manager: Release 11.2.0.2.0 - Production on Mon Apr 8 11:24:21 2013
Copyright (c) 1982, 2009, Oracle and/or its affiliates. All rights reserved.
connected to target database: TTS (DBID=1769654909)
RMAN> crosscheck copy of database;
allocated channel: ORA_DISK_1
channel ORA_DISK_1: SID=68 device type=DISK
validation succeeded for datafile copy
datafile copy file name=/u02/oradata/TTS/FRA/TTS/datafile/o1_mf_system_8owwc247_.dbf RECID=144 STAMP=812196024
validation succeeded for datafile copy
datafile copy file name=/u02/oradata/TTS/FRA/TTS/datafile/o1_mf_sysaux_8owwd7fd_.dbf RECID=143 STAMP=812196024
validation succeeded for datafile copy
datafile copy file name=/u02/oradata/TTS/FRA/TTS/datafile/o1_mf_undotbs1_8owwfbql_.dbf RECID=142 STAMP=812196019
validation succeeded for datafile copy
datafile copy file name=/u02/oradata/TTS/FRA/TTS/datafile/o1_mf_users_8owwfwm8_.dbf RECID=139 STAMP=812196015
validation succeeded for datafile copy
datafile copy file name=/u02/oradata/TTS/FRA/TTS/datafile/o1_mf_tts1_8owwft1v_.dbf RECID=141 STAMP=812196016
validation succeeded for datafile copy
datafile copy file name=/u02/oradata/TTS/FRA/TTS/datafile/o1_mf_testtbs_8owwfv98_.dbf RECID=140 STAMP=812196015
Crosschecked 6 objects
RMAN> list copy of database;
List of Datafile Copies
=======================
Key File S Completion Time Ckp SCN Ckp Time
------- ---- - ------------------- ---------- -------------------
144 1 A 2013-04-08 10:00:24 1520350 2013-04-08 09:57:42
Name: /u02/oradata/TTS/FRA/TTS/datafile/o1_mf_system_8owwc247_.dbf
Tag: DAILY_INCR
143 2 A 2013-04-08 10:00:24 1520350 2013-04-08 09:57:42
Name: /u02/oradata/TTS/FRA/TTS/datafile/o1_mf_sysaux_8owwd7fd_.dbf
Tag: DAILY_INCR
142 3 A 2013-04-08 10:00:19 1520350 2013-04-08 09:57:42
Name: /u02/oradata/TTS/FRA/TTS/datafile/o1_mf_undotbs1_8owwfbql_.dbf
Tag: DAILY_INCR
139 4 A 2013-04-08 10:00:15 1520350 2013-04-08 09:57:42
Name: /u02/oradata/TTS/FRA/TTS/datafile/o1_mf_users_8owwfwm8_.dbf
Tag: DAILY_INCR
141 5 A 2013-04-08 10:00:16 1520350 2013-04-08 09:57:42
Name: /u02/oradata/TTS/FRA/TTS/datafile/o1_mf_tts1_8owwft1v_.dbf
Tag: DAILY_INCR
140 6 A 2013-04-08 10:00:15 1520350 2013-04-08 09:57:42
Name: /u02/oradata/TTS/FRA/TTS/datafile/o1_mf_testtbs_8owwfv98_.dbf
Tag: DAILY_INCR
RMAN> list copy of archivelog all;
List of Archived Log Copies for database with db_unique_name TTS
=====================================================================
Key Thrd Seq S Low Time
------- ---- ------- - -------------------
79 1 7 A 2013-04-08 10:09:25
Name: /u02/oradata/TTS/FRA/TTS/archivelog/2013_04_08/o1_mf_1_7_8p4b926y_.arc
82 1 8 A 2013-04-08 10:19:14
Name: /u02/oradata/TTS/FRA/TTS/archivelog/2013_04_08/o1_mf_1_8_8p4flknl_.arc
RMAN> shutdown immediate
database closed
database dismounted
Oracle instance shut down
RMAN> exit
7. The alert log of above test.
Mon Apr 08 10:50:45 2013
db_recovery_file_dest_size of 2500 MB is 75.23% used. This is a
user-specified limit on the amount of space that will be used by this
database for recovery-related files, and does not reflect the amount of
space available in the underlying filesystem or ASM diskgroup.
Mon Apr 08 11:11:54 2013
Checker run found 6 new persistent data failures
Mon Apr 08 11:12:18 2013
Restore of datafile copy /u02/oradata/TTS/FRA/TTS/datafile/o1_mf_system_8owwc247_.dbf complete to datafile 1 /u02/oradata/TTS/system01.dbf
checkpoint is 1520350
Mon Apr 08 11:12:44 2013
Restore of datafile copy /u02/oradata/TTS/FRA/TTS/datafile/o1_mf_sysaux_8owwd7fd_.dbf complete to datafile 2 /u02/oradata/TTS/sysaux01.dbf
checkpoint is 1520350
Mon Apr 08 11:13:10 2013
Restore of datafile copy /u02/oradata/TTS/FRA/TTS/datafile/o1_mf_undotbs1_8owwfbql_.dbf complete to datafile 3 /u02/oradata/TTS/undotbs01.dbf
checkpoint is 1520350
Restore of datafile copy /u02/oradata/TTS/FRA/TTS/datafile/o1_mf_users_8owwfwm8_.dbf complete to datafile 4 /u02/oradata/TTS/users01.dbf
checkpoint is 1520350
Restore of datafile copy /u02/oradata/TTS/FRA/TTS/datafile/o1_mf_tts1_8owwft1v_.dbf complete to datafile 5 /u02/oradata/TTS/tts1_01.bdf
checkpoint is 1520350
Mon Apr 08 11:13:21 2013
Restore of datafile copy /u02/oradata/TTS/FRA/TTS/datafile/o1_mf_testtbs_8owwfv98_.dbf complete to datafile 6 /u02/oradata/TTS/testtbs1.dbf
checkpoint is 1520350
Mon Apr 08 11:13:35 2013
alter database recover datafile list clear
Completed: alter database recover datafile list clear
alter database recover datafile list
1 , 2 , 3 , 4 , 5 , 6
Completed: alter database recover datafile list
1 , 2 , 3 , 4 , 5 , 6
alter database recover if needed
start until time 'APR 08 2013 10:06:11'
Media Recovery Start
started logmerger process
Parallel Media Recovery started with 2 slaves
ORA-279 signalled during: alter database recover if needed
start until time 'APR 08 2013 10:06:11'
...
alter database recover logfile '/u02/oradata/TTS/FRA/TTS/archivelog/2013_04_08/o1_mf_1_5_8p4fh1n8_.arc'
Media Recovery Log /u02/oradata/TTS/FRA/TTS/archivelog/2013_04_08/o1_mf_1_5_8p4fh1n8_.arc
Mon Apr 08 11:13:39 2013
Recovery of Online Redo Log: Thread 1 Group 3 Seq 6 Reading mem 0
Mem# 0: /u02/oradata/TTS/redo03.log
Incomplete Recovery applied until change 1520849 time 04/08/2013 10:06:11
Media Recovery Complete (TTS)
Completed: alter database recover logfile '/u02/oradata/TTS/FRA/TTS/archivelog/2013_04_08/o1_mf_1_5_8p4fh1n8_.arc'
Mon Apr 08 11:15:05 2013
alter database open read only
AUDIT_TRAIL initialization parameter is changed to OS, as DB is NOT compatible for database opened with read-only access
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_ora_17159.trc:
ORA-16005: database requires recovery
ORA-16005 signalled during: alter database open read only...
Mon Apr 08 11:15:16 2013
alter database open read only
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_ora_17207.trc:
ORA-16005: database requires recovery
ORA-16005 signalled during: alter database open read only ...
Mon Apr 08 11:15:29 2013
alter database open resetlogs
RESETLOGS after incomplete recovery UNTIL CHANGE 1520849
Archived Log entry 82 added for thread 1 sequence 8 ID 0x698fe77b dest 1:
Clearing online redo logfile 1 /u02/oradata/TTS/redo01.log
Clearing online log 1 of thread 1 sequence number 7
Clearing online redo logfile 1 complete
Clearing online redo logfile 2 /u02/oradata/TTS/redo02.log
Clearing online redo logfile 2 complete
Clearing online redo logfile 3 /u02/oradata/TTS/redo03.log
Clearing online log 3 of thread 1 sequence number 6
Clearing online redo logfile 3 complete
Resetting resetlogs activation ID 1771038587 (0x698fe77b)
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_ora_17207.trc:
ORA-00367: checksum error in log file header
ORA-00322: log 1 of thread 1 is not current copy
ORA-00312: online log 1 thread 1: '/u02/oradata/TTS/redo01.log'
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_ora_17207.trc:
ORA-00367: checksum error in log file header
ORA-00322: log 2 of thread 1 is not current copy
ORA-00312: online log 2 thread 1: '/u02/oradata/TTS/redo02.log'
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_ora_17207.trc:
ORA-00367: checksum error in log file header
ORA-00322: log 3 of thread 1 is not current copy
ORA-00312: online log 3 thread 1: '/u02/oradata/TTS/redo03.log'
Mon Apr 08 11:15:31 2013
Setting recovery target incarnation to 12
Mon Apr 08 11:15:32 2013
Assigning activation ID 1771327040 (0x69944e40)
LGWR: STARTING ARCH PROCESSES
Mon Apr 08 11:15:32 2013
ARC0 started with pid=26, OS id=17275
ARC0: Archival started
LGWR: STARTING ARCH PROCESSES COMPLETE
ARC0: STARTING ARCH PROCESSES
Mon Apr 08 11:15:33 2013
ARC1 started with pid=27, OS id=17277
Mon Apr 08 11:15:33 2013
ARC2 started with pid=28, OS id=17281
Thread 1 opened at log sequence 1
Current log# 1 seq# 1 mem# 0: /u02/oradata/TTS/redo01.log
Successful open of redo thread 1
MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set
Mon Apr 08 11:15:33 2013
SMON: enabling cache recovery
ARC1: Archival started
Mon Apr 08 11:15:33 2013
ARC3 started with pid=29, OS id=17283
ARC2: Archival started
ARC1: Becoming the 'no FAL' ARCH
ARC1: Becoming the 'no SRL' ARCH
ARC2: Becoming the heartbeat ARCH
ARC3: Archival started
ARC0: STARTING ARCH PROCESSES COMPLETE
[17207] Successfully onlined Undo Tablespace 2.
Undo initialization finished serial:0 start:3404817924 end:3404818624 diff:700 (7 seconds)
Dictionary check beginning
Mon Apr 08 11:15:39 2013
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_dbw0_10423.trc:
ORA-01157: cannot identify/lock data file 201 - see DBWR trace file
ORA-01110: data file 201: '/u02/oradata/TTS/temp01.dbf'
ORA-27037: unable to obtain file status
Linux-x86_64 Error: 2: No such file or directory
Additional information: 3
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_dbw0_10423.trc:
ORA-01186: file 201 failed verification tests
ORA-01157: cannot identify/lock data file 201 - see DBWR trace file
ORA-01110: data file 201: '/u02/oradata/TTS/temp01.dbf'
File 201 not verified due to error ORA-01157
Dictionary check complete
Verifying file header compatibility for 11g tablespace encryption..
Verifying 11g file header compatibility for tablespace encryption completed
SMON: enabling tx recovery
Re-creating tempfile /u02/oradata/TTS/temp01.dbf
Database Characterset is US7ASCII
Mon Apr 08 11:15:42 2013
No Resource Manager plan active
replication_dependency_tracking turned off (no async multimaster replication found)
Starting background process QMNC
Mon Apr 08 11:15:44 2013
QMNC started with pid=30, OS id=17330
LOGSTDBY: Validating controlfile with logical metadata
LOGSTDBY: Validation complete
Completed: alter database open resetlogs
Mon Apr 08 11:15:49 2013
Starting background process CJQ0
Mon Apr 08 11:15:49 2013
CJQ0 started with pid=34, OS id=17362
Mon Apr 08 11:20:45 2013
Starting background process SMCO
Mon Apr 08 11:20:45 2013
SMCO started with pid=35, OS id=18169
Mon Apr 08 11:25:35 2013
Shutting down instance (immediate)
Stopping background process SMCO
Shutting down instance: further logons disabled
Mon Apr 08 11:25:35 2013
Stopping background process CJQ0
Stopping background process QMNC
Stopping background process MMNL
Stopping background process MMON
License high water mark = 6
All dispatchers and shared servers shutdown
alter database close
Mon Apr 08 11:25:39 2013
SMON: disabling tx recovery
SMON: disabling cache recovery
Mon Apr 08 11:25:39 2013
Shutting down archive processes
Archiving is disabled
Mon Apr 08 11:25:39 2013
ARCH shutting down
ARC3: Archival stopped
Mon Apr 08 11:25:39 2013
ARCH shutting down
Mon Apr 08 11:25:39 2013
ARCH shutting down
ARC1: Archival stopped
Mon Apr 08 11:25:39 2013
ARCH shutting down
ARC2: Archival stopped
ARC0: Archival stopped
Thread 1 closed at log sequence 1
Successful close of redo thread 1
Completed: alter database close
alter database dismount
Shutting down archive processes
Archiving is disabled
Completed: alter database dismount
ARCH: Archival disabled due to shutdown: 1089
Shutting down archive processes
Archiving is disabled
Mon Apr 08 11:25:40 2013
Stopping background process VKTM
ARCH: Archival disabled due to shutdown: 1089
Shutting down archive processes
Archiving is disabled
Mon Apr 08 11:25:42 2013
freeing rdom 0
Mon Apr 08 11:25:46 2013
Instance shutdown complete
Part 2: recover to a later time 10:10:00 1. Clean-up and using current control file only for recovery (without online redo logs).
orarac2poc:TTS:/u02/oradata/TTS> sqlplus / as sysdba
SQL*Plus: Release 11.2.0.2.0 Production on Mon Apr 8 11:29:41 2013
Copyright (c) 1982, 2010, Oracle. All rights reserved.
Connected to an idle instance.
SYS@TTS> exit
Disconnected
orarac2poc:TTS:/u02/oradata/TTS> ls -l
total 2129308
drwxr-xr-x 2 oracle oinstall 4096 Apr 5 15:05 bak
-rw-r----- 1 oracle oinstall 10010624 Apr 8 11:25 control01.ctl
-rw-r----- 1 oracle oinstall 59332 Apr 8 10:23 control01.ctl.gz.bak
-rw-r----- 1 oracle oinstall 10010624 Apr 8 11:25 control02.ctl
drwxr-xr-x 3 oracle oinstall 4096 Mar 27 09:33 FRA
-rw-r--r-- 1 oracle oinstall 42 Apr 5 14:51 login.sql.gz
-rw-r--r-- 1 oracle oinstall 180 Apr 4 16:25 manual_copy.sh.gz
drwxr-xr-x 2 oracle oinstall 4096 Apr 8 10:39 redo
-rw-r----- 1 oracle oinstall 52429312 Apr 8 11:25 redo01.log
-rw-r----- 1 oracle oinstall 52429312 Apr 8 11:15 redo02.log
-rw-r----- 1 oracle oinstall 52429312 Apr 8 11:15 redo03.log
-rw-r----- 1 oracle asmadmin 629153792 Apr 8 11:25 sysaux01.dbf
-rw-r----- 1 oracle oinstall 76447992 Apr 8 10:22 sysaux01.dbf.gz
-rw-r----- 1 oracle asmadmin 734011392 Apr 8 11:25 system01.dbf
-rw-r----- 1 oracle oinstall 127971383 Apr 8 10:22 system01.dbf.gz
-rw-r----- 1 oracle asmadmin 20979712 Apr 8 11:15 temp01.dbf
-rw-r----- 1 oracle oinstall 22531 Apr 5 18:00 temp01.dbf.gz
-rw-r----- 1 oracle asmadmin 10493952 Apr 8 11:25 testtbs1.dbf
-rw-r----- 1 oracle oinstall 24336 Apr 8 10:22 testtbs1.dbf.gz
-rw-r----- 1 oracle asmadmin 20979712 Apr 8 11:25 tts1_01.bdf
-rw-r----- 1 oracle oinstall 1137520 Apr 8 10:22 tts1_01.bdf.gz
-rw-r----- 1 oracle asmadmin 387981312 Apr 8 11:25 undotbs01.dbf
-rw-r----- 1 oracle oinstall 6234453 Apr 8 10:22 undotbs01.dbf.gz
-rw-r----- 1 oracle asmadmin 5251072 Apr 8 11:25 users01.dbf
-rw-r----- 1 oracle oinstall 13891 Apr 8 10:22 users01.dbf.gz
orarac2poc:TTS:/u02/oradata/TTS> ls -l con*.ctl
-rw-r----- 1 oracle oinstall 10010624 Apr 8 11:25 control01.ctl
-rw-r----- 1 oracle oinstall 10010624 Apr 8 11:25 control02.ctl
orarac2poc:TTS:/u02/oradata/TTS> rm con*.ctl
orarac2poc:TTS:/u02/oradata/TTS> rm redo*.log
orarac2poc:TTS:/u02/oradata/TTS> rm *.dbf
orarac2poc:TTS:/u02/oradata/TTS> rm tts1_01.bdf
orarac2poc:TTS:/u02/oradata/TTS> ls -l
total 207212
drwxr-xr-x 2 oracle oinstall 4096 Apr 5 15:05 bak
-rw-r----- 1 oracle oinstall 59332 Apr 8 10:23 control01.ctl.gz.bak
drwxr-xr-x 3 oracle oinstall 4096 Mar 27 09:33 FRA
-rw-r--r-- 1 oracle oinstall 42 Apr 5 14:51 login.sql.gz
-rw-r--r-- 1 oracle oinstall 180 Apr 4 16:25 manual_copy.sh.gz
drwxr-xr-x 2 oracle oinstall 4096 Apr 8 10:39 redo
-rw-r----- 1 oracle oinstall 76447992 Apr 8 10:22 sysaux01.dbf.gz
-rw-r----- 1 oracle oinstall 127971383 Apr 8 10:22 system01.dbf.gz
-rw-r----- 1 oracle oinstall 22531 Apr 5 18:00 temp01.dbf.gz
-rw-r----- 1 oracle oinstall 24336 Apr 8 10:22 testtbs1.dbf.gz
-rw-r----- 1 oracle oinstall 1137520 Apr 8 10:22 tts1_01.bdf.gz
-rw-r----- 1 oracle oinstall 6234453 Apr 8 10:22 undotbs01.dbf.gz
-rw-r----- 1 oracle oinstall 13891 Apr 8 10:22 users01.dbf.gz
orarac2poc:TTS:/u02/oradata/TTS> cp control01.ctl.gz.bak control01.ctl.gz
orarac2poc:TTS:/u02/oradata/TTS> gunzip control01.ctl.gz
orarac2poc:TTS:/u02/oradata/TTS> ls -lrt
total 217004
drwxr-xr-x 3 oracle oinstall 4096 Mar 27 09:33 FRA
-rw-r--r-- 1 oracle oinstall 180 Apr 4 16:25 manual_copy.sh.gz
-rw-r--r-- 1 oracle oinstall 42 Apr 5 14:51 login.sql.gz
drwxr-xr-x 2 oracle oinstall 4096 Apr 5 15:05 bak
-rw-r----- 1 oracle oinstall 22531 Apr 5 18:00 temp01.dbf.gz
-rw-r----- 1 oracle oinstall 13891 Apr 8 10:22 users01.dbf.gz
-rw-r----- 1 oracle oinstall 6234453 Apr 8 10:22 undotbs01.dbf.gz
-rw-r----- 1 oracle oinstall 1137520 Apr 8 10:22 tts1_01.bdf.gz
-rw-r----- 1 oracle oinstall 24336 Apr 8 10:22 testtbs1.dbf.gz
-rw-r----- 1 oracle oinstall 127971383 Apr 8 10:22 system01.dbf.gz
-rw-r----- 1 oracle oinstall 76447992 Apr 8 10:22 sysaux01.dbf.gz
-rw-r----- 1 oracle oinstall 59332 Apr 8 10:23 control01.ctl.gz.bak
drwxr-xr-x 2 oracle oinstall 4096 Apr 8 10:39 redo
-rw-r----- 1 oracle oinstall 10010624 Apr 8 11:30 control01.ctl
orarac2poc:TTS:/u02/oradata/TTS> cp -p control01.ctl control02.ctl
orarac2poc:TTS:/u02/oradata/TTS> ls -lrt
total 226796
drwxr-xr-x 3 oracle oinstall 4096 Mar 27 09:33 FRA
-rw-r--r-- 1 oracle oinstall 180 Apr 4 16:25 manual_copy.sh.gz
-rw-r--r-- 1 oracle oinstall 42 Apr 5 14:51 login.sql.gz
drwxr-xr-x 2 oracle oinstall 4096 Apr 5 15:05 bak
-rw-r----- 1 oracle oinstall 22531 Apr 5 18:00 temp01.dbf.gz
-rw-r----- 1 oracle oinstall 13891 Apr 8 10:22 users01.dbf.gz
-rw-r----- 1 oracle oinstall 6234453 Apr 8 10:22 undotbs01.dbf.gz
-rw-r----- 1 oracle oinstall 1137520 Apr 8 10:22 tts1_01.bdf.gz
-rw-r----- 1 oracle oinstall 24336 Apr 8 10:22 testtbs1.dbf.gz
-rw-r----- 1 oracle oinstall 127971383 Apr 8 10:22 system01.dbf.gz
-rw-r----- 1 oracle oinstall 76447992 Apr 8 10:22 sysaux01.dbf.gz
-rw-r----- 1 oracle oinstall 59332 Apr 8 10:23 control01.ctl.gz.bak
drwxr-xr-x 2 oracle oinstall 4096 Apr 8 10:39 redo
-rw-r----- 1 oracle oinstall 10010624 Apr 8 11:30 control02.ctl
-rw-r----- 1 oracle oinstall 10010624 Apr 8 11:30 control01.ctl
2. restore and recovery the database
orarac2poc:TTS:/u02/oradata/TTS> rman target /
Recovery Manager: Release 11.2.0.2.0 - Production on Mon Apr 8 11:31:18 2013
Copyright (c) 1982, 2009, Oracle and/or its affiliates. All rights reserved.
connected to target database (not started)
RMAN> startup mount;
Oracle instance started
database mounted
Total System Global Area 663908352 bytes
Fixed Size 2229440 bytes
Variable Size 281021248 bytes
Database Buffers 373293056 bytes
Redo Buffers 7364608 bytes
RMAN> restore database until time "to_date('2013-04-08:10:10:00','YYYY-MM-DD:HH24:MI:SS')";
Starting restore at 2013-04-08 11:32:01
using target database control file instead of recovery catalog
allocated channel: ORA_DISK_1
channel ORA_DISK_1: SID=62 device type=DISK
channel ORA_DISK_1: restoring datafile 00001
input datafile copy RECID=144 STAMP=812196024 file name=/u02/oradata/TTS/FRA/TTS/datafile/o1_mf_system_8owwc247_.dbf
destination for restore of datafile 00001: /u02/oradata/TTS/system01.dbf
channel ORA_DISK_1: copied datafile copy of datafile 00001
output file name=/u02/oradata/TTS/system01.dbf RECID=0 STAMP=0
channel ORA_DISK_1: restoring datafile 00002
input datafile copy RECID=143 STAMP=812196024 file name=/u02/oradata/TTS/FRA/TTS/datafile/o1_mf_sysaux_8owwd7fd_.dbf
destination for restore of datafile 00002: /u02/oradata/TTS/sysaux01.dbf
channel ORA_DISK_1: copied datafile copy of datafile 00002
output file name=/u02/oradata/TTS/sysaux01.dbf RECID=0 STAMP=0
channel ORA_DISK_1: restoring datafile 00003
input datafile copy RECID=142 STAMP=812196019 file name=/u02/oradata/TTS/FRA/TTS/datafile/o1_mf_undotbs1_8owwfbql_.dbf
destination for restore of datafile 00003: /u02/oradata/TTS/undotbs01.dbf
channel ORA_DISK_1: copied datafile copy of datafile 00003
output file name=/u02/oradata/TTS/undotbs01.dbf RECID=0 STAMP=0
channel ORA_DISK_1: restoring datafile 00004
input datafile copy RECID=139 STAMP=812196015 file name=/u02/oradata/TTS/FRA/TTS/datafile/o1_mf_users_8owwfwm8_.dbf
destination for restore of datafile 00004: /u02/oradata/TTS/users01.dbf
channel ORA_DISK_1: copied datafile copy of datafile 00004
output file name=/u02/oradata/TTS/users01.dbf RECID=0 STAMP=0
channel ORA_DISK_1: restoring datafile 00005
input datafile copy RECID=141 STAMP=812196016 file name=/u02/oradata/TTS/FRA/TTS/datafile/o1_mf_tts1_8owwft1v_.dbf
destination for restore of datafile 00005: /u02/oradata/TTS/tts1_01.bdf
channel ORA_DISK_1: copied datafile copy of datafile 00005
output file name=/u02/oradata/TTS/tts1_01.bdf RECID=0 STAMP=0
channel ORA_DISK_1: restoring datafile 00006
input datafile copy RECID=140 STAMP=812196015 file name=/u02/oradata/TTS/FRA/TTS/datafile/o1_mf_testtbs_8owwfv98_.dbf
destination for restore of datafile 00006: /u02/oradata/TTS/testtbs1.dbf
channel ORA_DISK_1: copied datafile copy of datafile 00006
output file name=/u02/oradata/TTS/testtbs1.dbf RECID=0 STAMP=0
Finished restore at 2013-04-08 11:33:23
RMAN> recover database until time "to_date('2013-04-08:10:10:00','YYYY-MM-DD:HH24:MI:SS')";
Starting recover at 2013-04-08 11:33:46
using channel ORA_DISK_1
starting media recovery
archived log for thread 1 with sequence 7 is already on disk as file /u02/oradata/TTS/FRA/TTS/archivelog/2013_04_08/o1_mf_1_7_8p4b926y_.arc
channel ORA_DISK_1: starting archived log restore to default destination
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=5
channel ORA_DISK_1: reading from backup piece /u02/oradata/TTS/FRA/TTS/backupset/2013_04_08/o1_mf_annnn_TAG20130408T095918_8p493q99_.bkp
channel ORA_DISK_1: piece handle=/u02/oradata/TTS/FRA/TTS/backupset/2013_04_08/o1_mf_annnn_TAG20130408T095918_8p493q99_.bkp tag=TAG20130408T095918
channel ORA_DISK_1: restored backup piece 1
channel ORA_DISK_1: restore complete, elapsed time: 00:00:01
archived log file name=/u02/oradata/TTS/FRA/TTS/archivelog/2013_04_08/o1_mf_1_5_8p4gnx8f_.arc thread=1 sequence=5
channel default: deleting archived log(s)
archived log file name=/u02/oradata/TTS/FRA/TTS/archivelog/2013_04_08/o1_mf_1_5_8p4gnx8f_.arc RECID=81 STAMP=812201629
channel ORA_DISK_1: starting archived log restore to default destination
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=6
channel ORA_DISK_1: reading from backup piece /u02/oradata/TTS/FRA/TTS/backupset/2013_04_08/o1_mf_annnn_TAG20130408T100926_8p49pps2_.bkp
channel ORA_DISK_1: piece handle=/u02/oradata/TTS/FRA/TTS/backupset/2013_04_08/o1_mf_annnn_TAG20130408T100926_8p49pps2_.bkp tag=TAG20130408T100926
channel ORA_DISK_1: restored backup piece 1
channel ORA_DISK_1: restore complete, elapsed time: 00:00:01
archived log file name=/u02/oradata/TTS/FRA/TTS/archivelog/2013_04_08/o1_mf_1_6_8p4gnysd_.arc thread=1 sequence=6
channel default: deleting archived log(s)
archived log file name=/u02/oradata/TTS/FRA/TTS/archivelog/2013_04_08/o1_mf_1_6_8p4gnysd_.arc RECID=82 STAMP=812201630
archived log file name=/u02/oradata/TTS/FRA/TTS/archivelog/2013_04_08/o1_mf_1_7_8p4b926y_.arc thread=1 sequence=7
media recovery complete, elapsed time: 00:00:02
Finished recover at 2013-04-08 11:33:53
RMAN> exit
Recovery Manager complete.
orarac2poc:TTS:/u02/oradata/TTS> sqlplus / as sysdba
SQL*Plus: Release 11.2.0.2.0 Production on Mon Apr 8 11:34:29 2013
Copyright (c) 1982, 2010, Oracle. All rights reserved.
Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
SYS@TTS> alter database open read only ;
alter database open read only
*
ERROR at line 1:
ORA-16005: database requires recovery
SYS@TTS> select controlfile_change# from v$database;
CONTROLFILE_CHANGE#
-------------------
1521335
SYS@TTS> select file#, CHECKPOINT_CHANGE# from V$DATAFILE_HEADER;
FILE# CHECKPOINT_CHANGE#
---------- ------------------
1 1520976
2 1520976
3 1520976
4 1520976
5 1520976
6 1520976
6 rows selected.
-- controlfile's SCN is greater than that in datafile's heaed, causes no open read only possible.
SYS@TTS> alter database open resetlogs ;
Database altered.
SYS@TTS> select * from liqy.incr_changes;
C1 CHANGES
---------- --------------------
3 some changes
4 some more changes
5 change no apply
6 last change
9 using bakctrlfile2
10 change before drop
12 bf delete
1 init backup copy
2 change before crash
7 after PITR
8 using bakctrlfile
7 no online redo
11 change2 before drop
13 rows selected.
SYS@TTS>
3. The alert log of part 2 test.
Mon Apr 08 11:31:33 2013
alter database mount
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_ora_19956.trc:
ORA-19816: WARNING: Files may exist in db_recovery_file_dest that are not known to database.
*************************************************************
WARNING: Files created after time 04/07/2013 00:05:42 may exist in
db_recovery_file_dest that is not known to the database.
Use the RMAN command CATALOG RECOVERY AREA to re-catalog
any such files. If files cannot be cataloged, then manually
delete them using OS command. This is most likely the
result of a crash during file creation.
*************************************************************
Successful mount of redo thread 1, with mount id 1771283285
Database mounted in Exclusive Mode
Lost write protection disabled
Completed: alter database mount
Mon Apr 08 11:32:02 2013
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_m000_20074.trc:
ORA-00313: open failed for members of log group 1 of thread 1
ORA-00312: online log 1 thread 1: '/u02/oradata/TTS/redo01.log'
ORA-27037: unable to obtain file status
Linux-x86_64 Error: 2: No such file or directory
Additional information: 3
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_m000_20074.trc:
ORA-00313: open failed for members of log group 2 of thread 1
ORA-00312: online log 2 thread 1: '/u02/oradata/TTS/redo02.log'
ORA-27037: unable to obtain file status
Linux-x86_64 Error: 2: No such file or directory
Additional information: 3
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_m000_20074.trc:
ORA-00313: open failed for members of log group 3 of thread 1
ORA-00312: online log 3 thread 1: '/u02/oradata/TTS/redo03.log'
ORA-27037: unable to obtain file status
Linux-x86_64 Error: 2: No such file or directory
Additional information: 3
Checker run found 7 new persistent data failures
Mon Apr 08 11:32:22 2013
Restore of datafile copy /u02/oradata/TTS/FRA/TTS/datafile/o1_mf_system_8owwc247_.dbf complete to datafile 1 /u02/oradata/TTS/system01.dbf
checkpoint is 1520350
Mon Apr 08 11:32:55 2013
Restore of datafile copy /u02/oradata/TTS/FRA/TTS/datafile/o1_mf_sysaux_8owwd7fd_.dbf complete to datafile 2 /u02/oradata/TTS/sysaux01.dbf
checkpoint is 1520350
Mon Apr 08 11:33:16 2013
Restore of datafile copy /u02/oradata/TTS/FRA/TTS/datafile/o1_mf_undotbs1_8owwfbql_.dbf complete to datafile 3 /u02/oradata/TTS/undotbs01.dbf
checkpoint is 1520350
Restore of datafile copy /u02/oradata/TTS/FRA/TTS/datafile/o1_mf_users_8owwfwm8_.dbf complete to datafile 4 /u02/oradata/TTS/users01.dbf
checkpoint is 1520350
Restore of datafile copy /u02/oradata/TTS/FRA/TTS/datafile/o1_mf_tts1_8owwft1v_.dbf complete to datafile 5 /u02/oradata/TTS/tts1_01.bdf
checkpoint is 1520350
Restore of datafile copy /u02/oradata/TTS/FRA/TTS/datafile/o1_mf_testtbs_8owwfv98_.dbf complete to datafile 6 /u02/oradata/TTS/testtbs1.dbf
checkpoint is 1520350
Mon Apr 08 11:33:47 2013
alter database recover datafile list clear
Completed: alter database recover datafile list clear
alter database recover datafile list
1 , 2 , 3 , 4 , 5 , 6
Completed: alter database recover datafile list
1 , 2 , 3 , 4 , 5 , 6
alter database recover if needed
start until time 'APR 08 2013 10:10:00'
Media Recovery Start
started logmerger process
Parallel Media Recovery started with 2 slaves
ORA-279 signalled during: alter database recover if needed
start until time 'APR 08 2013 10:10:00'
...
alter database recover logfile '/u02/oradata/TTS/FRA/TTS/archivelog/2013_04_08/o1_mf_1_5_8p4gnx8f_.arc'
Media Recovery Log /u02/oradata/TTS/FRA/TTS/archivelog/2013_04_08/o1_mf_1_5_8p4gnx8f_.arc
Mon Apr 08 11:33:50 2013
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_pr00_20372.trc:
ORA-00313: open failed for members of log group 3 of thread 1
ORA-00312: online log 3 thread 1: '/u02/oradata/TTS/redo03.log'
ORA-27037: unable to obtain file status
Linux-x86_64 Error: 2: No such file or directory
Additional information: 3
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_pr00_20372.trc:
ORA-00313: open failed for members of log group 3 of thread 1
ORA-00312: online log 3 thread 1: '/u02/oradata/TTS/redo03.log'
ORA-27037: unable to obtain file status
Linux-x86_64 Error: 2: No such file or directory
Additional information: 3
ORA-279 signalled during: alter database recover logfile '/u02/oradata/TTS/FRA/TTS/archivelog/2013_04_08/o1_mf_1_5_8p4gnx8f_.arc'...
Mon Apr 08 11:33:50 2013
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_m000_20390.trc:
ORA-00313: open failed for members of log group 1 of thread 1
ORA-00312: online log 1 thread 1: '/u02/oradata/TTS/redo01.log'
ORA-27037: unable to obtain file status
Linux-x86_64 Error: 2: No such file or directory
Additional information: 3
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_m000_20390.trc:
ORA-00313: open failed for members of log group 2 of thread 1
ORA-00312: online log 2 thread 1: '/u02/oradata/TTS/redo02.log'
ORA-27037: unable to obtain file status
Linux-x86_64 Error: 2: No such file or directory
Additional information: 3
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_m000_20390.trc:
ORA-00313: open failed for members of log group 3 of thread 1
ORA-00312: online log 3 thread 1: '/u02/oradata/TTS/redo03.log'
ORA-27037: unable to obtain file status
Linux-x86_64 Error: 2: No such file or directory
Additional information: 3
alter database recover logfile '/u02/oradata/TTS/FRA/TTS/archivelog/2013_04_08/o1_mf_1_6_8p4gnysd_.arc'
Media Recovery Log /u02/oradata/TTS/FRA/TTS/archivelog/2013_04_08/o1_mf_1_6_8p4gnysd_.arc
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_pr00_20372.trc:
ORA-00313: open failed for members of log group 1 of thread 1
ORA-00312: online log 1 thread 1: '/u02/oradata/TTS/redo01.log'
ORA-27037: unable to obtain file status
Linux-x86_64 Error: 2: No such file or directory
Additional information: 3
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_pr00_20372.trc:
ORA-00313: open failed for members of log group 1 of thread 1
ORA-00312: online log 1 thread 1: '/u02/oradata/TTS/redo01.log'
ORA-27037: unable to obtain file status
Linux-x86_64 Error: 2: No such file or directory
Additional information: 3
ORA-279 signalled during: alter database recover logfile '/u02/oradata/TTS/FRA/TTS/archivelog/2013_04_08/o1_mf_1_6_8p4gnysd_.arc'...
alter database recover logfile '/u02/oradata/TTS/FRA/TTS/archivelog/2013_04_08/o1_mf_1_7_8p4b926y_.arc'
Media Recovery Log /u02/oradata/TTS/FRA/TTS/archivelog/2013_04_08/o1_mf_1_7_8p4b926y_.arc
Incomplete Recovery applied until change 1520976 time 04/08/2013 10:10:34
Media Recovery Complete (TTS)
Completed: alter database recover logfile '/u02/oradata/TTS/FRA/TTS/archivelog/2013_04_08/o1_mf_1_7_8p4b926y_.arc'
Mon Apr 08 11:34:34 2013
alter database open read only
AUDIT_TRAIL initialization parameter is changed to OS, as DB is NOT compatible for database opened with read-only access
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_ora_20509.trc:
ORA-16005: database requires recovery
ORA-16005 signalled during: alter database open read only ...
Mon Apr 08 11:34:49 2013
alter database open resetlogs
RESETLOGS after incomplete recovery UNTIL CHANGE 1520976
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_ora_20509.trc:
ORA-00313: open failed for members of log group 2 of thread 1
ORA-00312: online log 2 thread 1: '/u02/oradata/TTS/redo02.log'
ORA-27037: unable to obtain file status
Linux-x86_64 Error: 2: No such file or directory
Additional information: 3
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_ora_20509.trc:
ORA-00313: open failed for members of log group 1 of thread 1
ORA-00312: online log 1 thread 1: '/u02/oradata/TTS/redo01.log'
ORA-27037: unable to obtain file status
Linux-x86_64 Error: 2: No such file or directory
Additional information: 3
Clearing online redo logfile 1 /u02/oradata/TTS/redo01.log
Clearing online log 1 of thread 1 sequence number 7
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_ora_20509.trc:
ORA-00313: open failed for members of log group 1 of thread 1
ORA-00312: online log 1 thread 1: '/u02/oradata/TTS/redo01.log'
ORA-27037: unable to obtain file status
Linux-x86_64 Error: 2: No such file or directory
Additional information: 3
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_ora_20509.trc:
ORA-00313: open failed for members of log group 1 of thread 1
ORA-00312: online log 1 thread 1: '/u02/oradata/TTS/redo01.log'
ORA-27037: unable to obtain file status
Linux-x86_64 Error: 2: No such file or directory
Additional information: 3
Clearing online redo logfile 1 complete
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_ora_20509.trc:
ORA-00313: open failed for members of log group 2 of thread 1
ORA-00312: online log 2 thread 1: '/u02/oradata/TTS/redo02.log'
ORA-27037: unable to obtain file status
Linux-x86_64 Error: 2: No such file or directory
Additional information: 3
Clearing online redo logfile 2 /u02/oradata/TTS/redo02.log
Clearing online redo logfile 2 complete
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_ora_20509.trc:
ORA-00313: open failed for members of log group 3 of thread 1
ORA-00312: online log 3 thread 1: '/u02/oradata/TTS/redo03.log'
ORA-27037: unable to obtain file status
Linux-x86_64 Error: 2: No such file or directory
Additional information: 3
Clearing online redo logfile 3 /u02/oradata/TTS/redo03.log
Clearing online log 3 of thread 1 sequence number 6
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_ora_20509.trc:
ORA-00313: open failed for members of log group 3 of thread 1
ORA-00312: online log 3 thread 1: '/u02/oradata/TTS/redo03.log'
ORA-27037: unable to obtain file status
Linux-x86_64 Error: 2: No such file or directory
Additional information: 3
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_ora_20509.trc:
ORA-00313: open failed for members of log group 3 of thread 1
ORA-00312: online log 3 thread 1: '/u02/oradata/TTS/redo03.log'
ORA-27037: unable to obtain file status
Linux-x86_64 Error: 2: No such file or directory
Additional information: 3
Clearing online redo logfile 3 complete
Resetting resetlogs activation ID 1771038587 (0x698fe77b)
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_ora_20509.trc:
ORA-00367: checksum error in log file header
ORA-00322: log 1 of thread 1 is not current copy
ORA-00312: online log 1 thread 1: '/u02/oradata/TTS/redo01.log'
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_ora_20509.trc:
ORA-00313: open failed for members of log group 2 of thread 1
ORA-00312: online log 2 thread 1: '/u02/oradata/TTS/redo02.log'
ORA-27037: unable to obtain file status
Linux-x86_64 Error: 2: No such file or directory
Additional information: 3
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_ora_20509.trc:
ORA-00313: open failed for members of log group 2 of thread 1
ORA-00312: online log 2 thread 1: '/u02/oradata/TTS/redo02.log'
ORA-27037: unable to obtain file status
Linux-x86_64 Error: 2: No such file or directory
Additional information: 3
Mon Apr 08 11:34:50 2013
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_m000_20576.trc:
ORA-00316: log 1 of thread 1, type 0 in header is not log file
ORA-00312: online log 1 thread 1: '/u02/oradata/TTS/redo01.log'
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_m000_20576.trc:
ORA-00316: log 2 of thread 1, type 0 in header is not log file
ORA-00312: online log 2 thread 1: '/u02/oradata/TTS/redo02.log'
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_m000_20576.trc:
ORA-00322: log 3 of thread 1 is not current copy
ORA-00312: online log 3 thread 1: '/u02/oradata/TTS/redo03.log'
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_ora_20509.trc:
ORA-00367: checksum error in log file header
ORA-00322: log 3 of thread 1 is not current copy
ORA-00312: online log 3 thread 1: '/u02/oradata/TTS/redo03.log'
Mon Apr 08 11:34:51 2013
Setting recovery target incarnation to 12
Checker run found 4 new persistent data failures
Mon Apr 08 11:34:51 2013
Assigning activation ID 1771283285 (0x6993a355)
LGWR: STARTING ARCH PROCESSES
Mon Apr 08 11:34:51 2013
ARC0 started with pid=26, OS id=20582
ARC0: Archival started
LGWR: STARTING ARCH PROCESSES COMPLETE
ARC0: STARTING ARCH PROCESSES
Mon Apr 08 11:34:52 2013
ARC1 started with pid=27, OS id=20586
Mon Apr 08 11:34:52 2013
ARC2 started with pid=28, OS id=20588
Thread 1 opened at log sequence 1
Current log# 1 seq# 1 mem# 0: /u02/oradata/TTS/redo01.log
Successful open of redo thread 1
MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set
ARC1: Archival started
ARC2: Archival started
ARC2: Becoming the 'no FAL' ARCH
ARC2: Becoming the 'no SRL' ARCH
Mon Apr 08 11:34:52 2013
ARC3 started with pid=29, OS id=20590
ARC1: Becoming the heartbeat ARCH
Mon Apr 08 11:34:52 2013
SMON: enabling cache recovery
ARC3: Archival started
ARC0: STARTING ARCH PROCESSES COMPLETE
[20509] Successfully onlined Undo Tablespace 2.
Undo initialization finished serial:0 start:3405974774 end:3405975354 diff:580 (5 seconds)
Dictionary check beginning
Mon Apr 08 11:34:56 2013
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_dbw0_19933.trc:
ORA-01157: cannot identify/lock data file 201 - see DBWR trace file
ORA-01110: data file 201: '/u02/oradata/TTS/temp01.dbf'
ORA-27037: unable to obtain file status
Linux-x86_64 Error: 2: No such file or directory
Additional information: 3
Errors in file /u01/app/oracle/diag/rdbms/tts/TTS/trace/TTS_dbw0_19933.trc:
ORA-01186: file 201 failed verification tests
ORA-01157: cannot identify/lock data file 201 - see DBWR trace file
ORA-01110: data file 201: '/u02/oradata/TTS/temp01.dbf'
File 201 not verified due to error ORA-01157
Dictionary check complete
Verifying file header compatibility for 11g tablespace encryption..
Verifying 11g file header compatibility for tablespace encryption completed
SMON: enabling tx recovery
Re-creating tempfile /u02/oradata/TTS/temp01.dbf
Database Characterset is US7ASCII
No Resource Manager plan active
replication_dependency_tracking turned off (no async multimaster replication found)
Mon Apr 08 11:34:59 2013
Starting background process QMNC
Mon Apr 08 11:34:59 2013
QMNC started with pid=30, OS id=20617
LOGSTDBY: Validating controlfile with logical metadata
LOGSTDBY: Validation complete
Completed: alter database open resetlogs
Mon Apr 08 11:35:03 2013
db_recovery_file_dest_size of 2500 MB is 75.62% used. This is a
user-specified limit on the amount of space that will be used by this
database for recovery-related files, and does not reflect the amount of
space available in the underlying filesystem or ASM diskgroup.
Mon Apr 08 11:35:03 2013
Starting background process CJQ0
Mon Apr 08 11:35:03 2013
CJQ0 started with pid=34, OS id=20642
Mon Apr 08 11:40:00 2013
Starting background process SMCO
Mon Apr 08 11:40:00 2013
SMCO started with pid=32, OS id=21418
No comments:
Post a Comment