Hi all
Having an odd one for a week now. Really hoping for some suggestions here - DP is handling all backups for roughly 50 servers including HV-Cluster, Hosted Exchange DAG Environment etc.
Server 2008R2 - DP8.0
Tape Library and D2D Disk Storage (File Library).
All jobs indicate:
[Warning] From: BSM@*SERVER*"VM - HCDB01" Time: 4/10/2015 6:00:08 AM
Cannot establish connection with the Media Management database.
Backup is waiting for the Media Management database to be accessible.
[Critical] From: BSM@*SERVER*" "VM - HCDB01" Time: 4/10/2015 7:00:16 AM
Could not establish connection with MMD within 60 minutes.
Session will be aborted.
[Minor] From: BSM@@*SERVER*" "VM - HCDB01" Time: 4/10/2015 7:01:24 AM
[61:4010] Pool "" not found in the database.
[Minor] From: BSM@*SERVER*" "VM - HCDB01" Time: 4/10/2015 7:01:24 AM
[61:4010] Pool "" not found in the database.
[Critical] From: BSM@*SERVER*" "VM - HCDB01" Time: 4/10/2015 7:01:24 AM [12:1243] Device not found.
If i restart the services/server it will work for a short while and break again.
Research coming up blank for fixes. Some data output below.
>omnidbcheck -extended
Check Level Mode Status
===========================================================
Database connection -connection OK
Schema consistency -schema_consistency OK
Datafiles consistency -verify_db_files OK
Database consistency -database_consistency OK
Media consistency -media_consistency OK
SIBF(readability) -sibf OK
DCBF(presence and size) -bf OK
OMNIDC(consistency) -dc OK
DONE!
>omnisv -status
ProcName Status [PID]
===============================
crs : Active [320]
mmd : Active [7608]
kms : Active [5052]
hpdp-idb : Active [4828]
hpdp-idb-cp : Active [3876]
hpdp-as : Active [7048]
omniinet : Active [2876]
Sending of traps disabled.
===============================
Status: All Data Protector processes/services up and running.
If I run a job it will then indicate the error:
Cannot establish connection with the Media Management database.
Then Output for omnisv -status changes to: (MMD: DOWN)
>omnisv -status
ProcName Status [PID]
===============================
crs : Active [2964]
mmd : Down
kms : Active [2908]
hpdp-idb : Active [9012]
hpdp-idb-cp : Active [8924]
hpdp-as : Active [8024]
omniinet : Active [7040]
Sending of traps disabled.
===============================
Status: At least one of the Data Protector processes/services is not running.
Event Log is also tossing out the below in Application log:
Event ID 1000 - Application Error
Faulting application name: mmd.exe, version: 8.0.596.0, time stamp: 0x5199e4b2
Faulting module name: facade.dll, version: 0.0.0.0, time stamp: 0x5199e2a0
Exception code: 0xc0000005
Fault offset: 0x00000000002f3597
Faulting process id: 0x1ec0
Faulting application start time: 0x01d061b31e0bab35
Faulting application path: C:\Program Files\OmniBack\bin\mmd.exe
Faulting module path: C:\Program Files\OmniBack\bin\facade.dll
Report Id: 08f4a717-d8c1-11e4-a2b7-18a905551156
Also Event ID 1000
Faulting application name: bsm.exe, version: 8.0.596.0, time stamp: 0x5199e4bc
Faulting module name: KERNELBASE.dll, version: 6.1.7601.17514, time stamp: 0x4ce7c78c
Exception code: 0xc00000fd
Fault offset: 0x0000000000002162
Faulting process id: 0x2290
Faulting application start time: 0x01d06cc94fb5b56f
Faulting application path: C:\Program Files\OmniBack\bin\bsm.exe
Faulting module path: C:\Windows\system32\KERNELBASE.dll
Report Id: fc388f1c-d8c9-11e4-a2b7-18a905551156
Faulting application name: omnidbutil.exe, version: 0.0.0.0, time stamp: 0x5199e4d4
Faulting module name: MSVCR90.dll, version: 9.0.30729.4940, time stamp: 0x4ca2e32e
Exception code: 0x40000015
Fault offset: 0x0000000000042686
Faulting process id: 0x518
Faulting application start time: 0x01d0711dd079614f
Faulting application path: C:\Program Files\OmniBack\bin\omnidbutil.exe
Faulting module path: C:\Windows\WinSxS\amd64_microsoft.vc90.crt_1fc8b3b9a1e18e3b_9.0.30729.4940_none_08e4299fa83d7e3c\MSVCR90.dll
Report Id: 0ed3b1b7-dd11-11e4-9003-18a905551156
I have tried to include as much info here as possible with my limited DP knowledge. Please request additional info if required and how to obtain it.
Thank you in advance for any advise.
Regards