Hi All,
We currently running SQL 2019 on Windows 2019 Core and have the analysis services running under a cluster. We had a storage failure 2 days ago and VMWare automatically rebooted all the hosts, and now we are getting this error with the analysis service.
I have looked at the cluster logs and see the following messages:
[GEM] Node 1: Processing message as part of GemRepair message 1:337 from node 1. Action: gum/do-update, Target: GUMA
00000e4c.000009e4::2020/08/04-08:42:17.848 INFO [RCM] rcm::RcmGroup::NodeIsPossibleOwner: Group SQL Server (SSAS): Node:1 IsPossibleOwner:true
00000e4c.000009e4::2020/08/04-08:42:17.849 INFO [RCM-rbtr] giving default token to group SQL Server (SSAS)
00000e4c.000009e4::2020/08/04-08:42:17.849 INFO [RCM-rbtr] giving default token to group SQL Server (SSAS)
00000e4c.000009e4::2020/08/04-08:42:17.849 INFO [RCM] Res Analysis Services (SSAS): Failed -> OnlineCallIssued( StateUnknown )
00000e4c.000009e4::2020/08/04-08:42:17.849 INFO [RCM] TransitionToState(Analysis Services (SSAS)) Failed-->OnlineCallIssued.
00000e4c.000009e4::2020/08/04-08:42:17.850 INFO [RCM] rcm::RcmGroup::UpdateStateIfChanged: (SQL Server (SSAS), Failed --> Pending)
00000e4c.000005cc::2020/08/04-08:42:17.850 INFO [GEM] Node 1: Processing message as part of GemRepair message 1:338 from node 1. Action: causal, Target: CAUS
00000e4c.000005cc::2020/08/04-08:42:17.850 INFO [GEM] Node 1: Processing message as part of GemRepair message 1:339 from node 1. Action: causal, Target: CAUS
00000e4c.00001ea4::2020/08/04-08:42:17.850 INFO [CM] mscs::RegCheckpoint::RestoreCheckpoint: Restoring checkpoint Software\Microsoft\Microsoft SQL Server\MSAS15.SSAS\Cluster for resource Analysis Services (SSAS).
00000e4c.000009e4::2020/08/04-08:42:17.852 INFO [RCM-rbtr] giving default token to group SQL Server (SSAS)
00000e4c.000009e4::2020/08/04-08:42:17.852 INFO [RCM] rcm::RcmResource::Online: SQL Server Analysis Services CEIP (SSAS)'s provider 'Analysis Services (SSAS)' is already coming online (state is OnlineCallIssued).
00000e4c.000009e4::2020/08/04-08:42:17.853 INFO [RCM-rbtr] giving default token to group SQL Server (SSAS)
00000e4c.000009e4::2020/08/04-08:42:17.853 INFO [RCM] Res SQL Server Analysis Services CEIP (SSAS): OfflineDueToProvider -> WaitingToComeOnline( StateUnknown )
00000e4c.000009e4::2020/08/04-08:42:17.853 INFO [RCM] TransitionToState(SQL Server Analysis Services CEIP (SSAS)) OfflineDueToProvider-->WaitingToComeOnline.
00000e4c.000009e4::2020/08/04-08:42:17.853 INFO [RCM-rbtr] giving default token to group SQL Server (SSAS)
00000e4c.000009e4::2020/08/04-08:42:17.853 INFO [RCM-rbtr] giving default token to group SQL Server (SSAS)
00000e4c.00001ea4::2020/08/04-08:42:17.859 INFO [CM] mscs::RegCheckpoint::StartRegistryMonitor: Calling threadpool to register for key change notifications for key Software\Microsoft\Microsoft SQL Server\MSAS15.SSAS\Cluster and resource Analysis Services
(SSAS).
00000e4c.00001ea4::2020/08/04-08:42:17.860 INFO [CM] mscs::RegCheckpoint::RestoreCheckpoint: Restoring checkpoint Software\Microsoft\Microsoft SQL Server\MSAS15.SSAS\CPE for resource Analysis Services (SSAS).
00000e4c.000011c4::2020/08/04-08:42:17.861 INFO [CM] mscs::RegCheckpoint::RegisterForKeyChangeNotifications: Registering for key change notifications for key Software\Microsoft\Microsoft SQL Server\MSAS15.SSAS\Cluster and resource Analysis Services (SSAS).
00000e4c.00001ea4::2020/08/04-08:42:17.866 INFO [CM] mscs::RegCheckpoint::StartRegistryMonitor: Calling threadpool to register for key change notifications for key Software\Microsoft\Microsoft SQL Server\MSAS15.SSAS\CPE and resource Analysis Services
(SSAS).
00000e4c.000011c4::2020/08/04-08:42:17.866 INFO [CM] mscs::RegCheckpoint::RegisterForKeyChangeNotifications: Registering for key change notifications for key Software\Microsoft\Microsoft SQL Server\MSAS15.SSAS\CPE and resource Analysis Services (SSAS).
00000e4c.00001ea4::2020/08/04-08:42:17.866 INFO [RCM] Issuing Online(Analysis Services (SSAS)) to RHS.
00000e4c.00001ea4::2020/08/04-08:42:17.867 INFO [RCM] HandleMonitorReply: ONLINERESOURCE for 'Analysis Services (SSAS)', gen(8) result 997/0.
00000e4c.00001ea4::2020/08/04-08:42:17.867 INFO [RCM] Res Analysis Services (SSAS): OnlineCallIssued -> OnlinePending( StateUnknown )
00000e4c.00001ea4::2020/08/04-08:42:17.867 INFO [RCM] TransitionToState(Analysis Services (SSAS)) OnlineCallIssued-->OnlinePending.
00000e4c.00001ea8::2020/08/04-08:42:17.867 INFO [GEM] Node 1: Processing message as part of GemRepair message 1:340 from node 1. Action: causal, Target: CAUS
00001474.00001d40::2020/08/04-08:42:19.181 ERR [RES] Generic Service <Analysis Services (SSAS)>: Service failed during initialization. Error: 1067.
00001474.00001d40::2020/08/04-08:42:19.181 WARN [RHS] Online for resource Analysis Services (SSAS) failed.
00000e4c.00001ea4::2020/08/04-08:42:19.181 WARN [RCM] HandleMonitorReply: ONLINERESOURCE for 'Analysis Services (SSAS)', gen(8) result 5018/0.
00001474.00001d40::2020/08/04-08:42:19.181 INFO [RHS-WER] Scheduling WER ERROR report in 10.000. ReportId 9f734795-d9d1-4768-ad6d-a963de2df128;
00000e4c.00001ea4::2020/08/04-08:42:19.181 INFO [RCM] Res Analysis Services (SSAS): OnlinePending -> ProcessingFailure( StateUnknown )
00000e4c.00001ea4::2020/08/04-08:42:19.181 INFO [RCM] TransitionToState(Analysis Services (SSAS)) OnlinePending-->ProcessingFailure.
00000e4c.000009e4::2020/08/04-08:42:19.181 INFO [GEM] Node 1: Processing message as part of GemRepair message 1:341 from node 1. Action: causal, Target: CAUS
00000e4c.00001ea4::2020/08/04-08:42:19.181 WARN [RCM] rcm::RcmResource::HandleFailure: (Analysis Services (SSAS))
00000e4c.000009e4::2020/08/04-08:42:19.181 INFO [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Acquiring lock...
00000e4c.000009e4::2020/08/04-08:42:19.181 INFO [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Lock acquired...
00000e4c.000009e4::2020/08/04-08:42:19.182 INFO [CM] mscs::CheckpointManager::OfflineHandler: 17993076 Starting to process 2 registry checkpoints for resource 184b9151-e61d-4d9f-8fbf-46c24b5b4445.
00000e4c.000009e4::2020/08/04-08:42:19.182 INFO [CM] mscs::RegCheckpoint::ShutdownKeyChangeNotifications: Shutting down change notifications on checkpoint Software\Microsoft\Microsoft SQL Server\MSAS15.SSAS\Cluster for resource Analysis Services (SSAS).
00000e4c.000009e4::2020/08/04-08:42:19.182 INFO [CM] mscs::RegCheckpoint::ShutdownKeyChangeNotifications: Before: Checkpoint state for key Software\Microsoft\Microsoft SQL Server\MSAS15.SSAS\Cluster.
00000e4c.000009e4::2020/08/04-08:42:19.182 INFO [CM] mscs::RegCheckpoint::ShutdownKeyChangeNotifications: 17993076 Calling SaveCheckpointInternal for key Software\Microsoft\Microsoft SQL Server\MSAS15.SSAS\Cluster.
00000e4c.000005cc::2020/08/04-08:42:19.182 INFO [GEM] Node 1: Processing message as part of GemRepair message 1:342 from node 1. Action: causal, Target: CAUS
The event logs don't give much information besides the following:
Event 1069:
The description for Event ID 1069 from source Microsoft-Windows-FailoverClustering cannot be found. Either the component that raises this event is not installed on your local computer or the installation is corrupted. You can install or repair the component
on the local computer.
If the event originated on another computer, the display information had to be saved with the event.
The following information was included with the event:
Analysis Services (SSAS)
SQL Server (SSAS)
Generic Service
The handle is invalid
Event 1042:
The description for Event ID 1042 from source Microsoft-Windows-FailoverClustering cannot be found. Either the component that raises this event is not installed on your local computer or the installation is corrupted. You can install or repair the component on the local computer.If the event originated on another computer, the display information had to be saved with the event.
The following information was included with the event:
Analysis Services (SSAS)
1067
The handle is invalid
I've checked the executable path and assumed that due to the storage crash the path could be an issue. The path has SSAS was fine, as I was able to access the path with no issues.
I'm starting to think that it could be a permissions issue.
Any help would be great on this.
Thanks






