MSDTC Throwing Errors: Internal Error and HR=0x80000171

Recently has a cluster installation of Microsoft Distributed Transaction Coordinator throwing the following errors:

MSDTC encountered an error (HR=0x80000171) while attempting to establish a secure connection with system <HOSTNAME>.

A MS DTC component has encountered an internal error. The process is being terminated. Error Specifics: DtcSystemShutdown (com\complus\dtc\dtc\msdtc\src\msdtc.cpp@2485): Shutting down with an error

This was fixed by taking two steps:


  1. Setup security properties on on both the Local DTC and Cluster DTC according to this support article


2. Downloaded SubInACL from this link and used the tool to apply permissions to the NT AUTHORITY\Network Service as follows:

In command prompt (launched as administrator)

subinacl /service msdtc /grant="Network Service"=QSETIL