[wix-users] Custom Action and 1723 error

[Andrey Sukhanov]

Hello,

I have a custom action DLL and trying to call its methods, like this:
---
<Binary Id="instdll" SourceFile="$(var.SetupBinaryPath)\instdll.dll"/>
        <CustomAction Id="FindRelatedProductsEx" BinaryKey="instdll"
DllEntry="FindRelatedProductsEx"/>
---


The installer fails with error 1723, the log looks like:
---
Action start 17:50:05: FindRelatedProductsEx.
MSI (s) (C0:44) [17:50:05:264]: Note: 1: 1723 2: FindRelatedProductsEx 3:
FindRelatedProductsEx 4: C:\Windows\Installer\MSICFC9.tmp
CustomAction FindRelatedProductsEx returned actual error code 1157 (note
this may not be 100% accurate if translation happened inside sandbox)
MSI (s) (C0:44) [17:50:07:105]: Error1709|2:Firewall
SDK|3:Error1|1:1723Error1723|2:FindRelatedProductsEx|3:FindRelatedProductsEx|4:C:\Windows\Installer\MSICFC9.tmp

Error1|1:1723Error1723|2:FindRelatedProductsEx|3:FindRelatedProductsEx|4:C:\Windows\Installer\MSICFC9.tmp
Action ended 17:50:07: FindRelatedProductsEx. Return value 3.
---

I am using Wix 3.10, the DLL is written in C++, and the installer works
well in Windows Test Mode.

I've spent a week googling around, didn't find anything helpful, and now
have no more ideas.

What do I do wrong? How to diagnose the issue?

Thanks,
Andrey