That preview for docx doesn't come from PowerToys. We don't do .docx preview.
So it's likely this is being caused by another Software.
One way to see what software is being used for .docx previews would be to look into registry
in Computer\HKEY_CLASSES_ROOT\.docx\ShellEx\{8895b1c6-b41f-4c1c-a562-0d564250836f} :
Then the value there can be used to check which software is being used in Computer\HKEY_CLASSES_ROOT\CLSID\
{THAT_ID}\LocalServer32 :
In my case, it's Office.