Skip to main content

Backup causes segfault in CentOS 6.6

Thread needs solution

I'm using Acronis Backup for VMware (build 9.2.10535) to backup our esxi 5.5 servers.
I have had no issues for months, however after the latest CentOS vmtools update, every time Acronis Backup starts backing up the guest OS, the guest servers throw a segfault and eventually die.

Here is the message generated on the guest OS the second the backup starts:
Jul 9 14:03:32 server1 kernel: vmtoolsd[782]: segfault at 7f5192013b50 ip 00007f5192013b50 sp 00007fffc4562788 error 15

Here is the error message generated by Acorns Backup for VMware:

Failed to perform the requested operation.
Additional info:
--------------------
Error code: 13
Module: 149
LineInfo: d1ab7fa1e56eca4e
Fields:
Message: Failed to perform the requested operation.
--------------------
Error code: 103
Module: 83
LineInfo: a859dd78cc91df40
Fields:
Message: Failed to open the virtual machine ([datastore1 (2)] server1 (new)/server1 (new).vmx).
--------------------
Error code: 253
Module: 83
LineInfo: c7610e0a857bedf4
Fields:
Message: VMware error: 'Remote method call failed.'.
--------------------
Error code: 32
Module: 0
LineInfo: c7610e0a857bedf4
Fields:
Message: Awaiting task 'CreateSnapshot' has failed. Reason: An error occurred while saving the snapshot: Failed to quiesce the virtual machine..
--------------------

This started a couple of nights ago, right after new vmtools were installed after a routine `yum update`.
Here are the vmtools that were updated:

Jul 08 04:35:26 Updated: vmware-tools-foundation-9.10.1-1.el6.x86_64
Jul 08 04:35:27 Updated: vmware-tools-libraries-nox-9.10.1-1.el6.x86_64
Jul 08 04:35:27 Updated: vmware-tools-guestlib-9.10.1-1.el6.x86_64
Jul 08 04:35:27 Updated: vmware-tools-core-9.10.1-1.el6.x86_64
Jul 08 04:35:30 Updated: vmware-tools-services-9.10.1-1.el6.x86_64
Jul 08 04:35:31 Updated: vmware-tools-plugins-autoUpgrade-9.10.1-1.el6.x86_64
Jul 08 04:35:32 Updated: vmware-tools-plugins-powerOps-9.10.1-1.el6.x86_64
Jul 08 04:35:33 Updated: vmware-tools-plugins-grabbitmqProxy-9.10.1-1.el6.x86_64
Jul 08 04:35:34 Updated: vmware-tools-plugins-timeSync-9.10.1-1.el6.x86_64
Jul 08 04:35:35 Updated: vmware-tools-plugins-deployPkg-9.10.1-1.el6.x86_64
Jul 08 04:35:35 Updated: vmware-tools-plugins-vmbackup-9.10.1-1.el6.x86_64
Jul 08 04:35:36 Updated: vmware-tools-plugins-vix-9.10.1-1.el6.x86_64
Jul 08 04:35:37 Updated: vmware-tools-plugins-hgfsServer-9.10.1-1.el6.x86_64
Jul 08 04:35:38 Updated: vmware-tools-plugins-guestInfo-9.10.1-1.el6.x86_64
Jul 08 04:35:38 Installed: vmware-tools-vgauth-9.10.1-1.el6.x86_64
Jul 08 04:35:39 Updated: vmware-tools-esx-nox-9.10.1-1.el6.x86_64

It seems obvious that the problem is cause by the vmware tools updates...
Any idea what's going on here?

JB

0 Users found this helpful
frestogaslorastaswastavewroviwroclolacorashibushurutraciwrubrishabenichikucrijorejenufrilomuwrigaslowrikejawrachosleratiswurelaseriprouobrunoviswosuthitribrepakotritopislivadrauibretisetewrapenuwrapi
Posts: 22
Comments: 3800

Hi Jorg,

Apparently the issue occurs when there is a quiesced snapshot called before backup via VMware API (the snapshot is used to read the backup data). The VMware Tools update seems to have broken the quiescing mechanism, so quiescing has to be disabled (disk.EnableUUID should be set to false in VM properties). See also http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cm… .

Thank you.
--
Best regards,
Vasily
Acronis Virtualization Program Manager