Skip to main content
Question

Connectivity issue with proxy during backup copy job

E

Hi all. I’ve got a Veeam backup & replication CE that backup some VM on VMware ESXi.

This backups are copied offsite to another site using a IPSEC VPN, a proxy is placed on other site and storage is a NAS.

At least once a week, randomly, backup copy job fail because can’t connect to Veeam proxy.

At this this I’m using Linux as a proxy but also with Windows we’ve issue.

 

What found in logs are this rows:

 

[26.08.2024 08:31:56.875]    <24>   Error (3)    [ReconnectableSocket][PacketAsyncReceiver] Exception on [af09e7b0-f7ed-4e85-969f-96d3cff82943].
[26.08.2024 08:31:56.875]    <24>   Error (3)    A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond (System.Net.Sockets.SocketException)
[26.08.2024 08:31:56.875]    <24>   Error (3)       at Veeam.Backup.Common.Reconnect.CPacketAsyncReceiver.PushData(CSocketAsyncEventArgsEx e)
[26.08.2024 08:31:56.875]    <24>    Info (3)        [ReconnectableSocket] Retryable error on [af09e7b0-f7ed-4e85-969f-96d3cff82943].
[26.08.2024 08:31:56.875]    <24>    Info (3)        [ReconnectableSocket] Reconnecting [af09e7b0-f7ed-4e85-969f-96d3cff82943] (retryable error)...
[26.08.2024 08:31:56.875]    <24>    Info (3)        [NetSocket] Connecting to '192.168.0.80:6162'.
[26.08.2024 08:31:56.890]    <24>    Info (3)    [ReconnectableSessionStarter] Reconnected to backup client on 'SRV-VPROXY.mydomain.local' at [192.168.0.80: 6162]. Connection id: af09e7b0-f7ed-4e85-969f-96d3cff82943.
[26.08.2024 08:31:56.906]    <24>    Info (3)        [ReconnectableSocket] Traffic history confirmation: remote [17], local [7].

 

I’ve setup a detailed monitoring on network and also using agent on proxy and backup server that verify every 30 sec. the connections but no issues where found.

 

This is the error:

Unable to access target repository Error: Selected server SRV-VPROXY.mydomain.local is unavailable.
Unable to access target repository, processing will be retried (retry 1 out of 6)

 

What is strange is that: when I connect to Veeam console to check the issue somethings happen or is triggered because copy job start working.

 

Any suggestion?

10 comments

coolsport00
Forum|alt.badge.img+20
  • coolsport00
  • Veeam Legend
  • 4133 comments
  • August 26, 2024

@epasqualotto -

I don’t have any specific suggestions, but your error does look like it’s network-related. Though you say you do have monitoring configured every 30secs, in network terms, that is a long time. I’d be curious to see what a ping -t <ip-of-proxy> (perpetual/continual ping) to the Proxy IP shows. How many packets are dropping due to some kind of connectivity issue.

Shane Williford - Veeam VMCA/VMCE | Veeam Legend | VUG Leader | VCP-DCV | Twitter: @coolsport00
Chris.Childerhose
Forum|alt.badge.img+21
  • Chris.Childerhose
  • Veeam Legend, Veeam Vanguard
  • 8459 comments
  • August 26, 2024

Based on the error messages you posted from the logs it seems there are network issues when this happens and Veeam cannot reach the proxy on the DR site.  I cannot explain it working when you go in to the Veeam Console as that seems strange.

I know you are using the CE edition but a Support ticket would be the ideal solution here unless your logging shows something related to the network and IPSec VPN.

Chris Childerhose - VMCA2024 | VMCE2023 | VMCE-SP2024 | Veeam Vanguard 8* | Veeam Legend 5* | vExpert 6* | VCAP-DCV/VCP-DCV | Object First Ace | Cisco Champion | Twitter: @cchilderhose | Blog Site – https://just-virtualization.tech
E
  • epasqualotto
  • Author
  • New Here
  • 2 comments
  • August 26, 2024

you’re right also for me seems a network-related issue but my tons of check in Zabbix and other service that use that VPN said the opposite.

I’m thinking about somethings related to MTU

Chris.Childerhose
1 person likes this
  • Chris.Childerhose
    Chris.Childerhose
Chris.Childerhose
Forum|alt.badge.img+21
  • Chris.Childerhose
  • Veeam Legend, Veeam Vanguard
  • 8459 comments
  • August 26, 2024
epasqualotto wrote:

you’re right also for me seems a network-related issue but my tons of check in Zabbix and other service that use that VPN said the opposite.

I’m thinking about somethings related to MTU

Yes could be MTU but it is network related somehow even if Zabbix says otherwise.

Chris Childerhose - VMCA2024 | VMCE2023 | VMCE-SP2024 | Veeam Vanguard 8* | Veeam Legend 5* | vExpert 6* | VCAP-DCV/VCP-DCV | Object First Ace | Cisco Champion | Twitter: @cchilderhose | Blog Site – https://just-virtualization.tech
coolsport00
Forum|alt.badge.img+20
  • coolsport00
  • Veeam Legend
  • 4133 comments
  • August 26, 2024

Did you try the ping I suggesed to see if packets are dropping?

Shane Williford - Veeam VMCA/VMCE | Veeam Legend | VUG Leader | VCP-DCV | Twitter: @coolsport00
E
  • epasqualotto
  • Author
  • New Here
  • 2 comments
  • August 27, 2024
coolsport00 wrote:

Did you try the ping I suggesed to see if packets are dropping?

Now I switched the connectivity for the VPN to a different ISP and I’ll monitor the issue.

Zabbix service pinged it 3 times every 30s and found nothing strange, only the latency goes up to 20/25ms during backup.

After this test I’ll setup a ping -t with the standard connectivity

 

Thanks

Chris.Childerhose
coolsport00
2 people like this
  • Chris.Childerhose
    Chris.Childerhose
  • coolsport00
    coolsport00
coolsport00
Forum|alt.badge.img+20
  • coolsport00
  • Veeam Legend
  • 4133 comments
  • August 27, 2024

Ok... Keep us posted. 

Shane Williford - Veeam VMCA/VMCE | Veeam Legend | VUG Leader | VCP-DCV | Twitter: @coolsport00
Chris.Childerhose
Forum|alt.badge.img+21
  • Chris.Childerhose
  • Veeam Legend, Veeam Vanguard
  • 8459 comments
  • August 27, 2024
epasqualotto wrote:
coolsport00 wrote:

Did you try the ping I suggesed to see if packets are dropping?

Now I switched the connectivity for the VPN to a different ISP and I’ll monitor the issue.

Zabbix service pinged it 3 times every 30s and found nothing strange, only the latency goes up to 20/25ms during backup.

After this test I’ll setup a ping -t with the standard connectivity

 

Thanks

Changing ISP hopefully that works.  Keep us posted on the issue.

Chris Childerhose - VMCA2024 | VMCE2023 | VMCE-SP2024 | Veeam Vanguard 8* | Veeam Legend 5* | vExpert 6* | VCAP-DCV/VCP-DCV | Object First Ace | Cisco Champion | Twitter: @cchilderhose | Blog Site – https://just-virtualization.tech
E
Forum|alt.badge.img
  • eblack
  • Experienced User
  • 45 comments
  • August 27, 2024

You can use iPerf to do some speed/connectivity testing outside of Veeam.

Chris.Childerhose
Andanet
2 people like this
  • Chris.Childerhose
    Chris.Childerhose
  • Andanet
    Andanet
Andanet
Forum|alt.badge.img+11
  • Andanet
  • Veeam Legend
  • 352 comments
  • August 27, 2024

I suggest to check connectivity from DR site to primary… on linux proxy you can use nc command… you can insert in a shell and run it every 5 secs and logging all in a text file…. 

 

Antonio D'Andrea | VMCE 2021 | VMCA 2022 | VMTSP2024 | Veeam Legend 2023/2024 | VUG Italy Leader | VCP6-DCV | I want it written on my tombstone "Please start a restore to the last valid backup"
Chris.Childerhose
1 person likes this
  • Chris.Childerhose
    Chris.Childerhose

Comment


Terms & Conditions