[pve-devel] corosync unicast : does somebody use it in production with 10-16 nodes ?

Alexandre DERUMIER aderumier at odiso.com
Wed Jul 12 09:14:16 CEST 2017


Hi,

just for the record,

I have migrate all my clusters with unicast, also big clusters with 16-20 nodes, and It's working fine.


"pvedaemon: ipcc_send_rec failed: Transport endpoint is not connected " seem to be gone.

don't see any error on the cluster.

traffic is around 3-4mbit/s on each node.



----- Mail original -----
De: "aderumier" <aderumier at odiso.com>
À: "pve-devel" <pve-devel at pve.proxmox.com>
Cc: "proxmoxve" <pve-user at pve.proxmox.com>
Envoyé: Vendredi 7 Juillet 2017 11:51:42
Objet: Re: [pve-devel] corosync unicast : does somebody use it in production with 10-16 nodes ?

note that I'm just seeing , time to time (around once by hour), 

pvedaemon: ipcc_send_rec failed: Transport endpoint is not connected 

But I don't have any corosync error / retransmit. 


----- Mail original ----- 
De: "aderumier" <aderumier at odiso.com> 
À: "pve-devel" <pve-devel at pve.proxmox.com>, "proxmoxve" <pve-user at pve.proxmox.com> 
Envoyé: Vendredi 7 Juillet 2017 10:46:33 
Objet: [pve-devel] corosync unicast : does somebody use it in production with 10-16 nodes ? 

Hi, 

I'm looking to remove multicast from my network (Don't have too much time to explain, but we have multicast storm problem,because of igmp snooping bug) 

Does somebody running it with "big" clusters ? (10-16 nodes) 


I'm currently testing it with 9 nodes (1200vm+containers), I'm seeing around 3mbit/s of traffic on each node, 

and I don't have any cluster break for now. (Switch have recents asics with around 0,015ms latency). 


Any return of experience is welcome :) 

Thanks ! 

Alexandre 
_______________________________________________ 
pve-devel mailing list 
pve-devel at pve.proxmox.com 
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel 

_______________________________________________ 
pve-devel mailing list 
pve-devel at pve.proxmox.com 
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel 




More information about the pve-devel mailing list