[PVE-User] CEPH planning: Expander vs. SAS 9305-16i / SAS 9305-24i

[Alexandre DERUMIER]

>>So, what is better, with or without expander ? :-)

it's also better without expander.


expander works like a switch, so the disks share the sas bandwidth. 
and also, sometime, expander firmware can be buggy, can give timeout,....


without expander, you should have a dedicated sas connection by disk. 

----- Mail original -----
De: "Denny Fuchs" <linuxmail at 4lin.net>
À: "proxmoxve" <pve-user at pve.proxmox.com>
Envoyé: Jeudi 29 Septembre 2016 21:46:30
Objet: [PVE-User] CEPH planning: Expander vs. SAS 9305-16i / SAS 9305-24i

hi, 

we want to build a CEPH storage out of 6 OSD Nodes with 24 SSD … we consider now to buy the first test hardware and try it out. But where we don’t know, which is better: i asking :-) 

We want to buy 6 x http://www.aicipc.com/ProductDetail.aspx?ref=RSC-2AH 

But don’t know, if it is better to use the expander version from the chassis and a SAS 9305-16i, or the non expander version with a SAS 9305-24i HBA. The motherboard we are testing is a https://www.asus.com/de/Commercial-Servers-Workstations/Z10PRD16/ and a powerful CPU and 128GB ram for each OSD node. The network switched from 10Gb/s ethernet to 56Gb/s Infiniband …. 


I wrote also the complete (except infiniband) plan also in the forum: 

https://forum.proxmox.com/threads/hw-planning-ceph-3-x-osd-cluster-for-pve-4-2.27555/#post-138692 

So, what is better, with or without expander ? :-) 

cu denny 
_______________________________________________ 
pve-user mailing list 
pve-user at pve.proxmox.com 
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user