[PVE-User] Why are images and rootdir not supported on CephFS?

[Humberto Jose De Sousa]

We have a deploy with RBD and cephfs. 

We are doing backup in a NFS storage shared with all hosts of cluster. One host act how NFS server and the others are clients. It's working well. 

Humberto. 


De: "Frank Thommen" <f.thommen at dkfz-heidelberg.de> 
Para: pve-user at pve.proxmox.com 
Enviadas: Domingo, 16 de fevereiro de 2020 17:55:41 
Assunto: Re: [PVE-User] Why are images and rootdir not supported on CephFS? 

I have now configured a Directory storage which points to the CephFS 
mountpoint. When creating a container (Alpine Linux, 10 GB disk, 2 GB 
Memory), this happens in the blink of an eye when using Ceph RBD or 
local storage as root disk, but it takes very, very long (10 to 20 times 
longer) when using the CephFS-directory as root disk. 



On 16/02/2020 17:26, Frank Thommen wrote: 
> Thank you for the link. 
> 
> Even though Fabian Gruenbichler writes in the bugreport 
> (https://bugzilla.proxmox.com/show_bug.cgi?id=2490#c2) that Ceph RBD 
> offers all features of CephFS, this doesn't seem to be true(?), as 
> CephFS supports "vztmpl iso backup snippets" and Ceph RBD "images 
> rootdir" (https://pve.proxmox.com/pve-docs/chapter-pvesm.html), so these 
> two storage types are complementary and RBD cannot replace CephFS. 
> 
> What would be a good practice (CephFS and RBD are already set up): 
> Create an RBD storage on the same (PVE based) Ceph storage that already 
> has CephFS on top of it and use one for templates and backups and the 
> other for images and rootdir? 
> 
> Won't it create problems when using the same Ceph pool with CephFS /and/ 
> RBD (this is probably rather a Ceph question, though) 
> 
> Additionally this might create problems with our inhouse tape backup, as 
> I don't think it supports backing up object storage... 
> 
> frank 
> 
> 
> On 15/02/2020 00:38, Gianni Milo wrote: 
>> This has been discussed in the past, see the post below for some 
>> answers... 
>> 
>> https://www.mail-archive.com/pve-user@pve.proxmox.com/msg10160.html 
>> 
>> 
>> 
>> 
>> On Fri, 14 Feb 2020 at 22:57, Frank Thommen 
>> <f.thommen at dkfz-heidelberg.de> 
>> wrote: 
>> 
>>> Dear all, 
>>> 
>>> the PVE documentation on 
>>> https://pve.proxmox.com/pve-docs/chapter-pvesm.html#_storage_types says, 
>>> that "[File level based storage technologies] allow you to store content 
>>> of any type". However I found now - after having combined all available 
>>> disks in a big CephFS setup - that this is not true for CephFS, which 
>>> does not support images and rootdir. 
>>> 
>>> What is the reason, that of all filesystens, CephFS doesn't support the 
>>> main PVE content type? :-) 
>>> 
>>> Ceph RPD on the other hand, doesn't support backup. 
>>> 
>>> This seems to rule our Ceph (in whatever variant) as an unifying, shared 
>>> storage for PVE. Or do I miss an important point here? 
>>> 
>>> Frank 
>>> _______________________________________________ 
>>> pve-user mailing list 
>>> pve-user at pve.proxmox.com 
>>> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user 
>>> 
>> _______________________________________________ 
>> pve-user mailing list 
>> pve-user at pve.proxmox.com 
>> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user 
>> 
> 
> _______________________________________________ 
> pve-user mailing list 
> pve-user at pve.proxmox.com 
> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user 

_______________________________________________ 
pve-user mailing list 
pve-user at pve.proxmox.com 
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user