[PVE-User] pve-csync version of pve-zsync?

Alexandre DERUMIER aderumier at odiso.com
Thu May 17 19:37:34 CEST 2018


>>Could you please elaborate more on how you have implemented ceph 
>>replication using proxmox?

As I said, I didn't replicate it with proxmox or proxmox code currently.

only custom scripts calling ceph api directly.

I need to dig a little bit more in current proxmox zfs replication, 
because it' mainly focus on local storage replication.
so it's a little it different with a shared storage (vm live migration, ha failover,...)


----- Mail original -----
De: "Mark Adams" <mark at openvs.co.uk>
À: "proxmoxve" <pve-user at pve.proxmox.com>
Envoyé: Jeudi 17 Mai 2018 17:36:43
Objet: Re: [PVE-User] pve-csync version of pve-zsync?

Hi Alexander, 

Could you please elaborate more on how you have implemented ceph 
replication using proxmox? 

Thanks, 
Mark 


On Thu, 17 May 2018, 15:26 Alexandre DERUMIER, <aderumier at odiso.com> wrote: 

> Hi, 
> 
> I'm currently a lot busy working on network code. 
> 
> for now, we have implemented ceph replication out of proxmox code, I'll 
> try to work on it this summer. 
> 
> 
> ----- Mail original ----- 
> De: "Mark Adams" <mark at openvs.co.uk> 
> À: "proxmoxve" <pve-user at pve.proxmox.com> 
> Envoyé: Mardi 15 Mai 2018 00:13:03 
> Objet: Re: [PVE-User] pve-csync version of pve-zsync? 
> 
> Hi Alexandre, 
> 
> Did you ever get a chance to take a look at this? 
> 
> Regards, 
> Mark 
> 
> On 13 March 2018 at 18:32, Alexandre DERUMIER <aderumier at odiso.com> 
> wrote: 
> 
> > Hi, 
> > 
> > I have plans to implement storage replication for rbd in proxmox, 
> > like for zfs export|import. (with rbd export-diff |rbd import-diff ) 
> > 
> > I'll try to work on it next month. 
> > 
> > I'm not sure that currently a plugin infrastructe in done in code, 
> > and that it's able to manage storages with differents name. 
> > 
> > Can't tell if it'll be hard to implement, but the workflow is almost the 
> > same. 
> > 
> > I'll try to look also at rbd mirror, but it's only work with librbd in 
> > qemu, not with krbd, 
> > so it can't be implemented for container. 
> > 
> > 
> > ----- Mail original ----- 
> > De: "Mark Adams" <mark at openvs.co.uk> 
> > À: "proxmoxve" <pve-user at pve.proxmox.com> 
> > Envoyé: Mardi 13 Mars 2018 18:52:21 
> > Objet: Re: [PVE-User] pve-csync version of pve-zsync? 
> > 
> > Hi Alwin, 
> > 
> > I might have to take another look at it, but have you actually done this 
> > with 2 proxmox clusters? I can't remember the exact part I got stuck on 
> as 
> > it was quite a while ago, but it wasn't as straight forward as you 
> > suggest. 
> > I think you couldn't use the same cluster name, which in turn created 
> > issues trying to use the "remote" (backup/dr/whatever you wanna call it) 
> > cluster with proxmox because it needed to be called ceph. 
> > 
> > The docs I was referring to were the ceph ones yes. Some of the options 
> > listed in that doc do not work in the current proxmox version (I think 
> the 
> > doc hasn't been updated for newer versions...) 
> > 
> > Regards, 
> > Mark 
> > 
> > On 13 March 2018 at 17:19, Alwin Antreich <a.antreich at proxmox.com> 
> wrote: 
> > 
> > > On Mon, Mar 12, 2018 at 04:51:32PM +0000, Mark Adams wrote: 
> > > > Hi Alwin, 
> > > > 
> > > > The last I looked at it, rbd mirror only worked if you had different 
> > > > cluster names. Tried to get it working with proxmox but to no avail, 
> > > > without really messing with how proxmox uses ceph I'm not sure it's 
> > > > feasible, as proxmox assumes the default cluster name for 
> > everything... 
> > > That isn't mentioned anywhere in the ceph docs, they use for ease of 
> > > explaining two different cluster names. 
> > > 
> > > If you have a config file named after the cluster, then you can 
> specifiy 
> > > it on the command line. 
> > > http://docs.ceph.com/docs/master/rados/configuration/ 
> > > ceph-conf/#running-multiple-clusters 
> > > 
> > > > 
> > > > Also the documentation was a bit poor for it IMO. 
> > > Which documentation do you mean? 
> > > ? -> http://docs.ceph.com/docs/master/rbd/rbd-mirroring/ 
> > > 
> > > > 
> > > > Would also be nice to choose specifically which VM's you want to be 
> > > > mirroring, rather than the whole cluster. 
> > > It is done either per pool or image separately. See the link above. 
> > > 
> > > > 
> > > > I've manually done rbd export-diff and rbd import-diff between 2 
> > separate 
> > > > proxmox clusters over ssh, and it seems to work really well... It 
> > would 
> > > > just be nice to have a tool like pve-zsync so I don't have to write 
> > some 
> > > > script myself. Seems to me like something that would be desirable as 
> > part 
> > > > of proxmox as well? 
> > > That would basically implement the ceph rbd mirror feature. 
> > > 
> > > > 
> > > > Cheers, 
> > > > Mark 
> > > > 
> > > > On 12 March 2018 at 16:37, Alwin Antreich <a.antreich at proxmox.com> 
> > > wrote: 
> > > > 
> > > > > Hi Mark, 
> > > > > 
> > > > > On Mon, Mar 12, 2018 at 03:49:42PM +0000, Mark Adams wrote: 
> > > > > > Hi All, 
> > > > > > 
> > > > > > Has anyone looked at or thought of making a version of pve-zsync 
> > for 
> > > > > ceph? 
> > > > > > 
> > > > > > This would be great for DR scenarios... 
> > > > > > 
> > > > > > How easy do you think this would be to do? I imagine it wouId it 
> > be 
> > > quite 
> > > > > > similar to pve-zsync, but using rbd export-diff and rbd 
> > import-diff 
> > > > > instead 
> > > > > > of zfs send and zfs receive? so could the existing script be 
> > > relatively 
> > > > > > easily modified? (I know nothing about perl....) 
> > > > > > 
> > > > > > Cheers, 
> > > > > > Mark 
> > > > > > _______________________________________________ 
> > > > > > pve-user mailing list 
> > > > > > pve-user at pve.proxmox.com 
> > > > > > https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user 
> > > > > Isn't ceph mirror already what you want? It can mirror a image or 
> a 
> > > > > whole pool. It keeps track of changes and serves remote image 
> > deletes 
> > > > > (adjustable delay). 
> > > > > 
> > > 
> > > _______________________________________________ 
> > > pve-user mailing list 
> > > pve-user at pve.proxmox.com 
> > > https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user 
> > > 
> > 
> _______________________________________________ 
> pve-user mailing list 
> pve-user at pve.proxmox.com 
> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user 
> 
> _______________________________________________ 
> pve-user mailing list 
> pve-user at pve.proxmox.com 
> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user 
> 
_______________________________________________ 
pve-user mailing list 
pve-user at pve.proxmox.com 
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user 




More information about the pve-user mailing list