[PVE-User] pve-csync version of pve-zsync?

[Mark Adams]

Hi Alexander,

Could you please elaborate more on how you have implemented ceph
replication using proxmox?

Thanks,
Mark


On Thu, 17 May 2018, 15:26 Alexandre DERUMIER, <aderumier at odiso.com> wrote:

> Hi,
>
> I'm currently a lot busy working on network code.
>
> for now, we have implemented ceph replication out of proxmox code, I'll
> try to work on it this summer.
>
>
> ----- Mail original -----
> De: "Mark Adams" <mark at openvs.co.uk>
> À: "proxmoxve" <pve-user at pve.proxmox.com>
> Envoyé: Mardi 15 Mai 2018 00:13:03
> Objet: Re: [PVE-User] pve-csync version of pve-zsync?
>
> Hi Alexandre,
>
> Did you ever get a chance to take a look at this?
>
> Regards,
> Mark
>
> On 13 March 2018 at 18:32, Alexandre DERUMIER <aderumier at odiso.com>
> wrote:
>
> > Hi,
> >
> > I have plans to implement storage replication for rbd in proxmox,
> > like for zfs export|import. (with rbd export-diff |rbd import-diff )
> >
> > I'll try to work on it next month.
> >
> > I'm not sure that currently a plugin infrastructe in done in code,
> > and that it's able to manage storages with differents name.
> >
> > Can't tell if it'll be hard to implement, but the workflow is almost the
> > same.
> >
> > I'll try to look also at rbd mirror, but it's only work with librbd in
> > qemu, not with krbd,
> > so it can't be implemented for container.
> >
> >
> > ----- Mail original -----
> > De: "Mark Adams" <mark at openvs.co.uk>
> > À: "proxmoxve" <pve-user at pve.proxmox.com>
> > Envoyé: Mardi 13 Mars 2018 18:52:21
> > Objet: Re: [PVE-User] pve-csync version of pve-zsync?
> >
> > Hi Alwin,
> >
> > I might have to take another look at it, but have you actually done this
> > with 2 proxmox clusters? I can't remember the exact part I got stuck on
> as
> > it was quite a while ago, but it wasn't as straight forward as you
> > suggest.
> > I think you couldn't use the same cluster name, which in turn created
> > issues trying to use the "remote" (backup/dr/whatever you wanna call it)
> > cluster with proxmox because it needed to be called ceph.
> >
> > The docs I was referring to were the ceph ones yes. Some of the options
> > listed in that doc do not work in the current proxmox version (I think
> the
> > doc hasn't been updated for newer versions...)
> >
> > Regards,
> > Mark
> >
> > On 13 March 2018 at 17:19, Alwin Antreich <a.antreich at proxmox.com>
> wrote:
> >
> > > On Mon, Mar 12, 2018 at 04:51:32PM +0000, Mark Adams wrote:
> > > > Hi Alwin,
> > > >
> > > > The last I looked at it, rbd mirror only worked if you had different
> > > > cluster names. Tried to get it working with proxmox but to no avail,
> > > > without really messing with how proxmox uses ceph I'm not sure it's
> > > > feasible, as proxmox assumes the default cluster name for
> > everything...
> > > That isn't mentioned anywhere in the ceph docs, they use for ease of
> > > explaining two different cluster names.
> > >
> > > If you have a config file named after the cluster, then you can
> specifiy
> > > it on the command line.
> > > http://docs.ceph.com/docs/master/rados/configuration/
> > > ceph-conf/#running-multiple-clusters
> > >
> > > >
> > > > Also the documentation was a bit poor for it IMO.
> > > Which documentation do you mean?
> > > ? -> http://docs.ceph.com/docs/master/rbd/rbd-mirroring/
> > >
> > > >
> > > > Would also be nice to choose specifically which VM's you want to be
> > > > mirroring, rather than the whole cluster.
> > > It is done either per pool or image separately. See the link above.
> > >
> > > >
> > > > I've manually done rbd export-diff and rbd import-diff between 2
> > separate
> > > > proxmox clusters over ssh, and it seems to work really well... It
> > would
> > > > just be nice to have a tool like pve-zsync so I don't have to write
> > some
> > > > script myself. Seems to me like something that would be desirable as
> > part
> > > > of proxmox as well?
> > > That would basically implement the ceph rbd mirror feature.
> > >
> > > >
> > > > Cheers,
> > > > Mark
> > > >
> > > > On 12 March 2018 at 16:37, Alwin Antreich <a.antreich at proxmox.com>
> > > wrote:
> > > >
> > > > > Hi Mark,
> > > > >
> > > > > On Mon, Mar 12, 2018 at 03:49:42PM +0000, Mark Adams wrote:
> > > > > > Hi All,
> > > > > >
> > > > > > Has anyone looked at or thought of making a version of pve-zsync
> > for
> > > > > ceph?
> > > > > >
> > > > > > This would be great for DR scenarios...
> > > > > >
> > > > > > How easy do you think this would be to do? I imagine it wouId it
> > be
> > > quite
> > > > > > similar to pve-zsync, but using rbd export-diff and rbd
> > import-diff
> > > > > instead
> > > > > > of zfs send and zfs receive? so could the existing script be
> > > relatively
> > > > > > easily modified? (I know nothing about perl....)
> > > > > >
> > > > > > Cheers,
> > > > > > Mark
> > > > > > _______________________________________________
> > > > > > pve-user mailing list
> > > > > > pve-user at pve.proxmox.com
> > > > > > https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
> > > > > Isn't ceph mirror already what you want? It can mirror a image or
> a
> > > > > whole pool. It keeps track of changes and serves remote image
> > deletes
> > > > > (adjustable delay).
> > > > >
> > >
> > > _______________________________________________
> > > pve-user mailing list
> > > pve-user at pve.proxmox.com
> > > https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
> > >
> >
> _______________________________________________
> pve-user mailing list
> pve-user at pve.proxmox.com
> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>
> _______________________________________________
> pve-user mailing list
> pve-user at pve.proxmox.com
> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>