[PVE-User] pveceph got timeout

Nux! nux at li.nux.ro
Tue Jun 20 15:42:14 CEST 2017


Thanks a lot, turns our upgrading from hammer to jewel requires some ownership changes in /var/lib/ceph (ie chown -R ceph:ceph /var/lib/ceph).

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

----- Original Message -----
> From: "Eneko Lacunza" <elacunza at binovo.es>
> To: "pve-user" <pve-user at pve.proxmox.com>
> Sent: Tuesday, 20 June, 2017 14:30:07
> Subject: Re: [PVE-User] pveceph got timeout

> Ok, seems your mon.0 is not up.
> 
> Try to start it with:
> systemctl start ceph.service
> 
> or
> service ceph-mon at 0 start
> 
> If it doesns't show up in netstat, look at /var/log/syslog for startup
> errors.
> 
> 
> El 20/06/17 a las 15:08, Nux! escribió:
>> Thanks, that doesn't work.
>> I ran netstat on the node with the mon and there is nothing listening on that
>> port at all.
>>
>> "service ceph status" says it's running, though ps doesn't show anything
>> containig "ceph".
>>
>> This is my ceph.conf on all nodes:
>>
>> [global]
>> 	 auth client required = cephx
>> 	 auth cluster required = cephx
>> 	 auth service required = cephx
>> 	 cluster network = 192.168.203.0/24
>> 	 filestore xattr use omap = true
>> 	 fsid = 18831ace-4d98-460d-af65-684bce4f6d9f
>> 	 keyring = /etc/pve/priv/$cluster.$name.keyring
>> 	 osd journal size = 5120
>> 	 osd pool default min size = 1
>> 	 public network = 192.168.203.0/24
>>
>> [osd]
>> 	 keyring = /var/lib/ceph/osd/ceph-$id/keyring
>>
>> [mon.0]
>> 	 host = prox1709
>> 	 mon addr = 192.168.203.66:6789
>>
>>
>> Version is "jewel".
>>
>> --
>> Sent from the Delta quadrant using Borg technology!
>>
>> Nux!
>> www.nux.ro
>>
>> ----- Original Message -----
>>> From: "Eneko Lacunza" <elacunza at binovo.es>
>>> To: "pve-user" <pve-user at pve.proxmox.com>
>>> Sent: Tuesday, 20 June, 2017 13:52:45
>>> Subject: Re: [PVE-User] pveceph got timeout
>>> Sorry, wrong port. Try to connect to port 6789 .
>>>
>>> El 20/06/17 a las 14:51, Eneko Lacunza escribió:
>>>> Can you telnet port 2128 of host of the first monitor, from the other
>>>> two proxmox nodes?
>>>>
>>>> If you can, can you read file /etc/ceph/ceph.conf from the other twho
>>>> proxmox nodes?
>>>>
>>>> El 20/06/17 a las 14:32, Nux! escribió:
>>>>> Nope, everything is on ACCEPT, these are very fresh installs, adding
>>>>> CEPH is literally the first thing I am doing to them.
>>>>>
>>>>> Lucian
>>>>>
>>>>> --
>>>>> Sent from the Delta quadrant using Borg technology!
>>>>>
>>>>> Nux!
>>>>> www.nux.ro
>>>>>
>>>>> ----- Original Message -----
>>>>>> From: "Eneko Lacunza" <elacunza at binovo.es>
>>>>>> To: "pve-user" <pve-user at pve.proxmox.com>
>>>>>> Sent: Tuesday, 20 June, 2017 12:13:44
>>>>>> Subject: Re: [PVE-User] pveceph got timeout
>>>>>> Are you using some firewall? Proxmox firewall?
>>>>>>
>>>>>> El 20/06/17 a las 12:38, Nux! escribió:
>>>>>>> Hello,
>>>>>>>
>>>>>>> Nodes in the same cluster and they can ping themselves via the
>>>>>>> private ceph
>>>>>>> network.
>>>>>>>
>>>>>>> --
>>>>>>> Sent from the Delta quadrant using Borg technology!
>>>>>>>
>>>>>>> Nux!
>>>>>>> www.nux.ro
>>>>>>>
>>>>>>> ----- Original Message -----
>>>>>>>> From: "Eneko Lacunza" <elacunza at binovo.es>
>>>>>>>> To: "pve-user" <pve-user at pve.proxmox.com>
>>>>>>>> Sent: Tuesday, 20 June, 2017 10:55:18
>>>>>>>> Subject: Re: [PVE-User] pveceph got timeout
>>>>>>>> Hi,
>>>>>>>>
>>>>>>>> Are you using a separate network for ceph? Did you check that proxmox
>>>>>>>> nodes see each other on that network?
>>>>>>>>
>>>>>>>> Are nodes in the same cluster?
>>>>>>>>
>>>>>>>> El 20/06/17 a las 11:50, Nux! escribió:
>>>>>>>>> Hello,
>>>>>>>>>
>>>>>>>>> I've just installed Ceph (jewel) and am following the
>>>>>>>>> documentation to enable it
>>>>>>>>> fully, but after an initial successful "pveceph createmon" on the
>>>>>>>>> first node,
>>>>>>>>> "pveceph createmon" on any other node times out.
>>>>>>>>> Restarted ceph, the network and in the end all the nodes, without
>>>>>>>>> any luck:
>>>>>>>>>
>>>>>>>>> All I'm getting in the web UI is "TASK ERROR: got timeout".
>>>>>>>>>
>>>>>>>>> And /var/log/syslog says:
>>>>>>>>> Jun 20 10:48:06 prox1708 pveceph[2338]: got timeout
>>>>>>>>> Jun 20 10:48:06 prox1708 pveceph[2337]: <root at pam> end task
>>>>>>>>> UPID:prox1708:00000922:00014EF4:5948EF1A:cephcreatemon:mon.1:root at pam:
>>>>>>>>> got
>>>>>>>>> timeout
>>>>>>>>>
>>>>>>>>> Any ideas?
>>>>>>>>>
>>>>>>>>> Lucian
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Sent from the Delta quadrant using Borg technology!
>>>>>>>>>
>>>>>>>>> Nux!
>>>>>>>>> www.nux.ro
>>>>>>>>> _______________________________________________
>>>>>>>>> pve-user mailing list
>>>>>>>>> pve-user at pve.proxmox.com
>>>>>>>>> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>>>>>>>> --
>>>>>>>> Zuzendari Teknikoa / Director Técnico
>>>>>>>> Binovo IT Human Project, S.L.
>>>>>>>> Telf. 943493611
>>>>>>>>          943324914
>>>>>>>> Astigarraga bidea 2, planta 6 dcha., ofi. 3-2; 20180 Oiartzun
>>>>>>>> (Gipuzkoa)
>>>>>>>> www.binovo.es
>>>>>>>>
>>>>>>>> _______________________________________________
>>>>>>>> pve-user mailing list
>>>>>>>> pve-user at pve.proxmox.com
>>>>>>>> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>>>>>>> _______________________________________________
>>>>>>> pve-user mailing list
>>>>>>> pve-user at pve.proxmox.com
>>>>>>> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>>>>>> --
>>>>>> Zuzendari Teknikoa / Director Técnico
>>>>>> Binovo IT Human Project, S.L.
>>>>>> Telf. 943493611
>>>>>>         943324914
>>>>>> Astigarraga bidea 2, planta 6 dcha., ofi. 3-2; 20180 Oiartzun
>>>>>> (Gipuzkoa)
>>>>>> www.binovo.es
>>>>>>
>>>>>> _______________________________________________
>>>>>> pve-user mailing list
>>>>>> pve-user at pve.proxmox.com
>>>>>> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>>>>> _______________________________________________
>>>>> pve-user mailing list
>>>>> pve-user at pve.proxmox.com
>>>>> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>>>>
>>> --
>>> Zuzendari Teknikoa / Director Técnico
>>> Binovo IT Human Project, S.L.
>>> Telf. 943493611
>>>        943324914
>>> Astigarraga bidea 2, planta 6 dcha., ofi. 3-2; 20180 Oiartzun (Gipuzkoa)
>>> www.binovo.es
>>>
>>> _______________________________________________
>>> pve-user mailing list
>>> pve-user at pve.proxmox.com
>>> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>> _______________________________________________
>> pve-user mailing list
>> pve-user at pve.proxmox.com
>> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
> 
> 
> --
> Zuzendari Teknikoa / Director Técnico
> Binovo IT Human Project, S.L.
> Telf. 943493611
>       943324914
> Astigarraga bidea 2, planta 6 dcha., ofi. 3-2; 20180 Oiartzun (Gipuzkoa)
> www.binovo.es
> 
> _______________________________________________
> pve-user mailing list
> pve-user at pve.proxmox.com
> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user



More information about the pve-user mailing list