[LON-CAPA-admin] subscription updates not happening

Sat Dec 6 12:40:29 EST 2014

Stuart,

For capa1, casea1, and fhwfa1, a dump of iptables shows port 5663 open for
capa1 and fhwfa1.  It also shows no entries for casea1 (cluster tables
already updated?).  So, I sent an email to our campus IT to check on their
firewall rules.

The situations for the other servers make sense.

As always, thank you for your time, effort and knowledge!

Bob Gonzales
Chemistry Dept
Binghamton University

On Fri, Dec 5, 2014 at 1:26 PM, Stuart Raeburn <raeburn at msu.edu> wrote:

> Hi Bob,
>
>  Any thoughts on what might be going on?  Also,  the status report that
>> gets
>> emailed when the warnings and errors get large enough is coming every day.
>>
>
> Inbound traffic to port 5663 from other LON-CAPA servers is blocked for
> the following:
>
>  capa1      (capa1.uwsp.edu - 143.236.33.124)
>> casea1    (capa.chem.case.edu - 129.22.128.219)
>> fhwfa1     (vita2.ostfalia.de - 141.41.235.60)
>>
>
> It seems likely that LON-CAPA is no longer in use in the case domain.  I
> have contacted the maintainer there, and if that is so I will update the
> cluster tables accordingly for casea1.
>
> Cluster tables used to determine lonHostID <-> hostname mapping are
> outdated for the following:
>
>  hujil1       (capa1.cc.huji.ac.il - 132.64.3.103)
>>
>
> This server populates its cluster membership data from the
> /home/httpd/lonTabs/dns_hosts.tab file shipped with 2.9.0 instead of by
> contacting one of the LON-CAPA "DNS" servers, e.g.,
> https://s10.lite.msu.edu/adm/dns/hosts for up to date information.  The
> hostname for the binghamton domain library server (binghamtonl1) changed
> from loncapal1.chem.binghamton.edu to loncapa.chem.binghamton.edu in
> December 2011, but hujil1 is using the old lonHostID <-> hostname mapping
> from May 2010.
>
> See:
>
> http://mail.lon-capa.org/pipermail/lon-capa-admin/2011-
> September/002546.html
> http://mail.lon-capa.org/pipermail/lon-capa-admin/2013-
> September/002753.html
>
> Temporarily offline?
>
>  ohioua6   (capa10.phy.ohiou.edu - 132.235.208.244)
>> ohioua4   (capa8.phy.ohiou.edu - 132.235.208.242)
>>
>
> See: http://mail.lon-capa.org/pipermail/lon-capa-admin/2014-
> November/002956.html
>
>
> Stuart Raeburn
> LON-CAPA Academic Consortium
>
>
> Quoting Bob Gonzales <rgonzal at binghamton.edu>:
>
>  Hi,
>>
>> My sockets/delayed directory and my lonnet.perm.log is growing due to
>> several hosts not completing the updates for problems they have
>> subscriptions to.  The contents of the various problem's log file shows
>> that other hosts are getting the updates.
>>
>> The hosts that don't update have the 'con_delayed' status.  These hosts
>> are
>> not updating for any of the problems they have subscriptions to and
>> haven't
>> been for a while.
>>
>> The hosts that are not updating are:
>>
>> capa1      (capa1.uwsp.edu - 143.236.33.124)
>> casea1    (capa.chem.case.edu - 129.22.128.219)
>> fhwfa1     (vita2.ostfalia.de - 141.41.235.60)
>> hujil1       (capa1.cc.huji.ac.il - 132.64.3.103)
>> ohioua6   (capa10.phy.ohiou.edu - 132.235.208.244)
>> ohioua4   (capa8.phy.ohiou.edu - 132.235.208.242)
>>
>> Here are log entries for capa1 from today:
>> Fri Dec  5 05:10:20 2014 (18281) [capa1.uwsp.edu] [Fri Dec  5 05:10:16
>> 2014: capa1.uwsp.edu Connection count: 0 Retries remaining: 5 ()] <font
>> color='red'>CRITICAL: Failed to make a connection with lond.</font>
>> Fri Dec  5 05:10:20 2014 (18281) [capa1.uwsp.edu] [Fri Dec  5 05:10:16
>> 2014: capa1.uwsp.edu Connection count: 0 Retries remaining: 5 ()] <font
>> color='blue'>WARNING: Failing transaction sethost</font>
>> Fri Dec  5 05:10:57 2014 (18281) [capa1.uwsp.edu] [Fri Dec  5 05:10:16
>> 2014: capa1.uwsp.edu Connection count: 0 Retries remaining: 5 ()] <font
>> color='red'>CRITICAL: Failed to make a connection with lond.</font>
>> Fri Dec  5 05:10:57 2014 (18281) [capa1.uwsp.edu] [Fri Dec  5 05:10:16
>> 2014: capa1.uwsp.edu Connection count: 0 Retries remaining: 5 ()] <font
>> color='blue'>WARNING: Failing transaction sethost</font>
>> Fri Dec  5 05:17:48 2014 (18281) [capa1.uwsp.edu] [Fri Dec  5 05:10:16
>> 2014: capa1.uwsp.edu Connection count: 0 Retries remaining: 5 ()] <font
>> color='red'>CRITICAL: Failed to make a connection with lond.</font>
>> Fri Dec  5 06:10:41 2014 (18281) [capa1.uwsp.edu] [Fri Dec  5 05:10:16
>> 2014: capa1.uwsp.edu Connection count: 0 Retries remaining: 5 ()] <font
>> color='yellow'>INFO: Resetting Connection Retries.</font>
>> Fri Dec  5 06:20:34 2014 (18281) [capa1.uwsp.edu] [Fri Dec  5 06:10:41
>> 2014: capa1.uwsp.edu Connection count: 0 Retries remaining: 5 ()] <font
>> color='yellow'>INFO: Resetting Connection Retries.</font>
>>
>> lond.log
>> Fri Dec  5 06:10:41 2014 (11766): <font color="yellow">INFO: Connection,
>> 143.236.33.124 (capa1) connection type = client </font>
>> Fri Dec  5 06:10:41 2014 (11766): <font color="green">Successful insecure
>> authentication with capa1 </font>
>> Fri Dec  5 06:10:41 2014 (11766): <font color='green'>Established
>> connection: capa1</font>
>> Fri Dec  5 06:15:42 2014 (11766): Client 143.236.33.124 (capa1) hanging
>> up:
>> exit:
>> Fri Dec  5 06:15:42 2014 (11766): <font color='red'>CRITICAL: Disconnect
>> from 143.236.33.124 (capa1)</font>
>> Fri Dec  5 06:20:34 2014 (11831): <font color="yellow">INFO: Connection,
>> 143.236.33.124 (capa1) connection type = client </font>
>> Fri Dec  5 06:20:34 2014 (11831): <font color="green">Successful insecure
>> authentication with capa1 </font>
>> Fri Dec  5 06:20:34 2014 (11831): <font color='green'>Established
>> connection: capa1</font>
>> Fri Dec  5 06:25:35 2014 (11831): Client 143.236.33.124 (capa1) hanging
>> up:
>> exit:
>> Fri Dec  5 06:25:35 2014 (11831): <font color='red'>CRITICAL: Disconnect
>> from 143.236.33.124 (capa1)</font>
>>
>> lonnet.log
>> Fri Dec  5 06:10:41 2014 (11766): Trying to reconnect lonc for capa1 (
>> capa1.uwsp.edu)
>> Fri Dec  5 06:20:34 2014 (11831): Trying to reconnect lonc for capa1 (
>> capa1.uwsp.edu)
>>
>> ----------------
>> Here are log entries for casea1 from today:
>> lonc.log
>> Fri Dec  5 05:10:23 2014 (18256) [capa.chem.case.edu] [Fri Dec  5
>> 05:10:16
>> 2014: capa.chem.case.edu Connection count: 0 Retries remaining: 5 ()]
>> <font
>> color='red'>CRITICAL: Failed to make a connection with lond.</font>
>> Fri Dec  5 05:10:23 2014 (18256) [capa.chem.case.edu] [Fri Dec  5
>> 05:10:16
>> 2014: capa.chem.case.edu Connection count: 0 Retries remaining: 5 ()]
>> <font
>> color='blue'>WARNING: Failing transaction sethost</font>
>> Fri Dec  5 05:11:07 2014 (18256) [capa.chem.case.edu] [Fri Dec  5
>> 05:10:16
>> 2014: capa.chem.case.edu Connection count: 0 Retries remaining: 5 ()]
>> <font
>> color='red'>CRITICAL: Failed to make a connection with lond.</font>
>> Fri Dec  5 05:11:07 2014 (18256) [capa.chem.case.edu] [Fri Dec  5
>> 05:10:16
>> 2014: capa.chem.case.edu Connection count: 0 Retries remaining: 5 ()]
>> <font
>> color='blue'>WARNING: Failing transaction sethost</font>
>> Fri Dec  5 05:17:41 2014 (18256) [capa.chem.case.edu] [Fri Dec  5
>> 05:10:16
>> 2014: capa.chem.case.edu Connection count: 0 Retries remaining: 5 ()]
>> <font
>> color='red'>CRITICAL: Failed to make a connection with lond.</font>
>>
>> lond.log
>> no entries
>>
>> lonnet.log
>> no entries
>>
>> Here are log entries for fhwfa1:
>> lonc.log
>> Fri Dec  5 05:10:26 2014 (18289) [vita2.ostfalia.de] [Fri Dec  5 05:10:16
>> 2014: vita2.ostfalia.de Connection count: 0 Retries remaining: 5 ()]
>> <font
>> color='red'>CRITICAL: Failed to make a connection with lond.</font>
>> Fri Dec  5 05:10:26 2014 (18289) [vita2.ostfalia.de] [Fri Dec  5 05:10:16
>> 2014: vita2.ostfalia.de Connection count: 0 Retries remaining: 5 ()]
>> <font
>> color='blue'>WARNING: Failing transaction sethost</font>
>> Fri Dec  5 05:11:39 2014 (18289) [vita2.ostfalia.de] [Fri Dec  5 05:10:16
>> 2014: vita2.ostfalia.de Connection count: 0 Retries remaining: 5 ()]
>> <font
>> color='red'>CRITICAL: Failed to make a connection with lond.</font>
>> Fri Dec  5 05:11:39 2014 (18289) [vita2.ostfalia.de] [Fri Dec  5 05:10:16
>> 2014: vita2.ostfalia.de Connection count: 0 Retries remaining: 5 ()]
>> <font
>> color='blue'>WARNING: Failing transaction sethost</font>
>> Fri Dec  5 05:21:01 2014 (18289) [vita2.ostfalia.de] [Fri Dec  5 05:10:16
>> 2014: vita2.ostfalia.de Connection count: 0 Retries remaining: 5 ()]
>> <font
>> color='red'>CRITICAL: Failed to make a connection with lond.</font>
>>
>> lond.log
>> no entries
>>
>> lonnet.log
>> no entries
>> -----------------
>>
>> Here are log entries for hujil1
>> lonc.log
>> Fri Dec  5 05:10:26 2014 (23736) [capa1.cc.huji.ac.il] [Fri Dec  5
>> 05:10:16
>> 2014: capa1.cc.huji.ac.il Connection count: 0 Retries remaining: 5 ()]
>> <font color='red'>CRITICAL: Failed to make a connection with lond.</font>
>> Fri Dec  5 05:10:26 2014 (23736) [capa1.cc.huji.ac.il] [Fri Dec  5
>> 05:10:16
>> 2014: capa1.cc.huji.ac.il Connection count: 0 Retries remaining: 5 ()]
>> <font color='blue'>WARNING: Failing transaction sethost</font>
>> Fri Dec  5 05:12:18 2014 (23736) [capa1.cc.huji.ac.il] [Fri Dec  5
>> 05:10:16
>> 2014: capa1.cc.huji.ac.il Connection count: 0 Retries remaining: 5 ()]
>> <font color='red'>CRITICAL: Failed to make a connection with lond.</font>
>> Fri Dec  5 05:12:18 2014 (23736) [capa1.cc.huji.ac.il] [Fri Dec  5
>> 05:10:16
>> 2014: capa1.cc.huji.ac.il Connection count: 0 Retries remaining: 5 ()]
>> <font color='blue'>WARNING: Failing transaction sethost</font>
>> Fri Dec  5 05:17:45 2014 (23736) [capa1.cc.huji.ac.il] [Fri Dec  5
>> 05:10:16
>> 2014: capa1.cc.huji.ac.il Connection count: 0 Retries remaining: 5 ()]
>> <font color='red'>CRITICAL: Failed to make a connection with lond.</font>
>>
>> lond.log
>> no entries
>>
>> lonnet.log
>> no entries
>> ------------------
>>
>> Here are log entries for ohioua6:
>> lonc.log
>> Fri Dec  5 05:10:32 2014 (23805) [capa10.phy.ohiou.edu] [Fri Dec  5
>> 05:10:16 2014: capa10.phy.ohiou.edu Connection count: 0 Retries
>> remaining:
>> 5 ()] <font color='red'>CRITICAL: Failed to make a connection with
>> lond.</font>
>> Fri Dec  5 05:10:32 2014 (23805) [capa10.phy.ohiou.edu] [Fri Dec  5
>> 05:10:16 2014: capa10.phy.ohiou.edu Connection count: 0 Retries
>> remaining:
>> 5 ()] <font color='blue'>WARNING: Failing transaction sethost</font>
>> Fri Dec  5 05:14:20 2014 (23805) [capa10.phy.ohiou.edu] [Fri Dec  5
>> 05:10:16 2014: capa10.phy.ohiou.edu Connection count: 0 Retries
>> remaining:
>> 5 ()] <font color='red'>CRITICAL: Failed to make a connection with
>> lond.</font>
>> Fri Dec  5 05:14:20 2014 (23805) [capa10.phy.ohiou.edu] [Fri Dec  5
>> 05:10:16 2014: capa10.phy.ohiou.edu Connection count: 0 Retries
>> remaining:
>> 5 ()] <font color='blue'>WARNING: Failing transaction sethost</font>
>> Fri Dec  5 05:17:51 2014 (23805) [capa10.phy.ohiou.edu] [Fri Dec  5
>> 05:10:16 2014: capa10.phy.ohiou.edu Connection count: 0 Retries
>> remaining:
>> 5 ()] <font color='red'>CRITICAL: Failed to make a connection with
>> lond.</font>
>>
>> lond.log
>> no entries
>>
>> lonnet.log
>> no entries
>> ----------------------------
>>
>> here are log entrie for ohioua4:
>> lonc.log
>> Fri Dec  5 05:10:29 2014 (23637) [capa8.phy.ohiou.edu] [Fri Dec  5
>> 05:10:16
>> 2014: capa8.phy.ohiou.edu Connection count: 0 Retries remaining: 5 ()]
>> <font color='red'>CRITICAL: Failed to make a connection with lond.</font>
>> Fri Dec  5 05:10:29 2014 (23637) [capa8.phy.ohiou.edu] [Fri Dec  5
>> 05:10:16
>> 2014: capa8.phy.ohiou.edu Connection count: 0 Retries remaining: 5 ()]
>> <font color='blue'>WARNING: Failing transaction sethost</font>
>> Fri Dec  5 05:14:13 2014 (23637) [capa8.phy.ohiou.edu] [Fri Dec  5
>> 05:10:16
>> 2014: capa8.phy.ohiou.edu Connection count: 0 Retries remaining: 5 ()]
>> <font color='red'>CRITICAL: Failed to make a connection with lond.</font>
>> Fri Dec  5 05:14:13 2014 (23637) [capa8.phy.ohiou.edu] [Fri Dec  5
>> 05:10:16
>> 2014: capa8.phy.ohiou.edu Connection count: 0 Retries remaining: 5 ()]
>> <font color='blue'>WARNING: Failing transaction sethost</font>
>> Fri Dec  5 05:17:57 2014 (23637) [capa8.phy.ohiou.edu] [Fri Dec  5
>> 05:10:16
>> 2014: capa8.phy.ohiou.edu Connection count: 0 Retries remaining: 5 ()]
>> <font color='red'>CRITICAL: Failed to make a connection with lond.</font>
>>
>> lond.log
>> no entries
>>
>> lonnet.log
>> no entries
>>
>> Any thoughts on what might be going on?  Also,  the status report that
>> gets
>> emailed when the warnings and errors get large enough is coming every day.
>>
>> Bob Gonzales
>> Chemistry Dept
>> Binghamton University
>>
>
> _______________________________________________
> LON-CAPA-admin mailing list
> LON-CAPA-admin at mail.lon-capa.org
> http://mail.lon-capa.org/mailman/listinfo/lon-capa-admin
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.lon-capa.org/pipermail/lon-capa-admin/attachments/20141206/d252f2aa/attachment-0001.html>