<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<p>
</p>
<p><span style="mso-ansi-language:EN-US">Dear Frank,</span></p>
<p><span style="mso-ansi-language:EN-US">Sorry for not being
able to share a short report on the incident earlier. Please
find below the
requested information.</span></p>
<br>
<p><span style="mso-ansi-language:EN-US">Once the afrinic.db file
is generated by WHOIS services, the file is transferred to an
intermediate
server before reaching AFRINIC FTP server.</span></p>
<p><span style="mso-ansi-language:EN-US">Initial investigation
showed that the Stealth WHOIS service was generating files
correctly. In the
other hand, the script that update and copy the file to the
final destination
(FTP) did not run properly even-though the timestamp changed on
<a class="moz-txt-link-abbreviated" href="ftp://ftp.afrinic.net">ftp.afrinic.net</a>.</span><span style="mso-ansi-language:EN-US"><br>
</span></p>
<p><span style="mso-ansi-language:EN-US">Deeper investigation
pointed
at issue caused by the limit of max open file on WHOIS Stealth
as no other
processes (including cron jobs) could be executed.</span>
</p>
<p><span style="mso-ansi-language:EN-US">Based on basic
knowledge of the WHOIS service, there is a high probability that
this issue is
caused by the addition of lame delegation feature. Which
increased the number
of open files by more than 300.</span></p>
<p><span style="mso-ansi-language:EN-US"></span></p>
<p><span style="mso-ansi-language:EN-US"></span></p>
<p><br>
<u><span style="mso-ansi-language:EN-US">Immediate remedial
action:</span></u></p>
<span style="mso-ansi-language:EN-US">Free up open files and
rerun script manually.</span>
<p><br>
<span lang="EN-GB"></span></p>
<u><span lang="EN-GB">Long term action:</span></u>
<p><span lang="EN-GB">Modify the transfer script to keep the actual
timestamp and setup monitoring on file age (</span><span
style="mso-ansi-language:
EN-US">check for file age greater than 24 hours)</span></p>
<p><span style="mso-ansi-language:EN-US">Adjust the max open file
limit on WHOIS node.</span></p>
<p><br>
<span style="mso-ansi-language:EN-US"></span></p>
<span style="mso-ansi-language:EN-US">We apologize for not updating
our status.afrinic.net page. Rest assure that from now on, it will
be part of
the systems that are systematically announce.</span>
<p><span style="mso-ansi-language:EN-US"><span
style="mso-spacerun:yes"></span></span></p>
<p><span style="mso-ansi-language:EN-US"><span
style="mso-spacerun:yes"></span>Wishing you all a Merry
Christmas and happy
new year. </span></p>
<p><br>
</p>
<p>Cedrick</p>
<p><br>
</p>
<p>
<style>
<!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;
mso-font-charset:0;
mso-generic-font-family:roman;
mso-font-pitch:variable;
mso-font-signature:-536870145 1107305727 0 0 415 0;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;
mso-font-charset:0;
mso-generic-font-family:swiss;
mso-font-pitch:variable;
mso-font-signature:-536859905 -1073732485 9 0 511 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"";
margin:0cm;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:"Calibri",sans-serif;
mso-ascii-font-family:Calibri;
mso-ascii-theme-font:minor-latin;
mso-fareast-font-family:Calibri;
mso-fareast-theme-font:minor-latin;
mso-hansi-font-family:Calibri;
mso-hansi-theme-font:minor-latin;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;
mso-ansi-language:EN-GB;}
.MsoChpDefault
{mso-style-type:export-only;
mso-default-props:yes;
font-family:"Calibri",sans-serif;
mso-ascii-font-family:Calibri;
mso-ascii-theme-font:minor-latin;
mso-fareast-font-family:Calibri;
mso-fareast-theme-font:minor-latin;
mso-hansi-font-family:Calibri;
mso-hansi-theme-font:minor-latin;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;
mso-ansi-language:EN-GB;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;
mso-header-margin:36.0pt;
mso-footer-margin:36.0pt;
mso-paper-source:0;}
div.WordSection1
{page:WordSection1;}
-->
</style></p>
<div class="moz-cite-prefix">On 20/12/2018 11:22, Frank Habicht
wrote:<br>
</div>
<blockquote type="cite"
cite="mid:d1c869a1-d768-39a4-4a00-e24a76dbb49a@geier.ne.tz">Dear
AfriNIC staff,
<br>
<br>
I would like to request you to share to this DBWG what happened
last Friday regarding the file afrinic.db.gz - ticket #641933.
<br>
<br>
I had requested and was expecting that something would be shared
here, but haven't seen anything after what I believe was a
reasonable time.
<br>
<br>
Yes, it affected internet operations, since it affected filter
generations and thus traffic patterns.
<br>
<br>
Thanks,
<br>
Frank
<br>
<br>
_______________________________________________
<br>
DBWG mailing list
<br>
<a class="moz-txt-link-abbreviated" href="mailto:DBWG@afrinic.net">DBWG@afrinic.net</a>
<br>
<a class="moz-txt-link-freetext" href="https://lists.afrinic.net/mailman/listinfo/dbwg">https://lists.afrinic.net/mailman/listinfo/dbwg</a>
<br>
</blockquote>
<pre class="moz-signature" cols="72">
--
_______________________________________________________________
Cedrick Adrien Mbeyet
Infrastructure Unit Manager, AFRINIC Ltd.
t: +230 403 5100 / 403 5115 | f: +230 466 6758 | tt: @afrinic | w: <a class="moz-txt-link-abbreviated" href="http://www.afrinic.net">www.afrinic.net</a>
facebook.com/afrinic | flickr.com/afrinic | youtube.com/afrinicmedia
______________________________________________________
</pre>
</body>
</html>