[dhi-servers] Isilon service restored - IRIS_DataCenter restored

Robert Casey rob at iris.washington.edu
Wed Feb 7 16:15:59 PST 2007


	Two issues with DHI to report.

	The recent incident with the Isilon outage was quickly resolved.   
Cause is apparently vendor support error which resulted in all disk  
mounts being dropped.

	Secondly, a recent bug was reported where IRIS_DataCenter, which  
accesses both the BUD real-time archive and the Isilon for long-term  
archive data was not returning data samples for certain stations,  
most visibly for BK network data.  Time region was around October  
15th, 2006, though the surrounding times were also affected.  The  
developer responsible for this code has detected a bug with a data  
quality filter for extracting miniSEED to the DHI system, where in  
special cases of mixed quality types it will filter out everything  
and pass nothing back.

	Recovery of this is happening in two stages.  First stage is to  
remove the quality filter and pass all data through the DHI system.   
This is currently running now as IRIS_DataCenter and data extraction  
or BK data from the Isilon has been verified.  The only caveat is  
that there may be some cases where more than one quality of data is  
present in the archive and both may be retrieved, causing  
indeterminable effects in the returned dataset, possibly some form of  
duplication.  A fix for the filtering problem is being worked on at  
time of writing, which will be the second stage of release, meant to  
filter through the 'best' quality of any given channel.  This  
solution should be available in a matter of a few days.

	Apologies for the recent inconveniences.  After a period of  
relatively reliable processing, we have experienced a convergence of  
a number of incidents at one time, most of them easily identified and  
resolved.  This is the final known outstanding DHI issue to be  
resolved and we are giving it our full attention.

	Thanks,

	-Rob



More information about the dhi-servers mailing list