[webservices] StationEpoch duplicates

Sun Nov 13 19:16:48 PST 2011

Hi John,

What happened is that you selected "station level" information using the -sta flag.  If you didn't use that, it would default to channel level and you would see that WS is returning one line for each channel and omitting the channel name, so it looks like lots of duplicates.  If you want only the earliest and latest station epochs, you will have to read them all to figure this out.

Also just as an FYI since you are interested in the epochs, sometimes a very tiny gap in station epochs can exist (like one sample point e.g. 0.05sec) or metadata gets changed and what happens is that you will see 2 epochs where the end of the first epoch will equal the start of the second.

epoch 1:  2002-03-17T00:00:00,2005-04-05T06:07:08
epoch 2: 2005-04-05T06:07:08,2599-12-31T23:59:59

Alex

channel level:

scoop synthetics/METADATA> FetchMetadata -ua 2011-06-06 -N ND -vvv -s 2010-01-01 -e 2500-12-12
FetchMetadata (2011.172) at 2011-11-13 18:37:39
== Data selections ==
    ND||||2010-01-01T00:00:00|2500-12-12T00:00:00
Metadata URI: 'http://www.iris.edu/ws/station/query?level=chan&network=ND&timewindow=2010-01-01,2500-12-12&updatedafter=2011-06-06'
Fetching metadata :: Received 108.1 KB  
Received 108.1 KB of metadata in 0.1 seconds (1.2 MB/s)
Parsing XML metadata... Done (0.1 seconds)
Processed metadata for 84 channel epochs in 0.2 seconds (488.3 KB/s)
Writing metadata (84 channel epochs) file
#net,sta,loc,chan,lat,lon,elev,depth,azimuth,SACdip,instrument,scale,scalefreq,scaleunits,samplerate,start,end
ND,KOUNC,--,BHE,-20.5507,164.2861,88.0,0.0,90.0,90,Trillium 120P; 120 s; 1201 V/m/s-Kephren; gain 1;,1.28257E11,0.05,M/S,20,2011-03-17T00:00:00,2599-12-31T23:59:59
ND,KOUNC,--,BHN,-20.5507,164.2861,88.0,0.0,0.0,90,Trillium 120P; 120 s; 1201 V/m/s-Kephren; gain 1;,1.28257E11,0.05,M/S,20,2011-03-17T00:00:00,2599-12-31T23:59:59
ND,KOUNC,--,BHZ,-20.5507,164.2861,88.0,0.0,0.0,0,Trillium 120P; 120 s; 1201 V/m/s-Kephren; gain 1;,1.28257E11,0.05,M/S,20,2011-03-17T00:00:00,2599-12-31T23:59:59
ND,KOUNC,--,BNE,-20.5507,164.2861,88.0,0.0,90.0,90,Episensor; DC to >200 Hz;  20V differential full s,2.18979E8,0.05,M/S**2,20,2011-03-17T00:00:00,2599-12-31T23:59:59
ND,KOUNC,--,BNN,-20.5507,164.2861,88.0,0.0,0.0,90,Episensor; DC to >200 Hz;  20V differential full s,2.18979E8,0.05,M/S**2,20,2011-03-17T00:00:00,2599-12-31T23:59:59
ND,KOUNC,--,BNZ,-20.5507,164.2861,88.0,0.0,0.0,0,Episensor; DC to >200 Hz;  20V differential full s,2.18979E8,0.05,M/S**2,20,2011-03-17T00:00:00,2599-12-31T23:59:59
ND,KOUNC,--,HHE,-20.5507,164.2861,88.0,0.0,90.0,90,Trillium 120P; 120 s; 1201 V/m/s-Kephren; gain 1;,1.28257E11,0.05,M/S,100,2011-03-17T00:00:00,2599-12-31T23:59:59
ND,KOUNC,--,HHN,-20.5507,164.2861,88.0,0.0,0.0,90,Trillium 120P; 120 s; 1201 V/m/s-Kephren; gain 1;,1.28257E11,0.05,M/S,100,2011-03-17T00:00:00,2599-12-31T23:59:59
ND,KOUNC,--,HHZ,-20.5507,164.2861,88.0,0.0,0.0,0,Trillium 120P; 120 s; 1201 V/m/s-Kephren; gain 1;,1.28257E11,0.05,M/S,100,2011-03-17T00:00:00,2599-12-31T23:59:59
ND,KOUNC,--,HNE,-20.5507,164.2861,88.0,0.0,90.0,90,Episensor; DC to >200 Hz;  20V differential full s,2.18979E8,0.05,M/S**2,100,2011-03-17T00:00:00,2599-12-31T23:59:59
ND,KOUNC,--,HNN,-20.5507,164.2861,88.0,0.0,0.0,90,Episensor; DC to >200 Hz;  20V differential full s,2.18979E8,0.05,M/S**2,100,2011-03-17T00:00:00,2599-12-31T23:59:59
ND,KOUNC,--,HNZ,-20.5507,164.2861,88.0,0.0,0.0,0,Episensor; DC to >200 Hz;  20V differential full s,2.18979E8,0.05,M/S**2,100,2011-03-17T00:00:00,2599-12-31T23:59:59
ND,LIFNC,--,BHE,-20.7771,167.2402,33.0,0.0,90.0,90,Trillium 120P; 120 s; 1201 V/m/s-Kephren; gain 1;,1.28257E11,0.05,M/S,20,2010-08-28T00:00:00,2599-12-31T23:59:59
ND,LIFNC,--,BHN,-20.7771,167.2402,33.0,0.0,0.0,90,Trillium 120P; 120 s; 1201 V/m/s-Kephren; gain 1;,1.28257E11,0.05,M/S,20,2010-08-28T00:00:00,2599-12-31T23:59:59
ND,LIFNC,--,BHZ,-20.7771,167.2402,33.0,0.0,0.0,0,Trillium 120P; 120 s; 1201 V/m/s-Kephren; gain 1;,1.28257E11,0.05,M/S,20,2010-08-28T00:00:00,2599-12-31T23:59:59
ND,LIFNC,--,BNE,-20.7771,167.2402,33.0,0.0,90.0,90,Episensor; DC to >200 Hz;  20V differential full s,2.18979E8,0.05,M/S**2,20,2010-08-28T00:00:00,2599-12-31T23:59:59

------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
station level  (-sta flag):

scoop synthetics/METADATA> FetchMetadata -ua 2011-06-06 -N ND -vvv -s 2010-01-01 -e 2500-12-12 -sta
FetchMetadata (2011.172) at 2011-11-13 18:36:27
== Data selections ==
    ND||||2010-01-01T00:00:00|2500-12-12T00:00:00
Metadata URI: 'http://www.iris.edu/ws/station/query?level=sta&network=ND&timewindow=2010-01-01,2500-12-12&updatedafter=2011-06-06'
Fetching metadata :: Received 38.3 KB   
Received 38.3 KB of metadata in 0.1 seconds (492.5 KB/s)
Parsing XML metadata... Done (0.0 seconds)
Processed metadata for 84 station epochs in 0.1 seconds (323.3 KB/s)
Writing metadata (84 station epochs) file
#net,sta,lat,lon,elev,site,start,end
ND,KOUNC,-20.5507,164.2861,88.0,Koumac; New Caledonia,2011-03-17T00:00:00,2599-12-31T23:59:59
ND,KOUNC,-20.5507,164.2861,88.0,Koumac; New Caledonia,2011-03-17T00:00:00,2599-12-31T23:59:59
ND,KOUNC,-20.5507,164.2861,88.0,Koumac; New Caledonia,2011-03-17T00:00:00,2599-12-31T23:59:59
ND,KOUNC,-20.5507,164.2861,88.0,Koumac; New Caledonia,2011-03-17T00:00:00,2599-12-31T23:59:59
ND,KOUNC,-20.5507,164.2861,88.0,Koumac; New Caledonia,2011-03-17T00:00:00,2599-12-31T23:59:59
ND,KOUNC,-20.5507,164.2861,88.0,Koumac; New Caledonia,2011-03-17T00:00:00,2599-12-31T23:59:59
ND,KOUNC,-20.5507,164.2861,88.0,Koumac; New Caledonia,2011-03-17T00:00:00,2599-12-31T23:59:59
ND,KOUNC,-20.5507,164.2861,88.0,Koumac; New Caledonia,2011-03-17T00:00:00,2599-12-31T23:59:59
ND,KOUNC,-20.5507,164.2861,88.0,Koumac; New Caledonia,2011-03-17T00:00:00,2599-12-31T23:59:59
ND,KOUNC,-20.5507,164.2861,88.0,Koumac; New Caledonia,2011-03-17T00:00:00,2599-12-31T23:59:59
ND,KOUNC,-20.5507,164.2861,88.0,Koumac; New Caledonia,2011-03-17T00:00:00,2599-12-31T23:59:59
ND,KOUNC,-20.5507,164.2861,88.0,Koumac; New Caledonia,2011-03-17T00:00:00,2599-12-31T23:59:59
ND,LIFNC,-20.7771,167.2402,33.0,Lifou; Loyalty Islands; New Caledonia,2010-08-28T00:00:00,2599-12-31T23:59:59
ND,LIFNC,-20.7771,167.2402,33.0,Lifou; Loyalty Islands; New Caledonia,2010-08-28T00:00:00,2599-12-31T23:59:59
ND,LIFNC,-20.7771,167.2402,33.0,Lifou; Loyalty Islands; New Caledonia,2010-08-28T00:00:00,2599-12-31T23:59:59
ND,LIFNC,-20.7771,167.2402,33.0,Lifou; Loyalty Islands; New Caledonia,2010-08-28T00:00:00,2599-12-31T23:59:59

On Nov 13, 2011, at 4:05 PM, John D. West wrote:

> Hi.
> 
> The query http://www.iris.edu/ws/station/query?updatedafter=2011-06-06&level=sta&net=ND&timewindow=2010-01-01,2500-12-12
> returns multiple duplicates of the <StationEpoch> sections for each station. 
> 
> Makes my sync to a local copy procedure very slow...
> 
> Thanks!
> 
>      -- John
> _______________________________________________
> webservices mailing list
> webservices at iris.washington.edu
> http://www.iris.washington.edu/mailman/listinfo/webservices

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.iris.washington.edu/pipermail/webservices/attachments/20111113/fb4574b2/attachment-0001.htm>