Skip to main content

time series - EventSeries v. TimeSeries


I have what technically should be an event series, spike times of a neuron. Here's a subset of the spiking data -


st = {2.60661, 4.39836, 5.01687, 6.09621, 6.62883, 6.93686, 7.31116, 8.14444, 8.56538, 9.11395}

If I whip this into a TimeSeries then I can easily Accumulate[] them to yield a counting function like so:


spikeData = TimeSeries[Table[1,Length[st]],{st}];
accSpikeData = Accumulate[spikeData];
Row[{ListPlot[spikeData, Filling -> Bottom],ListPlot[accSpikeData, Filling -> Bottom]}]


Mathematica graphics


But- If I do the same thing with an EventSeries instead...


spikeData = EventSeries[Table[1, Length[st]], {st}];
accSpikeData = Accumulate[spikeData];
Row[{ListPlot[spikeData, Filling -> Bottom], ListPlot[accSpikeData, Filling -> Bottom]}]

Mathematica graphics


And, indeed, looking at the data-


accSpikeData["Path"]
(* {{2.60661, 1}, {4.39836, Missing[]}, {5.01687, Missing[]}, {6.09621,

Missing[]}, {6.62883, Missing[]}, {6.93686, Missing[]}, {7.31116,
Missing[]}, {8.14444, Missing[]}, {8.56538, Missing[]}} *)

I'm not sure if this is a bug or 'intended behavior'. As I understand EventSeries it is simply a non-interpolating version of TimeSeries, and, of course I can do what I need here with a TimeSeries but was just wondering why even having EventSeries is a thing.



Answer



This is intended behaviour and here is why. Accumulate on TimeSeries or on EventSeries assumes that it accumulates according to every regular step on times. So in case of irregularly sampled TimeSeries it interpolates and in case of irregularly sampled EventSeries it creates Missing[] values. Examples:


In[41]:= data = {1, 2, 3, 4, 5};
Accumulate[data]

Out[42]= {1, 3, 6, 10, 15}


Create a TimeSeries with irregular time stamps:


In[43]:= ts1 = TimeSeries[data, {{1, 1.5, 3, 3.5, 4}}];

Now Accumulate will cause the values to be interpolated automatically:


In[44]:= Accumulate[ts1]["Path"]

Out[44]= {{1., 1.}, {1.5, 3.}, {3., 11.}, {3.5, 15.}, {4., 20.}}

This is coming from subsampling ts11:



In[49]:= ts11 = TimeSeriesResample[ts1];
Accumulate[ts11]["Path"]

Out[50]= {{1., 1.}, {1.5, 3.}, {2., 5.33333}, {2.5, 8.}, {3., 11.}, {3.5, 15.}, {4., 20.}}

Compare to accumulating the values of ts1 directly:


In[46]:= Accumulate[ts1["Values"]]

Out[46]= {1, 3, 6, 10, 15}


Create another TimeSeries forcing the irregular time stamps to be treated as sequentially regular:


In[47]:= ts2 = TimeSeries[data, {{1, 1.5, 3, 3.5, 4}}, TemporalRegularity -> True];

Now accumulating ts2 gives the expected answer equivalent to accumulating the original data:


In[48]:= Accumulate[ts2]["Values"]

Out[48]= {1, 3, 6, 10, 15}

EventSeries does not interpolate automatically hence Accumulate chokes on Missing[] and gives red flag that something is off. What you need is to Accumulate the values directly or set TemporalRegularity to True upon (re)construction.


Comments

Popular posts from this blog

front end - keyboard shortcut to invoke Insert new matrix

I frequently need to type in some matrices, and the menu command Insert > Table/Matrix > New... allows matrices with lines drawn between columns and rows, which is very helpful. I would like to make a keyboard shortcut for it, but cannot find the relevant frontend token command (4209405) for it. Since the FullForm[] and InputForm[] of matrices with lines drawn between rows and columns is the same as those without lines, it's hard to do this via 3rd party system-wide text expanders (e.g. autohotkey or atext on mac). How does one assign a keyboard shortcut for the menu item Insert > Table/Matrix > New... , preferably using only mathematica? Thanks! Answer In the MenuSetup.tr (for linux located in the $InstallationDirectory/SystemFiles/FrontEnd/TextResources/X/ directory), I changed the line MenuItem["&New...", "CreateGridBoxDialog"] to read MenuItem["&New...", "CreateGridBoxDialog", MenuKey["m", Modifiers-...

How to thread a list

I have data in format data = {{a1, a2}, {b1, b2}, {c1, c2}, {d1, d2}} Tableform: I want to thread it to : tdata = {{{a1, b1}, {a2, b2}}, {{a1, c1}, {a2, c2}}, {{a1, d1}, {a2, d2}}} Tableform: And I would like to do better then pseudofunction[n_] := Transpose[{data2[[1]], data2[[n]]}]; SetAttributes[pseudofunction, Listable]; Range[2, 4] // pseudofunction Here is my benchmark data, where data3 is normal sample of real data. data3 = Drop[ExcelWorkBook[[Column1 ;; Column4]], None, 1]; data2 = {a #, b #, c #, d #} & /@ Range[1, 10^5]; data = RandomReal[{0, 1}, {10^6, 4}]; Here is my benchmark code kptnw[list_] := Transpose[{Table[First@#, {Length@# - 1}], Rest@#}, {3, 1, 2}] &@list kptnw2[list_] := Transpose[{ConstantArray[First@#, Length@# - 1], Rest@#}, {3, 1, 2}] &@list OleksandrR[list_] := Flatten[Outer[List, List@First[list], Rest[list], 1], {{2}, {1, 4}}] paradox2[list_] := Partition[Riffle[list[[1]], #], 2] & /@ Drop[list, 1] RM[list_] := FoldList[Transpose[{First@li...

plotting - How to draw lines between specified dots on ListPlot?

I would like to create a plot where I have unconnected dots and some connected. So far, I have figured out how to draw the dots. My code is the following: ListPlot[{{1, 1}, {2, 2}, {3, 3}, {4, 4}, {1, 4}, {2, 5}, {3, 6}, {4, 7}, {1, 7}, {2, 8}, {3, 9}, {4, 10}, {1, 10}, {2, 11}, {3, 12}, {4,13}, {2.5, 7}}, Ticks -> {{1, 2, 3, 4}, None}, AxesStyle -> Thin, TicksStyle -> Directive[Black, Bold, 12], Mesh -> Full] I have thought using ListLinePlot command, but I don't know how to specify to the command to draw only selected lines between the dots. Do have any suggestions/hints on how to do that? Thank you. Answer One possibility would be to use Epilog with Line : ListPlot[ {{1, 1}, {2, 2}, {3, 3}, {4, 4}, {1, 4}, {2, 5}, {3, 6}, {4, 7}, {1, 7}, {2, 8}, {3, 9}, {4, 10}, {1, 10}, {2, 11}, {3, 12}, {4, 13}, {2.5, 7}}, Ticks -> {{1, 2, 3, 4}, None}, AxesStyle -> Thin, TicksStyle -> Directive[Black, Bold, 12], Mesh -> Full, Epilog -> { Line[ ...