Skip to main content

programming - Cases[data,Colon[key,_]] vs. Cases[data,key:_] toward XPath, XQuery


Exploring methods to index and search tree-structured key:value pairs via named-entity index (key paths) as opposed to Position-based indexing.





  • Using Rule as key->value causes difficulties for Cases, which is unfortunate since Rule could be combined with ReplaceAll to yield lightweight path queries.




  • Using List as {key,value} works but too many parentheses are visually confusing especially in data fusion tasks where multiple datasets are imported separately but must be joined and indexed properly for subsequent analysis.




  • Using Equal prevents the key from being a string, eg "key1" = value1 --> "Set::setraw : Cannot assign to raw object key1"




Why does Cases interpret Colon shortcut (key:value_) differently than Colon[key,value_]?



dataR (* for comparison *)


 Out[110]= {row1 -> {key1 -> value1, key2 -> value2}, 
row2 -> {key1 -> value3, key2 -> value4}}

In[69]:= dataC = dataR /. Rule -> Colon

Out[69]= {row1 \[Colon] {key1 \[Colon] value1, key2 \[Colon] value2},
row2 \[Colon] {key1 \[Colon] value3, key2 \[Colon] value4}}

Then, using Cases:



 In[113]:= Cases[dataC, Colon[row1  , v_] -> v]

Out[113]= {{key1 \[Colon] value1, key2 \[Colon] value2}}

In[114]:= Cases[dataC, (row1 : v_) -> v]

Out[114]= {row1 \[Colon] {key1 \[Colon] value1, key2 \[Colon] value2},
row2 \[Colon] {key1 \[Colon] value3, key2 \[Colon] value4}}

Levelspec can be specified to match the inner keys, eg key2 at Level 3.



Is there a more convenient syntax or method to rapidly restructure arbitrary tree-shaped data? XPath and XQuery, are W3C standards that could be adapted or improved. In particular, XQuery strikes me as being similar in flexibility as Cases in the ability to match and transform data. I've posed similar questions to Wolfram Tech Support. Has been suggested for implementation.



Answer



I'd like to discuss two points:


Cases, destructuring and escaping in patterns


There indeed can be a problem when using Cases to destructure expressions involving rules, because Cases has an extended syntax which uses rules, and interprets them differently. For example:


dataR = {row1 -> {key1 -> value1, key2 -> value2}, 
row2 -> {key1 -> value3, key2 -> value4}}

Here is a naive attempt that will fail:


Cases[dataR, row1 -> _]


(* {} *)

This will work:


Cases[dataR, p : (row1 -> _)]

(* {row1 -> {key1 -> value1, key2 -> value2}} *)

The reason is that the colon (which is a short-cut for Pattern) serves as an escaping mechanism in this case. The "politically correct" way to perform escaping in patterns is however to use Verbatim:


Cases[dataR, Verbatim[Rule][row1, _]]


(* {row1 -> {key1 -> value1, key2 -> value2}} *)

In some cases, particularly when you only need to collect some parts of the expression involving rules, this may be unnecessary since the escaping will be naturally achieved by the destructuring rule. Example:


Cases[dataR, (row1 -> x_) :> x]

(* {{key1 -> value1, key2 -> value2}} *)

Better ways to destructure trees


You can use the fact that your tree is made of rules, to destructure it better. There were a few questions here about it, particularly this and this. Let me just show you a simple construct here:



ClearAll[destructure];
destructure[tree_, keys__List] :=
Fold[If[#2 === All, Flatten[#1[[All, 2]]], #2 /. #1] &, tree, keys]

This uses the fact that each branch is itself a set of rules. Some examples of use:


destructure[dataR,{row1,key1}]

(* value1 *)

destructure[dataR,{row1,All}]


(* {value1,value2} *)

destructure[dataR,{All,All}]

(* {value1,value2,value3,value4} *)

Comments

Popular posts from this blog

plotting - How to draw lines between specified dots on ListPlot?

I would like to create a plot where I have unconnected dots and some connected. So far, I have figured out how to draw the dots. My code is the following: ListPlot[{{1, 1}, {2, 2}, {3, 3}, {4, 4}, {1, 4}, {2, 5}, {3, 6}, {4, 7}, {1, 7}, {2, 8}, {3, 9}, {4, 10}, {1, 10}, {2, 11}, {3, 12}, {4,13}, {2.5, 7}}, Ticks -> {{1, 2, 3, 4}, None}, AxesStyle -> Thin, TicksStyle -> Directive[Black, Bold, 12], Mesh -> Full] I have thought using ListLinePlot command, but I don't know how to specify to the command to draw only selected lines between the dots. Do have any suggestions/hints on how to do that? Thank you. Answer One possibility would be to use Epilog with Line : ListPlot[ {{1, 1}, {2, 2}, {3, 3}, {4, 4}, {1, 4}, {2, 5}, {3, 6}, {4, 7}, {1, 7}, {2, 8}, {3, 9}, {4, 10}, {1, 10}, {2, 11}, {3, 12}, {4, 13}, {2.5, 7}}, Ticks -> {{1, 2, 3, 4}, None}, AxesStyle -> Thin, TicksStyle -> Directive[Black, Bold, 12], Mesh -> Full, Epilog -> { Line[ ...

calculus and analysis - Integral of the Sinc product

Let us consider the following integral $$ B_n = \int_0^\infty \prod_{k=1,3,5,\dots}^n\frac{\sin (x/k)}{x/k}dx $$ By definition, Sinc[x] == Sin[x]/x , therefore B[n_?OddQ] := Integrate[Product[Sinc[x/k], {k, 1, n, 2}], {x, 0, Infinity}] B /@ Range[1, 13, 2] {Pi/2, Pi/2, Pi/2, Pi/2, Pi/2, Pi/2, Pi/2} OK, everything is fine. But... B[15] 467807924713440738696537864469 Pi/935615849440640907310521750000 What's going on? Answer As Eckhard wrote in comments B[n] is the n-th Borwein integral . (The letter B was not accidental :) ) This funny properties of Borwein integrals is related to the Fourier transform of Sinc function FourierTransform[Sinc[x], x, k] 1/2 Sqrt[Pi/2] (Sign[1 - k] + Sign[1 + k]) Plot[%, {k, -2, 2}, Filling -> 0] which is the box function. The result is $\pi/2$ while the sum $$ 1/3+1/5+\dots+1/n $$ B_n = \frac{\pi}{2} - \pi \bigg(\sum_{k=3,5,\ldots}^n\frac{1}{k} -1\biggr)^\frac{n-1}{2}\prod_{k=3,5,\dots}^n\frac{k}{k-1}. $$ For $n=15$ it is equal to $$ \frac{46780...

list manipulation - Selecting multiple columns from a matrix?

Sample data: data = { {{2013, 1, 1}, 24.13, 167.67, 231.82}, {{2013, 1, 2}, 32.15, 170.92, 225.99}, {{2013, 1, 3}, 35.43, 172.68, 221.67}, {{2013, 1, 4}, 36.73, 173.05, 218.32}, {{2013, 1, 5}, 58.19, 165.96, 197.05}, {{2013, 1, 6}, 69.99, 163.50, 187.52}, {{2013, 1, 7}, 71.37, 154.21, 175.58}, {{2013, 1, 8}, 72.51, 149.66, 163.25}}; I want a DateListPlot with three graphs, so for a matrix formed by columns 1 and 2, one for columns 1 and 3, and 1 for columns 1 and 4. At the moment I'm using this code: data2 = Transpose[{data[[All, 1]], data[[All, 2]]}]; data3 = Transpose[{data[[All, 1]], data[[All, 3]]}]; data4 = Transpose[{data[[All, 1]], data[[All, 4]]}]; DateListPlot[{data2, data3, data4}, Joined -> True, Filling -> {3 -> {1}}] but I have a hunch that this can be done more efficiently. I don't like the Transpose s in particular. Any ideas? edit (for extra credit) What if I need to multiply the second column by 2, which in my solution is simp...