Skip to main content

performance tuning - Faster way to extract partial data from AdjacencyMatrix


I am dealing with a lot of Graph objects. One task is to obtain an Id for each of them. So I first used


g = Graph[{1 -> 2, 1 -> 3, 4 -> 2, 3 -> 5, 4 -> 5, 7 -> 2, 4 -> 7, 3 -> 8}];

GraphId[g_] := Module[{}, AdjacencyMatrix@CanonicalGraph@g]

FullForm@GraphId@g

which gives


SparseArray[
Automatic,
List[7,7],
0,
List[
1,
List[

List[0,2,5,5,6,8,8,8],
List[List[5],List[7],List[4],List[6],List[7],List[7],List[3],List[6]]
],
List[1,1,1,1,1,1,1,1]
]
]

I have to reduce this result to save space. The first approach is not to including List[1,1,1,1,1,1,1,1] in the result. So I tried


ToData[g_] := (Last@ToExpression@StringReplace[ToString@FullForm@g, "Graph" -> "List"])[[1]]
GraphIdReduced[g_] := Module[{}, ToData@CanonicalGraph@g]

FullForm@GraphIdReduced@g

which gives


SparseArray[
Automatic,
List[7,7],
0,
List[
1,
List[

List[0,2,5,5,6,8,8,8],
List[List[5],List[7],List[4],List[6],List[7],List[7],List[3],List[6]]
],
Pattern
]
]

Of course I can use the same approach to reduce the result much further. But the problem is the above method is very slow.


gT=Table[g,{i,1,10^5}];
AbsoluteTiming[GraphId/@gT][[1]]

AbsoluteTiming[GraphIdReduced/@gT][[1]]

gives


1.185602
14.445625

, and for 10^6 times, the difference is 12.386422 vs 146.539146.


Maybe this is because the string operations are slow, but I don't know how to do without it. Graph and SparseArray are atomic object and I can't not use Apply to change their Head to List and then locate the contents I care about.


So how to extract some data from the above result more quickly?


In fact, the data I need is only



enter image description here



Answer



You can use the new-in-Version-10 properties "RowPointers" and "ColumnIndices" of a SparseArray object:


g = Graph[{1 -> 2, 1 -> 3, 4 -> 2, 3 -> 5, 4 -> 5, 7 -> 2, 4 -> 7, 3 -> 8}];
sa=AdjacencyMatrix@CanonicalGraph@g;

{sa["RowPointers"],Flatten[sa["ColumnIndices"]]}
(* {{0,2,5,5,6,8,8,8},{5,7,4,6,7,7,3,6}} *)

Or define a function



foo=Function[{s},{s@#,Flatten@s@#2}&@@{"RowPointers","ColumnIndices"}]
foo@sa
(* {{0,2,5,5,6,8,8,8},{5,7,4,6,7,7,3,6}} *)

Alternatively, you can use the second part of "NonzeroPositions" instead of "ColumnIndices":


{sa["RowPointers"],sa["NonzeroPositions"][[All,2]]}
(* {{0,2,5,5,6,8,8,8},{5,7,4,6,7,7,3,6}} *)

Note: There has been few additions to the still-undocumented SparseArray "Properties", including "RowPointers" and "ColumnIndices" used above.


sa["Properties"]

(* {AdjacencyLists, Background, ColumnIndices, Density, NonzeroPositions,
NonzeroValues, PatternArray, Properties, RowPointers} *)

Comments

Popular posts from this blog

mathematical optimization - Minimizing using indices, error: Part::pkspec1: The expression cannot be used as a part specification

I want to use Minimize where the variables to minimize are indices pointing into an array. Here a MWE that hopefully shows what my problem is. vars = u@# & /@ Range[3]; cons = Flatten@ { Table[(u[j] != #) & /@ vars[[j + 1 ;; -1]], {j, 1, 3 - 1}], 1 vec1 = {1, 2, 3}; vec2 = {1, 2, 3}; Minimize[{Total@((vec1[[#]] - vec2[[u[#]]])^2 & /@ Range[1, 3]), cons}, vars, Integers] The error I get: Part::pkspec1: The expression u[1] cannot be used as a part specification. >> Answer Ok, it seems that one can get around Mathematica trying to evaluate vec2[[u[1]]] too early by using the function Indexed[vec2,u[1]] . The working MWE would then look like the following: vars = u@# & /@ Range[3]; cons = Flatten@{ Table[(u[j] != #) & /@ vars[[j + 1 ;; -1]], {j, 1, 3 - 1}], 1 vec1 = {1, 2, 3}; vec2 = {1, 2, 3}; NMinimize[ {Total@((vec1[[#]] - Indexed[vec2, u[#]])^2 & /@ R...

functions - Get leading series expansion term?

Given a function f[x] , I would like to have a function leadingSeries that returns just the leading term in the series around x=0 . For example: leadingSeries[(1/x + 2)/(4 + 1/x^2 + x)] x and leadingSeries[(1/x + 2 + (1 - 1/x^3)/4)/(4 + x)] -(1/(16 x^3)) Is there such a function in Mathematica? Or maybe one can implement it efficiently? EDIT I finally went with the following implementation, based on Carl Woll 's answer: lds[ex_,x_]:=( (ex/.x->(x+O[x]^2))/.SeriesData[U_,Z_,L_List,Mi_,Ma_,De_]:>SeriesData[U,Z,{L[[1]]},Mi,Mi+1,De]//Quiet//Normal) The advantage is, that this one also properly works with functions whose leading term is a constant: lds[Exp[x],x] 1 Answer Update 1 Updated to eliminate SeriesData and to not return additional terms Perhaps you could use: leadingSeries[expr_, x_] := Normal[expr /. x->(x+O[x]^2) /. a_List :> Take[a, 1]] Then for your examples: leadingSeries[(1/x + 2)/(4 + 1/x^2 + x), x] leadingSeries[Exp[x], x] leadingSeries[(1/x + 2 + (1 - 1/x...

What is and isn't a valid variable specification for Manipulate?

I have an expression whose terms have arguments (representing subscripts), like this: myExpr = A[0] + V[1,T] I would like to put it inside a Manipulate to see its value as I move around the parameters. (The goal is eventually to plot it wrt one of the variables inside.) However, Mathematica complains when I set V[1,T] as a manipulated variable: Manipulate[Evaluate[myExpr], {A[0], 0, 1}, {V[1, T], 0, 1}] (*Manipulate::vsform: Manipulate argument {V[1,T],0,1} does not have the correct form for a variable specification. >> *) As a workaround, if I get rid of the symbol T inside the argument, it works fine: Manipulate[ Evaluate[myExpr /. T -> 15], {A[0], 0, 1}, {V[1, 15], 0, 1}] Why this behavior? Can anyone point me to the documentation that says what counts as a valid variable? And is there a way to get Manpiulate to accept an expression with a symbolic argument as a variable? Investigations I've done so far: I tried using variableQ from this answer , but it says V[1...