Skip to main content

image processing - Measure a DensityHistogram[] pair similarity


I study human vision and more specifically eye-movements.


"If we display 2 symmetrical patterns (20 min one after the other), will our gaze distribution be symmetric is my research question."



The 2 figures at the bottom row below is what is displayed to subjects for 3 seconds. One pattern, then, later in the experiment, its symmetrical transform.


Above are their respective Gaze Density histograms. That is the distribution of where their eyes were while observing the stimuli. The Blue square is the Center Of Gravity of the stimuli.


How can I measure their similarity ? If I have some ideas, I think Mathematica offers great means of image analysis that could be used here.


enter image description here


You could find here the data : allSymFix : 93 sublist for the 93 stimuli pairs I present, along with a manipulate to see all the histograms


allSymFix[[1,1]] are all the gaze observed on stimuli 1 original version.
allSymFix[[1,2]] on its symmetrical transform


enter image description here


How can I measure the similarity within each allSymFix[[original stimuli]].


I will then compare it with the similarity computed on random pairs assembled




Answer



We'll use SmoothKernelDistribution. Correlated pair with left data set reflected around y-axis:


lefTimagE = SmoothKernelDistribution[{-1, 1} # & /@ allSymFix[[3, 1]]];
righTimagE = SmoothKernelDistribution[allSymFix[[3, 2]]];

Visualize in 3D:


  Row@Plot3D[Evaluate[#], {x, -13, 13}, {y, -13, 13}, PlotRange -> All,
  MeshFunctions -> {#3 &}, Mesh -> 15, PlotPoints -> 50] & /@ 
  {PDF[lefTimagE, {x, y}], PDF[lefTimagE, {x, y}] PDF[righTimagE, {x, y}], 
  PDF[righTimagE, {x, y}]}


enter image description here


The middle is overlap - notice small values. Integrate to find total characteristic


NIntegrate[Evaluate[PDF[lefTimagE, {x, y}] PDF[righTimagE, {x, y}]], 
{x, -13, 13}, {y, -13, 13}, Method -> "AdaptiveMonteCarlo"]

Answer: 0.00549086


Random pair:


lefTimagE = SmoothKernelDistribution[{-1, 1} # & /@ allSymFix[[3, 1]]];
righTimagE = SmoothKernelDistribution[allSymFix[[15, 2]]];


Visualize in 2D this time for verity:


Row@ContourPlot[Evaluate[#], {x, -13, 13}, {y, -13, 13},PlotRange -> All, 
Mesh -> 15, PlotPoints -> 50] & /@ {PDF[lefTimagE, {x, y}], PDF[lefTimagE, 
{x, y}] PDF[righTimagE, {x, y}], PDF[righTimagE, {x, y}]}

enter image description here


The middle is overlap. Integrate to find total characteristic


NIntegrate[Evaluate[PDF[lefTimagE, {x, y}] PDF[righTimagE, {x, y}]], 
{x, -13, 13}, {y, -13, 13}, Method -> "AdaptiveMonteCarlo"]


Answer: 0.0038788


I liked Andy's analysis of the whole set for his metric. I ran it for my integral metric too:


Correlated pairs:


coRdaT = Table[NIntegrate[Evaluate[PDF[SmoothKernelDistribution[{-1, 1} 
# & /@ allSymFix[[k, 1]]], {x, y}] PDF[SmoothKernelDistribution[
allSymFix[[k, 2]]], {x, y}]], {x, -13,13}, {y, -13, 13}, 
Method -> "AdaptiveMonteCarlo"] , {k, 1, 93}];

Random pairs:



uNcoRdaT = Table[NIntegrate[Evaluate[PDF[SmoothKernelDistribution[{-1, 1} 
# & /@ allSymFix[[k, 1]]], {x, y}] PDF[SmoothKernelDistribution[
allSymFix[[RandomInteger[{1, 93}], 2]]], {x, y}]], {x, -13, 13}, 
{y, -13, 13}, Method -> "AdaptiveMonteCarlo"] , {k, 1, 93}];

Analysis:


SmoothHistogram[{coRdaT, uNcoRdaT}, Filling -> Axis, 
PlotStyle -> {{Thick, Blue}, {Thick, Red}}]

enter image description here



Conclusion: on average integral of overlap for correlated pairs almost order of magnitude greater than for random pairs.


======= ARCHIVE: less reliable, needs-polishing approach =======


Here is a very simple take on this. If my understanding is correct, @500 wishes to see spatial correlation between left and right 2D patterns. I'll use SmoothDensityHistogram because it IMO gives better data representation in this case, but you can use your original approach too. The idea is to use ImageMultiply to "amplify" overlapping regions. Midle image is the overlap for a specific set of your data. Note it was ImageAdjust-ed for better visual perception. As numeric measure you have red number (computed before ImageAdjust for uniform scale) The red number is total "intensity" of overlap which could be some sort of correlation measure. BTW we also need to reflect one of the images around vertical axis, otherwise overlap will be meaningless. Here is correlated pair - data set 3, left and right images. As you can see the red number is high and the overlap does look like originals.


ili = SmoothDensityHistogram[#, Background -> Black, 
     ColorFunction -> GrayLevel, ImageSize -> 300, 
     PlotRange -> {{-13, 13}, {-13, 13}}, ImagePadding -> 0, 
     ImageMargins -> 0, PlotRangePadding -> 0, Mesh -> 0] & /@ 
   allSymFix[[3]];
il = {ImageReflect[ili[[1]], Left -> Right], ili[[2]]};
Framed@Labeled[GraphicsRow[Riffle[il, (cori = 

       ColorConvert[ImageMultiply @@ il, "Grayscale"]) // 
     ImageAdjust], Spacings -> 1], ImageData[cori] // Total // Total, 
  Top, LabelStyle -> Directive[Red, Bold, 20]]

enter image description here


And here is random pairing of set 3 left image and set 15 right image. As you can see the red number is much less and the overlap does not look like originals.


ili = SmoothDensityHistogram[#, Background -> Black, 
     ColorFunction -> GrayLevel, ImageSize -> 300, 
     PlotRange -> {{-13, 13}, {-13, 13}}, ImagePadding -> 0, 
     ImageMargins -> 0, PlotRangePadding -> 0, 

     Mesh -> 0] & /@ {allSymFix[[3, 1]], allSymFix[[15, 2]]};
il = {ImageReflect[ili[[1]], Left -> Right], ili[[2]]};
Framed@Labeled[GraphicsRow[Riffle[il, (cori = 
       ColorConvert[ImageMultiply @@ il, "Grayscale"]) // 
     ImageAdjust], Spacings -> 1], ImageData[cori] // Total // Total, 
  Top, LabelStyle -> Directive[Red, Bold, 20]]

enter image description here


A word of caution: Andy's good comment made me realize there are a few things to worry about here. Most impotently, in most cases our graphics resales the data before it passes them to ColorFunction. This means that for these different data sets their maximums will look same bright on the plots:


Max /@ {allSymFix[[3, 1]], allSymFix[[15, 2]]}

*Answer:* {10.466, 11.172}

This affects correct overlap estimates.


Comments

Post a Comment

Popular posts from this blog

functions - Get leading series expansion term?

Given a function f[x] , I would like to have a function leadingSeries that returns just the leading term in the series around x=0 . For example: leadingSeries[(1/x + 2)/(4 + 1/x^2 + x)] x and leadingSeries[(1/x + 2 + (1 - 1/x^3)/4)/(4 + x)] -(1/(16 x^3)) Is there such a function in Mathematica? Or maybe one can implement it efficiently? EDIT I finally went with the following implementation, based on Carl Woll 's answer: lds[ex_,x_]:=( (ex/.x->(x+O[x]^2))/.SeriesData[U_,Z_,L_List,Mi_,Ma_,De_]:>SeriesData[U,Z,{L[[1]]},Mi,Mi+1,De]//Quiet//Normal) The advantage is, that this one also properly works with functions whose leading term is a constant: lds[Exp[x],x] 1 Answer Update 1 Updated to eliminate SeriesData and to not return additional terms Perhaps you could use: leadingSeries[expr_, x_] := Normal[expr /. x->(x+O[x]^2) /. a_List :> Take[a, 1]] Then for your examples: leadingSeries[(1/x + 2)/(4 + 1/x^2 + x), x] leadingSeries[Exp[x], x] leadingSeries[(1/x + 2 + (1 - 1/x...
Post a Comment
Read more

How to thread a list

I have data in format data = {{a1, a2}, {b1, b2}, {c1, c2}, {d1, d2}} Tableform: I want to thread it to : tdata = {{{a1, b1}, {a2, b2}}, {{a1, c1}, {a2, c2}}, {{a1, d1}, {a2, d2}}} Tableform: And I would like to do better then pseudofunction[n_] := Transpose[{data2[[1]], data2[[n]]}]; SetAttributes[pseudofunction, Listable]; Range[2, 4] // pseudofunction Here is my benchmark data, where data3 is normal sample of real data. data3 = Drop[ExcelWorkBook[[Column1 ;; Column4]], None, 1]; data2 = {a #, b #, c #, d #} & /@ Range[1, 10^5]; data = RandomReal[{0, 1}, {10^6, 4}]; Here is my benchmark code kptnw[list_] := Transpose[{Table[First@#, {Length@# - 1}], Rest@#}, {3, 1, 2}] &@list kptnw2[list_] := Transpose[{ConstantArray[First@#, Length@# - 1], Rest@#}, {3, 1, 2}] &@list OleksandrR[list_] := Flatten[Outer[List, List@First[list], Rest[list], 1], {{2}, {1, 4}}] paradox2[list_] := Partition[Riffle[list[[1]], #], 2] & /@ Drop[list, 1] RM[list_] := FoldList[Transpose[{First@li...
Post a Comment
Read more

front end - keyboard shortcut to invoke Insert new matrix

I frequently need to type in some matrices, and the menu command Insert > Table/Matrix > New... allows matrices with lines drawn between columns and rows, which is very helpful. I would like to make a keyboard shortcut for it, but cannot find the relevant frontend token command (4209405) for it. Since the FullForm[] and InputForm[] of matrices with lines drawn between rows and columns is the same as those without lines, it's hard to do this via 3rd party system-wide text expanders (e.g. autohotkey or atext on mac). How does one assign a keyboard shortcut for the menu item Insert > Table/Matrix > New... , preferably using only mathematica? Thanks! Answer In the MenuSetup.tr (for linux located in the $InstallationDirectory/SystemFiles/FrontEnd/TextResources/X/ directory), I changed the line MenuItem["&New...", "CreateGridBoxDialog"] to read MenuItem["&New...", "CreateGridBoxDialog", MenuKey["m", Modifiers-...
Post a Comment
Read more