Skip to main content

How to split data into clusters based on fitting to function


I have data which looks somewhat like this:


data


On the picture, you can see that the data can be described by 2 linear functions - if you manage to split it into 2 groups, each can easily be fitted with a x + b


However, when I run FindClusters on that data, I get this:


clusters


It seems, I need to adjust it somehow


Can anyone show me how to properly use FindClusters to split this data?



UPDATE


The functions are all known and the same.


To play with, the data can be emulated with:


dd = Join[Table[ {x, .3 x + 2 + RandomReal[{-1, 1}]}, {x, 0, 100}], 
Table[ {x, .6 x - 20 + RandomReal[{-1, 1}]}, {x, 0,
100}]]; ListPlot[dd]; cc = FindClusters[dd]; ListPlot[cc]

Answer



If we can assume we know more or less the functions for the two groups, in this case two linear functions (two parameters each) we can just NMinimize for the Min distance of the two functions.


{w, sol} = NMinimize[
Total[

Map[
Min[Abs[#[[2]] - (n1 + m1 #[[1]])],
Abs[#[[2]] - (n2 + m2 #[[1]])]] &
, dd
]
], {n1, n2, m1, m2}]


{95.3241, {n1 -> 1.84575, n2 -> -19.8623, m1 -> 0.300732,  m2 -> 0.598053}}


Once we have extracted the parameters for the two functions, then we just GatherBy each point, based on which function is closer.


ListPlot@Module[{n1, n2, m1, m2},
{n1, n2, m1, m2} = Values[sol];
GatherBy[dd,
LessEqual[Abs[#[[2]] - (n1 + m1 #[[1]])],
Abs[#[[2]] - (n2 + m2 #[[1]])]] &]
]


Mathematica graphics




More general


Define your function with arbitrary number of parameters


func[parms_List][x_] := parms[[1]] + parms[[2]]  x

A distance function


dist[f_][{x_, y_}] := Abs[y - f[x]]

Or (after comment by @SampoSmolander)


dist[f_][{x_, y_}] := (y - f[x])^2


Fake data


dd = Table[
With[
{
a = RandomChoice[{1, 4}],
b = RandomChoice[{1/2, 2}]
}, {x, func[{a, b}][x] + RandomReal[{-1, 1}]}], {x, 0, 10,
0.01}];


Minimisation, The i index goes through the number of parameters of each function (here 2), the index j over the number of functions to fit (in this case 4).


sol2 = Last@With[{n = 2, m = 4},
NMinimize[
Total@Map[Function[{L}, Min @@ Table[
dist[func[Array[c[#, k] &, n]]][L]
, {k, m}]], dd]
, Flatten[Table[c[i, j], {i, n}, {j, m}]]]
]

Plot



Show[
ListPlot@GatherBy[
dd
, Position[#, Min[#]] &[
Table[dist[func[{c[1, k], c[2, k]} /. sol2]][#], {k, 4}]] &
],
Plot[
Evaluate[
Table[
func[{c[1, k], c[2, k]}][x]

, {k, 4}] /. sol2
]
, {x, 0, 10}
]]


Mathematica graphics



Obviously there is no way to be sure this will converge to reasonable clusters if the lines are too mixed or the functions too complicated.


Fitting different number of functions



Let's see how does this perform when there are four groups of points and we ask for m different number of clusters, from 1 to 6.


plots = Table[
sol2 = Last@With[{n = 2},
NMinimize[
Total@Map[Function[{L}, Min @@ Table[
dist[func[Array[c[#, k] &, n]]][L]
, {k, m}]], dd]
, Flatten[Table[c[i, j], {i, n}, {j, m}]]]
];
ListPlot[

GatherBy[
dd
, Position[#, Min[#]] &[
Table[dist[func[{c[1, k], c[2, k]} /. sol2]][#], {k, m}]] &
], PlotLabel -> m], {m, 6}];

Grid@Partition[plots, 2]

Mathematica graphics


Comments

Popular posts from this blog

plotting - How to draw lines between specified dots on ListPlot?

I would like to create a plot where I have unconnected dots and some connected. So far, I have figured out how to draw the dots. My code is the following: ListPlot[{{1, 1}, {2, 2}, {3, 3}, {4, 4}, {1, 4}, {2, 5}, {3, 6}, {4, 7}, {1, 7}, {2, 8}, {3, 9}, {4, 10}, {1, 10}, {2, 11}, {3, 12}, {4,13}, {2.5, 7}}, Ticks -> {{1, 2, 3, 4}, None}, AxesStyle -> Thin, TicksStyle -> Directive[Black, Bold, 12], Mesh -> Full] I have thought using ListLinePlot command, but I don't know how to specify to the command to draw only selected lines between the dots. Do have any suggestions/hints on how to do that? Thank you. Answer One possibility would be to use Epilog with Line : ListPlot[ {{1, 1}, {2, 2}, {3, 3}, {4, 4}, {1, 4}, {2, 5}, {3, 6}, {4, 7}, {1, 7}, {2, 8}, {3, 9}, {4, 10}, {1, 10}, {2, 11}, {3, 12}, {4, 13}, {2.5, 7}}, Ticks -> {{1, 2, 3, 4}, None}, AxesStyle -> Thin, TicksStyle -> Directive[Black, Bold, 12], Mesh -> Full, Epilog -> { Line[ ...

calculus and analysis - Integral of the Sinc product

Let us consider the following integral $$ B_n = \int_0^\infty \prod_{k=1,3,5,\dots}^n\frac{\sin (x/k)}{x/k}dx $$ By definition, Sinc[x] == Sin[x]/x , therefore B[n_?OddQ] := Integrate[Product[Sinc[x/k], {k, 1, n, 2}], {x, 0, Infinity}] B /@ Range[1, 13, 2] {Pi/2, Pi/2, Pi/2, Pi/2, Pi/2, Pi/2, Pi/2} OK, everything is fine. But... B[15] 467807924713440738696537864469 Pi/935615849440640907310521750000 What's going on? Answer As Eckhard wrote in comments B[n] is the n-th Borwein integral . (The letter B was not accidental :) ) This funny properties of Borwein integrals is related to the Fourier transform of Sinc function FourierTransform[Sinc[x], x, k] 1/2 Sqrt[Pi/2] (Sign[1 - k] + Sign[1 + k]) Plot[%, {k, -2, 2}, Filling -> 0] which is the box function. The result is $\pi/2$ while the sum $$ 1/3+1/5+\dots+1/n $$ B_n = \frac{\pi}{2} - \pi \bigg(\sum_{k=3,5,\ldots}^n\frac{1}{k} -1\biggr)^\frac{n-1}{2}\prod_{k=3,5,\dots}^n\frac{k}{k-1}. $$ For $n=15$ it is equal to $$ \frac{46780...

list manipulation - Selecting multiple columns from a matrix?

Sample data: data = { {{2013, 1, 1}, 24.13, 167.67, 231.82}, {{2013, 1, 2}, 32.15, 170.92, 225.99}, {{2013, 1, 3}, 35.43, 172.68, 221.67}, {{2013, 1, 4}, 36.73, 173.05, 218.32}, {{2013, 1, 5}, 58.19, 165.96, 197.05}, {{2013, 1, 6}, 69.99, 163.50, 187.52}, {{2013, 1, 7}, 71.37, 154.21, 175.58}, {{2013, 1, 8}, 72.51, 149.66, 163.25}}; I want a DateListPlot with three graphs, so for a matrix formed by columns 1 and 2, one for columns 1 and 3, and 1 for columns 1 and 4. At the moment I'm using this code: data2 = Transpose[{data[[All, 1]], data[[All, 2]]}]; data3 = Transpose[{data[[All, 1]], data[[All, 3]]}]; data4 = Transpose[{data[[All, 1]], data[[All, 4]]}]; DateListPlot[{data2, data3, data4}, Joined -> True, Filling -> {3 -> {1}}] but I have a hunch that this can be done more efficiently. I don't like the Transpose s in particular. Any ideas? edit (for extra credit) What if I need to multiply the second column by 2, which in my solution is simp...