Skip to main content

mathlink or wstp - Reconnecting to remote kernels through SSH tunnelling


This is a follow up question to How can I connect to a remote machine? and the excellent answer provided by ybeltukov.


My system is now configured as described in the answer with my MacBook running the FrontEnd and a Linux server running the remote kernels. SSH and a VPN connect the two. Provided the network link is maintained at all times, it works very well.


However, if the connection is severed for any reason, the screen sessions on the remote machine continue to exist and MathKernel remains on the process list, but my FrontEnd cannot reconnect. On evaluating a cell, the FrontEnd waits around for about thirty seconds before ceasing to wait for the evaluation. No error is produced in the notebook and the value of Out[] is not updated. All the non-native symbols in the Frontend turn to a dark blue colour (not the undefined symbol blue, but a new dark blue that I hadn't seen before).


In the Messages window, I receive the following error: "The kernel remote.kernel.com failed to connect to the front end. (Error = MLECONNECT). You should try running the kernel connection outside the front end."


Inspecting screen -wipe on the remote machine, I see it has created multiple copies of the "Respawner" screen session.


If I kill -15 the MathKernel pids on the remote machine, the problem is solved, in the sense evaluating a cell will cause a new MathKernel instance to be created on the remote machine and a proper connection established, but I have to run my 30 hour computation again.



Is there a reliable way to reconnect to remote kernels?



I believe the problem stems from changing the value of $ParentLink on the remote machine. Once $ParentLink is set, the console stops responding to commands. I can see this if I connect to the screen session with a console to inspect it.


Mathematica 10.0 for Linux x86 (64-bit)
Copyright 1988-2014 Wolfram Research, Inc.

In[1]:= $ParentLink=LinkCreate["65272@127.0.0.1,65273@127.0.0.1",LinkMode->Connect,LinkProtocol->"TCPIP"];
$ParentLink=LinkCreate["49358@127.0.0.1,49359@127.0.0.1",LinkMode->Connect,LinkProtocol->"TCPIP"];
$ParentLink=LinkCreate["49366@127.0.0.1,49367@127.0.0.1",LinkMode->Connect,LinkProtocol->"TCPIP"];
$ParentLink=LinkCreate["49395@127.0.0.1,49396@127.0.0.1",LinkMode->Connect,LinkProtocol->"TCPIP"];


You can see, the Kernel is ignoring further instructions passed to it for execution, therefore the link back to the FrontEnd at its new place is never established. The first link works successfully but maybe it disconnects the console from the kernel.


Is this how $ParentLink is supposed to behave?




Comments

Post a Comment

Popular posts from this blog

front end - keyboard shortcut to invoke Insert new matrix

I frequently need to type in some matrices, and the menu command Insert > Table/Matrix > New... allows matrices with lines drawn between columns and rows, which is very helpful. I would like to make a keyboard shortcut for it, but cannot find the relevant frontend token command (4209405) for it. Since the FullForm[] and InputForm[] of matrices with lines drawn between rows and columns is the same as those without lines, it's hard to do this via 3rd party system-wide text expanders (e.g. autohotkey or atext on mac). How does one assign a keyboard shortcut for the menu item Insert > Table/Matrix > New... , preferably using only mathematica? Thanks! Answer In the MenuSetup.tr (for linux located in the $InstallationDirectory/SystemFiles/FrontEnd/TextResources/X/ directory), I changed the line MenuItem["&New...", "CreateGridBoxDialog"] to read MenuItem["&New...", "CreateGridBoxDialog", MenuKey["m", Modifiers-...
Post a Comment
Read more

How to thread a list

I have data in format data = {{a1, a2}, {b1, b2}, {c1, c2}, {d1, d2}} Tableform: I want to thread it to : tdata = {{{a1, b1}, {a2, b2}}, {{a1, c1}, {a2, c2}}, {{a1, d1}, {a2, d2}}} Tableform: And I would like to do better then pseudofunction[n_] := Transpose[{data2[[1]], data2[[n]]}]; SetAttributes[pseudofunction, Listable]; Range[2, 4] // pseudofunction Here is my benchmark data, where data3 is normal sample of real data. data3 = Drop[ExcelWorkBook[[Column1 ;; Column4]], None, 1]; data2 = {a #, b #, c #, d #} & /@ Range[1, 10^5]; data = RandomReal[{0, 1}, {10^6, 4}]; Here is my benchmark code kptnw[list_] := Transpose[{Table[First@#, {Length@# - 1}], Rest@#}, {3, 1, 2}] &@list kptnw2[list_] := Transpose[{ConstantArray[First@#, Length@# - 1], Rest@#}, {3, 1, 2}] &@list OleksandrR[list_] := Flatten[Outer[List, List@First[list], Rest[list], 1], {{2}, {1, 4}}] paradox2[list_] := Partition[Riffle[list[[1]], #], 2] & /@ Drop[list, 1] RM[list_] := FoldList[Transpose[{First@li...
Post a Comment
Read more

plotting - How to draw lines between specified dots on ListPlot?

I would like to create a plot where I have unconnected dots and some connected. So far, I have figured out how to draw the dots. My code is the following: ListPlot[{{1, 1}, {2, 2}, {3, 3}, {4, 4}, {1, 4}, {2, 5}, {3, 6}, {4, 7}, {1, 7}, {2, 8}, {3, 9}, {4, 10}, {1, 10}, {2, 11}, {3, 12}, {4,13}, {2.5, 7}}, Ticks -> {{1, 2, 3, 4}, None}, AxesStyle -> Thin, TicksStyle -> Directive[Black, Bold, 12], Mesh -> Full] I have thought using ListLinePlot command, but I don't know how to specify to the command to draw only selected lines between the dots. Do have any suggestions/hints on how to do that? Thank you. Answer One possibility would be to use Epilog with Line : ListPlot[ {{1, 1}, {2, 2}, {3, 3}, {4, 4}, {1, 4}, {2, 5}, {3, 6}, {4, 7}, {1, 7}, {2, 8}, {3, 9}, {4, 10}, {1, 10}, {2, 11}, {3, 12}, {4, 13}, {2.5, 7}}, Ticks -> {{1, 2, 3, 4}, None}, AxesStyle -> Thin, TicksStyle -> Directive[Black, Bold, 12], Mesh -> Full, Epilog -> { Line[ ...
Post a Comment
Read more