Skip to main content

parallelization - Server running WolframLightWeightGrid manager loses licensing information


"Once more into the breach..,"


I have 2 identical Xserves running OS X Server 10.6.8 each with 2 quad core Intel Xenon processors a total of 16 kernels. I have configured both servers identically and use them exclusively as a computing grid for Mathematica.


I run the WolframLightWeightGrid manager on the servers and distribute processing jobs to them from a number of different notebooks.


An earlier question Wolfram Light Weight Grid and parallel computing from when I setup this environment gives more background.


This environment has pretty much run like a charm over the past four months.



As a check on what goes on I run the following few lines of code when launching the grid:


Needs["LightweightGridClient`"]
Column[{
  ParallelEvaluate[$ProcessID],
  ParallelEvaluate[$MachineName],
  RemoteServicesAgents[] // ColumnForm}]

This will give me lists of the process IDs and machine names and remote service agents.


But today something has gone awry:


code & output



I should see 8 additional process ID's and 8 additional machine names (specifically "abb-1").


The output correctly identifies the remote service agents, but then it gets strange as it also generates the following error messages:


messages


I've tried calling Wolfram and while I have great respect for the support staff, not all of them have extensive experience with parallel processing and honestly, one can't reasonably expect all of them to have such experience.


If I get anything back from them I'll report it here. Until then...


The WolframLightWeightGrid manager should launch when the server boots. I have restarted "abb-1" several times, even shutting it down completely and powering it off, but still have the same problem.


I have current licenses for all the kernels in question.


Since RemoteServicesAgents[] identifies the server "abb-1" does this imply that the grid manager has launched?


It seems that something has caused to grid manager to lose its licensing infromation.




  • What could have gone wrong?

  • Where should I look to trouble shoot this?


I hope to get this working properly so that I can automate more of my daily processes and calculation. AND I need it to work reliably.


Suggestions, solutions, insights, and comments welcome.


Thx...



Answer



Well, further experiments have shown that altering my code to:


Needs["LightweightGridClient`"]
Column[{

  CloseKernels[],
  LaunchKernels[],
  ParallelEvaluate[$ProcessID],
  ParallelEvaluate[$MachineName],
  RemoteServicesAgents[] // ColumnForm}]

Which gives me:


output


appears to resolve the problem.


This does not explain why the problem occurred or why it did not occur before so, I'll happily vote up and select any answer that does provide an explanation (or even a plausible speculation) of why this happened.



It does seem that Manual Launching


enter image description here


see: Launching and Connecting


and thereby controlling the entire process of launching kernels programmatically and by passing the configuration mechanisms, the process runs more smoothly.


Comments

Post a Comment

Popular posts from this blog

functions - Get leading series expansion term?

Given a function f[x] , I would like to have a function leadingSeries that returns just the leading term in the series around x=0 . For example: leadingSeries[(1/x + 2)/(4 + 1/x^2 + x)] x and leadingSeries[(1/x + 2 + (1 - 1/x^3)/4)/(4 + x)] -(1/(16 x^3)) Is there such a function in Mathematica? Or maybe one can implement it efficiently? EDIT I finally went with the following implementation, based on Carl Woll 's answer: lds[ex_,x_]:=( (ex/.x->(x+O[x]^2))/.SeriesData[U_,Z_,L_List,Mi_,Ma_,De_]:>SeriesData[U,Z,{L[[1]]},Mi,Mi+1,De]//Quiet//Normal) The advantage is, that this one also properly works with functions whose leading term is a constant: lds[Exp[x],x] 1 Answer Update 1 Updated to eliminate SeriesData and to not return additional terms Perhaps you could use: leadingSeries[expr_, x_] := Normal[expr /. x->(x+O[x]^2) /. a_List :> Take[a, 1]] Then for your examples: leadingSeries[(1/x + 2)/(4 + 1/x^2 + x), x] leadingSeries[Exp[x], x] leadingSeries[(1/x + 2 + (1 - 1/x...
Post a Comment
Read more

mathematical optimization - Minimizing using indices, error: Part::pkspec1: The expression cannot be used as a part specification

I want to use Minimize where the variables to minimize are indices pointing into an array. Here a MWE that hopefully shows what my problem is. vars = u@# & /@ Range[3]; cons = Flatten@ { Table[(u[j] != #) & /@ vars[[j + 1 ;; -1]], {j, 1, 3 - 1}], 1 vec1 = {1, 2, 3}; vec2 = {1, 2, 3}; Minimize[{Total@((vec1[[#]] - vec2[[u[#]]])^2 & /@ Range[1, 3]), cons}, vars, Integers] The error I get: Part::pkspec1: The expression u[1] cannot be used as a part specification. >> Answer Ok, it seems that one can get around Mathematica trying to evaluate vec2[[u[1]]] too early by using the function Indexed[vec2,u[1]] . The working MWE would then look like the following: vars = u@# & /@ Range[3]; cons = Flatten@{ Table[(u[j] != #) & /@ vars[[j + 1 ;; -1]], {j, 1, 3 - 1}], 1 vec1 = {1, 2, 3}; vec2 = {1, 2, 3}; NMinimize[ {Total@((vec1[[#]] - Indexed[vec2, u[#]])^2 & /@ R...
Post a Comment
Read more

What is and isn't a valid variable specification for Manipulate?

I have an expression whose terms have arguments (representing subscripts), like this: myExpr = A[0] + V[1,T] I would like to put it inside a Manipulate to see its value as I move around the parameters. (The goal is eventually to plot it wrt one of the variables inside.) However, Mathematica complains when I set V[1,T] as a manipulated variable: Manipulate[Evaluate[myExpr], {A[0], 0, 1}, {V[1, T], 0, 1}] (*Manipulate::vsform: Manipulate argument {V[1,T],0,1} does not have the correct form for a variable specification. >> *) As a workaround, if I get rid of the symbol T inside the argument, it works fine: Manipulate[ Evaluate[myExpr /. T -> 15], {A[0], 0, 1}, {V[1, 15], 0, 1}] Why this behavior? Can anyone point me to the documentation that says what counts as a valid variable? And is there a way to get Manpiulate to accept an expression with a symbolic argument as a variable? Investigations I've done so far: I tried using variableQ from this answer , but it says V[1...
Post a Comment
Read more