Skip to main content

Export bug in combination with ParallelTable?


I am programming with Mathematica 10.3.1.0 on Windows 10 Professional 64 Bit and have an i7-4940-MX 3,1 GHz processor (4 cores).


When I use in the example code below Table the exported png files show axis numbers and labels, as expected.


With ParallelTable the axis numbers are randomly missing in the exported files.


What could be the problem?



Here are my exported plots:


for Table: https://drive.google.com/open?id=0B9wKP6yNcpyfYUJ6SW9PQUJINUE


for ParallelTable: https://drive.google.com/open?id=0B9wKP6yNcpyfSXZwVzVxNVotaUE produced with the code below.


ChoiceDialog[{FileNameSetter[Dynamic[outputDir], "Directory"], Dynamic[outputDir]}];
SetDirectory[outputDir];

image = ColorConvert[ExampleData[{"TestImage", "Lena"}], "Grayscale"];
levels = ImageLevels[image, "Byte"];

Table[

  strCounter = ToString@PaddedForm[i, 2, NumberPadding -> {"0", ""}];
  hist = Histogram[WeightedData @@ Transpose[levels], 
    256, {"Log", "Count"}, Frame -> True, 
    FrameLabel -> {{"# of Pixels", ""}, {"Brightness [0,255]", 
       strCounter}}, PlotRange -> {All, {0, 2^16}}, 
    BaseStyle -> {FontWeight -> "Bold", FontSize -> 40, 
      FontFamily -> "Calibri"}, ImageSize -> 2000];

  fileName = 
   StringJoin[outputDir, "\\histogram_table_", strCounter, ".png"];

  Export[fileName, hist, "PNG"],
  {i, 1, 10}
  ];

ParallelTable[
  strCounter = ToString@PaddedForm[i, 2, NumberPadding -> {"0", ""}];
  hist = Histogram[WeightedData @@ Transpose[levels], 
    256, {"Log", "Count"}, Frame -> True, 
    FrameLabel -> {{"# of Pixels", ""}, {"Brightness [0,255]", 
       strCounter}}, PlotRange -> {All, {0, 2^16}}, 

    BaseStyle -> {FontWeight -> "Bold", FontSize -> 40, 
      FontFamily -> "Calibri"}, ImageSize -> 2000];

  fileName = 
   StringJoin[outputDir, "\\histogram_parallel_table_", strCounter, 
    ".png"];
  Export[fileName, hist, "PNG"],
  {i, 1, 10}
  ];

Answer




This is a bug, and it has something to do with using log tick marks in combination with parallel kernels. I have versions 10.1 and 10.3 on my machine and this affects both of them.


This is a very odd bug, but a bug it is. It doesn't really have anything to do with Export, or Histogram, and you don't need that big example to demonstrate the bug:


ParallelEvaluate[Rasterize[LogPlot[8 x^4, {x, 1, 100}]]]
ParallelEvaluate[
 Rasterize[LogPlot[8 x^4, {x, 1, 100}, Frame -> True]]]

enter image description here


When the parallel kernels are invoked, some of them are faulty with respect to rasterizing log ticks. If you rerun the above code, it will give identical output, but if you close and reopen the kernels, then randomly some of them will have this fault and others will not. Invoking CloseKernels[]; LaunchKernels[]; and then running the above code gave me this output:


enter image description here


I always get two working kernels and two faulty kernels for this.



The above behavior goes away when you remove Rasterize, but I can't say that rasterization is the problem. You still get this issue if you export to a vector graphics format.


It does not work to set the tick marks manually,


ParallelEvaluate@
 Rasterize@
  LogPlot[8 x^4, {x, 1, 100}, 
   Ticks -> {{Automatic, 
      Charting`ScaledTicks[{Log, Exp}][0, 100]}, {Automatic, 
      Automatic}}, Frame -> True]

has the same output as above.



As of now I can't find a workaround, other than not producing the plot as an exported graphics inside of ParallelTable. What you can do is export the graphics object as code in Wolfram language, with a command like


  fileName = 
   StringJoin[outputDir, "\\histogram_parallel_table_", strCounter, 
    ".m"];
  Export[fileName, hist]

Thus you will have done all the image processing and histogram creation in parallel, but then at the end you turn the data into images in the main kernel. For example, this works:


outputdirectory = "output_directory";
CreateDirectory@outputdirectory;
ParallelDo[

 Export[FileNameJoin[{outputdirectory, 
    "file_" <> IntegerString[n] <> ".m"}], 
  LogPlot[8 x^4, {x, 1, 100}, Frame -> True]]
 , {n, 5}]
SetDirectory[outputdirectory];
Do[
 Export[StringReplace[fn, ".m" -> ".png"], Import[fn]],
 {fn, FileNames["*.m"]}]

and the resulting PNG files have the correct tick marks, and this works with OP's histograms as well.



Comments

Post a Comment

Popular posts from this blog

plotting - Filling between two spheres in SphericalPlot3D

Manipulate[ SphericalPlot3D[{1, 2 - n}, {θ, 0, Pi}, {ϕ, 0, 1.5 Pi}, Mesh -> None, PlotPoints -> 15, PlotRange -> {-2.2, 2.2}], {n, 0, 1}] I cant' seem to be able to make a filling between two spheres. I've already tried the obvious Filling -> {1 -> {2}} but Mathematica doesn't seem to like that option. Is there any easy way around this or ... Answer There is no built-in filling in SphericalPlot3D . One option is to use ParametricPlot3D to draw the surfaces between the two shells: Manipulate[ Show[SphericalPlot3D[{1, 2 - n}, {θ, 0, Pi}, {ϕ, 0, 1.5 Pi}, PlotPoints -> 15, PlotRange -> {-2.2, 2.2}], ParametricPlot3D[{ r {Sin[t] Cos[1.5 Pi], Sin[t] Sin[1.5 Pi], Cos[t]}, r {Sin[t] Cos[0 Pi], Sin[t] Sin[0 Pi], Cos[t]}}, {r, 1, 2 - n}, {t, 0, Pi}, PlotStyle -> Yellow, Mesh -> {2, 15}]], {n, 0, 1}]
Post a Comment
Read more

plotting - Plot 4D data with color as 4th dimension

I have a list of 4D data (x position, y position, amplitude, wavelength). I want to plot x, y, and amplitude on a 3D plot and have the color of the points correspond to the wavelength. I have seen many examples using functions to define color but my wavelength cannot be expressed by an analytic function. Is there a simple way to do this? Answer Here a another possible way to visualize 4D data: data = Flatten[Table[{x, y, x^2 + y^2, Sin[x - y]}, {x, -Pi, Pi,Pi/10}, {y,-Pi,Pi, Pi/10}], 1]; You can use the function Point along with VertexColors . Now the points are places using the first three elements and the color is determined by the fourth. In this case I used Hue, but you can use whatever you prefer. Graphics3D[ Point[data[[All, 1 ;; 3]], VertexColors -> Hue /@ data[[All, 4]]], Axes -> True, BoxRatios -> {1, 1, 1/GoldenRatio}]
Post a Comment
Read more

plotting - Mathematica: 3D plot based on combined 2D graphs

I have several sigmoidal fits to 3 different datasets, with mean fit predictions plus the 95% confidence limits (not symmetrical around the mean) and the actual data. I would now like to show these different 2D plots projected in 3D as in but then using proper perspective. In the link here they give some solutions to combine the plots using isometric perspective, but I would like to use proper 3 point perspective. Any thoughts? Also any way to show the mean points per time point for each series plus or minus the standard error on the mean would be cool too, either using points+vertical bars, or using spheres plus tubes. Below are some test data and the fit function I am using. Note that I am working on a logit(proportion) scale and that the final vertical scale is Log10(percentage). (* some test data *) data = Table[Null, {i, 4}]; data[[1]] = {{1, -5.8}, {2, -5.4}, {3, -0.8}, {4, -0.2}, {5, 4.6}, {1, -6.4}, {2, -5.6}, {3, -0.7}, {4, 0.04}, {5, 1.0}, {1, -6.8}, {2, -4.7}, {3, -1.
Post a Comment
Read more