Skip to main content

Export bug in combination with ParallelTable?


I am programming with Mathematica 10.3.1.0 on Windows 10 Professional 64 Bit and have an i7-4940-MX 3,1 GHz processor (4 cores).


When I use in the example code below Table the exported png files show axis numbers and labels, as expected.


With ParallelTable the axis numbers are randomly missing in the exported files.


What could be the problem?



Here are my exported plots:


for Table: https://drive.google.com/open?id=0B9wKP6yNcpyfYUJ6SW9PQUJINUE


for ParallelTable: https://drive.google.com/open?id=0B9wKP6yNcpyfSXZwVzVxNVotaUE produced with the code below.


ChoiceDialog[{FileNameSetter[Dynamic[outputDir], "Directory"], Dynamic[outputDir]}];
SetDirectory[outputDir];

image = ColorConvert[ExampleData[{"TestImage", "Lena"}], "Grayscale"];
levels = ImageLevels[image, "Byte"];

Table[

strCounter = ToString@PaddedForm[i, 2, NumberPadding -> {"0", ""}];
hist = Histogram[WeightedData @@ Transpose[levels],
256, {"Log", "Count"}, Frame -> True,
FrameLabel -> {{"# of Pixels", ""}, {"Brightness [0,255]",
strCounter}}, PlotRange -> {All, {0, 2^16}},
BaseStyle -> {FontWeight -> "Bold", FontSize -> 40,
FontFamily -> "Calibri"}, ImageSize -> 2000];

fileName =
StringJoin[outputDir, "\\histogram_table_", strCounter, ".png"];

Export[fileName, hist, "PNG"],
{i, 1, 10}
];

ParallelTable[
strCounter = ToString@PaddedForm[i, 2, NumberPadding -> {"0", ""}];
hist = Histogram[WeightedData @@ Transpose[levels],
256, {"Log", "Count"}, Frame -> True,
FrameLabel -> {{"# of Pixels", ""}, {"Brightness [0,255]",
strCounter}}, PlotRange -> {All, {0, 2^16}},

BaseStyle -> {FontWeight -> "Bold", FontSize -> 40,
FontFamily -> "Calibri"}, ImageSize -> 2000];

fileName =
StringJoin[outputDir, "\\histogram_parallel_table_", strCounter,
".png"];
Export[fileName, hist, "PNG"],
{i, 1, 10}
];

Answer




This is a bug, and it has something to do with using log tick marks in combination with parallel kernels. I have versions 10.1 and 10.3 on my machine and this affects both of them.


This is a very odd bug, but a bug it is. It doesn't really have anything to do with Export, or Histogram, and you don't need that big example to demonstrate the bug:


ParallelEvaluate[Rasterize[LogPlot[8 x^4, {x, 1, 100}]]]
ParallelEvaluate[
Rasterize[LogPlot[8 x^4, {x, 1, 100}, Frame -> True]]]

enter image description here


When the parallel kernels are invoked, some of them are faulty with respect to rasterizing log ticks. If you rerun the above code, it will give identical output, but if you close and reopen the kernels, then randomly some of them will have this fault and others will not. Invoking CloseKernels[]; LaunchKernels[]; and then running the above code gave me this output:


enter image description here


I always get two working kernels and two faulty kernels for this.



The above behavior goes away when you remove Rasterize, but I can't say that rasterization is the problem. You still get this issue if you export to a vector graphics format.


It does not work to set the tick marks manually,


ParallelEvaluate@
Rasterize@
LogPlot[8 x^4, {x, 1, 100},
Ticks -> {{Automatic,
Charting`ScaledTicks[{Log, Exp}][0, 100]}, {Automatic,
Automatic}}, Frame -> True]

has the same output as above.



As of now I can't find a workaround, other than not producing the plot as an exported graphics inside of ParallelTable. What you can do is export the graphics object as code in Wolfram language, with a command like


  fileName = 
StringJoin[outputDir, "\\histogram_parallel_table_", strCounter,
".m"];
Export[fileName, hist]

Thus you will have done all the image processing and histogram creation in parallel, but then at the end you turn the data into images in the main kernel. For example, this works:


outputdirectory = "output_directory";
CreateDirectory@outputdirectory;
ParallelDo[

Export[FileNameJoin[{outputdirectory,
"file_" <> IntegerString[n] <> ".m"}],
LogPlot[8 x^4, {x, 1, 100}, Frame -> True]]
, {n, 5}]
SetDirectory[outputdirectory];
Do[
Export[StringReplace[fn, ".m" -> ".png"], Import[fn]],
{fn, FileNames["*.m"]}]

and the resulting PNG files have the correct tick marks, and this works with OP's histograms as well.



Comments

Popular posts from this blog

plotting - How to draw lines between specified dots on ListPlot?

I would like to create a plot where I have unconnected dots and some connected. So far, I have figured out how to draw the dots. My code is the following: ListPlot[{{1, 1}, {2, 2}, {3, 3}, {4, 4}, {1, 4}, {2, 5}, {3, 6}, {4, 7}, {1, 7}, {2, 8}, {3, 9}, {4, 10}, {1, 10}, {2, 11}, {3, 12}, {4,13}, {2.5, 7}}, Ticks -> {{1, 2, 3, 4}, None}, AxesStyle -> Thin, TicksStyle -> Directive[Black, Bold, 12], Mesh -> Full] I have thought using ListLinePlot command, but I don't know how to specify to the command to draw only selected lines between the dots. Do have any suggestions/hints on how to do that? Thank you. Answer One possibility would be to use Epilog with Line : ListPlot[ {{1, 1}, {2, 2}, {3, 3}, {4, 4}, {1, 4}, {2, 5}, {3, 6}, {4, 7}, {1, 7}, {2, 8}, {3, 9}, {4, 10}, {1, 10}, {2, 11}, {3, 12}, {4, 13}, {2.5, 7}}, Ticks -> {{1, 2, 3, 4}, None}, AxesStyle -> Thin, TicksStyle -> Directive[Black, Bold, 12], Mesh -> Full, Epilog -> { Line[ ...

equation solving - Invert and fit implicitly defined curve

I need to fit an implicitly defined curve. I thought I could get some data out of Solve , and then using FindFit . Therefore, I would like to find the relation the parametric curve defined by $F(x,y)=0$: Solve[-(1/2) + 1/2 (0.41202 BesselK[0, 0.1 Sqrt[x^2 + y^2]] + (0.101483 x BesselK[1, 0.1 Sqrt[x^2 + y^2]])/Sqrt[x^2 + y^2]) == 0, y] But I can't get an output: Solve was unable to solve the system with inexact coefficients or the system obtained by direct rationalization of inexact numbers present in the system. Since many of the methods used by Solve require exact input, providing Solve with an exact version of the system may help. >> Edit: In particular, I would like to fit the data coming from the curve with the expression of another curve, and not with a function $f(x)$. In particular, since this clearly looks like a cardioid , I would like it to fit to something like it. What other strategies could I try?

dynamic - How can I make a clickable ArrayPlot that returns input?

I would like to create a dynamic ArrayPlot so that the rectangles, when clicked, provide the input. Can I use ArrayPlot for this? Or is there something else I should have to use? Answer ArrayPlot is much more than just a simple array like Grid : it represents a ranged 2D dataset, and its visualization can be finetuned by options like DataReversed and DataRange . These features make it quite complicated to reproduce the same layout and order with Grid . Here I offer AnnotatedArrayPlot which comes in handy when your dataset is more than just a flat 2D array. The dynamic interface allows highlighting individual cells and possibly interacting with them. AnnotatedArrayPlot works the same way as ArrayPlot and accepts the same options plus Enabled , HighlightCoordinates , HighlightStyle and HighlightElementFunction . data = {{Missing["HasSomeMoreData"], GrayLevel[ 1], {RGBColor[0, 1, 1], RGBColor[0, 0, 1], GrayLevel[1]}, RGBColor[0, 1, 0]}, {GrayLevel[0], GrayLevel...