Jeffrey S. Dunham 
dunham@middlebury.edu
Middlebury College
July 15, 2017
"Speed of light", abbreviated as SOL, (compute-only) code and data for the Colfax Cluster Xeon Phi 7250 (knl7250).


[Note:  The data acquired in these folders used the default environment variable KMP_AFFINITY=scatter, so no special environment variable was set before the compiled code was run.]

1.  Unzip the SOL_CODE_Colfax7250_Dunham.zip file.

2.  Within the extracted file folder are two folders, one for double precision and one for single precision.  Move to one of these two folders.  The instructions below assume you move to the double precision folder.

3.  If you have Mathematica installed, simply double-click the AVX512doubleNFMAAnalysis.nb and the Mathematica notebook should open.

If you do NOT have Mathematica installed, download the free CDF player at http://demonstrations.wolfram.com/download-cdf-player.html and install the CDF player for your Windows, Linux, or MacOS platform.  When the CDF player is installed, navigate to the double precision folder mentioned in item 2. and double-click AVX512doubleNFMAAnalysis.cdf  (CDF = Computable Document Format)  It is important that you double-click the .cdf version, not the .nb version.

4.  Once the Mathematica notebook opens, locate the "Evaluation" menu at the top of notebook window.  In the "Evaluation" drop-down menu, select "Evaluate Notebook".

5.  Once you have selected "Evaluate Notebook", the notebook will take about 1-2 minutes to evaluate; the data from 25 files need to be read in. [Running the Mathematica notebook in .nb or .cdf formats on a Xeon Phi workstation will be slow because only one 1.3 GHz thread will run]

You may see that the notebook window is scrolling down on its own.  If you move your mouse to the right side of the notebook screen, but not all of the way into the window scroll bar, you will see the cell markers used within a standard Mathematica notebook.  These cell markers will be thick black if the cell is still awaiting evaluation, and light blue if the cell has already been evaluated.

6. Here is what the files in the doubleNFMA directory do (similarly for the singleNFMA directory)

AVX512doubleNFMA
An executable that can be run immediately on the Xeon Phi 7250 in a terminal window using launch string: ./AVX512doubleNFMA
The executable likely runs for the case NFMA = 1 and takes a few minutes.



AVX512doubleNFMA.cc
This file contains the C/C++ code that can be compiled for any specific NFMA case, for example, for the NFMA=1 case:

icpc -qopenmp -xMIC-AVX512 -O3 -o AVX512doubleNFMA AVX512doubleNFMA.cc -DNFMA=1

or, for the NFMA=25 case:

icpc -qopenmp -xMIC-AVX512 -O3 -o AVX512doubleNFMA AVX512doubleNFMA.cc -DNFMA=25



AVX512doubleNFMA01.txt through AVX512doubleNFMA25.txt  (25 files)
Data from running the compiled C/C++ code for cases NFMA=1 through NFMA=25 on the Colfax Cluster Xeon Phi 7250.  This is the data one sees in the terminal window when a particular NFMA case is running during an NFMA sweep or when a single NFMA case is being run.  The files AVX512double.nb, AVX512double.cdf, and AVX512double.pdf use(d) these .txt data files to create their plots.



AVX512doubleNFMAAnalysis.nb, AVX512doubleNFMAAnalysis.cdf,AVX512doubleNFMAAnalysis.pdf
Mathematica notebook for combining the data from the 25 .txt data files and producing the two trustworthy plots (MEAN and MAX completion time cases) mentioned in the Colfax Research webinar talk.




dpMEAN.pdf,dpMax.dpf
These show the two plots generated by AVX512doubleNFMAAnalysis.nb or AVX512doubleNFMAAnalysis.cdf



launchAVX512doubleNFMA
The launch script for the Colfax Cluster queue.  Look at it contents; the environment variable KMP_AFFINITY=compact is set before an executable is run.  At the command line, an executable is submitted to the queue using

qsub launchAVX512doubleNFMA



launchAVX512doubleNFMA.o#####
These are the 25 text files the cluster queue returned to the submitter.  You can read them in any text editor.