Jeffrey S. Dunham
dunham@middlebury.edu
Middlebury College
July 15, 2017
"Speed of light", abbreviated as SOL, (compute-only) data and code for the Colfax Cluster Xeon Phi 7250 (knl7250).
[NOTE: The special environment variable KMP_AFFINITY=compact was set using
export KMP_AFFINITY=compact
before the compiled code was run on knl7250.]
1. Unzip the SOL_CODE_compact_Colfax7250_Dunham.zip file.
2. Within the extracted file folder are two folders, one for double precision and one for single precision. Move to one of these two folders. The instructions below assume you move to the double precision folder.
3. If you have Mathematica installed, simply double-click the AVX512doubleNFMAAnalysis.nb and the Mathematica notebook should open.
If you do NOT have Mathematica installed, download the free CDF player at http://demonstrations.wolfram.com/download-cdf-player.html and install the CDF player for your Windows, Linux, or MacOS platform. When the CDF player is installed, navigate to the double precision folder mentioned in item 2. and double-click AVX512doubleNFMAAnalysis.cdf (CDF = Computable Document Format) It is important that you double-click the .cdf version, not the .nb version.
4. Once the Mathematica notebook opens, locate the "Evaluation" menu at the top of notebook window. In the "Evaluation" drop-down menu, select "Evaluate Notebook".
5. Once you have selected "Evaluate Notebook", the notebook will take about 1-2 minutes to evaluate; the data from 25 files need to be read in. [Running the Mathematica notebook in .nb or .cdf formats on a Xeon Phi workstation will be slow because only one 1.3 GHz thread will run.]
You may see that the notebook window is scrolling down on its own. If you move your mouse to the right side of the notebook screen, but not all of the way into the window scroll bar, you will see the cell markers used within a standard Mathematica notebook. These cell markers will be thick black if the cell is still awaiting evaluation, and light blue if the cell has already been evaluated.
6. Here is what the files in the doubleNFMA directory do (similarly for the singleNFMA directory):
AVX512doubleNFMA
An executable that can be run immediately on the Xeon Phi 7250 at the command line using the launch string: ./AVX512doubleNFMA
The executable likely runs for the case NFMA=1, which should take only a few minutes.
AVX512doubleNFMA.cc
This file contains the C/C++ code that can be compiled for any specific NFMA case, for example, for the NFMA=1 case:
icpc -qopenmp -xMIC-AVX512 -O3 -o AVX512doubleNFMA AVX512doubleNFMA.cc -DNFMA=1
or, for the NFMA=25 case:
icpc -qopenmp -xMIC-AVX512 -O3 -o AVX512doubleNFMA AVX512doubleNFMA.cc -DNFMA=25
AVX512doubleNFMA01.txt through AVX512doubleNFMA25.txt (25 files)
Data from running the compiled C/C++ code for cases NFMA=1 through NFMA=25 on the Colfax Cluster Xeon Phi 7250. This is the data one sees in the terminal window when a particular NFMA case is running during an NFMA sweep or when a single NFMA case is being run. The files AVX512double.nb, AVX512double.cdf, and AVX512double.pdf use(d) these .txt data files to create their plots.
AVX512doubleNFMAAnalysis.nb, AVX512doubleNFMAAnalysis.cdf,AVX512doubleNFMAAnalysis.pdf
Mathematica notebook for combining the data from the 25 .txt data files and producing the two "trustworthy" plots (MEAN and MAX completion time cases) mentioned in the Colfax Research webinar talk.
dpMEAN.pdf,dpMax.dpf
These show the two plots generated by AVX512doubleNFMAAnalysis.nb or AVX512doubleNFMAAnalysis.cdf
launchAVX512doubleNFMA
The launch script for the Colfax Cluster queue. Look at it contents; the environment variable KMP_AFFINITY=compact is set before an executable is run. At the command line, an executable is submitted to the queue using
qsub launchAVX512doubleNFMA
launchAVX512doubleNFMA.o#####
These are the 25 text files the cluster queue returned to the submitter. You can read them in any text editor.