com.powsybl.computation.mpi

Class CsvMpiStatistics

java.lang.Object

com.powsybl.computation.mpi.CsvMpiStatistics

All Implemented Interfaces:

MpiStatistics, java.lang.AutoCloseable

public class CsvMpiStatistics
extends java.lang.Object
implements MpiStatistics

Author:

Geoffroy Jamgotchian

Constructor Summary

Constructors

Constructor and Description
CsvMpiStatistics(java.nio.file.Path dbDir, java.lang.String dbName)

Method Summary

Modifier and Type	Method and Description
void	close()
static void	exportBusyCores(java.nio.file.Path dbDir, java.lang.String dbName)
static void	exportCommonFileTransferDuration(java.nio.file.Path dbDir, java.lang.String dbName)
static void	exportTaskCount(java.nio.file.Path dbDir, java.lang.String dbName)
void	exportTasksToCsv(java.io.Writer writer) Export tasks statistics to CSV.
static void	exportWorkingDataSize(java.nio.file.Path dbDir, java.lang.String dbName)
void	logCommonFileTransfer(java.lang.String fileName, int chunk, long size, long duration) Log a common file transfer.
void	logJobEnd(int jobId) Log a job end.
void	logJobStart(int jobId, java.lang.String commandId, java.util.Map<java.lang.String,java.lang.String> tags) Log a job start.
void	logTaskEnd(int taskId, long taskDuration, java.util.List<java.lang.Long> commandsDuration, long dataTransferDuration, long outputMessageSize, long workingDataSize, int exitCode) Log a task end.
void	logTaskStart(int taskId, int jobId, int taskIndex, org.joda.time.DateTime startTime, int slaveRank, int slaveThread, long inputMessageSize) Log a task start.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CsvMpiStatistics

public CsvMpiStatistics(java.nio.file.Path dbDir,
                        java.lang.String dbName)
                 throws java.io.IOException

Throws:

java.io.IOException

Method Detail

logCommonFileTransfer

public void logCommonFileTransfer(java.lang.String fileName,
                                  int chunk,
                                  long size,
                                  long duration)

Description copied from interface: MpiStatistics

Log a common file transfer.

Specified by:

logCommonFileTransfer in interface MpiStatistics

Parameters:

fileName - the file name

chunk - chunk number

size - file size in bytes

duration - duration of the transfer in ms

logJobStart

public void logJobStart(int jobId,
                        java.lang.String commandId,
                        java.util.Map<java.lang.String,java.lang.String> tags)

Description copied from interface: MpiStatistics

Log a job start.

Specified by:

logJobStart in interface MpiStatistics

Parameters:

jobId - the job id

commandId - the command id

tags - tags associated to the job

logJobEnd

public void logJobEnd(int jobId)

Description copied from interface: MpiStatistics

Log a job end.

Specified by:

logJobEnd in interface MpiStatistics

Parameters:

jobId - the job id

logTaskStart

public void logTaskStart(int taskId,
                         int jobId,
                         int taskIndex,
                         org.joda.time.DateTime startTime,
                         int slaveRank,
                         int slaveThread,
                         long inputMessageSize)

Description copied from interface: MpiStatistics

Log a task start.

Specified by:

logTaskStart in interface MpiStatistics

Parameters:

taskId - the task id

jobId - the job id

taskIndex - index of the task in the job

startTime - task start time

slaveRank - slave rank that has managed the task

slaveThread - slave thread that has managed the task

inputMessageSize - input message size in bytes

logTaskEnd

public void logTaskEnd(int taskId,
                       long taskDuration,
                       java.util.List<java.lang.Long> commandsDuration,
                       long dataTransferDuration,
                       long outputMessageSize,
                       long workingDataSize,
                       int exitCode)

Description copied from interface: MpiStatistics

Log a task end.

Specified by:

logTaskEnd in interface MpiStatistics

Parameters:

taskId - the task id

taskDuration - task duration in ms

commandsDuration - duration in ms of all commands of the task

dataTransferDuration - part of the task duration corresponding to data transfer in ms

outputMessageSize - output message size in bytes

workingDataSize - working data size in bytes on slave side

exitCode - exit code of the command

exportTasksToCsv

public void exportTasksToCsv(java.io.Writer writer)

Description copied from interface: MpiStatistics

Export tasks statistics to CSV.

Specified by:

exportTasksToCsv in interface MpiStatistics

exportCommonFileTransferDuration

public static void exportCommonFileTransferDuration(java.nio.file.Path dbDir,
                                                    java.lang.String dbName)
                                             throws java.io.IOException

Throws:

java.io.IOException

exportTaskCount

public static void exportTaskCount(java.nio.file.Path dbDir,
                                   java.lang.String dbName)
                            throws java.io.IOException

Throws:

java.io.IOException

exportBusyCores

public static void exportBusyCores(java.nio.file.Path dbDir,
                                   java.lang.String dbName)
                            throws java.io.IOException

Throws:

java.io.IOException

exportWorkingDataSize

public static void exportWorkingDataSize(java.nio.file.Path dbDir,
                                         java.lang.String dbName)
                                  throws java.io.IOException

Throws:

java.io.IOException

close

public void close()

Specified by:

close in interface MpiStatistics

Specified by:

close in interface java.lang.AutoCloseable