======Middleware Access Drivers 5.4======

===== Information manager MAD =====

In order to provide an abstraction with the monitoring and discovery middleware layer (or Grid Information System), GridWay uses a Middleware Access Driver (MAD) module to discover and monitor hosts. This module provides basic operations with the monitoring and discovery middleware.

The format to send a request to the Information MAD, through its standard input, is:<file>OPERATION HID HOST - </file>
Where:

  * OPERATION: Can be one of the following:
    * INIT: Initializes the MAD.
    * DISCOVER: Discovers hosts.
    * MONITOR: Monitors a host.
    * FINALIZE: Finalizes the MAD.
  * HID: If the operation is MONITOR, it is a host identifier, chosen by GridWay. Otherwise it is ignored.
  * HOST: If the operation is MONITOR it specifies the host to monitor. Otherwise it is ignored.

On the other side, the format to receive a response from the MAD, through its standard output, is:<file>OPERATION HID RESULT INFO</file>
Where:

  * OPERATION: Is the operation specified in the request that originated the response.
  * HID: It is the host identifier, as provided in the submission request.
  * RESULT: It is the result of the operation. Could be SUCCESS or FAILURE.
  * INFO: If RESULT is FAILURE, it contains the cause of failure. Otherwise, if OPERATION is DISCOVER, it contains a list of discovered host, or if OPERATION is MONITOR, it contains a list of host attributes.

**Table 2. Attributes that should be defined by the Information MADs.**

^Attribute^Description^
| HOSTNAME | FQDN (Fully Qualified Domain Name) of the execution host (e.g. "hydrus.dacya.ucm.es") |
| ARCH | Architecture of the execution host (e.g. "i686", "alpha") |
| OS_NAME | Operating System name of the execution host (e.g. "Linux", "SL") |
| OS_VERSION | Operating System version of the execution host (e.g. "2.6.9-1.66", "3") |
| CPU_MODEL | CPU model of the execution host (e.g. "Intel(R) Pentium(R) 4 CPU 2", "PIV") |
| CPU_MHZ | CPU speed in MHz of the execution host |
| CPU_FREE | Percentage of free CPU of the execution host |
| CPU_SMP | CPU SMP size of the execution host |
| NODECOUNT | Total number of nodes of the execution host |
| SIZE_MEM_MB | Total memory size in MB of the execution host |
| FREE_MEM_MB | Free memory in MB of the execution hosts |
| SIZE_DISK_MB | Total disk space in MB of the execution hosts |
| FREE_DISK_MB | Free disk space in MB of the execution hosts |
| LRMS_NAME | Name of local DRM system (job manager) for execution, usually not fork (e.g. "jobmanager-pbs", "Pbs", "jobmanager-sge", "SGE") |
| LRMS_TYPE | Type of local DRM system for execution (e.g. "PBS", "SGE") |
| QUEUE_NAME[i] | Name of queue i (e.g. "default", "short", "dteam") |
| QUEUE_NODECOUNT[i] | Total node count of queue i |
| QUEUE_FREENODECOUNT[i] | Free node count of queue i |
| QUEUE_MAXTIME[i] | Maximum wall time of jobs in queue i |
| QUEUE_MAXCPUTIME[i] | Maximum CPU time of jobs in queue i |
| QUEUE_MAXCOUNT[i] | Maximum count of jobs that can be submitted in one request to queue i |
| QUEUE_MAXRUNNINGJOBS[i] | Maximum number of running jobs in queue i |
| QUEUE_MAXJOBSINQUEUE[i] | Maximum number of queued jobs in queue i |
| QUEUE_DISPATCHTYPE[i] | Dispatch type of queue i (e.g. "batch", "inmediate") |
| QUEUE_PRIORITY[i] | Priority of queue i |
| QUEUE_STATUS[i] | Status of queue i (e.g. "active", "production") |

\\

The information drivers interface to the grid information services to collect the resource attributes. These attributes can be used by the end-user to set requirement and rank expressions (job template), for filtering, prioritizing and selecting the candidate hosts. GridWay can simultaneously use as many Information drivers as needed. For example, GridWay allows you to simultaneously use MDS2 and MDS4 services, so you can also use resources from different Grids at the same time. Drivers for MDS 2 and MDS 4 provide the variables described in Table 2-1. However, the information manager is able to receive from the driver other parameters. The GridWay team has used other information parameters that could be very important to improve application efficiency (HTC apps) and for job migration: BANDWIDTH, LATENCY, SPEC_INT, SPEC_FLOAT...


===== Execution manager MAD =====

In order to provide an abstraction with the resource management middleware layer, GridWay uses a Middleware Access Driver (MAD) module to submit, control and monitor the execution of jobs. This module provides basic operations with the resource management middleware.

The format to send a request to the Execution MAD, through its standard input, is:<file>OPERATION JID HOST/JM RSL</file>
Where:

  * OPERATION: Can be one of the following:
    * INIT: Initializes the MAD.
    * SUBMIT: Submits a job.
    * POLL: Polls a job to obtain its state.
    * CANCEL: Cancels a job.
    * FINALIZE: Finalizes the MAD.
  * JID: Is a job identifier, chosen by GridWay.
  * HOST: If the operation is SUBMIT, it specifies the resource contact to submit the job. Otherwise it is ignored.
  * JM: If the operation is SUBMIT, it specifies the job manager to submit the job. Otherwise it is ignored.
  * RSL: If the operation is SUBMIT, it specifies the resource specification to submit the job. Otherwise it is ignored.

On the other side, the format to receive a response from the MAD, through its standard output, is:<file>OPERATION JID RESULT INFO</file>
Where:

  * OPERATION: Is the operation specified in the request that originated the response or CALLBACK, in the case of an asynchronous notification of a state change.
  * JID: It is the job identifier, as provided in the submission request.
  * RESULT: It is the result of the operation. Could be SUCCESS or FAILURE.
  * INFO: If RESULT is FAILURE, it contains the cause of failure. Otherwise, if OPERATION is POLL or CALLBACK, it contains the state of the job.




===== Transfer manager MAD =====

In order to provide an abstraction with the file transfer management middleware layer, GridWay uses a Middleware Access Driver (MAD) module to transfer job files. This module provides basic operations with the file transfer middleware.

The format to send a request to the Transfer MAD, through its standard input, is:<file>OPERATION JID TID EXE_MODE SRC_URL DST_URL</file>Where:

    * OPERATION: Can be one of the following:
    * INIT: Initializes the MAD, JID should be max number of jobs.
    * START: Init transfer associated with job JID
    * END: Finish transfer associated with job JID
    * MKDIR: Creates directory SRC_URL
    * RMDIR: Removes directory SRC_URL
    * CP: start a copy of SRC_URL to DST_URL, with identification TID, and associated with job JID.
    * FINALIZE: Finalizes the MAD.
  * JID: Is a job identifier, chosen by GridWay.
  * TID: Transfer identifier, only relevant for command CP.
  * EXE_MODE: If equal to 'X' file will be given execution permissions, only relevant for command CP.

On the other side, the format to receive a response from the MAD, through its standard output, is:<file>OPERATION JID TID RESULT INFO</file>

Where:

  * OPERATION: Is the operation specified in the request that originated the response or CALLBACK, in the case of an asynchronous notification of a state change.
  * JID: It is the job identifier, as provided in the START request.
  * TID: It is the transfer identifier, as provided in the CP request.
  * RESULT: It is the result of the operation. Could be SUCCESS or FAILURE.
  * INFO: If RESULT is FAILURE, it contains the cause of failure.