Challenge "aido1_amod1-v3"

These are the metrics defined:

service_quality - service_quality

-

efficiency - efficiency

-

fleet_size - fleet_size

-

Evaluation steps details

• At the beginning execute step step1-simulation.

• If step step1-simulation has result success, then execute step step2-scoring.

• If step step1-simulation has result failed, then declare the submission FAILED.

• If step step1-simulation has result error, then declare the submission ERROR.

• If step step2-scoring has result success, then declare the submission SUCCESS.

• If step step2-scoring has result failed, then declare the submission FAILED.

• If step step2-scoring has result error, then declare the submission ERROR.

Evaluation step step1-simulation

Timeout None

This is the Docker Compose configuration skeleton:

version: '3'
services:
    solution:
        image: SUBMISSION_CONTAINER
        environment: {}
    aido-host:
        image: andreacensi/aido1_amod1-v3-evaluator:2018_10_12_00_08_55
        environment: {}

The text SUBMISSION_CONTAINER will be replaced with the user containter.

Resources required for evaluating this step

No particular resources required.

Evaluation step step2-scoring

Timeout None

This is the Docker Compose configuration skeleton:

version: '3'
services:
    aido-scorer:
        image: andreacensi/aido1_amod1-v3-evaluator:2018_10_12_00_09_02
        environment: {}

The text SUBMISSION_CONTAINER will be replaced with the user containter.

Resources required for evaluating this step

No particular resources required.