Submission 9764

Submission

9764

Competing

yes

Challenge

aido5-LF-sim-validation

User

Yishu Malhotra 🇨🇦

Date submitted

2020-10-29 18:35:09+00:00

Last status update

2021-12-04 20:52:33+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

LFv-sim: 58106

User label

exercise_ros_template

Admin priority

Blessing

n/a

User priority

58106

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

58106

LFv-sim

success

yes

2020-12-03 21:17:44+00:00

2020-12-03 21:29:49+00:00

0:12:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.43664135051534186
survival_time_median	11.100000000000051
deviation-center-line_median	0.13268600291974153
in-drivable-lane_median	8.825000000000049

other stats

agent_compute-ego0_max	0.013153451698022251
agent_compute-ego0_mean	0.0128872934184946
agent_compute-ego0_median	0.01289160669001171
agent_compute-ego0_min	0.012612508595932732
complete-iteration_max	0.2419435495740912
complete-iteration_mean	0.18847580219608173
complete-iteration_median	0.18368905352944817
complete-iteration_min	0.14458155215133933
deviation-center-line_max	0.29342070903956635
deviation-center-line_mean	0.1625039262345827
deviation-center-line_min	0.09122299005928144
deviation-heading_max	1.4854349549880317
deviation-heading_mean	0.8487360446985357
deviation-heading_median	0.6914348812602493
deviation-heading_min	0.5266394612856127
driven_any_max	14.277789455724491
driven_any_mean	4.84394542082039
driven_any_median	2.2482909960331057
driven_any_min	0.6014102354908579
driven_lanedir_consec_max	0.8275103691789183
driven_lanedir_consec_mean	0.4592257198035231
driven_lanedir_consec_min	0.13610980900449032
driven_lanedir_max	0.8275103691789183
driven_lanedir_mean	0.4592257198035231
driven_lanedir_median	0.43664135051534186
driven_lanedir_min	0.13610980900449032
get_duckie_state_max	1.3019261735208918e-06
get_duckie_state_mean	1.242260836151321e-06
get_duckie_state_median	1.2384054630222256e-06
get_duckie_state_min	1.1903062450399407e-06
get_robot_state_max	0.00371267205925398
get_robot_state_mean	0.003678921404012465
get_robot_state_median	0.003706178549203661
get_robot_state_min	0.0035906564583885582
get_state_dump_max	0.004715356933936644
get_state_dump_mean	0.004601281223432521
get_state_dump_median	0.004622229555456466
get_state_dump_min	0.00444530884888051
get_ui_image_max	0.036540181449290075
get_ui_image_mean	0.03076786655437322
get_ui_image_median	0.03057015300570508
get_ui_image_min	0.025390978756792637
in-drivable-lane_max	56.849999999998715
in-drivable-lane_mean	19.3749999999997
in-drivable-lane_min	2.999999999999992
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 0.8400983063816851, "get_ui_image": 0.028233282027706023, "step_physics": 0.11391692264105684, "survival_time": 4.599999999999992, "driven_lanedir": 0.13610980900449032, "get_state_dump": 0.004618790841871692, "get_robot_state": 0.00371267205925398, "sim_render-ego0": 0.003988878701322822, "get_duckie_state": 1.227983864404822e-06, "in-drivable-lane": 3.4499999999999913, "deviation-heading": 0.5266394612856127, "agent_compute-ego0": 0.012791364423690305, "complete-iteration": 0.17959691632178523, "set_robot_commands": 0.0022139805619434644, "deviation-center-line": 0.1239732023555664, "driven_lanedir_consec": 0.13610980900449032, "sim_compute_sim_state": 0.00805087499721076, "sim_compute_performance-ego0": 0.001981886484289682}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6014102354908579, "get_ui_image": 0.036540181449290075, "step_physics": 0.16511023714301293, "survival_time": 4.399999999999992, "driven_lanedir": 0.20554052901984263, "get_state_dump": 0.004715356933936644, "get_robot_state": 0.0037038567360867273, "sim_render-ego0": 0.003929807898703586, "get_duckie_state": 1.3019261735208918e-06, "in-drivable-lane": 2.999999999999992, "deviation-heading": 0.7350478001164709, "agent_compute-ego0": 0.012991848956333115, "complete-iteration": 0.2419435495740912, "set_robot_commands": 0.0022330632370509457, "deviation-center-line": 0.09122299005928144, "driven_lanedir_consec": 0.20554052901984263, "sim_compute_sim_state": 0.010550890076026487, "sim_compute_performance-ego0": 0.0020736924717935285}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.656483685684526, "get_ui_image": 0.03290702398370413, "step_physics": 0.11430540300969023, "survival_time": 17.600000000000115, "driven_lanedir": 0.6677421720108411, "get_state_dump": 0.00462566826904124, "get_robot_state": 0.0037085003623205945, "sim_render-ego0": 0.004050239287422331, "get_duckie_state": 1.2488270616396291e-06, "in-drivable-lane": 14.200000000000108, "deviation-heading": 1.4854349549880317, "agent_compute-ego0": 0.013153451698022251, "complete-iteration": 0.18778119073711105, "set_robot_commands": 0.0022818441093812245, "deviation-center-line": 0.14139880348391667, "driven_lanedir_consec": 0.6677421720108411, "sim_compute_sim_state": 0.010651903854888827, "sim_compute_performance-ego0": 0.002005296793605383}, "LF-norm-small_loop-000-ego0": {"driven_any": 14.277789455724491, "get_ui_image": 0.025390978756792637, "step_physics": 0.0845040923649822, "survival_time": 59.99999999999873, "driven_lanedir": 0.8275103691789183, "get_state_dump": 0.00444530884888051, "get_robot_state": 0.0035906564583885582, "sim_render-ego0": 0.00386361277768455, "get_duckie_state": 1.1903062450399407e-06, "in-drivable-lane": 56.849999999998715, "deviation-heading": 0.6478219624040278, "agent_compute-ego0": 0.012612508595932732, "complete-iteration": 0.14458155215133933, "set_robot_commands": 0.0021886355076900232, "deviation-center-line": 0.29342070903956635, "driven_lanedir_consec": 0.8275103691789183, "sim_compute_sim_state": 0.005938469817695967, "sim_compute_performance-ego0": 0.0019608367789694906}}
set_robot_commands_max	0.0022818441093812245
set_robot_commands_mean	0.0022293808540164144
set_robot_commands_median	0.002223521899497205
set_robot_commands_min	0.0021886355076900232
sim_compute_performance-ego0_max	0.0020736924717935285
sim_compute_performance-ego0_mean	0.0020054281321645207
sim_compute_performance-ego0_median	0.0019935916389475323
sim_compute_performance-ego0_min	0.0019608367789694906
sim_compute_sim_state_max	0.010651903854888827
sim_compute_sim_state_mean	0.00879803468645551
sim_compute_sim_state_median	0.009300882536618624
sim_compute_sim_state_min	0.005938469817695967
sim_render-ego0_max	0.004050239287422331
sim_render-ego0_mean	0.003958134666283322
sim_render-ego0_median	0.003959343300013204
sim_render-ego0_min	0.00386361277768455
simulation-passed	1
step_physics_max	0.16511023714301293
step_physics_mean	0.11945916378968556
step_physics_median	0.11411116282537354
step_physics_min	0.0845040923649822
survival_time_max	59.99999999999873
survival_time_mean	21.649999999999707
survival_time_min	4.399999999999992

No reset possible

58104

LFv-sim

success

yes

2020-12-03 21:16:37+00:00

2020-12-03 21:31:45+00:00

0:15:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52184

LFv-sim

error

2020-12-02 11:07:02+00:00

2020-12-02 11:09:45+00:00

0:02:43

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140084647661824
- M:video_aido:cmdline(in:/;out:/) 140084647663024
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52172

LFv-sim

error

2020-12-02 11:05:34+00:00

2020-12-02 11:08:50+00:00

0:03:16

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140505468190880
- M:video_aido:cmdline(in:/;out:/) 140505468194432
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52169

LFv-sim

error

2020-12-02 11:05:03+00:00

2020-12-02 11:08:19+00:00

0:03:16

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140275395537648
- M:video_aido:cmdline(in:/;out:/) 140275395535344
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52166

LFv-sim

error

2020-12-02 11:04:51+00:00

2020-12-02 11:10:10+00:00

0:05:19

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140305331811184
- M:video_aido:cmdline(in:/;out:/) 140305331848336
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52127

LFv-sim

host-error

2020-12-02 10:59:23+00:00

2020-12-02 11:01:36+00:00

0:02:13

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

41659

LFv-sim

success

2020-11-08 11:29:17+00:00

2020-11-08 11:38:26+00:00

0:09:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

41657

LFv-sim

success

2020-11-08 11:28:11+00:00

2020-11-08 11:37:00+00:00

0:08:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

38043

LFv-sim

success

2020-11-03 22:33:53+00:00

2020-11-03 22:45:03+00:00

0:11:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36205

LFv-sim

success

2020-11-02 02:37:23+00:00

2020-11-02 02:45:49+00:00

0:08:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35615

LFv-sim

success

2020-11-01 03:27:14+00:00

2020-11-01 03:28:06+00:00

0:00:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35614

LFv-sim

success

2020-11-01 03:27:04+00:00

2020-11-01 03:27:57+00:00

0:00:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35279

LFv-sim

error

2020-10-30 21:07:44+00:00

2020-10-30 21:28:47+00:00

0:21:03

The result file is n [...]

The result file is not found in working dir /tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9764/LFv-sim-reg04-c054faef3177-1-job35279:

File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9764/LFv-sim-reg04-c054faef3177-1-job35279/challenge-results/challenge_results.yaml' does not exist.

This usually means that the evaluator did not finish and some times that there was an import error.
Check the evaluator log to see what happened.

List of all files:

 -/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9764/LFv-sim-reg04-c054faef3177-1-job35279/docker-compose.original.yaml
-/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9764/LFv-sim-reg04-c054faef3177-1-job35279/docker-compose.yaml
-/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9764/LFv-sim-reg04-c054faef3177-1-job35279/logs/challenges-runner/stdout.log
-/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9764/LFv-sim-reg04-c054faef3177-1-job35279/logs/challenges-runner/stderr.log

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35259

LFv-sim

timeout

2020-10-30 19:48:57+00:00

2020-10-30 20:53:58+00:00

1:05:01

I can see how the jo [...]

I can see how the job 35259 is timeout because passed 3901 seconds and the timeout is 3600.0.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35201

LFv-sim

success

2020-10-29 18:41:24+00:00

2020-10-29 19:01:27+00:00

0:20:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible