Submission 9381

Submission

9381

Competing

yes

Challenge

aido5-LF-sim-validation

User

Himanshu Arora 🇨🇦

Date submitted

2020-10-27 04:14:28+00:00

Last status update

2021-12-04 20:52:33+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

LFv-sim: 58119

User label

exercise_ros_template

Admin priority

Blessing

n/a

User priority

58119

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

58119

LFv-sim

success

yes

2020-12-03 21:28:43+00:00

2020-12-03 21:44:39+00:00

0:15:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.5379345581763697
survival_time_median	24.25000000000021
deviation-center-line_median	0.5790578655568437
in-drivable-lane_median	14.45000000000019

other stats

agent_compute-ego0_max	0.014257461175151255
agent_compute-ego0_mean	0.013568609749428896
agent_compute-ego0_median	0.013408139335112606
agent_compute-ego0_min	0.01320069915233912
complete-iteration_max	0.25435261342717314
complete-iteration_mean	0.19764580175176127
complete-iteration_median	0.18273357461645084
complete-iteration_min	0.17076344434697038
deviation-center-line_max	1.4408698898105543
deviation-center-line_mean	0.6721382787705776
deviation-center-line_min	0.08956749415806839
deviation-heading_max	6.2419656421346765
deviation-heading_mean	3.3928233416473352
deviation-heading_median	3.2660715933178537
deviation-heading_min	0.7971845378189586
driven_any_max	9.604363578473455
driven_any_mean	4.5890275104613
driven_any_median	4.085179497393162
driven_any_min	0.5813874685854185
driven_lanedir_consec_max	4.1815756834353985
driven_lanedir_consec_mean	1.8584635674538188
driven_lanedir_consec_min	0.1764094700271377
driven_lanedir_max	4.1815756834353985
driven_lanedir_mean	1.8584635674538188
driven_lanedir_median	1.5379345581763697
driven_lanedir_min	0.1764094700271377
get_duckie_state_max	2.3940704750579784e-06
get_duckie_state_mean	2.2326439901770525e-06
get_duckie_state_median	2.289702775211793e-06
get_duckie_state_min	1.957099935226647e-06
get_robot_state_max	0.0040916902097788725
get_robot_state_mean	0.003978187065131367
get_robot_state_median	0.004037990151230437
get_robot_state_min	0.0037450777482857223
get_state_dump_max	0.0052226494098531785
get_state_dump_mean	0.005144502003954142
get_state_dump_median	0.00517874277906865
get_state_dump_min	0.00499787304782609
get_ui_image_max	0.03807520318305355
get_ui_image_mean	0.03178146980452596
get_ui_image_median	0.030869622696691263
get_ui_image_min	0.02731143064166776
in-drivable-lane_max	28.94999999999988
in-drivable-lane_mean	15.187500000000064
in-drivable-lane_min	2.8999999999999924
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 9.604363578473455, "get_ui_image": 0.03011505486387195, "step_physics": 0.10689112566637272, "survival_time": 52.74999999999914, "driven_lanedir": 4.1815756834353985, "get_state_dump": 0.005175244627576886, "get_robot_state": 0.0040916902097788725, "sim_render-ego0": 0.00421515784480355, "get_duckie_state": 2.373348582874645e-06, "in-drivable-lane": 28.94999999999988, "deviation-heading": 6.2419656421346765, "agent_compute-ego0": 0.01334940055103013, "complete-iteration": 0.17867272866494727, "set_robot_commands": 0.002450915448593371, "deviation-center-line": 1.4408698898105543, "driven_lanedir_consec": 4.1815756834353985, "sim_compute_sim_state": 0.009952420538122004, "sim_compute_performance-ego0": 0.002327698649782123}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.5813874685854185, "get_ui_image": 0.03807520318305355, "step_physics": 0.17295353165988264, "survival_time": 4.299999999999993, "driven_lanedir": 0.1764094700271377, "get_state_dump": 0.0052226494098531785, "get_robot_state": 0.004012773776876515, "sim_render-ego0": 0.004287462124879333, "get_duckie_state": 2.20605696754894e-06, "in-drivable-lane": 2.8999999999999924, "deviation-heading": 0.7971845378189586, "agent_compute-ego0": 0.014257461175151255, "complete-iteration": 0.25435261342717314, "set_robot_commands": 0.00244108561811776, "deviation-center-line": 0.08956749415806839, "driven_lanedir_consec": 0.1764094700271377, "sim_compute_sim_state": 0.010872188655809424, "sim_compute_performance-ego0": 0.0021160525837163814}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.2130349639293, "get_ui_image": 0.03162419052951058, "step_physics": 0.1143413352449412, "survival_time": 18.400000000000126, "driven_lanedir": 1.7550280514532564, "get_state_dump": 0.00499787304782609, "get_robot_state": 0.0037450777482857223, "sim_render-ego0": 0.003992778498951982, "get_duckie_state": 1.957099935226647e-06, "in-drivable-lane": 8.250000000000092, "deviation-heading": 2.281988686538121, "agent_compute-ego0": 0.01320069915233912, "complete-iteration": 0.18679442056795445, "set_robot_commands": 0.0021983840601231025, "deviation-center-line": 0.6088412794241852, "driven_lanedir_consec": 1.7550280514532564, "sim_compute_sim_state": 0.010500190057728672, "sim_compute_performance-ego0": 0.0021002253865808006}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.957324030857024, "get_ui_image": 0.02731143064166776, "step_physics": 0.1051133173219798, "survival_time": 30.100000000000293, "driven_lanedir": 1.320841064899483, "get_state_dump": 0.005182240930560414, "get_robot_state": 0.004063206525584359, "sim_render-ego0": 0.004186124153200469, "get_duckie_state": 2.3940704750579784e-06, "in-drivable-lane": 20.650000000000286, "deviation-heading": 4.250154500097586, "agent_compute-ego0": 0.01346687811919508, "complete-iteration": 0.17076344434697038, "set_robot_commands": 0.0023984525531876343, "deviation-center-line": 0.5492744516895021, "driven_lanedir_consec": 1.320841064899483, "sim_compute_sim_state": 0.006702646489562482, "sim_compute_performance-ego0": 0.002231688839483815}}
set_robot_commands_max	0.002450915448593371
set_robot_commands_mean	0.002372209420005467
set_robot_commands_median	0.002419769085652697
set_robot_commands_min	0.0021983840601231025
sim_compute_performance-ego0_max	0.002327698649782123
sim_compute_performance-ego0_mean	0.00219391636489078
sim_compute_performance-ego0_median	0.002173870711600098
sim_compute_performance-ego0_min	0.0021002253865808006
sim_compute_sim_state_max	0.010872188655809424
sim_compute_sim_state_mean	0.009506861435305646
sim_compute_sim_state_median	0.01022630529792534
sim_compute_sim_state_min	0.006702646489562482
sim_render-ego0_max	0.004287462124879333
sim_render-ego0_mean	0.0041703806554588335
sim_render-ego0_median	0.00420064099900201
sim_render-ego0_min	0.003992778498951982
simulation-passed	1
step_physics_max	0.17295353165988264
step_physics_mean	0.1248248274732941
step_physics_median	0.11061623045565697
step_physics_min	0.1051133173219798
survival_time_max	52.74999999999914
survival_time_mean	26.38749999999989
survival_time_min	4.299999999999993

No reset possible

52181

LFv-sim

error

2020-12-02 11:06:42+00:00

2020-12-02 11:10:08+00:00

0:03:26

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140021430004080
- M:video_aido:cmdline(in:/;out:/) 140021430543120
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52179

LFv-sim

error

2020-12-02 11:06:23+00:00

2020-12-02 11:10:05+00:00

0:03:42

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139910471557904
- M:video_aido:cmdline(in:/;out:/) 139910471690848
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52174

LFv-sim

error

2020-12-02 11:05:42+00:00

2020-12-02 11:10:12+00:00

0:04:30

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140686053775824
- M:video_aido:cmdline(in:/;out:/) 140686053775344
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52167

LFv-sim

error

2020-12-02 11:04:56+00:00

2020-12-02 11:12:00+00:00

0:07:04

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140182970342896
- M:video_aido:cmdline(in:/;out:/) 140182970741088
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

41670

LFv-sim

success

2020-11-08 11:43:04+00:00

2020-11-08 11:51:56+00:00

0:08:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

38079

LFv-sim

success

2020-11-03 23:35:44+00:00

2020-11-03 23:46:09+00:00

0:10:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

38078

LFv-sim

success

2020-11-03 23:35:15+00:00

2020-11-03 23:45:43+00:00

0:10:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36245

LFv-sim

success

2020-11-02 03:24:27+00:00

2020-11-02 03:34:45+00:00

0:10:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36244

LFv-sim

success

2020-11-02 03:23:49+00:00

2020-11-02 03:34:08+00:00

0:10:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35692

LFv-sim

success

2020-11-01 03:52:01+00:00

2020-11-01 03:53:01+00:00

0:01:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35691

LFv-sim

success

2020-11-01 03:51:29+00:00

2020-11-01 03:52:24+00:00

0:00:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35690

LFv-sim

success

2020-11-01 03:51:08+00:00

2020-11-01 03:52:17+00:00

0:01:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35306

LFv-sim

error

2020-10-30 23:22:54+00:00

2020-10-30 23:45:57+00:00

0:23:03

The result file is n [...]

The result file is not found in working dir /tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9381/LFv-sim-reg01-94a6fab21ac9-1-job35306:

File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9381/LFv-sim-reg01-94a6fab21ac9-1-job35306/challenge-results/challenge_results.yaml' does not exist.

This usually means that the evaluator did not finish and some times that there was an import error.
Check the evaluator log to see what happened.

List of all files:

 -/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9381/LFv-sim-reg01-94a6fab21ac9-1-job35306/docker-compose.original.yaml
-/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9381/LFv-sim-reg01-94a6fab21ac9-1-job35306/docker-compose.yaml
-/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9381/LFv-sim-reg01-94a6fab21ac9-1-job35306/logs/challenges-runner/stdout.log
-/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9381/LFv-sim-reg01-94a6fab21ac9-1-job35306/logs/challenges-runner/stderr.log

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

34956

LFv-sim

success

2020-10-29 00:51:26+00:00

2020-10-29 01:14:59+00:00

0:23:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

34889

LFv-sim

timeout

2020-10-28 20:22:11+00:00

2020-10-28 21:27:37+00:00

1:05:26

I can see how the jo [...]

I can see how the job 34889 is timeout because passed 3926 seconds and the timeout is 3600.0.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

34888

LFv-sim

timeout

2020-10-28 20:21:48+00:00

2020-10-28 21:27:37+00:00

1:05:49

I can see how the jo [...]

I can see how the job 34888 is timeout because passed 3949 seconds and the timeout is 3600.0.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

34851

LFv-sim

success

2020-10-27 04:16:09+00:00

2020-10-27 04:43:25+00:00

0:27:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

34850

LFv-sim

success

2020-10-27 04:15:29+00:00

2020-10-27 04:41:29+00:00

0:26:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible