Submission 9309

Submission

9309

Competing

yes

Challenge

aido5-LF-sim-validation

User

Jerome Labonte 🇨🇦

Date submitted

2020-10-25 18:05:26+00:00

Last status update

2021-12-04 20:52:33+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

LFv-sim: 58253

User label

exercise_ros_template

Admin priority

Blessing

n/a

User priority

58253

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

58253

LFv-sim

success

yes

2020-12-03 22:31:43+00:00

2020-12-03 22:56:12+00:00

0:24:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	5.013810343411491
survival_time_median	48.1249999999994
deviation-center-line_median	2.469910555819082
in-drivable-lane_median	7.274999999999864

other stats

agent_compute-ego0_max	0.01317809813515434
agent_compute-ego0_mean	0.012795643949116696
agent_compute-ego0_median	0.012888068416332712
agent_compute-ego0_min	0.012228340828647028
complete-iteration_max	0.20690091078031791
complete-iteration_mean	0.1813601753862367
complete-iteration_median	0.17744133647115604
complete-iteration_min	0.16365711782231676
deviation-center-line_max	3.6287187397564376
deviation-center-line_mean	2.1858479477697164
deviation-center-line_min	0.1748519396842632
deviation-heading_max	12.677111590274828
deviation-heading_mean	8.882816594342268
deviation-heading_median	11.127908941336596
deviation-heading_min	0.5983369044210547
driven_any_max	13.18222718550617
driven_any_mean	8.44219926537332
driven_any_median	9.51454045815905
driven_any_min	1.5574889596690098
driven_lanedir_consec_max	7.433392005114449
driven_lanedir_consec_mean	4.533979416059831
driven_lanedir_consec_min	0.6749049723018914
driven_lanedir_max	12.33734102134521
driven_lanedir_mean	6.984350455646934
driven_lanedir_median	7.462577914470315
driven_lanedir_min	0.6749049723018914
get_duckie_state_max	1.4877852114885214e-06
get_duckie_state_mean	1.3728571733542118e-06
get_duckie_state_median	1.3680329360258397e-06
get_duckie_state_min	1.2675776098766466e-06
get_robot_state_max	0.003980201647743565
get_robot_state_mean	0.0037673659835362294
get_robot_state_median	0.0037659076464213606
get_robot_state_min	0.0035574469935586313
get_state_dump_max	0.004996983032652786
get_state_dump_mean	0.004799757588039518
get_state_dump_median	0.004802461405017668
get_state_dump_min	0.0045971245094699525
get_ui_image_max	0.03549579678890077
get_ui_image_mean	0.030405539645217285
get_ui_image_median	0.029977218222178904
get_ui_image_min	0.02617192534761056
in-drivable-lane_max	14.799999999999567
in-drivable-lane_mean	8.462499999999807
in-drivable-lane_min	4.4999999999999325
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 13.18222718550617, "get_ui_image": 0.027262587035129113, "step_physics": 0.09895751220201277, "survival_time": 59.99999999999873, "driven_lanedir": 12.33734102134521, "get_state_dump": 0.0045971245094699525, "get_robot_state": 0.0035574469935586313, "sim_render-ego0": 0.0036988838030634873, "get_duckie_state": 1.2691173823449531e-06, "in-drivable-lane": 4.4999999999999325, "deviation-heading": 12.677111590274828, "agent_compute-ego0": 0.012228340828647028, "complete-iteration": 0.1641550657651903, "set_robot_commands": 0.002153261615076629, "deviation-center-line": 3.6287187397564376, "driven_lanedir_consec": 6.976072329740974, "sim_compute_sim_state": 0.009682247581132545, "sim_compute_performance-ego0": 0.0019380242302455472}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.297840663511192, "get_ui_image": 0.03549579678890077, "step_physics": 0.12962353961132064, "survival_time": 41.49999999999978, "driven_lanedir": 4.642585160727647, "get_state_dump": 0.004868270688108588, "get_robot_state": 0.003980201647743565, "sim_render-ego0": 0.004057964836790817, "get_duckie_state": 1.4669484897067257e-06, "in-drivable-lane": 14.799999999999567, "deviation-heading": 10.63010407763965, "agent_compute-ego0": 0.012924497882094769, "complete-iteration": 0.20690091078031791, "set_robot_commands": 0.0023182784033452847, "deviation-center-line": 2.1711984911540827, "driven_lanedir_consec": 3.051548357082008, "sim_compute_sim_state": 0.011281364948167123, "sim_compute_performance-ego0": 0.002256300188287214}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.73124025280691, "get_ui_image": 0.032691849409228695, "step_physics": 0.11603985998752343, "survival_time": 54.74999999999903, "driven_lanedir": 10.282570668212983, "get_state_dump": 0.0047366521219267465, "get_robot_state": 0.00376339920245818, "sim_render-ego0": 0.0038578151351343977, "get_duckie_state": 1.2675776098766466e-06, "in-drivable-lane": 8.599999999999733, "deviation-heading": 11.625713805033543, "agent_compute-ego0": 0.012851638950570655, "complete-iteration": 0.19072760717712176, "set_robot_commands": 0.0023191334122288835, "deviation-center-line": 2.768622620484081, "driven_lanedir_consec": 7.433392005114449, "sim_compute_sim_state": 0.012326159398921215, "sim_compute_performance-ego0": 0.002052481592136578}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.5574889596690098, "get_ui_image": 0.02617192534761056, "step_physics": 0.10184804820481626, "survival_time": 8.899999999999991, "driven_lanedir": 0.6749049723018914, "get_state_dump": 0.004996983032652786, "get_robot_state": 0.003768416090384542, "sim_render-ego0": 0.003908338493475035, "get_duckie_state": 1.4877852114885214e-06, "in-drivable-lane": 5.949999999999994, "deviation-heading": 0.5983369044210547, "agent_compute-ego0": 0.01317809813515434, "complete-iteration": 0.16365711782231676, "set_robot_commands": 0.002268721937467266, "deviation-center-line": 0.1748519396842632, "driven_lanedir_consec": 0.6749049723018914, "sim_compute_sim_state": 0.005347069415300252, "sim_compute_performance-ego0": 0.002076552566869298}}
set_robot_commands_max	0.0023191334122288835
set_robot_commands_mean	0.002264848842029516
set_robot_commands_median	0.002293500170406275
set_robot_commands_min	0.002153261615076629
sim_compute_performance-ego0_max	0.002256300188287214
sim_compute_performance-ego0_mean	0.0020808396443846595
sim_compute_performance-ego0_median	0.002064517079502938
sim_compute_performance-ego0_min	0.0019380242302455472
sim_compute_sim_state_max	0.012326159398921215
sim_compute_sim_state_mean	0.009659210335880283
sim_compute_sim_state_median	0.010481806264649831
sim_compute_sim_state_min	0.005347069415300252
sim_render-ego0_max	0.004057964836790817
sim_render-ego0_mean	0.0038807505671159346
sim_render-ego0_median	0.0038830768143047166
sim_render-ego0_min	0.0036988838030634873
simulation-passed	1
step_physics_max	0.12962353961132064
step_physics_mean	0.11161724000141827
step_physics_median	0.10894395409616985
step_physics_min	0.09895751220201277
survival_time_max	59.99999999999873
survival_time_mean	41.28749999999938
survival_time_min	8.899999999999991

No reset possible

52338

LFv-sim

error

2020-12-02 11:25:32+00:00

2020-12-02 11:31:31+00:00

0:05:59

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139723101217648
- M:video_aido:cmdline(in:/;out:/) 139723100116112
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52337

LFv-sim

error

2020-12-02 11:25:15+00:00

2020-12-02 11:31:26+00:00

0:06:11

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140179154021872
- M:video_aido:cmdline(in:/;out:/) 140179154769040
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52336

LFv-sim

error

2020-12-02 11:24:40+00:00

2020-12-02 11:30:31+00:00

0:05:51

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140070832721776
- M:video_aido:cmdline(in:/;out:/) 140070833119680
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52328

LFv-sim

error

2020-12-02 11:23:30+00:00

2020-12-02 11:31:28+00:00

0:07:58

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140043952521072
- M:video_aido:cmdline(in:/;out:/) 140043952520496
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

41738

LFv-sim

success

2020-11-08 13:27:28+00:00

2020-11-08 13:36:16+00:00

0:08:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

38207

LFv-sim

error

2020-11-04 00:41:39+00:00

2020-11-04 00:42:12+00:00

0:00:33

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.49-py3.8.egg/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission9309/LFv-sim-mont05-227ea22a5fff-1-job38207-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

38202

LFv-sim

error

2020-11-04 00:40:33+00:00

2020-11-04 00:41:08+00:00

0:00:35

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.49-py3.8.egg/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission9309/LFv-sim-mont02-80325a328f54-1-job38202-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36337

LFv-sim

success

2020-11-02 04:39:39+00:00

2020-11-02 04:49:48+00:00

0:10:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36336

LFv-sim

success

2020-11-02 04:39:08+00:00

2020-11-02 04:50:17+00:00

0:11:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35769

LFv-sim

success

2020-11-01 04:09:48+00:00

2020-11-01 04:10:48+00:00

0:01:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35369

LFv-sim

error

2020-10-31 03:03:48+00:00

2020-10-31 03:26:21+00:00

0:22:33

The result file is n [...]

The result file is not found in working dir /tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9309/LFv-sim-reg05-b2dee9d94ee0-1-job35369:

File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9309/LFv-sim-reg05-b2dee9d94ee0-1-job35369/challenge-results/challenge_results.yaml' does not exist.

This usually means that the evaluator did not finish and some times that there was an import error.
Check the evaluator log to see what happened.

List of all files:

 -/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9309/LFv-sim-reg05-b2dee9d94ee0-1-job35369/docker-compose.original.yaml
-/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9309/LFv-sim-reg05-b2dee9d94ee0-1-job35369/docker-compose.yaml
-/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9309/LFv-sim-reg05-b2dee9d94ee0-1-job35369/logs/challenges-runner/stdout.log
-/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9309/LFv-sim-reg05-b2dee9d94ee0-1-job35369/logs/challenges-runner/stderr.log

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35003

LFv-sim

success

2020-10-29 03:55:59+00:00

2020-10-29 04:22:51+00:00

0:26:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

34654

LFv-sim

success

2020-10-25 18:06:38+00:00

2020-10-25 18:29:23+00:00

0:22:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

34653

LFv-sim

success

2020-10-25 18:06:05+00:00

2020-10-25 18:31:57+00:00

0:25:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible