Submission 11642

Submission

11642

Competing

yes

Challenge

aido5-LF-sim-validation

User

Mo Kleit 🇨🇦

Date submitted

2020-11-26 00:59:13+00:00

Last status update

2021-12-04 20:52:45+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

LFv-sim: 54187

User label

sim-exercise-2

Admin priority

Blessing

n/a

User priority

54187

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

54187

LFv-sim

success

yes

2020-12-03 01:43:04+00:00

2020-12-03 02:07:58+00:00

0:24:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.228230300876331
survival_time_median	43.624999999999545
deviation-center-line_median	0.919940438315364
in-drivable-lane_median	23.49999999999946

other stats

agent_compute-ego0_max	0.01389446725016055
agent_compute-ego0_mean	0.012974261578459902
agent_compute-ego0_median	0.012825704198783231
agent_compute-ego0_min	0.01235117066611259
complete-iteration_max	0.28710778238039114
complete-iteration_mean	0.2431244033228037
complete-iteration_median	0.2406376870771985
complete-iteration_min	0.20411445675642664
deviation-center-line_max	1.5806104130508685
deviation-center-line_mean	0.8995976597451906
deviation-center-line_min	0.17789934929916615
deviation-heading_max	8.218039310186441
deviation-heading_mean	4.617988815977041
deviation-heading_median	4.753630831120741
deviation-heading_min	0.7466542914802383
driven_any_max	15.839017341686835
driven_any_mean	10.14802639808125
driven_any_median	11.306515097223278
driven_any_min	2.1400580561916023
driven_lanedir_consec_max	4.4196325145328
driven_lanedir_consec_mean	2.473718716567178
driven_lanedir_consec_min	1.0187817499832486
driven_lanedir_max	4.991935481907523
driven_lanedir_mean	2.9545481803154305
driven_lanedir_median	2.903737744685476
driven_lanedir_min	1.0187817499832486
get_duckie_state_max	1.5251014543616253e-06
get_duckie_state_mean	1.4054447082426892e-06
get_duckie_state_median	1.426782843203823e-06
get_duckie_state_min	1.2431116922014857e-06
get_robot_state_max	0.004044965557430101
get_robot_state_mean	0.003843956865966212
get_robot_state_median	0.003814954581064733
get_robot_state_min	0.0037009527443052823
get_state_dump_max	0.005243002072624538
get_state_dump_mean	0.00490526857156977
get_state_dump_median	0.004818364242175551
get_state_dump_min	0.004741343729303441
get_ui_image_max	0.03702428637903867
get_ui_image_mean	0.03171004803776708
get_ui_image_median	0.03173057459521747
get_ui_image_min	0.026354756581594703
in-drivable-lane_max	53.34999999999868
in-drivable-lane_mean	26.287499999999397
in-drivable-lane_min	4.8000000000000025
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 15.229287810786852, "get_ui_image": 0.02905396501461189, "step_physics": 0.16204669314434225, "survival_time": 58.39999999999882, "driven_lanedir": 4.991935481907523, "get_state_dump": 0.004760515394121077, "get_robot_state": 0.003760039857353687, "sim_render-ego0": 0.003873414928021851, "get_duckie_state": 1.4700779453926968e-06, "in-drivable-lane": 37.49999999999882, "deviation-heading": 7.145973788224895, "agent_compute-ego0": 0.012645163833840062, "complete-iteration": 0.2304205178602625, "set_robot_commands": 0.0022612189104457103, "deviation-center-line": 1.5806104130508685, "driven_lanedir_consec": 4.4196325145328, "sim_compute_sim_state": 0.009841317698117295, "sim_compute_performance-ego0": 0.0020867729921234886}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.383742383659704, "get_ui_image": 0.03702428637903867, "step_physics": 0.2082725994314702, "survival_time": 28.850000000000275, "driven_lanedir": 4.338177282812565, "get_state_dump": 0.004876213090230025, "get_robot_state": 0.003869869304775779, "sim_render-ego0": 0.003948955387392671, "get_duckie_state": 1.3834877410149491e-06, "in-drivable-lane": 9.500000000000096, "deviation-heading": 8.218039310186441, "agent_compute-ego0": 0.013006244563726406, "complete-iteration": 0.28710778238039114, "set_robot_commands": 0.002350966410653402, "deviation-center-line": 1.341131409802535, "driven_lanedir_consec": 3.1296966260251566, "sim_compute_sim_state": 0.011530763550200676, "sim_compute_performance-ego0": 0.002131852311659024}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.1400580561916023, "get_ui_image": 0.034407184175823044, "step_physics": 0.17424024706301483, "survival_time": 9.149999999999997, "driven_lanedir": 1.0187817499832486, "get_state_dump": 0.005243002072624538, "get_robot_state": 0.004044965557430101, "sim_render-ego0": 0.004022757644238679, "get_duckie_state": 1.5251014543616253e-06, "in-drivable-lane": 4.8000000000000025, "deviation-heading": 0.7466542914802383, "agent_compute-ego0": 0.01389446725016055, "complete-iteration": 0.2508548562941344, "set_robot_commands": 0.002448890520178754, "deviation-center-line": 0.17789934929916615, "driven_lanedir_consec": 1.0187817499832486, "sim_compute_sim_state": 0.010242065657740052, "sim_compute_performance-ego0": 0.0022075292856796928}, "LF-norm-small_loop-000-ego0": {"driven_any": 15.839017341686835, "get_ui_image": 0.026354756581594703, "step_physics": 0.1424376083154861, "survival_time": 59.99999999999873, "driven_lanedir": 1.4692982065583864, "get_state_dump": 0.004741343729303441, "get_robot_state": 0.0037009527443052823, "sim_render-ego0": 0.0038072792913991143, "get_duckie_state": 1.2431116922014857e-06, "in-drivable-lane": 53.34999999999868, "deviation-heading": 2.3612878740165884, "agent_compute-ego0": 0.01235117066611259, "complete-iteration": 0.20411445675642664, "set_robot_commands": 0.0022676536979325903, "deviation-center-line": 0.4987494668281927, "driven_lanedir_consec": 1.3267639757275052, "sim_compute_sim_state": 0.006313773614977123, "sim_compute_performance-ego0": 0.0020530525591847897}}
set_robot_commands_max	0.002448890520178754
set_robot_commands_mean	0.0023321823848026137
set_robot_commands_median	0.0023093100542929956
set_robot_commands_min	0.0022612189104457103
sim_compute_performance-ego0_max	0.0022075292856796928
sim_compute_performance-ego0_mean	0.0021198017871617487
sim_compute_performance-ego0_median	0.0021093126518912566
sim_compute_performance-ego0_min	0.0020530525591847897
sim_compute_sim_state_max	0.011530763550200676
sim_compute_sim_state_mean	0.009481980130258787
sim_compute_sim_state_median	0.010041691677928675
sim_compute_sim_state_min	0.006313773614977123
sim_render-ego0_max	0.004022757644238679
sim_render-ego0_mean	0.003913101812763079
sim_render-ego0_median	0.0039111851577072615
sim_render-ego0_min	0.0038072792913991143
simulation-passed	1
step_physics_max	0.2082725994314702
step_physics_mean	0.17174928698857833
step_physics_median	0.16814347010367853
step_physics_min	0.1424376083154861
survival_time_max	59.99999999999873
survival_time_mean	39.099999999999454
survival_time_min	9.149999999999997

No reset possible

54184

LFv-sim

success

yes

2020-12-03 01:42:28+00:00

2020-12-03 02:02:58+00:00

0:20:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

54182

LFv-sim

success

yes

2020-12-03 01:41:55+00:00

2020-12-03 02:00:22+00:00

0:18:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

54180

LFv-sim

success

yes

2020-12-03 01:41:27+00:00

2020-12-03 01:56:12+00:00

0:14:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

54178

LFv-sim

success

yes

2020-12-03 01:40:56+00:00

2020-12-03 01:56:51+00:00

0:15:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

54173

LFv-sim

success

yes

2020-12-03 01:40:27+00:00

2020-12-03 02:01:36+00:00

0:21:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49293

LFv-sim

error

2020-12-02 05:19:04+00:00

2020-12-02 05:21:20+00:00

0:02:16

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140473274389216
- M:video_aido:cmdline(in:/;out:/) 140473274392336
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49287

LFv-sim

error

2020-12-02 05:18:29+00:00

2020-12-02 05:20:47+00:00

0:02:18

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139867494126160
- M:video_aido:cmdline(in:/;out:/) 139862843773232
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49275

LFv-sim

error

2020-12-02 05:17:28+00:00

2020-12-02 05:19:42+00:00

0:02:14

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140073834113920
- M:video_aido:cmdline(in:/;out:/) 140073834111520
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49273

LFv-sim

error

2020-12-02 05:16:21+00:00

2020-12-02 05:20:51+00:00

0:04:30

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140372938439696
- M:video_aido:cmdline(in:/;out:/) 140372938368624
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49261

LFv-sim

error

2020-12-02 05:15:46+00:00

2020-12-02 05:21:50+00:00

0:06:04

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140703465168320
- M:video_aido:cmdline(in:/;out:/) 140701194900816
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

43237

LFv-sim

success

2020-11-26 01:04:33+00:00

2020-11-26 01:13:17+00:00

0:08:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

43236

LFv-sim

success

2020-11-26 01:04:20+00:00

2020-11-26 01:10:59+00:00

0:06:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

43235

LFv-sim

success

2020-11-26 01:03:24+00:00

2020-11-26 01:15:02+00:00

0:11:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

43231

LFv-sim

host-error

2020-11-26 01:01:53+00:00

2020-11-26 01:02:11+00:00

0:00:18

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

43230

LFv-sim

success

2020-11-26 01:01:09+00:00

2020-11-26 01:09:29+00:00

0:08:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

43229

LFv-sim

success

2020-11-26 01:00:37+00:00

2020-11-26 01:12:11+00:00

0:11:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible