Duckietown Challenges Home Challenges Submissions

Submission 11574

Submission11574
Competingyes
Challengeaido5-LF-sim-validation
UserAnastasiya Nikolskaya 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 53899
Next
User labelJetBrains Research
Admin priority60
Blessingn/a
User priority60

53899

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
53899LFv-simsuccessyes0:51:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.408341686306755
survival_time_median59.99999999999873
deviation-center-line_median2.0007249543777896
in-drivable-lane_median38.64999999999875


other stats
agent_compute-ego0_max0.1310323219712231
agent_compute-ego0_mean0.11277248698606976
agent_compute-ego0_median0.125303965325558
agent_compute-ego0_min0.06944969532193987
complete-iteration_max0.4938439268752201
complete-iteration_mean0.39661757118199686
complete-iteration_median0.42208103434827104
complete-iteration_min0.2484642891562253
deviation-center-line_max5.324036018525398
deviation-center-line_mean2.503699463462911
deviation-center-line_min0.6893119265706664
deviation-heading_max10.118380600676508
deviation-heading_mean6.222180525954289
deviation-heading_median6.031027282631774
deviation-heading_min2.7082869378770997
driven_any_max18.972144348016453
driven_any_mean9.82530696942356
driven_any_median8.73000574571026
driven_any_min2.8690720382572734
driven_lanedir_consec_max16.139940167063106
driven_lanedir_consec_mean7.733526943728718
driven_lanedir_consec_min1.9774842352382551
driven_lanedir_max16.139940167063106
driven_lanedir_mean7.76025320534794
driven_lanedir_median6.408341686306755
driven_lanedir_min2.0843892817151444
get_duckie_state_max1.4340847755451187e-06
get_duckie_state_mean1.358499534918208e-06
get_duckie_state_median1.3518988540230147e-06
get_duckie_state_min1.2961156560816832e-06
get_robot_state_max0.004201357608830105
get_robot_state_mean0.0040377134784472975
get_robot_state_median0.0041085249379115936
get_robot_state_min0.003732446429135897
get_state_dump_max0.005107682313053534
get_state_dump_mean0.0049919786798666155
get_state_dump_median0.005045640677039966
get_state_dump_min0.004768951052332996
get_ui_image_max0.04211431756603232
get_ui_image_mean0.035044311484528225
get_ui_image_median0.035816533579417414
get_ui_image_min0.026429861213245757
in-drivable-lane_max52.099999999998715
in-drivable-lane_mean34.62499999999903
in-drivable-lane_min9.099999999999882
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 13.778213238971356, "get_ui_image": 0.03424666068833833, "step_physics": 0.18875632436944484, "survival_time": 59.99999999999873, "driven_lanedir": 10.193178307873016, "get_state_dump": 0.005009921365336117, "get_robot_state": 0.004104262089153611, "sim_render-ego0": 0.004112091191503825, "get_duckie_state": 1.4009324835301636e-06, "in-drivable-lane": 26.499999999998824, "deviation-heading": 9.03564816005375, "agent_compute-ego0": 0.1310323219712231, "complete-iteration": 0.38332351200983583, "set_robot_commands": 0.002567571366855644, "deviation-center-line": 3.1991346466698736, "driven_lanedir_consec": 10.193178307873016, "sim_compute_sim_state": 0.01112863959916724, "sim_compute_performance-ego0": 0.0022738789837128117}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.6817982524491657, "get_ui_image": 0.04211431756603232, "step_physics": 0.29206296863603554, "survival_time": 59.99999999999873, "driven_lanedir": 2.6235050647404923, "get_state_dump": 0.0050813599887438166, "get_robot_state": 0.004112787786669576, "sim_render-ego0": 0.00428579133515751, "get_duckie_state": 1.4340847755451187e-06, "in-drivable-lane": 50.799999999998676, "deviation-heading": 2.7082869378770997, "agent_compute-ego0": 0.1280366939668552, "complete-iteration": 0.4938439268752201, "set_robot_commands": 0.002493830545061733, "deviation-center-line": 0.8023152620857057, "driven_lanedir_consec": 2.6235050647404923, "sim_compute_sim_state": 0.01325063324292236, "sim_compute_performance-ego0": 0.002306478208149601}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.8690720382572734, "get_ui_image": 0.03738640647049649, "step_physics": 0.26967686935825014, "survival_time": 59.99999999999873, "driven_lanedir": 2.0843892817151444, "get_state_dump": 0.005107682313053534, "get_robot_state": 0.004201357608830105, "sim_render-ego0": 0.0043171293828807005, "get_duckie_state": 1.2961156560816832e-06, "in-drivable-lane": 52.099999999998715, "deviation-heading": 3.0264064052097974, "agent_compute-ego0": 0.1225712366842608, "complete-iteration": 0.4608385566867063, "set_robot_commands": 0.00252596742406078, "deviation-center-line": 0.6893119265706664, "driven_lanedir_consec": 1.9774842352382551, "sim_compute_sim_state": 0.012635511522189865, "sim_compute_performance-ego0": 0.0023255743253836523}, "LF-norm-small_loop-000-ego0": {"driven_any": 18.972144348016453, "get_ui_image": 0.026429861213245757, "step_physics": 0.12968436327703192, "survival_time": 59.99999999999873, "driven_lanedir": 16.139940167063106, "get_state_dump": 0.004768951052332996, "get_robot_state": 0.003732446429135897, "sim_render-ego0": 0.003792593818620083, "get_duckie_state": 1.3028652245158656e-06, "in-drivable-lane": 9.099999999999882, "deviation-heading": 10.118380600676508, "agent_compute-ego0": 0.06944969532193987, "complete-iteration": 0.2484642891562253, "set_robot_commands": 0.002259790252190049, "deviation-center-line": 5.324036018525398, "driven_lanedir_consec": 16.139940167063106, "sim_compute_sim_state": 0.006244277279144719, "sim_compute_performance-ego0": 0.0020148365027104487}}
set_robot_commands_max0.002567571366855644
set_robot_commands_mean0.0024617898970420516
set_robot_commands_median0.0025098989845612563
set_robot_commands_min0.002259790252190049
sim_compute_performance-ego0_max0.0023255743253836523
sim_compute_performance-ego0_mean0.002230192004989128
sim_compute_performance-ego0_median0.002290178595931206
sim_compute_performance-ego0_min0.0020148365027104487
sim_compute_sim_state_max0.01325063324292236
sim_compute_sim_state_mean0.010814765410856046
sim_compute_sim_state_median0.011882075560678553
sim_compute_sim_state_min0.006244277279144719
sim_render-ego0_max0.0043171293828807005
sim_render-ego0_mean0.00412690143204053
sim_render-ego0_median0.0041989412633306675
sim_render-ego0_min0.003792593818620083
simulation-passed1
step_physics_max0.29206296863603554
step_physics_mean0.2200451314101906
step_physics_median0.2292165968638475
step_physics_min0.12968436327703192
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
53897LFv-simsuccessyes0:52:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53896LFv-simsuccessyes0:51:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53895LFv-simtimeoutyes----No reset possible
53893LFv-simsuccessyes0:54:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53891LFv-simsuccessyes0:52:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53890LFv-simsuccessyes0:35:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53887LFv-simsuccessyes0:53:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
49515LFv-simerrorno0:03:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140147376950000
- M:video_aido:cmdline(in:/;out:/) 140147377319600
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
49505LFv-simerrorno0:10:49
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139777002043664
- M:video_aido:cmdline(in:/;out:/) 139777002044576
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
49504LFv-simerrorno0:11:20
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140218433303648
- M:video_aido:cmdline(in:/;out:/) 140218433305568
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
49492LFv-simerrorno0:10:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140356557537584
- M:video_aido:cmdline(in:/;out:/) 140356557721264
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
49489LFv-simerrorno0:10:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139742206634688
- M:video_aido:cmdline(in:/;out:/) 139742205865168
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42973LFv-simsuccessno0:10:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42972LFv-simsuccessno0:10:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42971LFv-simsuccessno0:08:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42970LFv-simsuccessno0:07:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42969LFv-simsuccessno0:11:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42968LFv-simsuccessno0:10:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42967LFv-simsuccessno0:16:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42966LFv-simsuccessno0:10:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42965LFv-simsuccessno0:10:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42964LFv-simsuccessno0:14:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42963LFv-simsuccessno0:13:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
42962LFv-simsuccessno0:13:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible