Submission 10932

Submission

10932

Competing

yes

Challenge

aido5-LF-sim-validation

User

Yishu Malhotra 🇨🇦

Date submitted

2020-11-04 07:34:33+00:00

Last status update

2021-12-04 20:52:34+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

LFv-sim: 57420

User label

exercise_ros_template

Admin priority

Blessing

n/a

User priority

57420

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

57420

LFv-sim

success

yes

2020-12-03 09:47:19+00:00

2020-12-03 10:10:17+00:00

0:22:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.1961238150146727
survival_time_median	47.724999999999426
deviation-center-line_median	1.4124082550402657
in-drivable-lane_median	7.724999999999973

other stats

agent_compute-ego0_max	0.04943670877596227
agent_compute-ego0_mean	0.035716461580399
agent_compute-ego0_median	0.04023906442148302
agent_compute-ego0_min	0.012951008702667664
complete-iteration_max	0.2563426843503626
complete-iteration_mean	0.19683126898494377
complete-iteration_median	0.18236566208647845
complete-iteration_min	0.16625106741645554
deviation-center-line_max	3.3597453895648584
deviation-center-line_mean	1.5848459360821807
deviation-center-line_min	0.15482184468333365
deviation-heading_max	10.058269649583549
deviation-heading_mean	5.334613486878761
deviation-heading_median	4.717565742768647
deviation-heading_min	1.845052812394204
driven_any_max	6.972747754361618
driven_any_mean	4.316837702152087
driven_any_median	5.008481350675872
driven_any_min	0.27764035289498584
driven_lanedir_consec_max	6.233145004203759
driven_lanedir_consec_mean	3.184173868043511
driven_lanedir_consec_min	0.11130283794093998
driven_lanedir_max	6.233145004203759
driven_lanedir_mean	3.184173868043511
driven_lanedir_median	3.1961238150146727
driven_lanedir_min	0.11130283794093998
get_duckie_state_max	1.2137312178409269e-06
get_duckie_state_mean	1.1995506302251473e-06
get_duckie_state_median	1.197642975599715e-06
get_duckie_state_min	1.1891853518602326e-06
get_robot_state_max	0.0036226625173864232
get_robot_state_mean	0.0035969681897503464
get_robot_state_median	0.0035974281432798534
get_robot_state_min	0.003570353955055256
get_state_dump_max	0.00458612350698911
get_state_dump_mean	0.00455472491800549
get_state_dump_median	0.004575978871101808
get_state_dump_min	0.004480818422829233
get_ui_image_max	0.036617377909218395
get_ui_image_mean	0.03033009542626068
get_ui_image_median	0.029797332303415056
get_ui_image_min	0.025108339188994216
in-drivable-lane_max	29.39999999999959
in-drivable-lane_mean	11.212499999999883
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 6.972747754361618, "get_ui_image": 0.027722698365718897, "step_physics": 0.091705250998123, "survival_time": 59.99999999999873, "driven_lanedir": 4.07071548609704, "get_state_dump": 0.00458612350698911, "get_robot_state": 0.003618789850722542, "sim_render-ego0": 0.0038372082674533103, "get_duckie_state": 1.1998350475352572e-06, "in-drivable-lane": 29.39999999999959, "deviation-heading": 4.608436004850047, "agent_compute-ego0": 0.04351359700084626, "complete-iteration": 0.1900084951735853, "set_robot_commands": 0.002236387513261552, "deviation-center-line": 1.2046228552594251, "driven_lanedir_consec": 4.07071548609704, "sim_compute_sim_state": 0.010749433558747532, "sim_compute_performance-ego0": 0.001953042814078478}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.27764035289498584, "get_ui_image": 0.036617377909218395, "step_physics": 0.14436047542385938, "survival_time": 4.049999999999994, "driven_lanedir": 0.11130283794093998, "get_state_dump": 0.004480818422829233, "get_robot_state": 0.003576066435837164, "sim_render-ego0": 0.0038564757602970777, "get_duckie_state": 1.1891853518602326e-06, "in-drivable-lane": 1.649999999999994, "deviation-heading": 1.845052812394204, "agent_compute-ego0": 0.04943670877596227, "complete-iteration": 0.2563426843503626, "set_robot_commands": 0.00235184809056724, "deviation-center-line": 0.15482184468333365, "driven_lanedir_consec": 0.11130283794093998, "sim_compute_sim_state": 0.00961403439684612, "sim_compute_performance-ego0": 0.001961347533435356}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.673833653051254, "get_ui_image": 0.031871966241111216, "step_physics": 0.10321330755529268, "survival_time": 35.450000000000124, "driven_lanedir": 2.3215321439323056, "get_state_dump": 0.004577416097614127, "get_robot_state": 0.0036226625173864232, "sim_render-ego0": 0.0038382006363129953, "get_duckie_state": 1.1954509036641726e-06, "in-drivable-lane": 13.799999999999953, "deviation-heading": 4.826695480687248, "agent_compute-ego0": 0.012951008702667664, "complete-iteration": 0.17472282899937158, "set_robot_commands": 0.002145933769118618, "deviation-center-line": 1.6201936548211056, "driven_lanedir_consec": 2.3215321439323056, "sim_compute_sim_state": 0.010484976164052183, "sim_compute_performance-ego0": 0.0019337227646733673}, "LF-norm-small_loop-000-ego0": {"driven_any": 6.34312904830049, "get_ui_image": 0.025108339188994216, "step_physics": 0.08214366862815584, "survival_time": 59.99999999999873, "driven_lanedir": 6.233145004203759, "get_state_dump": 0.00457454164458949, "get_robot_state": 0.003570353955055256, "sim_render-ego0": 0.003761489822108184, "get_duckie_state": 1.2137312178409269e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.058269649583549, "agent_compute-ego0": 0.036964531842119785, "complete-iteration": 0.16625106741645554, "set_robot_commands": 0.0022085935845164635, "deviation-center-line": 3.3597453895648584, "driven_lanedir_consec": 6.233145004203759, "sim_compute_sim_state": 0.005930734018203519, "sim_compute_performance-ego0": 0.001905580245882744}}
set_robot_commands_max	0.00235184809056724
set_robot_commands_mean	0.002235690739365968
set_robot_commands_median	0.0022224905488890077
set_robot_commands_min	0.002145933769118618
sim_compute_performance-ego0_max	0.001961347533435356
sim_compute_performance-ego0_mean	0.0019384233395174865
sim_compute_performance-ego0_median	0.0019433827893759227
sim_compute_performance-ego0_min	0.001905580245882744
sim_compute_sim_state_max	0.010749433558747532
sim_compute_sim_state_mean	0.00919479453446234
sim_compute_sim_state_median	0.010049505280449154
sim_compute_sim_state_min	0.005930734018203519
sim_render-ego0_max	0.0038564757602970777
sim_render-ego0_mean	0.003823343621542892
sim_render-ego0_median	0.003837704451883153
sim_render-ego0_min	0.003761489822108184
simulation-passed	1
step_physics_max	0.14436047542385938
step_physics_mean	0.10535567565135771
step_physics_median	0.09745927927670783
step_physics_min	0.08214366862815584
survival_time_max	59.99999999999873
survival_time_mean	39.87499999999939
survival_time_min	4.049999999999994

No reset possible

57414

LFv-sim

success

yes

2020-12-03 09:45:54+00:00

2020-12-03 10:13:36+00:00

0:27:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51202

LFv-sim

error

2020-12-02 09:06:16+00:00

2020-12-02 09:15:04+00:00

0:08:48

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139673068532160
- M:video_aido:cmdline(in:/;out:/) 139673642547760
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51194

LFv-sim

error

2020-12-02 09:05:41+00:00

2020-12-02 09:14:22+00:00

0:08:41

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140109301273696
- M:video_aido:cmdline(in:/;out:/) 140109301275184
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51192

LFv-sim

error

2020-12-02 09:05:33+00:00

2020-12-02 09:16:24+00:00

0:10:51

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140336717703248
- M:video_aido:cmdline(in:/;out:/) 140337046634352
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51186

LFv-sim

error

2020-12-02 09:04:59+00:00

2020-12-02 09:13:11+00:00

0:08:12

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139641414795424
- M:video_aido:cmdline(in:/;out:/) 139641414796672
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51180

LFv-sim

error

2020-12-02 09:04:17+00:00

2020-12-02 09:12:45+00:00

0:08:28

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140112369922112
- M:video_aido:cmdline(in:/;out:/) 140112370403120
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51168

LFv-sim

error

2020-12-02 09:03:11+00:00

2020-12-02 09:12:12+00:00

0:09:01

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140070102918816
- M:video_aido:cmdline(in:/;out:/) 140070103265536
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

40600

LFv-sim

success

2020-11-07 15:02:23+00:00

2020-11-07 15:11:50+00:00

0:09:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

40598

LFv-sim

success

2020-11-07 15:01:51+00:00

2020-11-07 15:10:32+00:00

0:08:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

40588

LFv-sim

success

2020-11-07 14:51:43+00:00

2020-11-07 15:01:35+00:00

0:09:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

40587

LFv-sim

success

2020-11-07 14:50:50+00:00

2020-11-07 15:00:10+00:00

0:09:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

39878

LFv-sim

success

2020-11-06 19:45:58+00:00

2020-11-06 19:55:05+00:00

0:09:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

39877

LFv-sim

success

2020-11-06 19:45:22+00:00

2020-11-06 19:54:42+00:00

0:09:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

39876

LFv-sim

success

2020-11-06 19:44:48+00:00

2020-11-06 19:54:00+00:00

0:09:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

39874

LFv-sim

success

2020-11-06 19:44:14+00:00

2020-11-06 19:53:51+00:00

0:09:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

38495

LFv-sim

success

2020-11-04 07:36:01+00:00

2020-11-04 07:44:56+00:00

0:08:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

38494

LFv-sim

success

2020-11-04 07:35:32+00:00

2020-11-04 07:46:44+00:00

0:11:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible