Submission 9313

Submission

9313

Competing

yes

Challenge

aido5-LF-sim-validation

User

Raphael Jean

Date submitted

2020-10-25 19:22:39+00:00

Last status update

2021-12-04 20:52:33+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

LFv-sim: 58221

User label

sim-exercise-1

Admin priority

Blessing

n/a

User priority

58221

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

58221

LFv-sim

success

yes

2020-12-03 22:19:06+00:00

2020-12-03 22:53:56+00:00

0:34:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	10.349124275635678
survival_time_median	59.99999999999873
deviation-center-line_median	2.465664448308667
in-drivable-lane_median	1.024999999999983

other stats

agent_compute-ego0_max	0.012645303160820676
agent_compute-ego0_mean	0.012212850817236475
agent_compute-ego0_median	0.01219156024656526
agent_compute-ego0_min	0.011822979614994709
complete-iteration_max	0.2114642595470597
complete-iteration_mean	0.18627651699575953
complete-iteration_median	0.1855834598445972
complete-iteration_min	0.1624748887467841
deviation-center-line_max	3.349208702162592
deviation-center-line_mean	2.6463648446766506
deviation-center-line_min	2.304921779926675
deviation-heading_max	12.32684910791114
deviation-heading_mean	11.751090744029929
deviation-heading_median	11.793358434368846
deviation-heading_min	11.090796999470884
driven_any_max	11.742538408999287
driven_any_mean	11.002827368661327
driven_any_median	10.863548127258454
driven_any_min	10.541674811129129
driven_lanedir_consec_max	11.424113121611075
driven_lanedir_consec_mean	9.87648515112168
driven_lanedir_consec_min	7.383578931604296
driven_lanedir_max	11.424113121611075
driven_lanedir_mean	9.902432610891076
driven_lanedir_median	10.349124275635678
driven_lanedir_min	7.487368770681874
get_duckie_state_max	1.386639279787189e-06
get_duckie_state_mean	1.352395145819646e-06
get_duckie_state_median	1.3546780880841483e-06
get_duckie_state_min	1.3135851273230966e-06
get_robot_state_max	0.003856546773600837
get_robot_state_mean	0.0036611480081607463
get_robot_state_median	0.0036081489575693353
get_robot_state_min	0.0035717473439034774
get_state_dump_max	0.004679399366482013
get_state_dump_mean	0.004594692133745484
get_state_dump_median	0.004583113795017621
get_state_dump_min	0.0045331415784646825
get_ui_image_max	0.03390924857121324
get_ui_image_mean	0.02935353464925418
get_ui_image_median	0.029427038938377816
get_ui_image_min	0.02465081214904785
in-drivable-lane_max	16.099999999999355
in-drivable-lane_mean	4.53749999999983
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 11.742538408999287, "get_ui_image": 0.02710378715934404, "step_physics": 0.1050636857673588, "survival_time": 59.99999999999873, "driven_lanedir": 11.424113121611075, "get_state_dump": 0.0046248447885124215, "get_robot_state": 0.003625021886071198, "sim_render-ego0": 0.0037492004461232866, "get_duckie_state": 1.386639279787189e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.090796999470884, "agent_compute-ego0": 0.01211044889604122, "complete-iteration": 0.16962101675886398, "set_robot_commands": 0.002188100306616536, "deviation-center-line": 2.481256490025932, "driven_lanedir_consec": 11.424113121611075, "sim_compute_sim_state": 0.009109307486846187, "sim_compute_performance-ego0": 0.001959229587615281}, "LF-norm-zigzag-000-ego0": {"driven_any": 10.541674811129129, "get_ui_image": 0.03390924857121324, "step_physics": 0.136140662367199, "survival_time": 59.99999999999873, "driven_lanedir": 7.487368770681874, "get_state_dump": 0.0045331415784646825, "get_robot_state": 0.0035912760290674724, "sim_render-ego0": 0.0037185139302707134, "get_duckie_state": 1.3312531152831624e-06, "in-drivable-lane": 16.099999999999355, "deviation-heading": 12.194429950990209, "agent_compute-ego0": 0.0122726715970893, "complete-iteration": 0.2114642595470597, "set_robot_commands": 0.002158811944013432, "deviation-center-line": 2.304921779926675, "driven_lanedir_consec": 7.383578931604296, "sim_compute_sim_state": 0.013054827071546416, "sim_compute_performance-ego0": 0.0020004196230517537}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.000297083662383, "get_ui_image": 0.031750290717411596, "step_physics": 0.1269590179687932, "survival_time": 59.99999999999873, "driven_lanedir": 10.70181107160244, "get_state_dump": 0.004679399366482013, "get_robot_state": 0.003856546773600837, "sim_render-ego0": 0.003885806549796455, "get_duckie_state": 1.3781030608851349e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.392286917747484, "agent_compute-ego0": 0.012645303160820676, "complete-iteration": 0.20154590293033037, "set_robot_commands": 0.0023125839868651937, "deviation-center-line": 3.349208702162592, "driven_lanedir_consec": 10.70181107160244, "sim_compute_sim_state": 0.013216500278317264, "sim_compute_performance-ego0": 0.0021482945282592265}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.72679917085452, "get_ui_image": 0.02465081214904785, "step_physics": 0.10425929701596276, "survival_time": 59.99999999999873, "driven_lanedir": 9.996437479668913, "get_state_dump": 0.0045413828015228195, "get_robot_state": 0.0035717473439034774, "sim_render-ego0": 0.003644223217166135, "get_duckie_state": 1.3135851273230966e-06, "in-drivable-lane": 2.049999999999966, "deviation-heading": 12.32684910791114, "agent_compute-ego0": 0.011822979614994709, "complete-iteration": 0.1624748887467841, "set_robot_commands": 0.0020703540852822235, "deviation-center-line": 2.450072406591402, "driven_lanedir_consec": 9.996437479668913, "sim_compute_sim_state": 0.005964676009725274, "sim_compute_performance-ego0": 0.0018682811381318589}}
set_robot_commands_max	0.0023125839868651937
set_robot_commands_mean	0.0021824625806943464
set_robot_commands_median	0.002173456125314984
set_robot_commands_min	0.0020703540852822235
sim_compute_performance-ego0_max	0.0021482945282592265
sim_compute_performance-ego0_mean	0.0019940562192645303
sim_compute_performance-ego0_median	0.0019798246053335175
sim_compute_performance-ego0_min	0.0018682811381318589
sim_compute_sim_state_max	0.013216500278317264
sim_compute_sim_state_mean	0.010336327711608783
sim_compute_sim_state_median	0.011082067279196302
sim_compute_sim_state_min	0.005964676009725274
sim_render-ego0_max	0.003885806549796455
sim_render-ego0_mean	0.003749436035839148
sim_render-ego0_median	0.003733857188197
sim_render-ego0_min	0.003644223217166135
simulation-passed	1
step_physics_max	0.136140662367199
step_physics_mean	0.11810566577982844
step_physics_median	0.11601135186807598
step_physics_min	0.10425929701596276
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

52351

LFv-sim

error

2020-12-02 11:28:01+00:00

2020-12-02 11:38:31+00:00

0:10:30

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140373310584672
- M:video_aido:cmdline(in:/;out:/) 140373311027088
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52347

LFv-sim

error

2020-12-02 11:27:34+00:00

2020-12-02 11:31:10+00:00

0:03:36

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139623881884000
- M:video_aido:cmdline(in:/;out:/) 139623881913248
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52342

LFv-sim

error

2020-12-02 11:26:29+00:00

2020-12-02 11:39:06+00:00

0:12:37

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140415789312224
- M:video_aido:cmdline(in:/;out:/) 140415789311408
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52341

LFv-sim

error

2020-12-02 11:26:21+00:00

2020-12-02 11:29:26+00:00

0:03:05

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140620435271840
- M:video_aido:cmdline(in:/;out:/) 140620432981584
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52340

LFv-sim

error

2020-12-02 11:26:04+00:00

2020-12-02 11:31:39+00:00

0:05:35

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139682167421632
- M:video_aido:cmdline(in:/;out:/) 139682167359904
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

41733

LFv-sim

success

2020-11-08 13:17:25+00:00

2020-11-08 13:27:06+00:00

0:09:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

38193

LFv-sim

error

2020-11-04 00:39:20+00:00

2020-11-04 00:39:58+00:00

0:00:38

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.49-py3.8.egg/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission9313/LFv-sim-mont05-227ea22a5fff-1-job38193-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

38191

LFv-sim

error

2020-11-04 00:38:50+00:00

2020-11-04 00:39:29+00:00

0:00:39

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.49-py3.8.egg/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission9313/LFv-sim-mont02-80325a328f54-1-job38191-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

38190

LFv-sim

error

2020-11-04 00:38:34+00:00

2020-11-04 00:39:10+00:00

0:00:36

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.49-py3.8.egg/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission9313/LFv-sim-mont04-e828c68b6a88-1-job38190-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36331

LFv-sim

error

2020-11-02 04:29:33+00:00

2020-11-02 04:30:15+00:00

0:00:42

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9313/LFv-sim-Sandy2-sandy-1-job36331-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36329

LFv-sim

success

2020-11-02 04:28:54+00:00

2020-11-02 04:40:08+00:00

0:11:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36327

LFv-sim

error

2020-11-02 04:28:36+00:00

2020-11-02 04:29:24+00:00

0:00:48

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9313/LFv-sim-Sandy1-sandy-1-job36327-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35764

LFv-sim

success

2020-11-01 04:08:54+00:00

2020-11-01 04:10:00+00:00

0:01:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35762

LFv-sim

success

2020-11-01 04:08:23+00:00

2020-11-01 04:09:26+00:00

0:01:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35366

LFv-sim

error

2020-10-31 02:45:11+00:00

2020-10-31 03:08:14+00:00

0:23:03

The result file is n [...]

The result file is not found in working dir /tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9313/LFv-sim-reg03-0c28c9d61367-1-job35366:

File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9313/LFv-sim-reg03-0c28c9d61367-1-job35366/challenge-results/challenge_results.yaml' does not exist.

This usually means that the evaluator did not finish and some times that there was an import error.
Check the evaluator log to see what happened.

List of all files:

 -/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9313/LFv-sim-reg03-0c28c9d61367-1-job35366/docker-compose.original.yaml
-/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9313/LFv-sim-reg03-0c28c9d61367-1-job35366/docker-compose.yaml
-/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9313/LFv-sim-reg03-0c28c9d61367-1-job35366/logs/challenges-runner/stdout.log
-/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9313/LFv-sim-reg03-0c28c9d61367-1-job35366/logs/challenges-runner/stderr.log

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

34999

LFv-sim

success

2020-10-29 03:33:41+00:00

2020-10-29 03:57:27+00:00

0:23:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

34661

LFv-sim

success

2020-10-25 19:24:04+00:00

2020-10-25 19:49:48+00:00

0:25:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

34660

LFv-sim

success

2020-10-25 19:23:37+00:00

2020-10-25 19:49:35+00:00

0:25:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible