Submission 9337

Submission

9337

Competing

yes

Challenge

aido5-LF-sim-validation

User

Jerome Labonte 🇨🇦

Date submitted

2020-10-26 00:28:23+00:00

Last status update

2021-12-04 20:52:33+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

LFv-sim: 58160

User label

exercise_ros_template

Admin priority

Blessing

n/a

User priority

58160

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

58160

LFv-sim

success

yes

2020-12-03 21:57:30+00:00

2020-12-03 22:31:03+00:00

0:33:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	4.217483904163541
survival_time_median	59.99999999999873
deviation-center-line_median	3.3771582613434363
in-drivable-lane_median	7.299999999999741

other stats

agent_compute-ego0_max	0.013223976814975152
agent_compute-ego0_mean	0.012510125776765793
agent_compute-ego0_median	0.01257001816631901
agent_compute-ego0_min	0.01167648995944999
complete-iteration_max	0.20948529576921796
complete-iteration_mean	0.18891332785737816
complete-iteration_median	0.19305854951412257
complete-iteration_min	0.1600509166320496
deviation-center-line_max	4.14445121459823
deviation-center-line_mean	3.178080948372933
deviation-center-line_min	1.8135560562066295
deviation-heading_max	15.7903722073631
deviation-heading_mean	12.340353048546865
deviation-heading_median	12.600051824631915
deviation-heading_min	8.370936337560519
driven_any_max	11.220187908101686
driven_any_mean	9.463688833599406
driven_any_median	10.362834697274575
driven_any_min	5.908898031746789
driven_lanedir_consec_max	6.9542112924539214
driven_lanedir_consec_mean	4.4385644282679735
driven_lanedir_consec_min	2.3650786122908927
driven_lanedir_max	10.772588549188884
driven_lanedir_mean	8.405916495537213
driven_lanedir_median	9.05925011718411
driven_lanedir_min	4.73257719859175
get_duckie_state_max	1.4878828062999258e-06
get_duckie_state_mean	1.337288023530196e-06
get_duckie_state_median	1.3049099467179856e-06
get_duckie_state_min	1.2514493943848876e-06
get_robot_state_max	0.003904954678410793
get_robot_state_mean	0.003766542046846244
get_robot_state_median	0.0037314090800225786
get_robot_state_min	0.003698395348929025
get_state_dump_max	0.004964882090724974
get_state_dump_mean	0.004736464415750842
get_state_dump_median	0.004675742490007717
get_state_dump_min	0.004629490592262962
get_ui_image_max	0.03523459601235556
get_ui_image_mean	0.030940632687053778
get_ui_image_median	0.03090425990801072
get_ui_image_min	0.026719414919838123
in-drivable-lane_max	7.649999999999924
in-drivable-lane_mean	6.037499999999858
in-drivable-lane_min	1.900000000000027
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 10.879991576964525, "get_ui_image": 0.028441598869978043, "step_physics": 0.1116041902896268, "survival_time": 59.99999999999873, "driven_lanedir": 9.652177731989552, "get_state_dump": 0.004642653127792574, "get_robot_state": 0.0037364195427430063, "sim_render-ego0": 0.003813045010975656, "get_duckie_state": 1.2746758504672214e-06, "in-drivable-lane": 7.099999999999643, "deviation-heading": 13.489529806864546, "agent_compute-ego0": 0.012483461016322254, "complete-iteration": 0.17904628742545173, "set_robot_commands": 0.002278269379462529, "deviation-center-line": 3.384380878258017, "driven_lanedir_consec": 6.9542112924539214, "sim_compute_sim_state": 0.009929175182345706, "sim_compute_performance-ego0": 0.002025849813227848}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.908898031746789, "get_ui_image": 0.03523459601235556, "step_physics": 0.1338588184410042, "survival_time": 35.70000000000011, "driven_lanedir": 4.73257719859175, "get_state_dump": 0.004629490592262962, "get_robot_state": 0.003698395348929025, "sim_render-ego0": 0.003824658493895631, "get_duckie_state": 1.33514404296875e-06, "in-drivable-lane": 7.499999999999839, "deviation-heading": 8.370936337560519, "agent_compute-ego0": 0.012656575316315763, "complete-iteration": 0.20948529576921796, "set_robot_commands": 0.002217631239991088, "deviation-center-line": 1.8135560562066295, "driven_lanedir_consec": 2.3650786122908927, "sim_compute_sim_state": 0.0112584010704414, "sim_compute_performance-ego0": 0.002016869124832687}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.845677817584628, "get_ui_image": 0.0333669209460434, "step_physics": 0.13066363354507435, "survival_time": 59.99999999999873, "driven_lanedir": 8.46632250237867, "get_state_dump": 0.004964882090724974, "get_robot_state": 0.003904954678410793, "sim_render-ego0": 0.0040053662213556575, "get_duckie_state": 1.4878828062999258e-06, "in-drivable-lane": 7.649999999999924, "deviation-heading": 15.7903722073631, "agent_compute-ego0": 0.013223976814975152, "complete-iteration": 0.20707081160279336, "set_robot_commands": 0.0023703356765886825, "deviation-center-line": 4.14445121459823, "driven_lanedir_consec": 4.072102159687985, "sim_compute_sim_state": 0.012283909827048932, "sim_compute_performance-ego0": 0.0021831143607108617}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.220187908101686, "get_ui_image": 0.026719414919838123, "step_physics": 0.09880309875164302, "survival_time": 59.99999999999873, "driven_lanedir": 10.772588549188884, "get_state_dump": 0.004708831852222858, "get_robot_state": 0.0037263986173021505, "sim_render-ego0": 0.0037929846980391097, "get_duckie_state": 1.2514493943848876e-06, "in-drivable-lane": 1.900000000000027, "deviation-heading": 11.710573842399286, "agent_compute-ego0": 0.01167648995944999, "complete-iteration": 0.1600509166320496, "set_robot_commands": 0.0022286475449180125, "deviation-center-line": 3.3699356444288555, "driven_lanedir_consec": 4.362865648639097, "sim_compute_sim_state": 0.006299016477662657, "sim_compute_performance-ego0": 0.002007027053515381}}
set_robot_commands_max	0.0023703356765886825
set_robot_commands_mean	0.002273720960240078
set_robot_commands_median	0.0022534584621902707
set_robot_commands_min	0.002217631239991088
sim_compute_performance-ego0_max	0.0021831143607108617
sim_compute_performance-ego0_mean	0.0020582150880716944
sim_compute_performance-ego0_median	0.0020213594690302672
sim_compute_performance-ego0_min	0.002007027053515381
sim_compute_sim_state_max	0.012283909827048932
sim_compute_sim_state_mean	0.009942625639374671
sim_compute_sim_state_median	0.010593788126393552
sim_compute_sim_state_min	0.006299016477662657
sim_render-ego0_max	0.0040053662213556575
sim_render-ego0_mean	0.0038590136060665135
sim_render-ego0_median	0.003818851752435643
sim_render-ego0_min	0.0037929846980391097
simulation-passed	1
step_physics_max	0.1338588184410042
step_physics_mean	0.11873243525683708
step_physics_median	0.12113391191735058
step_physics_min	0.09880309875164302
survival_time_max	59.99999999999873
survival_time_mean	53.92499999999907
survival_time_min	35.70000000000011

No reset possible

52318

LFv-sim

error

2020-12-02 11:22:36+00:00

2020-12-02 11:31:37+00:00

0:09:01

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140685501581008
- M:video_aido:cmdline(in:/;out:/) 140685501568720
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52307

LFv-sim

error

2020-12-02 11:21:32+00:00

2020-12-02 11:31:03+00:00

0:09:31

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139625437628592
- M:video_aido:cmdline(in:/;out:/) 139625104954560
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52300

LFv-sim

error

2020-12-02 11:20:31+00:00

2020-12-02 11:30:10+00:00

0:09:39

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140442655431312
- M:video_aido:cmdline(in:/;out:/) 140442655094912
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52295

LFv-sim

error

2020-12-02 11:20:04+00:00

2020-12-02 11:29:05+00:00

0:09:01

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139635337796672
- M:video_aido:cmdline(in:/;out:/) 139635338021472
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52287

LFv-sim

error

2020-12-02 11:18:26+00:00

2020-12-02 11:24:10+00:00

0:05:44

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139867696617888
- M:video_aido:cmdline(in:/;out:/) 139867696671376
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

41699

LFv-sim

success

2020-11-08 12:30:14+00:00

2020-11-08 12:39:49+00:00

0:09:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

38306

LFv-sim

success

2020-11-04 01:52:35+00:00

2020-11-04 02:03:42+00:00

0:11:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

38304

LFv-sim

success

2020-11-04 01:51:58+00:00

2020-11-04 02:02:47+00:00

0:10:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

38156

LFv-sim

aborted

2020-11-04 00:32:18+00:00

2020-11-04 00:32:59+00:00

0:00:41

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner_daffy-6.0.49-py3.8.egg/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/media/sdb/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission9337/LFv-sim-mont01-6ef51bb8a9d6-1-job38156-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

38149

LFv-sim

aborted

2020-11-04 00:31:09+00:00

2020-11-04 00:43:01+00:00

0:11:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36295

LFv-sim

aborted

2020-11-02 04:14:47+00:00

2020-11-02 04:15:52+00:00

0:01:05

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9337/LFv-sim-Sandy2-sandy-1-job36295-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36294

LFv-sim

aborted

2020-11-02 04:14:26+00:00

2020-11-02 04:15:32+00:00

0:01:06

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9337/LFv-sim-Sandy1-sandy-1-job36294-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35733

LFv-sim

aborted

2020-11-01 04:01:51+00:00

2020-11-01 04:02:49+00:00

0:00:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35732

LFv-sim

aborted

2020-11-01 04:01:20+00:00

2020-11-01 04:02:09+00:00

0:00:49

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1063, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9337/LFv-sim-noname-sandy-1-job35732-a-wd/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35344

LFv-sim

aborted

2020-10-31 01:37:01+00:00

2020-10-31 01:59:24+00:00

0:22:23

The result file is n [...]

The result file is not found in working dir /tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9337/LFv-sim-reg03-0c28c9d61367-1-job35344:

File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9337/LFv-sim-reg03-0c28c9d61367-1-job35344/challenge-results/challenge_results.yaml' does not exist.

This usually means that the evaluator did not finish and some times that there was an import error.
Check the evaluator log to see what happened.

List of all files:

 -/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9337/LFv-sim-reg03-0c28c9d61367-1-job35344/docker-compose.original.yaml
-/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9337/LFv-sim-reg03-0c28c9d61367-1-job35344/docker-compose.yaml
-/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9337/LFv-sim-reg03-0c28c9d61367-1-job35344/logs/challenges-runner/stdout.log
-/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9337/LFv-sim-reg03-0c28c9d61367-1-job35344/logs/challenges-runner/stderr.log

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35343

LFv-sim

aborted

2020-10-31 01:36:24+00:00

2020-10-31 01:58:03+00:00

0:21:39

The result file is n [...]

The result file is not found in working dir /tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9337/LFv-sim-reg05-b2dee9d94ee0-1-job35343:

File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9337/LFv-sim-reg05-b2dee9d94ee0-1-job35343/challenge-results/challenge_results.yaml' does not exist.

This usually means that the evaluator did not finish and some times that there was an import error.
Check the evaluator log to see what happened.

List of all files:

 -/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9337/LFv-sim-reg05-b2dee9d94ee0-1-job35343/docker-compose.original.yaml
-/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9337/LFv-sim-reg05-b2dee9d94ee0-1-job35343/docker-compose.yaml
-/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9337/LFv-sim-reg05-b2dee9d94ee0-1-job35343/logs/challenges-runner/stdout.log
-/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9337/LFv-sim-reg05-b2dee9d94ee0-1-job35343/logs/challenges-runner/stderr.log

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

34979

LFv-sim

aborted

2020-10-29 02:30:37+00:00

2020-10-29 02:53:50+00:00

0:23:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

34706

LFv-sim

aborted

2020-10-26 00:29:35+00:00

2020-10-26 00:55:30+00:00

0:25:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

34705

LFv-sim

aborted

2020-10-26 00:28:58+00:00

2020-10-26 00:56:23+00:00

0:27:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible