Submission 11412

Submission

11412

Competing

yes

Challenge

aido5-LF-sim-validation

User

Frank (Chude) Qian 🇨🇦

Date submitted

2020-11-15 03:13:47+00:00

Last status update

2021-12-04 20:52:43+00:00

Complete

complete

Details

Evaluation is complete.

Sisters

Result

💚

Jobs

LFv-sim: 54658

User label

challenge-aido_LF-baseline-behavior-cloning

Admin priority

Blessing

n/a

User priority

54658

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID

step

status

up to date

date started

date completed

duration

message

54658

LFv-sim

success

yes

2020-12-03 04:12:09+00:00

2020-12-03 04:44:08+00:00

0:31:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	11.194408739242675
survival_time_median	59.99999999999873
deviation-center-line_median	2.9177291847287825
in-drivable-lane_median	7.624999999999981

other stats

agent_compute-ego0_max	0.04422148320200441
agent_compute-ego0_mean	0.04377818428503984
agent_compute-ego0_median	0.04406439917166373
agent_compute-ego0_min	0.04276245559482749
complete-iteration_max	0.2523700121121529
complete-iteration_mean	0.22031200240244692
complete-iteration_median	0.21556538030765737
complete-iteration_min	0.19774723688232015
deviation-center-line_max	3.5854841634205568
deviation-center-line_mean	2.708803920559169
deviation-center-line_min	1.414273149358554
deviation-heading_max	16.246845587528156
deviation-heading_mean	11.83874705467808
deviation-heading_median	11.715311080414748
deviation-heading_min	7.677520470354664
driven_any_max	14.590331279396567
driven_any_mean	12.544965281069052
driven_any_median	14.589920705145063
driven_any_min	6.409688434589515
driven_lanedir_consec_max	14.273203992920322
driven_lanedir_consec_mean	10.241563493624824
driven_lanedir_consec_min	4.3042325030936235
driven_lanedir_max	14.273203992920322
driven_lanedir_mean	10.241563493624824
driven_lanedir_median	11.194408739242675
driven_lanedir_min	4.3042325030936235
get_duckie_state_max	1.33105459856451e-06
get_duckie_state_mean	1.2243108682228462e-06
get_duckie_state_median	1.21275590447502e-06
get_duckie_state_min	1.1406770653768344e-06
get_robot_state_max	0.003699936140189063
get_robot_state_mean	0.003645557484117883
get_robot_state_median	0.0036485533630917417
get_robot_state_min	0.0035851870700989888
get_state_dump_max	0.004697566425472771
get_state_dump_mean	0.004648693165660717
get_state_dump_median	0.004653084585807604
get_state_dump_min	0.004591037065554888
get_ui_image_max	0.03480329487349961
get_ui_image_mean	0.03018239020309777
get_ui_image_median	0.029965382134487583
get_ui_image_min	0.025995501669916286
in-drivable-lane_max	12.449999999999685
in-drivable-lane_mean	7.012499999999914
in-drivable-lane_min	0.350000000000005
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 14.590331279396567, "get_ui_image": 0.02805535898518304, "step_physics": 0.09910674118975817, "survival_time": 59.99999999999873, "driven_lanedir": 14.273203992920322, "get_state_dump": 0.004681902265270783, "get_robot_state": 0.003679314620488887, "sim_render-ego0": 0.003916606021661941, "get_duckie_state": 1.33105459856451e-06, "in-drivable-lane": 0.350000000000005, "deviation-heading": 7.786808909748183, "agent_compute-ego0": 0.0441582842135211, "complete-iteration": 0.19774723688232015, "set_robot_commands": 0.002336901490833241, "deviation-center-line": 2.485091425613998, "driven_lanedir_consec": 14.273203992920322, "sim_compute_sim_state": 0.0096745437428318, "sim_compute_performance-ego0": 0.0020386700229184217}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.409688434589515, "get_ui_image": 0.03480329487349961, "step_physics": 0.14595438971187605, "survival_time": 27.250000000000252, "driven_lanedir": 4.3042325030936235, "get_state_dump": 0.004591037065554888, "get_robot_state": 0.0035851870700989888, "sim_render-ego0": 0.0037703784830840953, "get_duckie_state": 1.2230960440723015e-06, "in-drivable-lane": 7.350000000000075, "deviation-heading": 7.677520470354664, "agent_compute-ego0": 0.04397051412980635, "complete-iteration": 0.2523700121121529, "set_robot_commands": 0.002187349857428135, "deviation-center-line": 1.414273149358554, "driven_lanedir_consec": 4.3042325030936235, "sim_compute_sim_state": 0.011430191906380564, "sim_compute_performance-ego0": 0.0019809156110435176}, "LF-norm-techtrack-000-ego0": {"driven_any": 14.590023754066548, "get_ui_image": 0.03187540528379213, "step_physics": 0.12552357672850953, "survival_time": 59.99999999999873, "driven_lanedir": 11.69228957913841, "get_state_dump": 0.004697566425472771, "get_robot_state": 0.0036177921056945953, "sim_render-ego0": 0.00373442881708836, "get_duckie_state": 1.1406770653768344e-06, "in-drivable-lane": 7.899999999999888, "deviation-heading": 16.246845587528156, "agent_compute-ego0": 0.04422148320200441, "complete-iteration": 0.22989472243112888, "set_robot_commands": 0.002187165888421839, "deviation-center-line": 3.350366943843567, "driven_lanedir_consec": 11.69228957913841, "sim_compute_sim_state": 0.01197852520621091, "sim_compute_performance-ego0": 0.0019643749424460327}, "LF-norm-small_loop-000-ego0": {"driven_any": 14.58981765622358, "get_ui_image": 0.025995501669916286, "step_physics": 0.10985429876551442, "survival_time": 59.99999999999873, "driven_lanedir": 10.696527899346938, "get_state_dump": 0.004624266906344424, "get_robot_state": 0.003699936140189063, "sim_render-ego0": 0.0037690874539644498, "get_duckie_state": 1.2024157648777389e-06, "in-drivable-lane": 12.449999999999685, "deviation-heading": 15.643813251081312, "agent_compute-ego0": 0.04276245559482749, "complete-iteration": 0.2012360381841858, "set_robot_commands": 0.002269566803550244, "deviation-center-line": 3.5854841634205568, "driven_lanedir_consec": 10.696527899346938, "sim_compute_sim_state": 0.006171250521987801, "sim_compute_performance-ego0": 0.001991344629775277}}
set_robot_commands_max	0.002336901490833241
set_robot_commands_mean	0.002245246010058365
set_robot_commands_median	0.0022284583304891894
set_robot_commands_min	0.002187165888421839
sim_compute_performance-ego0_max	0.0020386700229184217
sim_compute_performance-ego0_mean	0.0019938263015458124
sim_compute_performance-ego0_median	0.0019861301204093973
sim_compute_performance-ego0_min	0.0019643749424460327
sim_compute_sim_state_max	0.01197852520621091
sim_compute_sim_state_mean	0.00981362784435277
sim_compute_sim_state_median	0.010552367824606182
sim_compute_sim_state_min	0.006171250521987801
sim_render-ego0_max	0.003916606021661941
sim_render-ego0_mean	0.003797625193949711
sim_render-ego0_median	0.003769732968524273
sim_render-ego0_min	0.00373442881708836
simulation-passed	1
step_physics_max	0.14595438971187605
step_physics_mean	0.12010975159891454
step_physics_median	0.11768893774701196
step_physics_min	0.09910674118975817
survival_time_max	59.99999999999873
survival_time_mean	51.812499999999105
survival_time_min	27.250000000000252

No reset possible

54650

LFv-sim

success

yes

2020-12-03 04:11:05+00:00

2020-12-03 04:44:00+00:00

0:32:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

54632

LFv-sim

success

yes

2020-12-03 04:10:47+00:00

2020-12-03 04:41:00+00:00

0:30:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

54616

LFv-sim

success

yes

2020-12-03 04:08:48+00:00

2020-12-03 04:41:43+00:00

0:32:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

54612

LFv-sim

success

yes

2020-12-03 04:08:35+00:00

2020-12-03 04:41:37+00:00

0:33:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49954

LFv-sim

error

2020-12-02 06:46:28+00:00

2020-12-02 06:59:31+00:00

0:13:03

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140632173488448
- M:video_aido:cmdline(in:/;out:/) 140632173422384
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49808

LFv-sim

timeout

2020-12-02 06:27:42+00:00

2020-12-02 06:43:08+00:00

0:15:26

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49806

LFv-sim

error

2020-12-02 06:27:20+00:00

2020-12-02 06:39:27+00:00

0:12:07

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139878462102400
- M:video_aido:cmdline(in:/;out:/) 139878462052000
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49800

LFv-sim

error

2020-12-02 06:26:24+00:00

2020-12-02 06:34:22+00:00

0:07:58

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140237179068624
- M:video_aido:cmdline(in:/;out:/) 140237169473376
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49798

LFv-sim

error

2020-12-02 06:26:06+00:00

2020-12-02 06:36:19+00:00

0:10:13

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139643279708416
- M:video_aido:cmdline(in:/;out:/) 139643279589232
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49779

LFv-sim

error

2020-12-02 06:23:46+00:00

2020-12-02 06:35:10+00:00

0:11:24

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140225342670208
- M:video_aido:cmdline(in:/;out:/) 140225342693968
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42276

LFv-sim

success

2020-11-15 03:16:53+00:00

2020-11-15 03:24:30+00:00

0:07:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42273

LFv-sim

success

2020-11-15 03:16:07+00:00

2020-11-15 03:25:20+00:00

0:09:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42272

LFv-sim

host-error

2020-11-15 03:16:07+00:00

2020-11-15 03:16:29+00:00

0:00:22

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42271

LFv-sim

host-error

2020-11-15 03:15:27+00:00

2020-11-15 03:15:51+00:00

0:00:24

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42270

LFv-sim

success

2020-11-15 03:14:37+00:00

2020-11-15 03:24:25+00:00

0:09:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible