Duckietown Challenges Home Challenges Submissions

Submission 10064

Submission10064
Competingyes
Challengeaido5-LF-sim-validation
UserRaphael Jean
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 57985
Next
User labelsim-exercise-1
Admin priority50
Blessingn/a
User priority50

57985

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
57985LFv-simsuccessyes0:23:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.812300477117798
survival_time_median41.674999999999464
deviation-center-line_median1.820378587236736
in-drivable-lane_median7.850000000000058


other stats
agent_compute-ego0_max0.013105820386837693
agent_compute-ego0_mean0.012543818020643124
agent_compute-ego0_median0.0124953104772534
agent_compute-ego0_min0.012078830741228012
complete-iteration_max0.20499926245110667
complete-iteration_mean0.1815378480614808
complete-iteration_median0.18340604509739555
complete-iteration_min0.1543400396000255
deviation-center-line_max3.60551430463296
deviation-center-line_mean1.824318544097288
deviation-center-line_min0.05100269728271976
deviation-heading_max11.311647013525787
deviation-heading_mean6.186466188340997
deviation-heading_median6.543072607313515
deviation-heading_min0.34807252521117094
driven_any_max11.975153096034898
driven_any_mean6.591748017837105
driven_any_median6.269543787958353
driven_any_min1.852751399396817
driven_lanedir_consec_max7.762489669266367
driven_lanedir_consec_mean4.5150075085819195
driven_lanedir_consec_min0.6729394108257176
driven_lanedir_max7.762489669266367
driven_lanedir_mean4.5150075085819195
driven_lanedir_median4.812300477117798
driven_lanedir_min0.6729394108257176
get_duckie_state_max2.7093020352450283e-06
get_duckie_state_mean2.2672021118079295e-06
get_duckie_state_median2.1617594727437086e-06
get_duckie_state_min2.035987466499271e-06
get_robot_state_max0.0037273168563842778
get_robot_state_mean0.003635620255288964
get_robot_state_median0.003628216483279993
get_robot_state_min0.0035587311982115937
get_state_dump_max0.004921099152227845
get_state_dump_mean0.0046832120172188105
get_state_dump_median0.004647775370059849
get_state_dump_min0.004516198176527699
get_ui_image_max0.034186428730732
get_ui_image_mean0.029886698014256523
get_ui_image_median0.030005920439960903
get_ui_image_min0.02534852244637229
in-drivable-lane_max26.200000000000088
in-drivable-lane_mean11.412500000000064
in-drivable-lane_min3.7500000000000537
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.975153096034898, "get_ui_image": 0.027455630052298133, "step_physics": 0.10087271713396592, "survival_time": 59.99999999999873, "driven_lanedir": 6.773794273086472, "get_state_dump": 0.004534865100616023, "get_robot_state": 0.0035755679966706618, "sim_render-ego0": 0.003720063948809952, "get_duckie_state": 2.1191659716146375e-06, "in-drivable-lane": 26.200000000000088, "deviation-heading": 7.593442012452684, "agent_compute-ego0": 0.012078830741228012, "complete-iteration": 0.1658004606693214, "set_robot_commands": 0.0020948302041084743, "deviation-center-line": 2.083533551044011, "driven_lanedir_consec": 6.773794273086472, "sim_compute_sim_state": 0.00948434487469091, "sim_compute_performance-ego0": 0.0019022136008511176}, "LF-norm-zigzag-000-ego0": {"driven_any": 9.039388028787684, "get_ui_image": 0.034186428730732, "step_physics": 0.12517473878312568, "survival_time": 59.99999999999873, "driven_lanedir": 7.762489669266367, "get_state_dump": 0.004516198176527699, "get_robot_state": 0.0035587311982115937, "sim_render-ego0": 0.003783346909865253, "get_duckie_state": 2.035987466499271e-06, "in-drivable-lane": 7.950000000000113, "deviation-heading": 11.311647013525787, "agent_compute-ego0": 0.012407658995438576, "complete-iteration": 0.2010116295254697, "set_robot_commands": 0.0021264171917968547, "deviation-center-line": 3.60551430463296, "driven_lanedir_consec": 7.762489669266367, "sim_compute_sim_state": 0.013247272751909012, "sim_compute_performance-ego0": 0.001927962013327212}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.499699547129022, "get_ui_image": 0.03255621082762368, "step_physics": 0.13104805070110875, "survival_time": 23.350000000000197, "driven_lanedir": 2.850806681149125, "get_state_dump": 0.004760685639503675, "get_robot_state": 0.0037273168563842778, "sim_render-ego0": 0.003971319422762618, "get_duckie_state": 2.20435297387278e-06, "in-drivable-lane": 3.7500000000000537, "deviation-heading": 5.492703202174345, "agent_compute-ego0": 0.013105820386837693, "complete-iteration": 0.20499926245110667, "set_robot_commands": 0.0022550826398735372, "deviation-center-line": 1.557223623429461, "driven_lanedir_consec": 2.850806681149125, "sim_compute_sim_state": 0.011457603201906905, "sim_compute_performance-ego0": 0.002031089403690436}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.852751399396817, "get_ui_image": 0.02534852244637229, "step_physics": 0.09476170395359848, "survival_time": 9.850000000000003, "driven_lanedir": 0.6729394108257176, "get_state_dump": 0.004921099152227845, "get_robot_state": 0.003680864969889323, "sim_render-ego0": 0.0038473016083842575, "get_duckie_state": 2.7093020352450283e-06, "in-drivable-lane": 7.750000000000004, "deviation-heading": 0.34807252521117094, "agent_compute-ego0": 0.01258296195906822, "complete-iteration": 0.1543400396000255, "set_robot_commands": 0.0021934485194658993, "deviation-center-line": 0.05100269728271976, "driven_lanedir_consec": 0.6729394108257176, "sim_compute_sim_state": 0.004978565254596749, "sim_compute_performance-ego0": 0.001933679436192368}}
set_robot_commands_max0.0022550826398735372
set_robot_commands_mean0.0021674446388111916
set_robot_commands_median0.002159932855631377
set_robot_commands_min0.0020948302041084743
sim_compute_performance-ego0_max0.002031089403690436
sim_compute_performance-ego0_mean0.0019487361135152835
sim_compute_performance-ego0_median0.00193082072475979
sim_compute_performance-ego0_min0.0019022136008511176
sim_compute_sim_state_max0.013247272751909012
sim_compute_sim_state_mean0.009791946520775894
sim_compute_sim_state_median0.010470974038298908
sim_compute_sim_state_min0.004978565254596749
sim_render-ego0_max0.003971319422762618
sim_render-ego0_mean0.00383050797245552
sim_render-ego0_median0.0038153242591247552
sim_render-ego0_min0.003720063948809952
simulation-passed1
step_physics_max0.13104805070110875
step_physics_mean0.11296430264294972
step_physics_median0.1130237279585458
step_physics_min0.09476170395359848
survival_time_max59.99999999999873
survival_time_mean38.299999999999415
survival_time_min9.850000000000003
No reset possible
51901LFv-simerrorno0:07:14
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140036380992560
- M:video_aido:cmdline(in:/;out:/) 140036380907504
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
41516LFv-simsuccessno0:07:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
37171LFv-simsuccessno0:10:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
36599LFv-simsuccessno0:11:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
36598LFv-simsuccessno0:10:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible