Duckietown Challenges Home Challenges Submissions

Submission 10923

Submission10923
Competingyes
Challengeaido5-LF-sim-validation
UserYishu Malhotra 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 57433
Next
User labelexercise_ros_template
Admin priority50
Blessingn/a
User priority50

57433

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
57433LFv-simsuccessyes0:29:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9920887036845083
survival_time_median50.67499999999926
deviation-center-line_median0.7677531077878685
in-drivable-lane_median39.29999999999944


other stats
agent_compute-ego0_max0.042444355567140823
agent_compute-ego0_mean0.026972779974671436
agent_compute-ego0_median0.026307930768960545
agent_compute-ego0_min0.012830902793623825
complete-iteration_max0.2196739871720761
complete-iteration_mean0.1893636112075082
complete-iteration_median0.1833453240280043
complete-iteration_min0.1710898096019481
deviation-center-line_max1.7171693554171148
deviation-center-line_mean0.9525145438728906
deviation-center-line_min0.5573826044987101
deviation-heading_max6.535536316517429
deviation-heading_mean4.556390357907468
deviation-heading_median5.053790081833379
deviation-heading_min1.5824449514456829
driven_any_max10.192142949405705
driven_any_mean7.444785961540374
driven_any_median7.766810759457304
driven_any_min4.053379377841182
driven_lanedir_consec_max3.269765112970738
driven_lanedir_consec_mean2.23603235802077
driven_lanedir_consec_min1.6901869117433257
driven_lanedir_max3.269765112970738
driven_lanedir_mean2.237354864256484
driven_lanedir_median1.9920887036845083
driven_lanedir_min1.6954769366861808
get_duckie_state_max1.3661244610750978e-06
get_duckie_state_mean1.2792567831094468e-06
get_duckie_state_median1.3010432102605526e-06
get_duckie_state_min1.1488162508415838e-06
get_robot_state_max0.003933031731622326
get_robot_state_mean0.00372345758230192
get_robot_state_median0.0037336550587377983
get_robot_state_min0.0034934884801097557
get_state_dump_max0.004797686802664382
get_state_dump_mean0.004688165532241392
get_state_dump_median0.0047347851345519885
get_state_dump_min0.004485405057197208
get_ui_image_max0.03587351732207957
get_ui_image_mean0.030538553266033643
get_ui_image_median0.02947244993554464
get_ui_image_min0.02733579587096571
in-drivable-lane_max50.44999999999872
in-drivable-lane_mean33.48749999999941
in-drivable-lane_min4.900000000000047
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.192142949405705, "get_ui_image": 0.0285481098391035, "step_physics": 0.10345890956754789, "survival_time": 59.99999999999873, "driven_lanedir": 1.9720492384248456, "get_state_dump": 0.004722920980779059, "get_robot_state": 0.0036939470893040385, "sim_render-ego0": 0.0038974146164029366, "get_duckie_state": 1.2945275223324638e-06, "in-drivable-lane": 50.44999999999872, "deviation-heading": 1.5824449514456829, "agent_compute-ego0": 0.012966474625192813, "complete-iteration": 0.1710898096019481, "set_robot_commands": 0.0022136200278327425, "deviation-center-line": 0.5573826044987101, "driven_lanedir_consec": 1.9720492384248456, "sim_compute_sim_state": 0.009533191699965807, "sim_compute_performance-ego0": 0.001964488096975665}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.299178197774395, "get_ui_image": 0.03587351732207957, "step_physics": 0.11569454992450952, "survival_time": 41.34999999999979, "driven_lanedir": 1.6954769366861808, "get_state_dump": 0.004746649288324918, "get_robot_state": 0.0037733630281715576, "sim_render-ego0": 0.00401083887487218, "get_duckie_state": 1.3075588981886416e-06, "in-drivable-lane": 29.94999999999985, "deviation-heading": 5.659010625331443, "agent_compute-ego0": 0.03964938691272828, "complete-iteration": 0.2196739871720761, "set_robot_commands": 0.002355572682071999, "deviation-center-line": 0.8201586437226343, "driven_lanedir_consec": 1.6901869117433257, "sim_compute_sim_state": 0.011378112622505224, "sim_compute_performance-ego0": 0.002096526576700994}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.234443321140212, "get_ui_image": 0.030396790031985775, "step_physics": 0.10372124861718018, "survival_time": 59.99999999999873, "driven_lanedir": 2.0121281689441712, "get_state_dump": 0.004485405057197208, "get_robot_state": 0.0034934884801097557, "sim_render-ego0": 0.0038307501215621097, "get_duckie_state": 1.1488162508415838e-06, "in-drivable-lane": 48.649999999999025, "deviation-heading": 4.448569538335316, "agent_compute-ego0": 0.012830902793623825, "complete-iteration": 0.1726630865584603, "set_robot_commands": 0.0021699798990546613, "deviation-center-line": 0.7153475718531029, "driven_lanedir_consec": 2.0121281689441712, "sim_compute_sim_state": 0.009751457655856652, "sim_compute_performance-ego0": 0.001900696536087176}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.053379377841182, "get_ui_image": 0.02733579587096571, "step_physics": 0.10048459933928548, "survival_time": 25.500000000000227, "driven_lanedir": 3.269765112970738, "get_state_dump": 0.004797686802664382, "get_robot_state": 0.003933031731622326, "sim_render-ego0": 0.004025923062677253, "get_duckie_state": 1.3661244610750978e-06, "in-drivable-lane": 4.900000000000047, "deviation-heading": 6.535536316517429, "agent_compute-ego0": 0.042444355567140823, "complete-iteration": 0.19402756149754832, "set_robot_commands": 0.002395976546225949, "deviation-center-line": 1.7171693554171148, "driven_lanedir_consec": 3.269765112970738, "sim_compute_sim_state": 0.0063963986189631335, "sim_compute_performance-ego0": 0.002111698083448317}}
set_robot_commands_max0.002395976546225949
set_robot_commands_mean0.002283787288796338
set_robot_commands_median0.0022845963549523707
set_robot_commands_min0.0021699798990546613
sim_compute_performance-ego0_max0.002111698083448317
sim_compute_performance-ego0_mean0.0020183523233030377
sim_compute_performance-ego0_median0.0020305073368383293
sim_compute_performance-ego0_min0.001900696536087176
sim_compute_sim_state_max0.011378112622505224
sim_compute_sim_state_mean0.009264790149322704
sim_compute_sim_state_median0.00964232467791123
sim_compute_sim_state_min0.0063963986189631335
sim_render-ego0_max0.004025923062677253
sim_render-ego0_mean0.00394123166887862
sim_render-ego0_median0.003954126745637558
sim_render-ego0_min0.0038307501215621097
simulation-passed1
step_physics_max0.11569454992450952
step_physics_mean0.10583982686213075
step_physics_median0.10359007909236403
step_physics_min0.10048459933928548
survival_time_max59.99999999999873
survival_time_mean46.712499999999366
survival_time_min25.500000000000227
No reset possible
51187LFv-simerrorno0:07:47
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140395578873504
- M:video_aido:cmdline(in:/;out:/) 140395578875232
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
40599LFv-simsuccessno0:08:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
39896LFv-simsuccessno0:08:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
39895LFv-simsuccessno0:10:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
39888LFv-simsuccessno0:08:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
38478LFv-simsuccessno0:07:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
38477LFv-simsuccessno0:10:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible