Duckietown Challenges Home Challenges Submissions

Submission 10755

Submission10755
Competingyes
Challengeaido5-LF-sim-validation
UserFernanda Custodio Pereira do Carmo 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 57923
Next
User labelexercise_ros_template
Admin priority50
Blessingn/a
User priority50

57923

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
57923LFv-simsuccessyes0:19:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.004299591071301
survival_time_median36.82499999999939
deviation-center-line_median1.268573503335199
in-drivable-lane_median3.424999999999946


other stats
agent_compute-ego0_max0.01324020250879153
agent_compute-ego0_mean0.012721670393965047
agent_compute-ego0_median0.01279939878592384
agent_compute-ego0_min0.012047681495220992
complete-iteration_max0.2058152381819908
complete-iteration_mean0.17495149131271617
complete-iteration_median0.17087281246566455
complete-iteration_min0.15224510213754472
deviation-center-line_max3.7446252320244136
deviation-center-line_mean1.5968735674744667
deviation-center-line_min0.10572203120305523
deviation-heading_max7.360821794823155
deviation-heading_mean4.211990938218115
deviation-heading_median4.263549219038148
deviation-heading_min0.9600435199730092
driven_any_max10.56850929776584
driven_any_mean5.9891445054000405
driven_any_median6.372721517226856
driven_any_min0.6426256893806079
driven_lanedir_consec_max9.624011369376912
driven_lanedir_consec_mean4.4535961019866095
driven_lanedir_consec_min0.1817738564269238
driven_lanedir_max9.624011369376912
driven_lanedir_mean4.478914642539593
driven_lanedir_median4.054936672177268
driven_lanedir_min0.1817738564269238
get_duckie_state_max1.7529026257009133e-06
get_duckie_state_mean1.6356182003888682e-06
get_duckie_state_median1.6241391756798053e-06
get_duckie_state_min1.5412918244949497e-06
get_robot_state_max0.003928565065827
get_robot_state_mean0.0036932531665541655
get_robot_state_median0.0036550226549948673
get_robot_state_min0.0035344022903999275
get_state_dump_max0.004681795264759429
get_state_dump_mean0.004578373466199925
get_state_dump_median0.004613475513455846
get_state_dump_min0.004404747573128582
get_ui_image_max0.03489827387260668
get_ui_image_mean0.030214594896255657
get_ui_image_median0.02991726992938648
get_ui_image_min0.02612556585364298
in-drivable-lane_max24.949999999999378
in-drivable-lane_mean8.462499999999824
in-drivable-lane_min2.050000000000029
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4044508192512635, "get_ui_image": 0.0267147452291781, "step_physics": 0.08864708625487168, "survival_time": 13.65000000000006, "driven_lanedir": 2.1251052729497513, "get_state_dump": 0.004404747573128582, "get_robot_state": 0.0035344022903999275, "sim_render-ego0": 0.003680391903341251, "get_duckie_state": 1.5888771001439896e-06, "in-drivable-lane": 2.050000000000029, "deviation-heading": 1.5710622141345574, "agent_compute-ego0": 0.012047681495220992, "complete-iteration": 0.15224510213754472, "set_robot_commands": 0.002118060188571902, "deviation-center-line": 0.540172773368313, "driven_lanedir_consec": 2.1251052729497513, "sim_compute_sim_state": 0.009084510977250815, "sim_compute_performance-ego0": 0.0019351992293866012}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6426256893806079, "get_ui_image": 0.03489827387260668, "step_physics": 0.13083840620638143, "survival_time": 4.899999999999991, "driven_lanedir": 0.1817738564269238, "get_state_dump": 0.004666617422392874, "get_robot_state": 0.0036241695134326666, "sim_render-ego0": 0.003970871068010426, "get_duckie_state": 1.5412918244949497e-06, "in-drivable-lane": 3.1999999999999895, "deviation-heading": 0.9600435199730092, "agent_compute-ego0": 0.01324020250879153, "complete-iteration": 0.2058152381819908, "set_robot_commands": 0.002239499429259637, "deviation-center-line": 0.10572203120305523, "driven_lanedir_consec": 0.1817738564269238, "sim_compute_sim_state": 0.01022690474384963, "sim_compute_performance-ego0": 0.002026813198821713}, "LF-norm-techtrack-000-ego0": {"driven_any": 10.56850929776584, "get_ui_image": 0.03311979462959486, "step_physics": 0.11043372797430008, "survival_time": 59.99999999999873, "driven_lanedir": 5.984768071404785, "get_state_dump": 0.004681795264759429, "get_robot_state": 0.003928565065827, "sim_render-ego0": 0.0040735980056902455, "get_duckie_state": 1.7529026257009133e-06, "in-drivable-lane": 24.949999999999378, "deviation-heading": 6.956036223941739, "agent_compute-ego0": 0.013237626228999535, "complete-iteration": 0.18624597624080763, "set_robot_commands": 0.002379058104172833, "deviation-center-line": 1.996974233302085, "driven_lanedir_consec": 5.88349390919285, "sim_compute_sim_state": 0.012168591862217176, "sim_compute_performance-ego0": 0.002135753433075078}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.34099221520245, "get_ui_image": 0.02612556585364298, "step_physics": 0.09448612202811896, "survival_time": 59.99999999999873, "driven_lanedir": 9.624011369376912, "get_state_dump": 0.0045603336045188176, "get_robot_state": 0.003685875796557069, "sim_render-ego0": 0.003817736159554131, "get_duckie_state": 1.659401251215621e-06, "in-drivable-lane": 3.649999999999902, "deviation-heading": 7.360821794823155, "agent_compute-ego0": 0.012361171342848145, "complete-iteration": 0.15549964869052146, "set_robot_commands": 0.0022131124205831483, "deviation-center-line": 3.7446252320244136, "driven_lanedir_consec": 9.624011369376912, "sim_compute_sim_state": 0.0061788955993398245, "sim_compute_performance-ego0": 0.0019876289923522594}}
set_robot_commands_max0.002379058104172833
set_robot_commands_mean0.0022374325356468803
set_robot_commands_median0.002226305924921393
set_robot_commands_min0.002118060188571902
sim_compute_performance-ego0_max0.002135753433075078
sim_compute_performance-ego0_mean0.0020213487134089127
sim_compute_performance-ego0_median0.0020072210955869862
sim_compute_performance-ego0_min0.0019351992293866012
sim_compute_sim_state_max0.012168591862217176
sim_compute_sim_state_mean0.00941472579566436
sim_compute_sim_state_median0.009655707860550224
sim_compute_sim_state_min0.0061788955993398245
sim_render-ego0_max0.0040735980056902455
sim_render-ego0_mean0.0038856492841490135
sim_render-ego0_median0.0038943036137822785
sim_render-ego0_min0.003680391903341251
simulation-passed1
step_physics_max0.13083840620638143
step_physics_mean0.10610133561591804
step_physics_median0.10245992500120953
step_physics_min0.08864708625487168
survival_time_max59.99999999999873
survival_time_mean34.63749999999938
survival_time_min4.899999999999991
No reset possible
51739LFv-simerrorno0:08:03
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140427396113504
- M:video_aido:cmdline(in:/;out:/) 140427396113360
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
41006LFv-simsuccessno0:08:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
37108LFv-simsuccessno0:10:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible