Duckietown Challenges Home Challenges Submissions

Submission 10980

Submission10980
Competingyes
Challengeaido5-LF-sim-validation
UserFernanda Custodio Pereira do Carmo 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 57280
Next
User labelexercise_ros_template
Admin priority50
Blessingn/a
User priority50

57280

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
57280LFv-simsuccessyes0:21:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.654618826563127
survival_time_median38.04999999999978
deviation-center-line_median1.3962319994832029
in-drivable-lane_median12.874999999999645


other stats
agent_compute-ego0_max0.040835550439502544
agent_compute-ego0_mean0.03724212952602486
agent_compute-ego0_median0.038999604554279046
agent_compute-ego0_min0.030133758556038812
complete-iteration_max0.2139413762189116
complete-iteration_mean0.188871919143701
complete-iteration_median0.1839080326663501
complete-iteration_min0.17373023502319213
deviation-center-line_max3.700738831343764
deviation-center-line_mean1.8162354212065897
deviation-center-line_min0.7717388545161897
deviation-heading_max7.771859218641016
deviation-heading_mean3.893281181120575
deviation-heading_median3.1635858940602812
deviation-heading_min1.4740937177207212
driven_any_max11.330327077043858
driven_any_mean6.886646690918119
driven_any_median7.038027771084406
driven_any_min2.140204144459806
driven_lanedir_consec_max6.9609594130439305
driven_lanedir_consec_mean4.494687689535361
driven_lanedir_consec_min1.7085536919712574
driven_lanedir_max6.9609594130439305
driven_lanedir_mean4.494687689535361
driven_lanedir_median4.654618826563127
driven_lanedir_min1.7085536919712574
get_duckie_state_max1.3999398999369016e-06
get_duckie_state_mean1.2555295889408078e-06
get_duckie_state_median1.2594446208016549e-06
get_duckie_state_min1.10328921422302e-06
get_robot_state_max0.003816755089930551
get_robot_state_mean0.003560721255722305
get_robot_state_median0.003528258358966525
get_robot_state_min0.0033696132150256197
get_state_dump_max0.004844008635521729
get_state_dump_mean0.004582507808371453
get_state_dump_median0.004585177886873407
get_state_dump_min0.0043156668242172675
get_ui_image_max0.03213575108331225
get_ui_image_mean0.028897052380048836
get_ui_image_median0.029003871051030698
get_ui_image_min0.025444716334821708
in-drivable-lane_max21.24999999999946
in-drivable-lane_mean12.449999999999696
in-drivable-lane_min2.8000000000000353
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.812496026221973, "get_ui_image": 0.02634181940194332, "step_physics": 0.08481536534699527, "survival_time": 26.35000000000024, "driven_lanedir": 3.987910884151872, "get_state_dump": 0.00436451489275152, "get_robot_state": 0.003427836931113041, "sim_render-ego0": 0.003649142655459317, "get_duckie_state": 1.240860332142223e-06, "in-drivable-lane": 4.90000000000007, "deviation-heading": 1.6468742533219165, "agent_compute-ego0": 0.038178570342786385, "complete-iteration": 0.17451408369974655, "set_robot_commands": 0.0020791504419211187, "deviation-center-line": 0.7717388545161897, "driven_lanedir_consec": 3.987910884151872, "sim_compute_sim_state": 0.009726865725083784, "sim_compute_performance-ego0": 0.0018523452859936335}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.140204144459806, "get_ui_image": 0.03213575108331225, "step_physics": 0.11592874642808428, "survival_time": 12.30000000000004, "driven_lanedir": 1.7085536919712574, "get_state_dump": 0.0043156668242172675, "get_robot_state": 0.0033696132150256197, "sim_render-ego0": 0.0036053966414107967, "get_duckie_state": 1.10328921422302e-06, "in-drivable-lane": 2.8000000000000353, "deviation-heading": 1.4740937177207212, "agent_compute-ego0": 0.040835550439502544, "complete-iteration": 0.2139413762189116, "set_robot_commands": 0.0020203078806641612, "deviation-center-line": 0.8808883417988647, "driven_lanedir_consec": 1.7085536919712574, "sim_compute_sim_state": 0.009884600697258706, "sim_compute_performance-ego0": 0.001767895964958407}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.330327077043858, "get_ui_image": 0.03166592270011807, "step_physics": 0.10239240291414411, "survival_time": 59.99999999999873, "driven_lanedir": 6.9609594130439305, "get_state_dump": 0.004844008635521729, "get_robot_state": 0.003816755089930551, "sim_render-ego0": 0.004032407374703616, "get_duckie_state": 1.3999398999369016e-06, "in-drivable-lane": 21.24999999999946, "deviation-heading": 7.771859218641016, "agent_compute-ego0": 0.030133758556038812, "complete-iteration": 0.19330198163295367, "set_robot_commands": 0.0023272351162518987, "deviation-center-line": 3.700738831343764, "driven_lanedir_consec": 6.9609594130439305, "sim_compute_sim_state": 0.01193663917115884, "sim_compute_performance-ego0": 0.0020585923667355045}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.263559515946838, "get_ui_image": 0.025444716334821708, "step_physics": 0.08607032141053533, "survival_time": 49.74999999999931, "driven_lanedir": 5.321326768974384, "get_state_dump": 0.0048058408809952945, "get_robot_state": 0.0036286797868200094, "sim_render-ego0": 0.0038131463479804226, "get_duckie_state": 1.2780289094610864e-06, "in-drivable-lane": 20.84999999999922, "deviation-heading": 4.680297534798646, "agent_compute-ego0": 0.03982063876577171, "complete-iteration": 0.17373023502319213, "set_robot_commands": 0.0022577454287364303, "deviation-center-line": 1.911575657167541, "driven_lanedir_consec": 5.321326768974384, "sim_compute_sim_state": 0.005875195844106406, "sim_compute_performance-ego0": 0.00193348395297805}}
set_robot_commands_max0.0023272351162518987
set_robot_commands_mean0.0021711097168934023
set_robot_commands_median0.0021684479353287745
set_robot_commands_min0.0020203078806641612
sim_compute_performance-ego0_max0.0020585923667355045
sim_compute_performance-ego0_mean0.0019030793926663988
sim_compute_performance-ego0_median0.0018929146194858416
sim_compute_performance-ego0_min0.001767895964958407
sim_compute_sim_state_max0.01193663917115884
sim_compute_sim_state_mean0.009355825359401932
sim_compute_sim_state_median0.009805733211171244
sim_compute_sim_state_min0.005875195844106406
sim_render-ego0_max0.004032407374703616
sim_render-ego0_mean0.003775023254888538
sim_render-ego0_median0.00373114450171987
sim_render-ego0_min0.0036053966414107967
simulation-passed1
step_physics_max0.11592874642808428
step_physics_mean0.09730170902493974
step_physics_median0.09423136216233972
step_physics_min0.08481536534699527
survival_time_max59.99999999999873
survival_time_mean37.09999999999958
survival_time_min12.30000000000004
No reset possible
57278LFv-simsuccessyes0:17:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
57274LFv-simsuccessyes0:20:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
57263LFv-simsuccessyes0:14:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
51004LFv-simerrorno0:03:13
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139813833993664
- M:video_aido:cmdline(in:/;out:/) 139813833994000
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
50993LFv-simhost-errorno0:06:00
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
40517LFv-simsuccessno0:10:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
40514LFv-simsuccessno0:10:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
40502LFv-simsuccessno0:12:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
39782LFv-simsuccessno0:09:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
38591LFv-simsuccessno0:11:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
38590LFv-simsuccessno0:08:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible