Duckietown Challenges Home Challenges Submissions

Submission 10913

Submission10913
Competingyes
Challengeaido5-LF-sim-validation
UserFernanda Custodio Pereira do Carmo 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFv-sim: 57483
Next
User labelexercise_ros_template
Admin priority50
Blessingn/a
User priority50

57483

Click the images to see detailed statistics about the episode.

LF-norm-loop-000

LF-norm-small_loop-000

LF-norm-techtrack-000

LF-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
57483LFv-simsuccessyes0:15:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9090750312057103
survival_time_median18.300000000000125
deviation-center-line_median0.6468089846252046
in-drivable-lane_median10.550000000000114


other stats
agent_compute-ego0_max0.01386360239587436
agent_compute-ego0_mean0.012780074326792424
agent_compute-ego0_median0.012538285407929103
agent_compute-ego0_min0.012180124095437133
complete-iteration_max0.1908527196094554
complete-iteration_mean0.16840009229838693
complete-iteration_median0.16931166741840342
complete-iteration_min0.1441243147472855
deviation-center-line_max3.569359471311559
deviation-center-line_mean1.2528706937046483
deviation-center-line_min0.14850533425662624
deviation-heading_max4.152169522882272
deviation-heading_mean2.482239510729447
deviation-heading_median2.5175894505483587
deviation-heading_min0.7416096189387988
driven_any_max10.672741302590126
driven_any_mean4.812346499662047
driven_any_median3.083245769447386
driven_any_min2.4101531571632875
driven_lanedir_consec_max4.98536842056495
driven_lanedir_consec_mean2.3793237847603184
driven_lanedir_consec_min0.7137766560649027
driven_lanedir_max4.98536842056495
driven_lanedir_mean2.3793237847603184
driven_lanedir_median1.9090750312057103
driven_lanedir_min0.7137766560649027
get_duckie_state_max1.3189931069650958e-06
get_duckie_state_mean1.3003192440976307e-06
get_duckie_state_median1.3065832435402368e-06
get_duckie_state_min1.2691173823449531e-06
get_robot_state_max0.003894001739459802
get_robot_state_mean0.003648555521317189
get_robot_state_median0.0035875319290540977
get_robot_state_min0.00352515648770076
get_state_dump_max0.004963433544938735
get_state_dump_mean0.004567798290986049
get_state_dump_median0.004448976187239244
get_state_dump_min0.0044098072445269716
get_ui_image_max0.03517402756598688
get_ui_image_mean0.030084177211032855
get_ui_image_median0.03022815294383981
get_ui_image_min0.024706375390464917
in-drivable-lane_max31.399999999999448
in-drivable-lane_mean13.762499999999928
in-drivable-lane_min2.550000000000036
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4101531571632875, "get_ui_image": 0.027325702287077498, "step_physics": 0.09299731746162336, "survival_time": 14.500000000000073, "driven_lanedir": 2.0474437744812652, "get_state_dump": 0.0044098072445269716, "get_robot_state": 0.0036314000788423206, "sim_render-ego0": 0.0037005258999329663, "get_duckie_state": 1.3051573763188628e-06, "in-drivable-lane": 2.550000000000036, "deviation-heading": 1.5191218341244137, "agent_compute-ego0": 0.01237952914024956, "complete-iteration": 0.15792278243913682, "set_robot_commands": 0.002173300051607217, "deviation-center-line": 0.5934803500521798, "driven_lanedir_consec": 2.0474437744812652, "sim_compute_sim_state": 0.009296654016291563, "sim_compute_performance-ego0": 0.001928658010214055}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.1324257699189664, "get_ui_image": 0.03517402756598688, "step_physics": 0.11588731632437756, "survival_time": 18.55000000000013, "driven_lanedir": 1.7707062879301556, "get_state_dump": 0.004479165359209942, "get_robot_state": 0.00352515648770076, "sim_render-ego0": 0.003813999955372144, "get_duckie_state": 1.3189931069650958e-06, "in-drivable-lane": 7.600000000000097, "deviation-heading": 3.5160570669723032, "agent_compute-ego0": 0.012697041675608645, "complete-iteration": 0.1908527196094554, "set_robot_commands": 0.002086234989986625, "deviation-center-line": 0.7001376191982295, "driven_lanedir_consec": 1.7707062879301556, "sim_compute_sim_state": 0.011207660039265953, "sim_compute_performance-ego0": 0.0019024822019761609}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.0340657689758057, "get_ui_image": 0.033130603600602125, "step_physics": 0.10599234617876084, "survival_time": 18.05000000000012, "driven_lanedir": 0.7137766560649027, "get_state_dump": 0.004963433544938735, "get_robot_state": 0.003894001739459802, "sim_render-ego0": 0.004092778290174284, "get_duckie_state": 1.3080091107616108e-06, "in-drivable-lane": 13.50000000000013, "deviation-heading": 0.7416096189387988, "agent_compute-ego0": 0.01386360239587436, "complete-iteration": 0.18070055239767, "set_robot_commands": 0.0022882539264404973, "deviation-center-line": 0.14850533425662624, "driven_lanedir_consec": 0.7137766560649027, "sim_compute_sim_state": 0.010344262939790336, "sim_compute_performance-ego0": 0.0020474452340141845}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.672741302590126, "get_ui_image": 0.024706375390464917, "step_physics": 0.08565049723324232, "survival_time": 59.99999999999873, "driven_lanedir": 4.98536842056495, "get_state_dump": 0.004418787015268546, "get_robot_state": 0.0035436637792658748, "sim_render-ego0": 0.003685343176200924, "get_duckie_state": 1.2691173823449531e-06, "in-drivable-lane": 31.399999999999448, "deviation-heading": 4.152169522882272, "agent_compute-ego0": 0.012180124095437133, "complete-iteration": 0.1441243147472855, "set_robot_commands": 0.0021372079650726445, "deviation-center-line": 3.569359471311559, "driven_lanedir_consec": 4.98536842056495, "sim_compute_sim_state": 0.00584047025288273, "sim_compute_performance-ego0": 0.001885999152305025}}
set_robot_commands_max0.0022882539264404973
set_robot_commands_mean0.002171249233276746
set_robot_commands_median0.002155254008339931
set_robot_commands_min0.002086234989986625
sim_compute_performance-ego0_max0.0020474452340141845
sim_compute_performance-ego0_mean0.0019411461496273564
sim_compute_performance-ego0_median0.001915570106095108
sim_compute_performance-ego0_min0.001885999152305025
sim_compute_sim_state_max0.011207660039265953
sim_compute_sim_state_mean0.009172261812057644
sim_compute_sim_state_median0.00982045847804095
sim_compute_sim_state_min0.00584047025288273
sim_render-ego0_max0.004092778290174284
sim_render-ego0_mean0.00382316183042008
sim_render-ego0_median0.0037572629276525554
sim_render-ego0_min0.003685343176200924
simulation-passed1
step_physics_max0.11588731632437756
step_physics_mean0.10013186929950102
step_physics_median0.0994948318201921
step_physics_min0.08565049723324232
survival_time_max59.99999999999873
survival_time_mean27.774999999999764
survival_time_min14.500000000000073
No reset possible
51269LFv-simerrorno0:04:46
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140239780605472
- M:video_aido:cmdline(in:/;out:/) 140239849432736
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
51237LFv-simerrorno0:05:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139783757673376
- M:video_aido:cmdline(in:/;out:/) 139783792721200
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
40617LFv-simsuccessno0:08:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
40616LFv-simsuccessno0:09:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
39906LFv-simsuccessno0:11:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
39905LFv-simsuccessno0:09:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
38429LFv-simsuccessno0:09:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
38428LFv-simsuccessno0:09:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible