Duckietown Challenges Home Challenges Submissions

Submission 12564

Submission12564
Competingyes
Challengeaido5-LFV-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVv-sim: 53468
Next
User labelstraight
Admin priority50
Blessingn/a
User priority50

53468

Click the images to see detailed statistics about the episode.

LFV-norm-loop-000

LFV-norm-small_loop-000

LFV-norm-techtrack-000

LFV-norm-zigzag-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
53468LFVv-simsuccessyes0:19:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6052853975330239
survival_time_median10.400000000000013
deviation-center-line_median0.33068119559683
in-drivable-lane_median6.4250000000000185


other stats
agent_compute-ego0_max0.010610285842526716
agent_compute-ego0_mean0.010270716015809448
agent_compute-ego0_median0.01025371871287038
agent_compute-ego0_min0.009965140794970325
agent_compute-npc0_max0.02601321999515806
agent_compute-npc0_mean0.022136278053042864
agent_compute-npc0_median0.021180621662146425
agent_compute-npc0_min0.02017064889272054
agent_compute-npc1_max0.04805171366819402
agent_compute-npc1_mean0.04314244867069947
agent_compute-npc1_median0.0473838428716285
agent_compute-npc1_min0.033991789472275886
agent_compute-npc2_max0.04422519718412186
agent_compute-npc2_mean0.037355136219048464
agent_compute-npc2_median0.03455660638120985
agent_compute-npc2_min0.03328360509181368
agent_compute-npc3_max0.04637265997710905
agent_compute-npc3_mean0.040773966538002755
agent_compute-npc3_median0.040773966538002755
agent_compute-npc3_min0.03517527309889646
complete-iteration_max1.123717958165198
complete-iteration_mean0.8082934591637303
complete-iteration_median0.9050270991080268
complete-iteration_min0.2994016802736691
deviation-center-line_max0.3928686233240577
deviation-center-line_mean0.30090564831821964
deviation-center-line_min0.14939157875516085
deviation-heading_max2.4882932462564837
deviation-heading_mean1.2598791665337652
deviation-heading_median0.9819032459436928
deviation-heading_min0.5874169279911909
driven_any_max2.5526814329726717
driven_any_mean1.6505206590139387
driven_any_median1.5456861375242053
driven_any_min0.958028928034673
driven_lanedir_consec_max0.7818318353273331
driven_lanedir_consec_mean0.6206463219842938
driven_lanedir_consec_min0.4901826575437944
driven_lanedir_max0.7818318353273331
driven_lanedir_mean0.6206463219842938
driven_lanedir_median0.6052853975330239
driven_lanedir_min0.4901826575437944
get_duckie_state_max1.3788950811956346e-06
get_duckie_state_mean1.2774125270267138e-06
get_duckie_state_median1.274120724656869e-06
get_duckie_state_min1.182513577597482e-06
get_robot_state_max0.017880987184645546
get_robot_state_mean0.014004831984379068
get_robot_state_median0.015498110821620066
get_robot_state_min0.007142119109630585
get_state_dump_max0.011065933999698328
get_state_dump_mean0.009281904833620774
get_state_dump_median0.010015358006528507
get_state_dump_min0.006030969321727753
get_ui_image_max0.05780784457111647
get_ui_image_mean0.04658590775566894
get_ui_image_median0.048016784749685806
get_ui_image_min0.032502216952187676
in-drivable-lane_max12.000000000000108
in-drivable-lane_mean6.6125000000000345
in-drivable-lane_min1.5999999999999943
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 0.958028928034673, "get_ui_image": 0.04366207986638166, "step_physics": 0.5059863553530928, "survival_time": 6.849999999999984, "driven_lanedir": 0.7818318353273331, "get_state_dump": 0.009221609087957851, "get_robot_state": 0.0136626440545787, "sim_render-ego0": 0.003774691319120103, "sim_render-npc0": 0.0035844643910725913, "sim_render-npc1": 0.0035876208457393923, "sim_render-npc2": 0.003873876903368079, "get_duckie_state": 1.2387400088102922e-06, "in-drivable-lane": 1.5999999999999943, "deviation-heading": 0.7131079805935505, "agent_compute-ego0": 0.01032604341921599, "agent_compute-npc0": 0.02017064889272054, "agent_compute-npc1": 0.033991789472275886, "agent_compute-npc2": 0.03328360509181368, "complete-iteration": 0.7283060360645902, "set_robot_commands": 0.0023565793382948723, "deviation-center-line": 0.14939157875516085, "driven_lanedir_consec": 0.7818318353273331, "sim_compute_sim_state": 0.02637067048445992, "sim_compute_performance-ego0": 0.001912861630536508, "sim_compute_performance-npc0": 0.0018501368121824405, "sim_compute_performance-npc1": 0.001851104307865751, "sim_compute_performance-npc2": 0.002005236736242322}, "LFV-norm-zigzag-000-ego0": {"driven_any": 2.5526814329726717, "get_ui_image": 0.05780784457111647, "step_physics": 0.721555601073896, "survival_time": 16.5000000000001, "driven_lanedir": 0.6655453555451283, "get_state_dump": 0.011065933999698328, "get_robot_state": 0.017880987184645546, "sim_render-ego0": 0.00390108690521148, "sim_render-npc0": 0.003733153069487511, "sim_render-npc1": 0.003836237051695855, "sim_render-npc2": 0.0037938496857611434, "sim_render-npc3": 0.003740940929539614, "get_duckie_state": 1.309501440503446e-06, "in-drivable-lane": 12.000000000000108, "deviation-heading": 1.2506985112938351, "agent_compute-ego0": 0.010610285842526716, "agent_compute-npc0": 0.021154109805012037, "agent_compute-npc1": 0.0473838428716285, "agent_compute-npc2": 0.04422519718412186, "agent_compute-npc3": 0.04637265997710905, "complete-iteration": 1.0817481621514635, "set_robot_commands": 0.0022636216212615504, "deviation-center-line": 0.3050692260162657, "driven_lanedir_consec": 0.6655453555451283, "sim_compute_sim_state": 0.06307344206150205, "sim_compute_performance-ego0": 0.002024566298885288, "sim_compute_performance-npc0": 0.001957415814126006, "sim_compute_performance-npc1": 0.0020291077766533706, "sim_compute_performance-npc2": 0.002037394082798338, "sim_compute_performance-npc3": 0.002023184047364757}, "LFV-norm-techtrack-000-ego0": {"driven_any": 1.4238275887832712, "get_ui_image": 0.052371489632989945, "step_physics": 0.7978557348251343, "survival_time": 9.650000000000002, "driven_lanedir": 0.5450254395209196, "get_state_dump": 0.010809106925099166, "get_robot_state": 0.01733357758866143, "sim_render-ego0": 0.003643574173917475, "sim_render-npc0": 0.0035257978537647995, "sim_render-npc1": 0.003603628001262232, "sim_render-npc2": 0.003596748273397229, "sim_render-npc3": 0.0035971550597357995, "get_duckie_state": 1.3788950811956346e-06, "in-drivable-lane": 5.0500000000000105, "deviation-heading": 2.4882932462564837, "agent_compute-ego0": 0.009965140794970325, "agent_compute-npc0": 0.021207133519280816, "agent_compute-npc1": 0.04805171366819402, "agent_compute-npc2": 0.03455660638120985, "agent_compute-npc3": 0.03517527309889646, "complete-iteration": 1.123717958165198, "set_robot_commands": 0.002204914682919217, "deviation-center-line": 0.3928686233240577, "driven_lanedir_consec": 0.5450254395209196, "sim_compute_sim_state": 0.05797915851946959, "sim_compute_performance-ego0": 0.0019114988366353144, "sim_compute_performance-npc0": 0.0018288978596323544, "sim_compute_performance-npc1": 0.0018895409770847596, "sim_compute_performance-npc2": 0.00189652393773659, "sim_compute_performance-npc3": 0.0019152483989282984}, "LFV-norm-small_loop-000-ego0": {"driven_any": 1.667544686265139, "get_ui_image": 0.032502216952187676, "step_physics": 0.19194073230028152, "survival_time": 11.150000000000023, "driven_lanedir": 0.4901826575437944, "get_state_dump": 0.006030969321727753, "get_robot_state": 0.007142119109630585, "sim_render-ego0": 0.003709217267377036, "sim_render-npc0": 0.0036296099424362183, "get_duckie_state": 1.182513577597482e-06, "in-drivable-lane": 7.800000000000027, "deviation-heading": 0.5874169279911909, "agent_compute-ego0": 0.010181394006524768, "agent_compute-npc0": 0.02601321999515806, "complete-iteration": 0.2994016802736691, "set_robot_commands": 0.0023194625973701477, "deviation-center-line": 0.35629316517739434, "driven_lanedir_consec": 0.4901826575437944, "sim_compute_sim_state": 0.009860706116471971, "sim_compute_performance-ego0": 0.0019197485276630944, "sim_compute_performance-npc0": 0.0018829490457262313}}
set_robot_commands_max0.0023565793382948723
set_robot_commands_mean0.002286144559961447
set_robot_commands_median0.002291542109315849
set_robot_commands_min0.002204914682919217
sim_compute_performance-ego0_max0.002024566298885288
sim_compute_performance-ego0_mean0.0019421688234300511
sim_compute_performance-ego0_median0.0019163050790998012
sim_compute_performance-ego0_min0.0019114988366353144
sim_compute_performance-npc0_max0.001957415814126006
sim_compute_performance-npc0_mean0.0018798498829167576
sim_compute_performance-npc0_median0.001866542928954336
sim_compute_performance-npc0_min0.0018288978596323544
sim_compute_performance-npc1_max0.0020291077766533706
sim_compute_performance-npc1_mean0.0019232510205346271
sim_compute_performance-npc1_median0.0018895409770847596
sim_compute_performance-npc1_min0.001851104307865751
sim_compute_performance-npc2_max0.002037394082798338
sim_compute_performance-npc2_mean0.0019797182522590835
sim_compute_performance-npc2_median0.002005236736242322
sim_compute_performance-npc2_min0.00189652393773659
sim_compute_performance-npc3_max0.002023184047364757
sim_compute_performance-npc3_mean0.0019692162231465275
sim_compute_performance-npc3_median0.0019692162231465275
sim_compute_performance-npc3_min0.0019152483989282984
sim_compute_sim_state_max0.06307344206150205
sim_compute_sim_state_mean0.03932099429547588
sim_compute_sim_state_median0.042174914501964755
sim_compute_sim_state_min0.009860706116471971
sim_render-ego0_max0.00390108690521148
sim_render-ego0_mean0.003757142416406524
sim_render-ego0_median0.003741954293248569
sim_render-ego0_min0.003643574173917475
sim_render-npc0_max0.003733153069487511
sim_render-npc0_mean0.00361825631419028
sim_render-npc0_median0.003607037166754405
sim_render-npc0_min0.0035257978537647995
sim_render-npc1_max0.003836237051695855
sim_render-npc1_mean0.00367582863289916
sim_render-npc1_median0.003603628001262232
sim_render-npc1_min0.0035876208457393923
sim_render-npc2_max0.003873876903368079
sim_render-npc2_mean0.003754824954175484
sim_render-npc2_median0.0037938496857611434
sim_render-npc2_min0.003596748273397229
sim_render-npc3_max0.003740940929539614
sim_render-npc3_mean0.003669047994637707
sim_render-npc3_median0.003669047994637707
sim_render-npc3_min0.0035971550597357995
simulation-passed1
step_physics_max0.7978557348251343
step_physics_mean0.5543346058881011
step_physics_median0.6137709782134944
step_physics_min0.19194073230028152
survival_time_max16.5000000000001
survival_time_mean11.037500000000026
survival_time_min6.849999999999984
No reset possible
53467LFVv-simsuccessyes0:18:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53466LFVv-simsuccessyes0:19:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53465LFVv-simsuccessyes0:17:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53428LFVv-simabortedno0:00:35
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53418LFVv-simabortedno0:00:46
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53407LFVv-simabortedno0:00:33
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53400LFVv-simabortedno0:01:11
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53391LFVv-simabortedno0:01:51
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
53340LFVv-simabortedno0:07:06
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible