Duckietown Challenges Home Challenges Submissions

Submission 3154

Submission3154
Competingyes
Challengeaido2-LF-sim-testing
UserAndy Ser
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22569
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
22569step1-simulationsuccessyes0:26:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7558089837379898
survival_time_median5.14999999999999
deviation-center-line_median0.5972575558212546
in-drivable-lane_median0.04999999999999982


other stats
agent_compute-ego_max0.0861385049699228
agent_compute-ego_mean0.08146238425108848
agent_compute-ego_median0.08122026786375582
agent_compute-ego_min0.07658008416493733
deviation-center-line_max1.4566361413176834
deviation-center-line_mean0.6238616045607289
deviation-center-line_min0.24963414325507
deviation-heading_max5.94797529118521
deviation-heading_mean2.407699167833836
deviation-heading_median2.047535135021629
deviation-heading_min0.4602317948329937
driven_any_max2.3491133524134176
driven_any_mean1.2373991597843033
driven_any_median0.7740457812561404
driven_any_min0.4606439371512595
driven_lanedir_consec_max2.3012911307811823
driven_lanedir_consec_mean0.9862002430872264
driven_lanedir_consec_min0.1738893588728288
driven_lanedir_max2.3012911307811823
driven_lanedir_mean1.0437492464709874
driven_lanedir_median0.7558089837379898
driven_lanedir_min0.42183610269126326
in-drivable-lane_max4.300000000000016
in-drivable-lane_mean0.5366666666666682
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5735412552946656, "sim_physics": 0.05918171435971803, "survival_time": 3.949999999999994, "driven_lanedir": 0.5281709398115586, "sim_render-ego": 0.0563344864905635, "in-drivable-lane": 0, "agent_compute-ego": 0.0861385049699228, "deviation-heading": 1.2451342719334284, "set_robot_commands": 0.07655122913891756, "deviation-center-line": 0.32304288361721556, "driven_lanedir_consec": 0.5281709398115586, "sim_compute_sim_state": 0.038776856434496146, "sim_compute_performance-ego": 0.05892335915867286, "sim_compute_robot_state-ego": 0.058960253679299655}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7658462355851402, "sim_physics": 0.056859741023942534, "survival_time": 5.09999999999999, "driven_lanedir": 0.42183610269126326, "sim_render-ego": 0.0564731990589815, "in-drivable-lane": 0.8499999999999992, "agent_compute-ego": 0.08475769734850117, "deviation-heading": 2.9219200466819424, "set_robot_commands": 0.07305249045876895, "deviation-center-line": 0.24963414325507, "driven_lanedir_consec": 0.1738893588728288, "sim_compute_sim_state": 0.037685116132100425, "sim_compute_performance-ego": 0.05899385143728817, "sim_compute_robot_state-ego": 0.060456766801721906}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5731633803295738, "sim_physics": 0.05636792916517992, "survival_time": 3.899999999999994, "driven_lanedir": 0.5687174100806671, "sim_render-ego": 0.0551453553713285, "in-drivable-lane": 0, "agent_compute-ego": 0.08283510269262852, "deviation-heading": 0.4602317948329937, "set_robot_commands": 0.07341514183924748, "deviation-center-line": 0.4374329792570928, "driven_lanedir_consec": 0.5687174100806671, "sim_compute_sim_state": 0.037655011201516174, "sim_compute_performance-ego": 0.06095285904713166, "sim_compute_robot_state-ego": 0.061146133985274874}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.352576060075401, "sim_physics": 0.05519396781921387, "survival_time": 8.74999999999999, "driven_lanedir": 1.2349491669099812, "sim_render-ego": 0.05285736356462751, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.08142209734235491, "deviation-heading": 2.3395259241983215, "set_robot_commands": 0.07115920339311872, "deviation-center-line": 0.6576651552935265, "driven_lanedir_consec": 1.2349491669099812, "sim_compute_sim_state": 0.03558862549918038, "sim_compute_performance-ego": 0.05727039473397391, "sim_compute_robot_state-ego": 0.057643158776419505}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.34848595396039, "sim_physics": 0.05374588410059611, "survival_time": 14.950000000000076, "driven_lanedir": 1.280815783498297, "sim_render-ego": 0.05148905913035075, "in-drivable-lane": 4.300000000000016, "agent_compute-ego": 0.08022499243418375, "deviation-heading": 5.94797529118521, "set_robot_commands": 0.07138798395792643, "deviation-center-line": 0.7403537888559721, "driven_lanedir_consec": 1.0300928423474272, "sim_compute_sim_state": 0.035241355101267496, "sim_compute_performance-ego": 0.05525538444519043, "sim_compute_robot_state-ego": 0.05677066485087077}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.3490811945936496, "sim_physics": 0.05131618420283, "survival_time": 14.950000000000076, "driven_lanedir": 2.166241246449922, "sim_render-ego": 0.05037335634231568, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.07658008416493733, "deviation-heading": 3.9042739923367296, "set_robot_commands": 0.07171250263849895, "deviation-center-line": 1.31784884302188, "driven_lanedir_consec": 2.166241246449922, "sim_compute_sim_state": 0.03447954734166463, "sim_compute_performance-ego": 0.05468621412913005, "sim_compute_robot_state-ego": 0.055509246190388994}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.5694491907367352, "sim_physics": 0.05232413334421592, "survival_time": 10.100000000000009, "driven_lanedir": 1.2706591409544572, "sim_render-ego": 0.051982537354573165, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.08021297903344182, "deviation-heading": 4.881121538815666, "set_robot_commands": 0.07153334830066946, "deviation-center-line": 0.6078289682461113, "driven_lanedir_consec": 1.2706591409544572, "sim_compute_sim_state": 0.03531741623831267, "sim_compute_performance-ego": 0.05652418703135877, "sim_compute_robot_state-ego": 0.057281222673926026}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.6213811511641038, "sim_physics": 0.05474425497509185, "survival_time": 4.199999999999993, "driven_lanedir": 0.6047993715497519, "sim_render-ego": 0.05611259029025123, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.08127611591702416, "deviation-heading": 0.5565426505184625, "set_robot_commands": 0.07379644541513353, "deviation-center-line": 0.42365781877343106, "driven_lanedir_consec": 0.6047993715497519, "sim_compute_sim_state": 0.03777603592191424, "sim_compute_performance-ego": 0.06119229963847569, "sim_compute_robot_state-ego": 0.06007050900232224}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.7740457812561404, "sim_physics": 0.05420535976446948, "survival_time": 5.14999999999999, "driven_lanedir": 0.7558089837379898, "sim_render-ego": 0.05352549182558523, "in-drivable-lane": 0, "agent_compute-ego": 0.07869374636307504, "deviation-heading": 0.9568341719053772, "set_robot_commands": 0.07312975346463398, "deviation-center-line": 0.44579789799199143, "driven_lanedir_consec": 0.7558089837379898, "sim_compute_sim_state": 0.03789884604296638, "sim_compute_performance-ego": 0.05742642023030994, "sim_compute_robot_state-ego": 0.058636947742943625}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.7257851864040474, "sim_physics": 0.05421742704725757, "survival_time": 4.849999999999991, "driven_lanedir": 0.6575700984553992, "sim_render-ego": 0.05451119068971614, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.07934218829440087, "deviation-heading": 1.5605097714950278, "set_robot_commands": 0.07143034885839089, "deviation-center-line": 0.33405986360550305, "driven_lanedir_consec": 0.6575700984553992, "sim_compute_sim_state": 0.0354699228227753, "sim_compute_performance-ego": 0.05940426747823499, "sim_compute_robot_state-ego": 0.05776060979390882}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.376696898699096, "sim_physics": 0.0544883119926024, "survival_time": 8.899999999999991, "driven_lanedir": 1.3224750944254289, "sim_render-ego": 0.05468379513601239, "in-drivable-lane": 0, "agent_compute-ego": 0.08122026786375582, "deviation-heading": 2.047535135021629, "set_robot_commands": 0.07375274883227402, "deviation-center-line": 0.6395801728881447, "driven_lanedir_consec": 1.3224750944254289, "sim_compute_sim_state": 0.037352557932392935, "sim_compute_performance-ego": 0.05755777707260646, "sim_compute_robot_state-ego": 0.058596347155195946}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4606439371512595, "sim_physics": 0.05551881343126297, "survival_time": 3.1999999999999966, "driven_lanedir": 0.44135607998331694, "sim_render-ego": 0.05299586430191994, "in-drivable-lane": 0, "agent_compute-ego": 0.08027100190520287, "deviation-heading": 0.7546602813577944, "set_robot_commands": 0.072764091193676, "deviation-center-line": 0.29017778662164223, "driven_lanedir_consec": 0.44135607998331694, "sim_compute_sim_state": 0.03606844320893288, "sim_compute_performance-ego": 0.05991605296730995, "sim_compute_robot_state-ego": 0.05831873044371605}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.9792683281876855, "sim_physics": 0.0548680243284806, "survival_time": 12.650000000000045, "driven_lanedir": 1.369346289826605, "sim_render-ego": 0.05819957246893479, "in-drivable-lane": 1.900000000000002, "agent_compute-ego": 0.08480174550897047, "deviation-heading": 5.23392703930455, "set_robot_commands": 0.07540158791975542, "deviation-center-line": 0.8369500698444151, "driven_lanedir_consec": 1.0047809240394934, "sim_compute_sim_state": 0.039325928028393166, "sim_compute_performance-ego": 0.06070183482565899, "sim_compute_robot_state-ego": 0.06077959414998533}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.3491133524134176, "sim_physics": 0.05460955301920573, "survival_time": 14.950000000000076, "driven_lanedir": 2.3012911307811823, "sim_render-ego": 0.05660493771235149, "in-drivable-lane": 0, "agent_compute-ego": 0.08357137600580851, "deviation-heading": 2.6344475243728036, "set_robot_commands": 0.07522379398345948, "deviation-center-line": 1.4566361413176834, "driven_lanedir_consec": 2.3012911307811823, "sim_compute_sim_state": 0.03891982396443685, "sim_compute_performance-ego": 0.061382737159729, "sim_compute_robot_state-ego": 0.06104830344518026}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.741909490913244, "sim_physics": 0.054115936009570806, "survival_time": 4.94999999999999, "driven_lanedir": 0.7322018579089957, "sim_render-ego": 0.053041270284941704, "in-drivable-lane": 0, "agent_compute-ego": 0.08058786392211914, "deviation-heading": 0.6708480835476137, "set_robot_commands": 0.07251739261126278, "deviation-center-line": 0.5972575558212546, "driven_lanedir_consec": 0.7322018579089957, "sim_compute_sim_state": 0.03697039864280007, "sim_compute_performance-ego": 0.058370881610446505, "sim_compute_robot_state-ego": 0.05865450098056986}}
set_robot_commands_max0.07655122913891756
set_robot_commands_mean0.07312187080038224
set_robot_commands_median0.07305249045876895
set_robot_commands_min0.07115920339311872
sim_compute_performance-ego_max0.061382737159729
sim_compute_performance-ego_mean0.05857056806436781
sim_compute_performance-ego_median0.05892335915867286
sim_compute_performance-ego_min0.05468621412913005
sim_compute_robot_state-ego_max0.061146133985274874
sim_compute_robot_state-ego_mean0.0587755326447816
sim_compute_robot_state-ego_median0.058636947742943625
sim_compute_robot_state-ego_min0.055509246190388994
sim_compute_sim_state_max0.039325928028393166
sim_compute_sim_state_mean0.03696839230087665
sim_compute_sim_state_median0.037352557932392935
sim_compute_sim_state_min0.03447954734166463
sim_physics_max0.05918171435971803
sim_physics_mean0.05478381563890918
sim_physics_median0.05460955301920573
sim_physics_min0.05131618420283
sim_render-ego_max0.05819957246893479
sim_render-ego_mean0.05428867133483024
sim_render-ego_median0.05451119068971614
sim_render-ego_min0.05037335634231568
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.036666666666681
survival_time_min3.1999999999999966
No reset possible
21454step1-simulationsuccessno0:31:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21453step1-simulationsuccessno0:24:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
21452step1-simulationhost-errorno0:07:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission3154/step1-simulation-ip-172-31-38-104-5317-job21452/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible