Duckietown Challenges Home Challenges Submissions

Evaluator 443

ID443
evaluatornctuece-24044
ownerEric Lu
machinenctuece
processnctuece-24044
versionDC:3.1.58;DCR:3.2.14;DTS:3.0.30
first heard
last heard
statusinactive
# evaluating
# success4 16779
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
167822222Eric LuROS-based Lane Followingaido1_LF1_r4_cont-v3step4-vizsuccessyesnctuece-240440:04:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3243361110823251
deviation-center-line_median0.1041520544984799
in-drivable-lane_median0


other stats
deviation-center-line_max1.5122126377936431
deviation-center-line_mean0.3029016989325819
deviation-center-line_min0.05007284622519989
deviation-heading_max0.9818032846657224
deviation-heading_mean0.31898196682113655
deviation-heading_median0.19575548895890557
deviation-heading_min0.15906988835298722
driven_any_max5.345862830441994
driven_any_mean1.020690721335753
driven_any_median0.36405576850009513
driven_any_min0.1176989868765968
driven_lanedir_consec_max3.0617182099623395
driven_lanedir_consec_mean0.6696948480263353
driven_lanedir_consec_min0.10078121315921652
driven_lanedir_max3.0617182099623395
driven_lanedir_mean0.6696948480263353
driven_lanedir_median0.3243361110823251
driven_lanedir_min0.10078121315921652
in-drivable-lane_max6.933333333333313
in-drivable-lane_mean1.0238095238095208
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 5.345862830441994, "driven_lanedir": 3.0617182099623395, "in-drivable-lane": 6.933333333333313, "deviation-heading": 0.9818032846657224, "deviation-center-line": 1.5122126377936431, "driven_lanedir_consec": 3.0617182099623395}, "ep001": {"driven_any": 0.5356495111093108, "driven_lanedir": 0.530699463643868, "in-drivable-lane": 0, "deviation-heading": 0.19217505755372769, "deviation-center-line": 0.20677963384654205, "driven_lanedir_consec": 0.530699463643868}, "ep002": {"driven_any": 0.36405576850009513, "driven_lanedir": 0.33535564897012815, "in-drivable-lane": 0.03333333333333344, "deviation-heading": 0.253078035353277, "deviation-center-line": 0.11078451428160624, "driven_lanedir_consec": 0.33535564897012815}, "ep003": {"driven_any": 0.12827684540497494, "driven_lanedir": 0.1085748357945997, "in-drivable-lane": 0, "deviation-heading": 0.17905667610396425, "deviation-center-line": 0.05007284622519989, "driven_lanedir_consec": 0.1085748357945997}, "ep004": {"driven_any": 0.1176989868765968, "driven_lanedir": 0.10078121315921652, "in-drivable-lane": 0, "deviation-heading": 0.15906988835298722, "deviation-center-line": 0.05126737111950026, "driven_lanedir_consec": 0.10078121315921652}, "ep005": {"driven_any": 0.24631615027622372, "driven_lanedir": 0.2263984535718695, "in-drivable-lane": 0, "deviation-heading": 0.19575548895890557, "deviation-center-line": 0.08504283476310179, "driven_lanedir_consec": 0.2263984535718695}, "ep006": {"driven_any": 0.4069749567410757, "driven_lanedir": 0.3243361110823251, "in-drivable-lane": 0.20000000000000065, "deviation-heading": 0.27193533675937165, "deviation-center-line": 0.1041520544984799, "driven_lanedir_consec": 0.3243361110823251}}
No reset possible
167812222Eric LuROS-based Lane Followingaido1_LF1_r4_cont-v3step3-videossuccessyesnctuece-240440:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
167802222Eric LuROS-based Lane Followingaido1_LF1_r4_cont-v3step2-scoringsuccessyesnctuece-240440:00:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.166666666666667


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.04783480816939846, "good_angle": 1.5492044329752672, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 3.2000000000000135}, "ep001": {"nsteps": 51, "reward": -19.304496032058022, "good_angle": 0.03300166532715481, "survival_time": 1.700000000000002, "traveled_tiles": 2, "valid_direction": 0.06666666666666665}, "ep002": {"nsteps": 35, "reward": -28.259470125181338, "good_angle": 0.16908056949507663, "survival_time": 1.166666666666667, "traveled_tiles": 2, "valid_direction": 0.2000000000000004}, "ep003": {"nsteps": 13, "reward": -76.77953802507658, "good_angle": 0.16132885810487824, "survival_time": 0.4333333333333333, "traveled_tiles": 1, "valid_direction": 0.2333333333333333}, "ep004": {"nsteps": 12, "reward": -83.26318940737595, "good_angle": 0.1343305304713133, "survival_time": 0.4, "traveled_tiles": 2, "valid_direction": 0.16666666666666663}, "ep005": {"nsteps": 24, "reward": -41.35837177730476, "good_angle": 0.1650770074569248, "survival_time": 0.7999999999999999, "traveled_tiles": 1, "valid_direction": 0.19999999999999996}, "ep006": {"nsteps": 39, "reward": -25.42290176847615, "good_angle": 0.3016363386815286, "survival_time": 1.3000000000000007, "traveled_tiles": 2, "valid_direction": 0.5000000000000007}}
good_angle_max1.5492044329752672
good_angle_mean0.3590942003588776
good_angle_median0.1650770074569248
good_angle_min0.03300166532715481
reward_max0.04783480816939846
reward_mean-39.19144747532906
reward_median-28.259470125181338
reward_min-83.26318940737595
survival_time_max16.666666666666654
survival_time_mean3.2095238095238083
survival_time_min0.4
traveled_tiles_max10
traveled_tiles_mean2.857142857142857
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.2000000000000135
valid_direction_mean0.6523809523809544
valid_direction_median0.2000000000000004
valid_direction_min0.06666666666666665
No reset possible
167792222Eric LuROS-based Lane Followingaido1_LF1_r4_cont-v3step1-simulationsuccessyesnctuece-240440:02:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible