Duckietown Challenges Home Challenges Submissions

Evaluator 1727

ID1727
evaluatorp-1
ownerI don't have one 😀
machineb518bdea6b82
processp-1
versiond-c:5.1.1;d-c-r:5.0.12;d-s:5.1.2
first heard
last heard
statusinactive
# evaluating
# success5 32946
# timeout
# failed2 32967
# error3 32925
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
329856647Frank (Chude) Qian 🇨🇦TF version fix 1645 TF Distributeaido3-off-LF-sim-validationstep1-simulationsuccessyesp-10:12:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.496662021504888
survival_time_median11.850000000000032
deviation-center-line_median0.5441107356438346
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.08135946035385132
agent_compute-ego_mean0.0788963009952705
agent_compute-ego_median0.07893385062237832
agent_compute-ego_min0.07611629312688654
deviation-center-line_max0.8953543219647002
deviation-center-line_mean0.5333899659687343
deviation-center-line_min0.17329250167446514
deviation-heading_max2.7855337753700167
deviation-heading_mean1.6392570269114188
deviation-heading_median1.7111558175370785
deviation-heading_min0.4158838520924875
driven_any_max5.515765587589171
driven_any_mean3.5730150395197504
driven_any_median4.368626963920386
driven_any_min1.00424570380348
driven_lanedir_consec_max5.4046875479070735
driven_lanedir_consec_mean3.0674770795109234
driven_lanedir_consec_min0.8843761487839185
driven_lanedir_max5.4046875479070735
driven_lanedir_mean3.0674770795109234
driven_lanedir_median3.496662021504888
driven_lanedir_min0.8843761487839185
in-drivable-lane_max3.949999999999986
in-drivable-lane_mean1.34
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.7712024911354005, "sim_physics": 0.06222344319025675, "survival_time": 14.950000000000076, "driven_lanedir": 4.664685584449153, "sim_render-ego": 0.012263561884562174, "in-drivable-lane": 0, "agent_compute-ego": 0.08135946035385132, "deviation-heading": 2.7855337753700167, "set_robot_commands": 0.008265259265899659, "deviation-center-line": 0.8690426805468082, "driven_lanedir_consec": 4.664685584449153, "sim_compute_sim_state": 0.005859875679016113, "sim_compute_performance-ego": 0.007361079851786296, "sim_compute_robot_state-ego": 0.009339884916941325}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.2052344511503135, "sim_physics": 0.06182767133243748, "survival_time": 6.099999999999986, "driven_lanedir": 0.8869740949095866, "sim_render-ego": 0.01236199941791472, "in-drivable-lane": 3.949999999999986, "agent_compute-ego": 0.08018649406120425, "deviation-heading": 0.4158838520924875, "set_robot_commands": 0.007965414250483279, "deviation-center-line": 0.17329250167446514, "driven_lanedir_consec": 0.8869740949095866, "sim_compute_sim_state": 0.005929395800731221, "sim_compute_performance-ego": 0.007213492862513808, "sim_compute_robot_state-ego": 0.00938539231409792}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.00424570380348, "sim_physics": 0.06281263178045099, "survival_time": 2.7499999999999982, "driven_lanedir": 0.8843761487839185, "sim_render-ego": 0.01203093095259233, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.07611629312688654, "deviation-heading": 0.7307383377952903, "set_robot_commands": 0.008003230528397994, "deviation-center-line": 0.1851495900138632, "driven_lanedir_consec": 0.8843761487839185, "sim_compute_sim_state": 0.006029124693437056, "sim_compute_performance-ego": 0.007011136141690341, "sim_compute_robot_state-ego": 0.009340511668812146}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.368626963920386, "sim_physics": 0.061441124743047144, "survival_time": 11.850000000000032, "driven_lanedir": 3.496662021504888, "sim_render-ego": 0.0122549302467314, "in-drivable-lane": 2.550000000000014, "agent_compute-ego": 0.07893385062237832, "deviation-heading": 1.7111558175370785, "set_robot_commands": 0.008023973255720823, "deviation-center-line": 0.5441107356438346, "driven_lanedir_consec": 3.496662021504888, "sim_compute_sim_state": 0.0060096229681988805, "sim_compute_performance-ego": 0.00728355379547248, "sim_compute_robot_state-ego": 0.009311824911254369}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.515765587589171, "sim_physics": 0.06263643821080525, "survival_time": 14.950000000000076, "driven_lanedir": 5.4046875479070735, "sim_render-ego": 0.012032492955525716, "in-drivable-lane": 0, "agent_compute-ego": 0.07788540681203206, "deviation-heading": 2.552973351762221, "set_robot_commands": 0.008139514128367106, "deviation-center-line": 0.8953543219647002, "driven_lanedir_consec": 5.4046875479070735, "sim_compute_sim_state": 0.0060187037785847984, "sim_compute_performance-ego": 0.007193392912546794, "sim_compute_robot_state-ego": 0.009186046918233236}}
set_robot_commands_max0.008265259265899659
set_robot_commands_mean0.008079478285773772
set_robot_commands_median0.008023973255720823
set_robot_commands_min0.007965414250483279
sim_compute_performance-ego_max0.007361079851786296
sim_compute_performance-ego_mean0.007212531112801944
sim_compute_performance-ego_median0.007213492862513808
sim_compute_performance-ego_min0.007011136141690341
sim_compute_robot_state-ego_max0.00938539231409792
sim_compute_robot_state-ego_mean0.009312732145867798
sim_compute_robot_state-ego_median0.009339884916941325
sim_compute_robot_state-ego_min0.009186046918233236
sim_compute_sim_state_max0.006029124693437056
sim_compute_sim_state_mean0.005969344583993614
sim_compute_sim_state_median0.0060096229681988805
sim_compute_sim_state_min0.005859875679016113
sim_physics_max0.06281263178045099
sim_physics_mean0.062188261851399515
sim_physics_median0.06222344319025675
sim_physics_min0.061441124743047144
sim_render-ego_max0.01236199941791472
sim_render-ego_mean0.01218878309146527
sim_render-ego_median0.0122549302467314
sim_render-ego_min0.01203093095259233
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.120000000000031
survival_time_min2.7499999999999982
No reset possible
329796643Frank (Chude) Qian 🇨🇦TF version fix 1353aido3-off-LF-sim-validationstep1-simulationerroryesp-10:01:56
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
329716637Anthony Courchesne 🇨🇦baseline-IL-sim-tensorflowaido3-off-LF-sim-validationstep1-simulationfailedyesp-10:01:08
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 301, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 54, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.current_image)
               ||   File "solution.py", line 51, in compute_action
               ||     return actions.astype(float)
               || AttributeError: 'list' object has no attribute 'astype'
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "experiment_manager.py", line 446, in <module>
    wrap(cie)
  File "experiment_manager.py", line 434, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 138, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
329676635Anthony Courchesne 🇨🇦baseline-IL-sim-tensorflowaido3-off-LF-sim-validationstep1-simulationfailedyesp-10:01:02
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 301, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 53, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.current_image)
               ||   File "solution.py", line 50, in compute_action
               ||     return action.astype(float)
               || AttributeError: 'Tensor' object has no attribute 'astype'
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 676, in scoring_context
    yield cie
  File "experiment_manager.py", line 446, in <module>
    wrap(cie)
  File "experiment_manager.py", line 434, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 138, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
329536627Vincenzo Polizzi 🇮🇹PredictorLastaido2-PREDstep1-simulationsuccessyesp-10:00:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11835362369436772
error_L20.021982470225569924


No reset possible
329514083Alexander Hatteland 🇨🇭PredictorLastaido2-PREDstep1-simulationsuccessyesp-10:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11935496728144714
error_L20.022992555373144583


No reset possible
329476625Anthony Courchesne 🇨🇦challenge-aido_LF-baseline-duckietownaido3-off-LF-sim-validationstep1-simulationsuccessyesp-10:07:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.098280468788015
survival_time_median14.950000000000076
deviation-center-line_median0.7881415703817196
in-drivable-lane_median0


other stats
agent_compute-ego_max0.06708623091379802
agent_compute-ego_mean0.06285385038871176
agent_compute-ego_median0.06425025593882372
agent_compute-ego_min0.05563313107825442
deviation-center-line_max0.8563045910966494
deviation-center-line_mean0.7147034640552198
deviation-center-line_min0.3955914635216929
deviation-heading_max3.659956671717063
deviation-heading_mean2.029291452849068
deviation-heading_median1.2214126817863296
deviation-heading_min1.053803552805881
driven_any_max2.3491580320234355
driven_any_mean2.047029256018734
driven_any_median2.3413702067984774
driven_any_min1.3445965251008378
driven_lanedir_consec_max2.333712214003415
driven_lanedir_consec_mean1.9705323781701167
driven_lanedir_consec_min1.3275410050844534
driven_lanedir_max2.333712214003415
driven_lanedir_mean1.9705323781701167
driven_lanedir_median2.098280468788015
driven_lanedir_min1.3275410050844534
in-drivable-lane_max0.6500000000000092
in-drivable-lane_mean0.13000000000000184
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.3413702067984774, "sim_physics": 0.06132953541733349, "survival_time": 14.950000000000076, "driven_lanedir": 2.098280468788015, "sim_render-ego": 0.012101959624019354, "in-drivable-lane": 0.6500000000000092, "agent_compute-ego": 0.05563313107825442, "deviation-heading": 3.659956671717063, "set_robot_commands": 0.008289158543615437, "deviation-center-line": 0.7881415703817196, "driven_lanedir_consec": 2.098280468788015, "sim_compute_sim_state": 0.005852751109911048, "sim_compute_performance-ego": 0.0071851967967872235, "sim_compute_robot_state-ego": 0.009466097107699084}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.8508986959885805, "sim_physics": 0.06153897695903537, "survival_time": 11.850000000000032, "driven_lanedir": 1.8387058900912057, "sim_render-ego": 0.012283224596755918, "in-drivable-lane": 0, "agent_compute-ego": 0.06425025593882372, "deviation-heading": 1.058404118921818, "set_robot_commands": 0.008319414114650292, "deviation-center-line": 0.6902778922056377, "driven_lanedir_consec": 1.8387058900912057, "sim_compute_sim_state": 0.006012945738522815, "sim_compute_performance-ego": 0.0071429109774561374, "sim_compute_robot_state-ego": 0.009458375882498826}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3491228201823375, "sim_physics": 0.06114410400390625, "survival_time": 14.950000000000076, "driven_lanedir": 2.254422312883493, "sim_render-ego": 0.01216458797454834, "in-drivable-lane": 0, "agent_compute-ego": 0.06237041314442952, "deviation-heading": 3.152880239014249, "set_robot_commands": 0.008219459851582844, "deviation-center-line": 0.8563045910966494, "driven_lanedir_consec": 2.254422312883493, "sim_compute_sim_state": 0.006075723965962728, "sim_compute_performance-ego": 0.007072188854217529, "sim_compute_robot_state-ego": 0.009478349685668946}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3445965251008378, "sim_physics": 0.06315764613535213, "survival_time": 8.699999999999989, "driven_lanedir": 1.3275410050844534, "sim_render-ego": 0.01240133417063746, "in-drivable-lane": 0, "agent_compute-ego": 0.06492922086825316, "deviation-heading": 1.053803552805881, "set_robot_commands": 0.008346069818255544, "deviation-center-line": 0.3955914635216929, "driven_lanedir_consec": 1.3275410050844534, "sim_compute_sim_state": 0.006042169428419793, "sim_compute_performance-ego": 0.007232093262946469, "sim_compute_robot_state-ego": 0.009450713793436686}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3491580320234355, "sim_physics": 0.06238470713297526, "survival_time": 14.950000000000076, "driven_lanedir": 2.333712214003415, "sim_render-ego": 0.012244723637898762, "in-drivable-lane": 0, "agent_compute-ego": 0.06708623091379802, "deviation-heading": 1.2214126817863296, "set_robot_commands": 0.008274147510528565, "deviation-center-line": 0.8432018030703989, "driven_lanedir_consec": 2.333712214003415, "sim_compute_sim_state": 0.006035974025726318, "sim_compute_performance-ego": 0.007310210069020589, "sim_compute_robot_state-ego": 0.009496394793192546}}
set_robot_commands_max0.008346069818255544
set_robot_commands_mean0.008289649967726537
set_robot_commands_median0.008289158543615437
set_robot_commands_min0.008219459851582844
sim_compute_performance-ego_max0.007310210069020589
sim_compute_performance-ego_mean0.00718851999208559
sim_compute_performance-ego_median0.0071851967967872235
sim_compute_performance-ego_min0.007072188854217529
sim_compute_robot_state-ego_max0.009496394793192546
sim_compute_robot_state-ego_mean0.009469986252499216
sim_compute_robot_state-ego_median0.009466097107699084
sim_compute_robot_state-ego_min0.009450713793436686
sim_compute_sim_state_max0.006075723965962728
sim_compute_sim_state_mean0.00600391285370854
sim_compute_sim_state_median0.006035974025726318
sim_compute_sim_state_min0.005852751109911048
sim_physics_max0.06315764613535213
sim_physics_mean0.061910993929720506
sim_physics_median0.06153897695903537
sim_physics_min0.06114410400390625
sim_render-ego_max0.01240133417063746
sim_render-ego_mean0.012239166000771969
sim_render-ego_median0.012244723637898762
sim_render-ego_min0.012101959624019354
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.08000000000005
survival_time_min8.699999999999989
No reset possible
329466624Anthony Courchesne 🇨🇦challenge-aido_LF-baseline-duckietownaido3-off-LF-sim-validationstep1-simulationsuccessyesp-10:07:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3785806384453383
survival_time_median11.65000000000003
deviation-center-line_median0.6871790359550077
in-drivable-lane_median0


other stats
agent_compute-ego_max0.04353002827576916
agent_compute-ego_mean0.03329522785784304
agent_compute-ego_median0.03086804013395514
agent_compute-ego_min0.030569769553284148
deviation-center-line_max0.8551404643084253
deviation-center-line_mean0.5862001446030487
deviation-center-line_min0.15954475493915946
deviation-heading_max4.7591123013829755
deviation-heading_mean2.0185318584045033
deviation-heading_median1.4462039037330827
deviation-heading_min1.0331440377263326
driven_any_max2.3491468263161397
driven_any_mean1.6709186648806214
driven_any_median1.8187504025711283
driven_any_min0.7342326421843358
driven_lanedir_consec_max2.329899403988829
driven_lanedir_consec_mean1.4909788657211116
driven_lanedir_consec_min0.6987838870977553
driven_lanedir_max2.329899403988829
driven_lanedir_mean1.5611428191794032
driven_lanedir_median1.727341023169069
driven_lanedir_min0.6987838870977553
in-drivable-lane_max0.8000000000000114
in-drivable-lane_mean0.23000000000000329
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7342326421843358, "sim_physics": 0.06354323300448331, "survival_time": 4.94999999999999, "driven_lanedir": 0.6987838870977553, "sim_render-ego": 0.012373281247688064, "in-drivable-lane": 0, "agent_compute-ego": 0.04353002827576916, "deviation-heading": 1.0331440377263326, "set_robot_commands": 0.008141370734783134, "deviation-center-line": 0.15954475493915946, "driven_lanedir_consec": 0.6987838870977553, "sim_compute_sim_state": 0.005649870092218573, "sim_compute_performance-ego": 0.007587755569303879, "sim_compute_robot_state-ego": 0.009485962414982342}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.8187504025711283, "sim_physics": 0.06307939705418926, "survival_time": 11.65000000000003, "driven_lanedir": 1.727341023169069, "sim_render-ego": 0.01214829125629474, "in-drivable-lane": 0.350000000000005, "agent_compute-ego": 0.03086804013395514, "deviation-heading": 1.325876868053918, "set_robot_commands": 0.008357501336944973, "deviation-center-line": 0.6871790359550077, "driven_lanedir_consec": 1.727341023169069, "sim_compute_sim_state": 0.0054014138397740705, "sim_compute_performance-ego": 0.0069985880872210715, "sim_compute_robot_state-ego": 0.009795045648009992}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.099847675425497, "sim_physics": 0.06349846409327949, "survival_time": 13.400000000000055, "driven_lanedir": 1.7294004057367962, "sim_render-ego": 0.01215687616547542, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.030569769553284148, "deviation-heading": 4.7591123013829755, "set_robot_commands": 0.008345001669072392, "deviation-center-line": 0.8409217482257048, "driven_lanedir_consec": 1.3785806384453383, "sim_compute_sim_state": 0.005487573680593006, "sim_compute_performance-ego": 0.00697999036134179, "sim_compute_robot_state-ego": 0.009749259521712118}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3526157779060044, "sim_physics": 0.06281830651419504, "survival_time": 8.74999999999999, "driven_lanedir": 1.320289375904567, "sim_render-ego": 0.01274892670767648, "in-drivable-lane": 0, "agent_compute-ego": 0.030576704570225308, "deviation-heading": 1.5283221811262098, "set_robot_commands": 0.008457555770874023, "deviation-center-line": 0.3882147195869463, "driven_lanedir_consec": 1.320289375904567, "sim_compute_sim_state": 0.005748413630894253, "sim_compute_performance-ego": 0.007065565926688058, "sim_compute_robot_state-ego": 0.00975825309753418}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3491468263161397, "sim_physics": 0.06280231952667237, "survival_time": 14.950000000000076, "driven_lanedir": 2.329899403988829, "sim_render-ego": 0.012548934618632, "in-drivable-lane": 0, "agent_compute-ego": 0.030931596755981446, "deviation-heading": 1.4462039037330827, "set_robot_commands": 0.008381677468617758, "deviation-center-line": 0.8551404643084253, "driven_lanedir_consec": 2.329899403988829, "sim_compute_sim_state": 0.005620114008585612, "sim_compute_performance-ego": 0.007143429120381673, "sim_compute_robot_state-ego": 0.009817978541056316}}
set_robot_commands_max0.008457555770874023
set_robot_commands_mean0.008336621396058456
set_robot_commands_median0.008357501336944973
set_robot_commands_min0.008141370734783134
sim_compute_performance-ego_max0.007587755569303879
sim_compute_performance-ego_mean0.007155065812987295
sim_compute_performance-ego_median0.007065565926688058
sim_compute_performance-ego_min0.00697999036134179
sim_compute_robot_state-ego_max0.009817978541056316
sim_compute_robot_state-ego_mean0.00972129984465899
sim_compute_robot_state-ego_median0.00975825309753418
sim_compute_robot_state-ego_min0.009485962414982342
sim_compute_sim_state_max0.005748413630894253
sim_compute_sim_state_mean0.005581477050413103
sim_compute_sim_state_median0.005620114008585612
sim_compute_sim_state_min0.0054014138397740705
sim_physics_max0.06354323300448331
sim_physics_mean0.06314834403856388
sim_physics_median0.06307939705418926
sim_physics_min0.06280231952667237
sim_render-ego_max0.01274892670767648
sim_render-ego_mean0.01239526199915334
sim_render-ego_median0.012373281247688064
sim_render-ego_min0.01214829125629474
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.740000000000029
survival_time_min4.94999999999999
No reset possible
329386620Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido3-off-LF-sim-validationstep1-simulationerroryesp-10:02:40
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
329256614Hyejun Yuchallenge-aido_LF-template-ros - Template solution using ROSaido3-off-LF-sim-validationstep1-simulationerroryesp-10:03:27
The container "solut [...]
The container "solution" exited with code 255.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible