Duckietown challenges

Duckietown challenges server

This is the Duckietown challenges server. For more information, look at duckietown.org.

Challenges

These are the challenges for the 2022 mooc.

Challenge LX - Braitenberg 1

#1 user7842 `27873`	#2 user7822 `20857`	#2 user7859 `20856`

copy link	copy link	copy link

Rank (user)	User	Submission	complete	User label	Distance from starting point.↑
1	user7842	`27873`	1/5	exercises_braitenberg	5.85
2	user7822	`20857`	1/5	exercises_braitenberg	5.8
3	user7859	`20856`	1/5	exercises_braitenberg	5.8
4	user7805	`20777`	1/5	exercises_braitenberg	5.8
5	user8411	`26401`	1/5	exercises_braitenberg	5.7
6	user9119	`28150`	1/5	exercises_braitenberg	5.65
7	user8317	`26329`	1/5	exercises_braitenberg	5.65
8	user9329	`28045`	1/5	exercises_braitenberg	5.55
9	user8408	`26521`	1/5	exercises_braitenberg	5.55
10	user7809	`20871`	1/5	exercises_braitenberg	5.55

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is OPEN for submissions.

Challenge LX - Visual Lane Servoing

This is the challenge to test the Visual Lane Servoing of the MOOC’s robot vision exercise.

For more information about the “Self-Driving Cars with Duckietown” MOOC, visit duckietown.org.

#1 Sampsa Ranta `19405`	#2 user8433 `27388`	#3 Davide Iafrate `27520`

copy link	copy link	copy link

Rank (user)	User	Submission	complete	User label	Major infractions ↓	Lateral deviation ↓	Traveled distance↑	Survival time↑
1	Sampsa Ranta	`19405`	1/1	lx22-visservoing	0.	0.53	6.6	60.
2	user8433	`27388`	1/1	lx22-visservoing	0.	0.66	6.6	60.
3	Davide Iafrate	`27520`	1/1	lx22-visservoing	0.	0.75	6.6	60.
4	user7822	`21336`	1/1	lx22-visservoing	0.	0.75	6.6	60.
5	user7793	`21451`	1/1	lx22-visservoing	0.	0.79	6.6	60.
6	user8366	`27335`	1/1	lx22-visservoing	0.	0.84	6.6	60.
7	user7809	`21423`	1/1	lx22-visservoing	0.	0.89	6.6	60.
8	user8365	`27435`	1/1	lx22-visservoing	0.	0.9	0.6	60.
9	user8008	`26632`	1/1	lx22-visservoing	0.	0.9	0.6	60.
10	Bea Baselines 🐤	`19154`	1/1	baseline-duckietown-ml	0.	0.9	0.6	60.

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is OPEN for submissions.

Challenge LX - State Estimation

This is the challenge is part of the the MOOC’s state estimation exercise.

For more information about the “Self-Driving Cars with Duckietown” MOOC, visit duckietown.org.

#1 Anna Berghoff `21078`	#2 user7060 `20421`	#3 user7808 `21599`

copy link	copy link	copy link

Rank (user)	User	Submission	complete	User label	Traveled distance↑	Survival time↑	Lateral deviation ↓	Major infractions ↓
1	Anna Berghoff	`21078`	1/1	state estimation exercise	12.4	60.	2.49	0.
2	user7060	`20421`	1/1	state estimation exercise	12.4	60.	2.99	0.
3	user7808	`21599`	1/1	state estimation exercise	9.3	60.	3.56	11.6
4	Bea Baselines 🐤	`19161`	1/1	baseline-duckietown	7.44	60.	4.61	4.8
5	Nikoloz Gubeladze	`19721`	1/1	exercises_braitenberg	5.58	60.	2.13	35.6
6	user9701	`28736`	1/1	state estimation exercise	4.34	60.	1.34	4.8
7	user7806	`21937`	1/1	state estimation exercise	4.34	60.	1.5	0.
8	user7810	`21879`	1/1	state estimation exercise	4.34	60.	1.51	0.
9	user7793	`21810`	1/1	state estimation exercise	4.34	60.	1.66	3.2
10	user7802	`21930`	1/1	state estimation exercise	4.34	60.	1.79	0.

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is OPEN for submissions.

Challenge LX - ModCon

This is the challenge to test the PID controller of the MOOC’s modcon exercise.

For more information about the “Self-Driving Cars with Duckietown” MOOC, visit duckietown.org.

#1 user7527 `28299`	#2 user8030 `27652`	#2 user8595 `27062`

copy link	copy link	copy link

Rank (user)	User	Submission	complete	User label	Major infractions ↓	Lateral deviation ↓	Traveled distance↑	Survival time↑
1	user7527	`28299`	1/1	lx22-modcon	2.6	2.64	6.	46.
2	user8030	`27652`	1/1	lx22-modcon	2.8	1.8	6.	46.
3	user8595	`27062`	1/1	lx22-modcon	2.8	1.8	6.	46.
4	user9028	`27907`	1/1	lx22-modcon	2.8	1.89	6.	44.
5	user8126	`25950`	1/1	lx22-modcon	3.	3.47	6.6	50.
6	user9848	`28425`	1/1	lx22-modcon	3.2	1.19	4.2	32.
7		`19808`	1/1	lx22-modcon	3.4	0.	0.	4.
8	user7808	`21026`	1/1	lx22-modcon	3.4	1.57	6.	44.
9	user7821	`20880`	1/1	lx22-modcon	3.4	1.59	6.	44.
10	user7116	`20128`	1/1	lx22-modcon	3.4	1.59	6.	44.

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is OPEN for submissions.

Challenge LX - Object Detection

This is the challenge is part of the the MOOC’s object detection exercise.

For more information about the “Self-Driving Cars with Duckietown” MOOC, visit duckietown.org.

#1 user9696 `28680`	#1 user9672 `28574`	#1 user7593 `27997`

copy link	copy link	copy link

Rank (user)	User	Submission	complete	User label	Survival time↑	Traveled distance↑
1	user9696	`28680`	1/1	objdet exercise	60.	4.8
2	user9672	`28574`	1/1	objdet exercise	60.	4.8
3	user7593	`27997`	1/1	objdet exercise	60.	4.8
4	user7415	`27902`	1/1	objdet exercise	60.	4.8
5	user8126	`27818`	1/1	objdet exercise	60.	4.8
6	user8299	`27162`	1/1	objdet exercise	60.	4.8
7	user8212	`26934`	1/1	objdet exercise	60.	4.8
8	user8483	`26926`	1/1	objdet exercise	60.	4.8
9	user8481	`26923`	1/1	objdet exercise	60.	4.8
10	user8411	`26920`	1/1	objdet exercise	60.	4.8

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is OPEN for submissions.

Challenge LX - Planning dynamic (validation)

Planning intermediate (validation)

Rank (user)	User	Submission	complete	User label	mistake ratio ↓	Success ratio↑	Duration ↓	Plan complexity ↓	Min distance↑
1	user9672	`28666`	1/4	planning-exercise	0.	0.	1000.	1000.	0.
2	user7811	`25765`	1/4	planning-exercise	0.	0.	1000.	1000.	0.
3	user7802	`22222`	1/4	planning-exercise	0.25	0.25	752.	750.8	0.01
4	user7800	`25837`	1/4	planning-exercise	0.25	0.25	752.6	751.2	0.03
5	user7818	`23343`	1/4	planning-exercise	0.25	0.25	753.	750.8	0.
6	user7815	`22699`	1/4	planning-exercise	0.25	0.25	753.	750.8	0.
7	user7820	`24859`	1/4	planning-exercise	0.25	0.25	753.8	751.6	0.
8	user7822	`24674`	1/4	planning-exercise	0.25	0.25	754.2	750.8	0.01
9	user7812	`24626`	1/4	planning-exercise	0.25	0.25	754.2	750.8	0.01
10	user7810	`23801`	1/4	planning-exercise	0.25	0.25	754.2	750.8	0.01

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is OPEN for submissions.

Challenge LX - Planning constrained (validation)

Planning intermediate (validation)

Rank (user)	User	Submission	complete	User label	mistake ratio ↓	Success ratio↑	Duration ↓	Plan complexity ↓	Min distance↑
1	user7811	`25766`	1/4	planning-exercise	0.	0.	1000.	1000.	0.
2	user7802	`22223`	1/4	planning-exercise	0.25	0.25	750.	750.8	0.03
3	user7818	`23344`	1/4	planning-exercise	0.25	0.25	752.4	750.8	0.01
4	user7807	`23061`	1/4	planning-exercise	0.25	0.25	752.4	751.8	0.03
5	user7815	`22700`	1/4	planning-exercise	0.25	0.25	752.6	750.8	0.01
6	user7822	`24812`	1/4	planning-exercise	0.25	0.25	753.4	750.8	0.01
7	user7791	`24459`	1/4	planning-exercise	0.25	0.25	753.4	750.8	0.01
8	user7810	`24097`	1/4	planning-exercise	0.25	0.25	753.4	750.8	0.01
9	user7808	`23368`	1/4	planning-exercise	0.25	0.25	753.4	750.8	0.01
10	user7823	`22102`	1/4	planning-exercise	0.25	0.25	753.4	750.8	0.

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is OPEN for submissions.

Challenge LX - Planning (empty env)

Planning test with empty environment.

Rank (user)	User	Submission	complete	User label	mistake ratio ↓	Success ratio↑	Duration ↓	Plan complexity ↓	Min distance↑
1	user7811	`25767`	1/1	planning-exercise	0.	0.	1000.	1000.	0.
2	user7820	`25659`	1/1	planning-exercise	0.89	1.	5.	3.4	0.89
3	user7793	`25030`	1/1	planning-exercise	0.89	1.	5.	6.4	0.85
4	user7810	`25006`	1/1	planning-exercise	0.89	1.	7.8	2.8	0.82
5	user7818	`25779`	1/1	planning-exercise	0.89	1.	7.8	2.8	0.8
6	user7802	`22224`	1/1	planning-exercise	0.93	1.	2.4	3.	0.88
7	user7815	`23973`	1/1	planning-exercise	0.93	1.	3.	3.	0.82
8	user7819	`22175`	1/1	planning-exercise	0.93	1.	3.8	3.	0.87
9	user7822	`24676`	1/1	planning-exercise	0.93	1.	6.8	2.8	0.91
10	user9344	`28756`	1/1	planning-exercise	0.93	1.	6.8	3.	0.91

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is OPEN for submissions.

Challenge LX - Planning dynamic (validation)

Planning intermediate (validation)

Rank (user)	User	Submission	complete	User label	mistake ratio ↓	Success ratio↑	Duration ↓	Plan complexity ↓	Min distance↑
1	user7793	`25214`	1/4	planning-exercise	0.	0.25	754.6	752.2	0.02
2	user7810	`24911`	1/4	planning-exercise	0.	0.25	755.2	751.6	0.02
3	user7820	`24862`	1/4	planning-exercise	0.	0.	1000.	1000.	0.
4	user7807	`23658`	1/4	planning-exercise	0.17	0.25	756.2	756.2	0.01
5	user7802	`22225`	1/4	planning-exercise	0.25	0.25	751.6	750.8	0.
6	user7815	`22301`	1/4	planning-exercise	0.25	0.25	752.6	750.8	0.01
7	user7818	`23346`	1/4	planning-exercise	0.25	0.25	752.6	750.8	0.
8	user7809	`25114`	1/4	planning-exercise	0.25	0.25	754.2	750.8	0.
9	user7823	`22104`	1/4	planning-exercise	0.25	0.25	754.2	750.8	0.
10	user7824	`25708`	1/4	planning-exercise	0.25	0.25	754.2	758.4	0.01

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is OPEN for submissions.

Challenge LX - Planning intermediate (validation)

Planning intermediate (validation)

Rank (user)	User	Submission	complete	User label	mistake ratio ↓	Success ratio↑	Duration ↓	Plan complexity ↓	Min distance↑
1	user7820	`25588`	1/4	planning-exercise	0.	1.	18.	7.6	0.14
2	user7810	`24731`	1/4	planning-exercise	0.	1.	18.4	5.6	0.12
3	user7793	`24510`	1/4	planning-exercise	0.	1.	20.2	19.	0.12
4	user7796	`22805`	1/4	planning-exercise	0.	1.	20.6	9.	0.14
5	user7798	`22137`	1/4	planning-exercise	0.	1.	24.6	6.4	0.1
6	Bea Baselines 🐤	`19208`	1/4	baseline-solution	0.	1.	45.	105.	0.21
7	user7805	`25395`	1/4	planning-exercise	0.	0.88	29.2	36.6	0.1
8	user7818	`25781`	1/4	planning-exercise	0.05	1.	16.4	7.2	0.13
9	user7807	`23901`	1/4	planning-exercise	0.09	1.	18.8	16.6	0.1
10	user7815	`23939`	1/4	planning-exercise	0.1	0.88	31.6	137.8	0.12

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is OPEN for submissions.

Challenge LX - Planning (empty env)

Planning test with empty environment.

Rank (user)	User	Submission	complete	User label	mistake ratio ↓	Success ratio↑	Duration ↓	Plan complexity ↓	Min distance↑
1	user7793	`24973`	1/1	planning-exercise	0.	1.	5.	4.4	0.88
2	user7810	`25009`	1/1	planning-exercise	0.	1.	5.2	2.6	0.9
3	user7820	`25662`	1/1	planning-exercise	0.	1.	5.2	3.	0.9
4	user7818	`25782`	1/1	planning-exercise	0.	1.	5.8	2.8	0.9
5	olivier B	`26863`	1/1	planning-exercise	0.	1.	6.8	2.6	0.91
6	user7805	`25396`	1/1	planning-exercise	0.	1.	6.8	2.6	0.91
7	user7791	`24463`	1/1	planning-exercise	0.	1.	6.8	2.6	0.91
8	user7802	`23516`	1/1	planning-exercise	0.	1.	6.8	2.6	0.91
9	user7822	`24816`	1/1	planning-exercise	0.	1.	6.8	2.8	0.91
10	user9344	`28759`	1/1	planning-exercise	0.	1.	6.8	3.	0.91

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is OPEN for submissions.

Challenge LX - Collision checking

Collision checking (validation)

Rank (user)	User	Submission	complete	User label	false negative rate ↓	false positive rate ↓
1	user9576	`28403`	1/1	collision-check-exercise	0.	0.
2	user9582	`28302`	1/1	collision-check-exercise	0.	0.
3	user7842	`27885`	1/1	collision-check-exercise	0.	0.
4	user8439	`26120`	1/1	collision-check-exercise	0.	0.
5	user7820	`22966`	1/1	collision-check-exercise	0.	0.
6	Anna Berghoff	`21715`	1/1	collision-check-exercise	0.	0.
7	Weigang Li	`19410`	1/1	collision-check-exercise	0.	0.
8	Bea Baselines 🐤	`19202`	1/1	baseline-solution	0.	0.
9	user7810	`23727`	1/1	collision-check-exercise	0.	0.02
10	user9829	`28652`	1/1	collision-check-exercise	0.	0.04

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is OPEN for submissions.

In these challenges you must guide a Duckiebot through the streets of Duckietown with only a camera and encoders available.

There are 3 variations:

`LF`	`LFP`	`LFV_multi`
Follow the lane	Avoid the duckies pedestrians	Control multiple Duckiebots

To get started, read the docs.

Note: these are the validation 🏋 challenge - you can see the output but these are not the scores that count. Select the “AI-DO 5 Testing 🥇” tab to see the scores that count.

Challenge Sanity check (full)

Very short “challenge”. Sanity check.

Rank (user)	User	Submission	complete	User label	Survival time↑	Major infractions ↓	Traveled distance↑	Lateral deviation ↓
1	Bea Baselines 🐤	`19168`	1/1	minimal-agent-state	2.	0.	0.62	0.01
-	Bea Baselines 🐤	`19166`	1/1	baseline-simple-yield	2.	0.	0.62	0.01

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is CLOSED for submissions.

Challenge Sanity check (full)

Very short “challenge”. Sanity check.

#1 Bea Baselines 19167

copy link

Rank (user)	User	Submission	complete	User label	Survival time↑	Major infractions ↓	Traveled distance↑	Lateral deviation ↓
1	Bea Baselines 🐤	`19167`	1/1	minimal-agent-full	2.	0.	0.62	0.01

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is CLOSED for submissions.

Challenge Sanity check

Very short “challenge”. Sanity check.

#0 user7030 `19880`	#0 Nikoloz Gubeladze `19718`	#0 Shintaro Matsushita `19647`

copy link	copy link	copy link

Rank (user)	User	Submission	complete	User label	Survival time↑	Major infractions ↓	Traveled distance↑	Lateral deviation ↓
1	user7030	`19880`	1/1	exercises_braitenberg	2.	0.	0.62	0.01
2	Nikoloz Gubeladze	`19718`	1/1	exercises_braitenberg	2.	0.	0.62	0.01
3	Shintaro Matsushita	`19647`	1/1	template-ros	2.	0.	0.62	0.01
4	Hiroyuki Nabae	`19590`	1/1	template-ros	2.	0.	0.62	0.01
-	Hiroyuki Nabae	`19589`	1/1	template-pytorch	2.	0.	0.62	0.01
5	Zara Weir	`19561`	1/1	baseline-duckietown	2.	0.	0.62	0.01
6	Alim W.H. Prayuda	`19330`	1/1	objdet exercise	2.	0.	0.62	0.01
7	Frey Dominik	`19265`	1/1	baseline-behavior-cloning	2.	0.	0.62	0.01
8	Bea Baselines 🐤	`19192`	1/1	template-ros	2.	0.	0.62	0.01
-	Bea Baselines 🐤	`19180`	1/1	template-pytorch	2.	0.	0.62	0.01

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is CLOSED for submissions.

These are support challenges. There is no prize for them for AI-DO 5.

Challenge LFV 🚗🚗 - Lane following + Vehicles (simulation 👾, validation 🏋)

Lane following challenge.

#1 Peter Almasi `13110`	#2 Melisande Teng `12830`	#3 Raphael Jean `12755`

copy link	copy link	copy link

Rank (user)	User	Submission	complete	User label	Traveled distance↑	Survival time↑	Lateral deviation ↓	Major infractions ↓
1	Peter Almasi 🇭🇺	`13110`	1/1	rl-agent-9502-real	7.44	42.	1.02	0.
2	Melisande Teng	`12830`	1/1	exercise_state_estimation	6.2	34.	1.56	0.
3	Raphael Jean	`12755`	1/1	sim-exercise-1	6.2	34.	1.8	1.2
-	Raphael Jean	`12844`	1/1	exercise_state_estimation	4.34	20.	0.98	0.
-	Raphael Jean	`12872`	1/1	sim-exercise-2	4.34	18.	0.93	0.
4	Thomas Wiggers 🇳🇱	`12946`	1/1	ppo_v1	3.72	36.	1.48	3.4
5	Yury Belousov 🇷🇺	`13215`	1/1	JetBrains Research2 sim2real	3.72	18.	1.27	2.
6	András Kalapos 🇭🇺	`13269`	1/1	real-v0.5-3091-310	3.72	16.	0.62	0.
-	Yury Belousov 🇷🇺	`13187`	1/1	JetBrains Research2 sim2real v0.1.1	3.72	16.	0.99	3.4
7	Robert Moni 🇭🇺	`12891`	1/1	speedRL	3.72	14.	0.37	0.

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is CLOSED for submissions.

Challenge LFV 🚗🚗 - Lane following + Vehicles (simulation 👾, testing 🥇)

Lane following challenge.

Rank (user)	User	Submission	complete	User label	Traveled distance↑	Survival time↑	Lateral deviation ↓	Major infractions ↓
1	Peter Almasi 🇭🇺	`13113`	1/1	rl-agent-9502-real	5.58	30.	0.69	0.
2	Anastasiya Nikolskaya 🇷🇺	`13169`	1/1	JetBrains Research0 real2sim v0.1.0 --REAL	5.58	16.	0.71	0.
3	András Kalapos 🇭🇺	`13234`	1/1	real-v0.5-3091-310	4.96	20.	0.69	0.
4	Yishu Malhotra 🇨🇦	`12815`	1/1	sim-exercise-2	4.34	30.	1.66	1.
5	Márton Tim 🇭🇺	`12989`	1/1	test_submit	3.72	14.	0.58	1.4
6	Thomas Wiggers 🇳🇱	`12944`	1/1	ppo_v1	3.1	36.	1.17	3.
7	Melisande Teng	`12829`	1/1	exercise_state_estimation	3.1	16.	0.7	0.
8	Raphael Jean	`12754`	1/1	sim-exercise-1	3.1	16.	0.73	0.
-	Raphael Jean	`12843`	1/1	exercise_state_estimation	3.1	14.	0.6	0.
9	Robert Moni 🇭🇺	`12913`	1/1	speedRL	3.1	10.	0.28	0.

See also the extended leaderboard.

This is a testing challenge: the scores are visible, but not the full output.This challenge is CLOSED for submissions.

Challenge LFI - Intersections (simulation 👾, validation 🏋)

#1 András Kalapos `13089`	#2 Yury Belousov `13210`	#3 Anastasiya Nikolskaya `12764`

copy link	copy link	copy link

Rank (user)	User	Submission	complete	User label	Traveled distance↑	Survival time↑	Lateral deviation ↓	Major infractions ↓
1	András Kalapos 🇭🇺	`13089`	1/1	3090	15.5	36.	1.57	1.6
2	Yury Belousov 🇷🇺	`13210`	1/1	JetBrains Research2 sim2real	14.26	60.	6.17	5.2
3	Anastasiya Nikolskaya 🇷🇺	`12764`	1/1	JetBrains Research	12.4	34.	1.85	1.2
4	Raphael Jean	`12840`	1/1	exercise_state_estimation	11.16	48.	2.23	0.2
5	Robert Moni 🇭🇺	`12890`	1/1	speedRL	9.92	36.	1.42	2.
-	Raphael Jean	`12868`	1/1	sim-exercise-2	8.06	32.	1.63	0.4
-	Raphael Jean	`12749`	1/1	sim-exercise-1	7.44	44.	1.95	2.2
6	Kaiyi Chen 🇺🇸	`12854`	1/1	KK Net	6.82	36.	1.94	6.2
7	Melisande Teng	`12826`	1/1	exercise_state_estimation	6.2	34.	1.54	0.
8	Bea Baselines 🐤	`12675`	1/1	baseline-duckietown	4.96	52.	3.45	4.2

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is CLOSED for submissions.

Challenge LFI - Intersections (simulation 👾, testing 🏋)

#1 András Kalapos `13090`	#2 Yury Belousov `13209`	#3 Anastasiya Nikolskaya `12763`

copy link	copy link	copy link

Rank (user)	User	Submission	complete	User label	Traveled distance↑	Survival time↑	Lateral deviation ↓	Major infractions ↓
1	András Kalapos 🇭🇺	`13090`	1/1	3090	14.88	36.	1.62	1.2
2	Yury Belousov 🇷🇺	`13209`	1/1	JetBrains Research2 sim2real	12.4	60.	5.61	5.8
3	Anastasiya Nikolskaya 🇷🇺	`12763`	1/1	JetBrains Research	11.78	34.	1.76	0.8
4	Raphael Jean	`12839`	1/1	exercise_state_estimation	9.3	46.	1.99	0.6
5	Robert Moni 🇭🇺	`12889`	1/1	speedRL	9.3	34.	1.45	0.2
6	Kaiyi Chen 🇺🇸	`12853`	1/1	KK Net	8.68	48.	2.55	8.
-	Raphael Jean	`12867`	1/1	sim-exercise-2	8.68	36.	1.82	0.8
7	Melisande Teng	`12825`	1/1	exercise_state_estimation	8.06	44.	1.84	0.4
-	Raphael Jean	`12748`	1/1	sim-exercise-1	6.2	34.	1.42	0.4
8	Bea Baselines 🐤	`12676`	1/1	baseline-duckietown	4.96	48.	3.15	1.

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is CLOSED for submissions.

Challenge LFVI 🚗🚗🚦 - Lane following + Vehicles + Intersections (simulation 👾, validation 🏋)

#1 Raphael Jean `12846`	#2 Anastasiya Nikolskaya `12770`	#3 Kaiyi Chen `12860`

copy link	copy link	copy link

Rank (user)	User	Submission	complete	User label	Traveled distance↑	Survival time↑	Lateral deviation ↓	Major infractions ↓
1	Raphael Jean	`12846`	1/1	exercise_state_estimation	9.3	40.	1.44	0.6
2	Anastasiya Nikolskaya 🇷🇺	`12770`	1/1	JetBrains Research	8.68	28.	1.54	0.2
3	Kaiyi Chen 🇺🇸	`12860`	1/1	KK Net	8.06	38.	2.	3.4
4	Bea Baselines 🐤	`12710`	1/1	baseline-behavior-cloning	8.06	34.	1.62	0.8
5	Robert Moni 🇭🇺	`12928`	1/1	speedRL	8.06	28.	1.18	0.8
-	Raphael Jean	`12874`	1/1	sim-exercise-2	7.44	30.	1.51	1.8
6	András Kalapos 🇭🇺	`13101`	1/1	3090	7.44	20.	1.	0.4
7	Andras Beres	`13260`	1/1	101-1	6.2	20.	1.03	3.2
-	Anastasiya Nikolskaya 🇷🇺	`13173`	1/1	JetBrains Research0 real2sim v0.1.0 --REAL	4.34	18.	0.92	4.
8	Márton Tim 🇭🇺	`13025`	1/1	LF-only	4.34	14.	0.96	2.6

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is CLOSED for submissions.

Challenge LFVI 🚗🚗🚦 - Lane following + Vehicles + Intersections (simulation 👾, testing 🥇)

Rank (user)	User	Submission	complete	User label	Traveled distance↑	Survival time↑	Lateral deviation ↓	Major infractions ↓
1	Peter Almasi 🇭🇺	`13112`	1/1	rl-agent-9502-real	4.96	32.	0.8	0.4
2	Márton Tim 🇭🇺	`13039`	1/1	3625	3.72	10.	0.69	0.4
-	Márton Tim 🇭🇺	`13026`	1/1	LF-only	3.1	10.	0.6	1.4
3	Andras Beres	`13261`	1/1	101-1	3.1	8.	0.49	0.2
4	Melisande Teng	`12831`	1/1	exercise_state_estimation	2.48	16.	0.64	0.8
5	Raphael Jean	`12756`	1/1	sim-exercise-1	2.48	14.	0.46	0.
6	Kaiyi Chen 🇺🇸	`12859`	1/1	KK Net	2.48	12.	0.33	0.
7	Bea Baselines 🐤	`12711`	1/1	baseline-behavior-cloning	2.48	12.	0.42	0.6
-	Raphael Jean	`12845`	1/1	exercise_state_estimation	2.48	12.	0.43	0.
-	Raphael Jean	`12873`	1/1	sim-exercise-2	2.48	12.	0.54	0.

See also the extended leaderboard.

This is a testing challenge: the scores are visible, but not the full output.This challenge is CLOSED for submissions.

Challenge LFVI multibody 🚗🚗🚦 - Lane following + Vehicles + Intersections (simulation 👾, validation 🏋)

#1 Raphael Jean `12847`	#2 András Kalapos `13100`	#3 Bea Baselines `12712`

copy link	copy link	copy link

Rank (user)	User	Submission	complete	User label	Traveled distance↑	Survival time↑	Lateral deviation ↓	Major infractions ↓
1	Raphael Jean	`12847`	1/1	exercise_state_estimation	9.92	60.	2.44	0.
2	András Kalapos 🇭🇺	`13100`	1/1	3090	8.68	46.	1.47	3.8
3	Bea Baselines 🐤	`12712`	1/1	baseline-behavior-cloning	8.06	60.	2.83	0.4
-	Raphael Jean	`12875`	1/1	sim-exercise-2	8.06	52.	2.38	5.
-	Raphael Jean	`12758`	1/1	sim-exercise-1	6.82	60.	2.47	0.2
4	Robert Moni 🇭🇺	`12929`	1/1	speedRL	6.82	48.	2.32	0.8
5	Melisande Teng	`12833`	1/1	exercise_state_estimation	4.96	44.	2.29	0.
6	Yishu Malhotra 🇨🇦	`12819`	1/1	sim-exercise-2	3.72	40.	2.13	0.8
7	Kaiyi Chen 🇺🇸	`12861`	1/1	KK Net	2.48	44.	1.62	5.8
8	Yury Belousov 🇷🇺	`13219`	1/1	JetBrains Research2 sim2real	2.48	40.	2.28	0.8

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is CLOSED for submissions.

These challenges are the full-state information version as the other ones.

Challenge LF 🚗 - Lane following (simulation 👾, validation 🏋)

LF

Follow the lane

`LF`
Follow the lane
	This is the basic lane following challenge. You must follow the lane using the outputs of camera and encoders. See the documentation for more details .

This is the basic lane following challenge.

You must follow the lane using the outputs of camera and encoders.

See the documentation for more details .

Note: this is the validation 🏋 challenge - you can see the output but these are not the scores that count.

No entries to display.

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is CLOSED for submissions.

Challenge LFV_multi_full 🚗🚗🚗 - Lane following multibody (simulation 👾, validation 🏋)

This is LFV_multi with full state observability.

No entries to display.

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is CLOSED for submissions.

Challenge LFVI multibody full 🚗🚗🚦 - Lane following + Vehicles + Intersections (simulation 👾, validation 🏋)

This is LFVI_multi with full state observability.

No entries to display.

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is CLOSED for submissions.

Challenge LFP 🚗 - Lane following with Duckies (simulation 👾, validation 🏋)

LFP

Avoid the duckies pedestrians

`LFP`
Avoid the duckies pedestrians
	In this variation of the lane following challenge, you must follow the lane and avoid the duckies. See the documentation for more details .

In this variation of the lane following challenge, you must follow the lane and avoid the duckies.

See the documentation for more details .

Note: this is the validation challenge - you can see the output but these are not the scores that count.

No entries to display.

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is CLOSED for submissions.

Challenge LFVI 🚗🚗🚦 - Lane following + Vehicles + Intersections (simulation 👾, validation 🏋)

#1 Anastasiya Nikolskaya `12762`	#2 Robert Moni `12888`	#3 András Kalapos `13098`

copy link	copy link	copy link

Rank (user)	User	Submission	complete	User label	Traveled distance↑	Survival time↑	Lateral deviation ↓	Major infractions ↓
1	Anastasiya Nikolskaya 🇷🇺	`12762`	1/1	JetBrains Research	19.22	60.	3.48	1.4
2	Robert Moni 🇭🇺	`12888`	1/1	speedRL	17.36	60.	2.38	0.8
3	András Kalapos 🇭🇺	`13098`	1/1	3090	14.88	38.	1.56	2.
4	Márton Tim 🇭🇺	`13012`	1/1	3626	14.26	34.	1.9	2.8
5	Melisande Teng	`12824`	1/1	exercise_state_estimation	11.16	60.	2.75	0.
6	Raphael Jean	`12866`	1/1	sim-exercise-2	11.16	52.	2.2	7.4
-	Anastasiya Nikolskaya 🇷🇺	`13163`	1/1	JetBrains Research0 real2sim v0.1.0 --REAL	10.54	32.	1.56	0.
-	Raphael Jean	`12838`	1/1	exercise_state_estimation	8.68	42.	1.45	4.2
7	Bea Baselines 🐤	`12707`	1/1	baseline-behavior-cloning	7.44	32.	1.39	0.2
8	Kaiyi Chen 🇺🇸	`12852`	1/1	KK Net	6.2	36.	1.55	8.8

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is CLOSED for submissions.

Challenge LFV 🚗🚗 - Lane following + Vehicles (simulation 👾, validation 🏋)

Lane following challenge.

No entries to display.

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is CLOSED for submissions.

Challenge LFVI 🚗🚗🚦 - Lane following + Vehicles + Intersections (simulation 👾, validation 🏋)

#1 Robert Moni `12887`	#2 Anastasiya Nikolskaya `12761`	#3 Márton Tim `13013`

copy link	copy link	copy link

Rank (user)	User	Submission	complete	User label	Traveled distance↑	Survival time↑	Lateral deviation ↓	Major infractions ↓
1	Robert Moni 🇭🇺	`12887`	1/1	speedRL	17.36	60.	2.25	1.2
2	Anastasiya Nikolskaya 🇷🇺	`12761`	1/1	JetBrains Research	16.12	60.	3.33	1.4
3	Márton Tim 🇭🇺	`13013`	1/1	3626	14.88	34.	1.84	2.8
4	András Kalapos 🇭🇺	`13099`	1/1	3090	14.26	34.	1.43	0.8
5	Raphael Jean	`12865`	1/1	sim-exercise-2	10.54	42.	2.04	1.6
-	Anastasiya Nikolskaya 🇷🇺	`13162`	1/1	JetBrains Research0 real2sim v0.1.0 --REAL	10.54	32.	1.63	0.
-	Raphael Jean	`12837`	1/1	exercise_state_estimation	8.06	32.	1.29	0.
-	Raphael Jean	`12750`	1/1	sim-exercise-1	7.44	42.	1.78	3.4
6	Bea Baselines 🐤	`12700`	1/1	baseline-behavior-cloning	7.44	32.	1.39	0.2
7	Melisande Teng	`12823`	1/1	exercise_state_estimation	6.2	36.	1.51	2.

See also the extended leaderboard.

This is a validation challenge: the output is visible to everybody. This challenge is CLOSED for submissions.

Statistics

1523	users
222	challenges
28317	submissions
199220	evaluation jobs