-
Notifications
You must be signed in to change notification settings - Fork 0
/
survey.html
168 lines (137 loc) · 6.61 KB
/
survey.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
<!DOCTYPE HTML>
<!--
Massively by HTML5 UP
html5up.net | @ajlkn
Free for personal and commercial use under the CCA 3.0 license (html5up.net/license)
-->
<html>
<head>
<title>Survey|Purdue Digital Twin Lab</title>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1, user-scalable=no" />
<link rel="stylesheet" href="assets/css/main.css" />
<link rel="icon" href="images/icon_36_36.png"/>
<noscript>
<link rel="stylesheet" href="assets/css/noscript.css" />
</noscript>
</head>
<body class="is-preload">
<!-- Wrapper -->
<div id="wrapper">
<!-- Header -->
<header id="header">
<a href="index.html" class="logo">LLM4AD</a>
</header>
<!-- Nav -->
<nav id="nav">
<ul class="links">
<li><a href="index.html">Overview</a></li>
<li><a href="talk2drive.html">Talk2Drive</a></li>
<!-- <li><a href="generic.html">Demos</a></li> -->
<li><a href="3R.html">3R</a></li>
<li class="active"><a href="survey.html">Survey</a></li>
<li><a href="lampilot.html">Lampilot</a></li>
<!-- <li class="active"><a href="elements.html">Elements Reference</a></li> -->
</ul>
</nav>
<!-- Main -->
<div id="main">
<!-- Post -->
<section class="post">
<center>
<h2>A Survey on Multimodal Large Language Models for Autonomous Driving</h2>
</center>
<center>
<h4>Can Cui*, Yunsheng Ma*, Xu Cao*, Wenqian Ye*, Yang Zhou, Kaizhao Liang, Jintai Chen,
Juanwu Lu, Zichong Yang, Kuei-Da Liao, Erlong Li, Kun Tang, Zhipeng Cao, Tong Zhou,
Ao Liu, Xinrui Yan, Shuqi Mei, Jianguo Cao, Ziran Wang and Chao Zheng<br /></h4>
</center>
<ul class="actions special">
<li><a href="https://github.com/IrohXu/Awesome-Multimodal-LLM-Autonomous-Driving"
class="button large">Github</a></li>
<li><a href="https://openaccess.thecvf.com/content/WACV2024W/LLVM-AD/html/Cui_A_Survey_on_Multimodal_Large_Language_Models_for_Autonomous_Driving_WACVW_2024_paper.html"
class="button large">Paper</a></li>
</ul>
<p>This survey is the first survey of investigating the current efforts, key challenges, and
opportunities in
applying Multimodal Large Language Models (MLLMs) to driving systems.<br /></p>
</header>
<header>
<p>Key Features:<br />
1. We first introduce the background of MLLMs, the multimodal models development using LLMs, and
the history of autonomous driving.<br />
2. We overview existing MLLM tools for driving, transportation, and map systems together with
existing datasets.<br />
3. We summarize the works in The 1st WACV Workshop on Large Language and Vision Models for
Autonomous Driving. <br />
4. We also discuss several important problems regarding using MLLMs in autonomous driving
systems that need to be solved by both academia and industry. <br />
<a href="#" class="image main"><img src="images/workflow_survey.png" alt="" /></a>
<hr />
<h2>Recent Advancements in MLLMs</h2>
<div class="image main"><img src="images/timeline.png" alt="" /></div>
<hr />
<header>
<h2>The chronological development of autonomous driving technology</h2>
<div class="image main"><img src="images/av_timeline.png" alt="" /></div>
<!-- <p>Lorem ipsum dolor sit amet nullam id egestas urna aliquam</p> -->
</header>
<hr />
<h2>The chronological development of autonomous driving technology</h2>
<div class="image main"><img src="images/table_MMLMs.png" alt="" /></div>
<hr />
<header>
<h2>Multimodal-Language datasets for autonomous driving technology</h2>
<div class="image main"><img src="images/table_dataset.png" alt="" /></div>
<!-- <p>Lorem ipsum dolor sit amet nullam id egestas urna aliquam</p> -->
</header>
<hr />
<div style="overflow-x: auto;">
<table style="width:100%">
<h2> Core Contributors</h2>
<tr>
<td style="text-align:center"><img src="https://purduedigitaltwin.github.io/assets/images/people/can.jpg" height="160"></td>
<td style="text-align:center"><img src="https://purduedigitaltwin.github.io/assets/images/people/yunsheng.jpg" height="160"></td>
<td style="text-align:center"><img src="https://raw.githubusercontent.com/LLVM-AD/llvm-ad.github.io/main/assets/img/Xu_Cao.jpg" height="160"></td>
<td style="text-align:center"><img src="https://wenqian-ye.github.io/images/selfie.jpeg" height="160"></td>
<td style="text-align:center"><img src="https://purduedigitaltwin.github.io/assets/images/people/prof_wang.jpg" height="160"></td>
</tr>
<tr>
<td style="text-align:center"><a href="https://cancui19.github.io/">Can Cui</a> <br> Purdue University</td>
<td style="text-align:center"><a href="https://maysonma.github.io/">Yunsheng Ma</a> <br>Purdue University</td>
<td style="text-align:center"><a href="https://www.linkedin.com/in/irohxu/">Xu Cao</a> <br>PediaMed AI & UIUC</td>
<td style="text-align:center"><a href="https://wenqian-ye.github.io/">Wenqian Ye</a> <br> PediaMed AI & UVA </td>
<td style="text-align:center"><a href="https://ziranw.github.io">Ziran Wang</a> <br>Purdue University</td>
</tr>
<tr>
<td style="text-align:center"><img src="https://scholar.googleusercontent.com/citations?view_op=medium_photo&user=6A1yEFMAAAAJ&citpid=1" height="200"></td>
<!-- <td style="text-align:center"><img src="https://raw.githubusercontent.com/LLVM-AD/llvm-ad.github.io/main/assets/img/Tong_Zhou.jpg" height="100"></td> -->
</tr>
<tr>
<td style="text-align:center"><a href="">Chao Zheng</a> <br>Tencent</td>
<!-- <td style="text-align:center"><a href="">Tong Zhou</a> <br> Tencent</td> -->
</tr>
<!-- <td style="text-align:center"><a href="">Tong Zhou</a> <br> Tencent</td> -->
</tr>
</table>
</div>
</div>
</div>
<!-- Copyright -->
<div id="copyright">
<ul>
<li>© Purdue Digital Twin Lab</li>
<li>Lab Website: <a href="https://purduedigitaltwin.github.io">purduedigitaltwin.github.io</a></li>
</ul>
</div>
</div>
<!-- Scripts -->
<script src="assets/js/jquery.min.js"></script>
<script src="assets/js/jquery.scrollex.min.js"></script>
<script src="assets/js/jquery.scrolly.min.js"></script>
<script src="assets/js/browser.min.js"></script>
<script src="assets/js/breakpoints.min.js"></script>
<script src="assets/js/util.js"></script>
<script src="assets/js/main.js"></script>
</body>
</html>