Skip to content

Commit

Permalink
update
Browse files Browse the repository at this point in the history
  • Loading branch information
Manchery committed Dec 10, 2024
1 parent b049169 commit 8cec474
Show file tree
Hide file tree
Showing 19 changed files with 79 additions and 1 deletion.
80 changes: 79 additions & 1 deletion index.html
Original file line number Diff line number Diff line change
Expand Up @@ -132,7 +132,29 @@ <h3 class="title is-4">NeurIPS 2024</h3>
<span class="icon">
<i class="fa fa-database"></i>
</span>
<span>Model</span>
<span>Models</span>
</a>
</span>

<!-- Poster Link. -->
<span class="link-block">
<a target="_blank" href="https://manchery.github.io/assets/pub/nips2024_ivideogpt/poster.pdf"
class="external-link button is-normal is-rounded is-dark">
<span class="icon">
<i class="fa fa-image"></i>
</span>
<span>Poster</span>
</a>
</span>

<!-- Slides Link. -->
<span class="link-block">
<a target="_blank" href="https://manchery.github.io/assets/pub/nips2024_ivideogpt/slides.pdf"
class="external-link button is-normal is-rounded is-dark">
<span class="icon">
<i class="fa fa-film"></i>
</span>
<span>Slides</span>
</a>
</span>
</div>
Expand Down Expand Up @@ -281,6 +303,62 @@ <h3 class="title is-4">Video Samples: Open X-Embodiment (Action-free)</h3>
</div>
<p class="content has-text-centered"><i>In each pair, the left image is the ground truth and the right image is the predicted video.
The red border indicates the context frame and the green border means the frame was predicted. <b>Hover to zoom in.</b></i></p>
</div>
<br/>
<h3 class="title is-4">Open X-Embodiment (Goal-conditioned)</h3>
<p class="content has-text-justified">
A sequence of tokens provides a flexible way to specify tasks, inputs, and outputs. A variant of iVideoGPT for <b>goal-conditioned video prediction</b>
is simply achieved by rearranging the frame sequence, while keeping the architecture and training procedure consistent.
</p>
<div class="zoom_container has-text-centered">
<div id="content_zoom_out">
<img src="./static/gifs/oxe_goal_cond_1.gif" style="width:16%"/>
<img src="./static/gifs/oxe_goal_cond_2.gif" style="width:16%"/>
<img src="./static/gifs/oxe_goal_cond_3.gif" style="width:16%"/>
<img src="./static/gifs/oxe_goal_cond_4.gif" style="width:16%"/>
<img src="./static/gifs/oxe_goal_cond_5.gif" style="width:16%"/>
<img src="./static/gifs/oxe_goal_cond_6.gif" style="width:16%"/>
<br/>
<img src="./static/gifs/oxe_goal_cond_7.gif" style="width:16%"/>
<img src="./static/gifs/oxe_goal_cond_8.gif" style="width:16%"/>
<img src="./static/gifs/oxe_goal_cond_9.gif" style="width:16%"/>
<img src="./static/gifs/oxe_goal_cond_10.gif" style="width:16%"/>
<img src="./static/gifs/oxe_goal_cond_11.gif" style="width:16%"/>
<img src="./static/gifs/oxe_goal_cond_12.gif" style="width:16%"/>
<br/>
<img src="./static/gifs/oxe_goal_cond_13.gif" style="width:16%"/>
<img src="./static/gifs/oxe_goal_cond_14.gif" style="width:16%"/>
<img src="./static/gifs/oxe_goal_cond_15.gif" style="width:16%"/>
<img src="./static/gifs/oxe_goal_cond_16.gif" style="width:16%"/>
<img src="./static/gifs/oxe_goal_cond_17.gif" style="width:16%"/>
<img src="./static/gifs/oxe_goal_cond_18.gif" style="width:16%"/>
</div>
<div id="content_zoom_in">
<img src="./static/gifs/oxe_goal_cond_1.gif" style="width:33%"/>
<img src="./static/gifs/oxe_goal_cond_2.gif" style="width:33%"/>
<img src="./static/gifs/oxe_goal_cond_3.gif" style="width:33%"/>
<br/>
<img src="./static/gifs/oxe_goal_cond_4.gif" style="width:33%"/>
<img src="./static/gifs/oxe_goal_cond_5.gif" style="width:33%"/>
<img src="./static/gifs/oxe_goal_cond_6.gif" style="width:33%"/>
<br/>
<img src="./static/gifs/oxe_goal_cond_7.gif" style="width:33%"/>
<img src="./static/gifs/oxe_goal_cond_8.gif" style="width:33%"/>
<img src="./static/gifs/oxe_goal_cond_9.gif" style="width:33%"/>
<br/>
<img src="./static/gifs/oxe_goal_cond_10.gif" style="width:33%"/>
<img src="./static/gifs/oxe_goal_cond_11.gif" style="width:33%"/>
<img src="./static/gifs/oxe_goal_cond_12.gif" style="width:33%"/>
<br/>
<img src="./static/gifs/oxe_goal_cond_13.gif" style="width:33%"/>
<img src="./static/gifs/oxe_goal_cond_14.gif" style="width:33%"/>
<img src="./static/gifs/oxe_goal_cond_15.gif" style="width:33%"/>
<br/>
<img src="./static/gifs/oxe_goal_cond_16.gif" style="width:33%"/>
<img src="./static/gifs/oxe_goal_cond_17.gif" style="width:33%"/>
<img src="./static/gifs/oxe_goal_cond_18.gif" style="width:33%"/>
</div>
<p class="content has-text-centered"><i>In each pair, the left image is the ground truth and the right image is the predicted video. <b>Hover to zoom in.</b></i></p>
</div>
<br/>
<details>
Expand Down
Binary file added static/gifs/oxe_goal_cond_1.gif
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added static/gifs/oxe_goal_cond_10.gif
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added static/gifs/oxe_goal_cond_11.gif
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added static/gifs/oxe_goal_cond_12.gif
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added static/gifs/oxe_goal_cond_13.gif
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added static/gifs/oxe_goal_cond_14.gif
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added static/gifs/oxe_goal_cond_15.gif
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added static/gifs/oxe_goal_cond_16.gif
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added static/gifs/oxe_goal_cond_17.gif
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added static/gifs/oxe_goal_cond_18.gif
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added static/gifs/oxe_goal_cond_2.gif
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added static/gifs/oxe_goal_cond_3.gif
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added static/gifs/oxe_goal_cond_4.gif
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added static/gifs/oxe_goal_cond_5.gif
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added static/gifs/oxe_goal_cond_6.gif
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added static/gifs/oxe_goal_cond_7.gif
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added static/gifs/oxe_goal_cond_8.gif
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added static/gifs/oxe_goal_cond_9.gif
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 8cec474

Please sign in to comment.