Skip to content

Releases: spear-sim/spear

v0.5.0

16 Jun 03:41
e1165c2
Compare
Choose a tag to compare

Precompiled binaries

Changes

This release includes the following new user-facing features and improvements.

  • We have developed an experimental new Python API that can be used to call any public Unreal function, and can be used to get or set any public Unreal property, on any Unreal object, at any time. Our new API exposes more than 10,000 public Unreal functions and more than 50,000 public Unreal properties. As far as we are aware, there is no comparable functionality in any existing video game simulator. We have started using the new API in our mujoco_interop example application (see below), and we expect it to support all of our internal use cases going forward.

  • We have developed an export pipeline to support interoperability with the MuJoCo physics engine. To demonstrate this pipeline, we have developed a new example application, mujoco_interop, shown in the image below. In this example application, an interactive MuJoCo simulation (left) is used to set the poses of objects in the photorealistic SPEAR rendering (right).

image
  • We are releasing 23 new photorealistic Kujiale scenes. The following images of kujiale_0010, kujiale_0020, kujiale_0030 were captured in SPEAR running at over 60 fps.

image

image

image

  • We have made many usability and readability improvements to our code.

v0.4.0

31 Dec 02:06
0bded5e
Compare
Choose a tag to compare

Precompiled binaries

Scenes

Windows

macOS

Linux

Changes

This release includes the following new user-facing features and improvements.

  • We are releasing nine new photorealistic Kujiale scenes. The following image of kujiale_0004 was captured in SPEAR running at 4K resolution at 50 fps.

image

  • We are re-releasing our warehouse_0000 scene (pictured below), which is now fully compatible with Unreal Engine 5.

image

  • We have re-enabled our Fetch robot agent, which is now fully compatible with Unreal Engine 5 (pictured above). We have also implemented an improved tutorial, open_loop_control_fetch, demonstrating how to interact with our Fetch agent in a mobile manipulation application.

  • We have made several usability and readability improvements to our code.

v0.3.0

21 Jul 08:35
Compare
Choose a tag to compare

Precompiled binaries

Scenes

kujiale_0000

Changes

This release includes the following new user-facing features and improvements.

  • We are releasing a new photorealistic scene, apartment_0000 under a Creative Commons license. We include all of the Unreal content for this scene directly in our GitHub repository, so users can easily modify and experiment with the content directly in the Unreal Editor. The following image of apartment_0000 was captured in SPEAR running at 4K resolution at 60 fps.

image

  • We have upgraded from Unreal Engine 4 to Unreal Engine 5. This update significantly improves the overall visual quality that users can expect from SPEAR, and makes rendering noticeably more consistent across platforms. The following image shows our kujiale_0000 scene, and demonstrates the visual quality users can expect in Unreal Engine 5. This image was captured in SPEAR running at 4K resolution at 40 fps.

image

  • Under the hood, upgrading to Unreal Engine 5 enables SPEAR to take advantage of Unreal's latest rendering features, including a state-of-the-art fully dynamic global illumination lighting system known as Lumen, and a state-of-the-art virtual geometry streaming system known as Nanite. Lumen enables all lights and objects to be moved fully dynamically with minimal precomputation required, and Nanite enables very high-resolution geometry to be imported and rendered such that the overall rendering cost scales with pixels rather than triangles. We expect these features to be especially useful as we scale the number of scenes that are available in SPEAR in the coming months.

  • We have improved the visual appearance of our OpenBot model.

image

  • We have made several usability and readability improvements to our code, especially to our examples.

v0.2.0

31 Mar 16:37
Compare
Choose a tag to compare

Precompiled binaries

Scene data

kujiale_0000

warehouse_0000

Changes

This release includes the following new user-facing features and improvements.

  • A large new photorealistic scene, warehouse_0000, which can be used to train industrial robots for warehouse applications.

image

  • A new agent, Fetch, that is capable of mobile manipulation tasks.
  • A new example application, open_loop_control_fetch, which demonstrates our Fetch agent performing a simple mobile manipulation task.

image

  • A new scene that is intended for debugging, starter_content_0000, which loads very quickly and is suitable for simple manipulation and navigation tasks.

image

  • Improved behavior when running the SpearSim executable with no additional arguments. The default behavior is now an interactive navigation mode, where a user can navigate around the kujiale_0000 scene.
  • A new command-line tool, run_executable, which launches SpearSim in interactive navigation mode and loads a user-specified scene.
  • An improved communication mechanism between the SpearSim executable and surrounding Python code, which more than doubles the overall frame rate when communicating large image observations.
  • An improved navigation policy that was trained using our imitation_learning_openbot example application to collect data.
  • Our macOS SpearSim executable is now correctly code-signed.

v0.1.0

10 Dec 00:03
Compare
Choose a tag to compare

Precompiled binaries

  • Windows: SpearSim-v0.1.0-Win64-Shipping.zip
    • If you are running on Windows, you will need to use the executable located at SpearSim-Win64-Shipping/SpearSim/Binaries/Win64/SpearSim-Win64-Shipping-Cmd.exe. This executable ensures that stdout output is routed correctly to the Windows terminal.
  • macOS: SpearSim-v0.1.0-Mac-Shipping.zip
    • Our macOS binary is unsigned, due to a known issue with signing Unreal Engine binaries on macOS. If you are running on macOS, you will need to explicitly grant permission to run this precompiled binary. See this thread for more details.
  • Linux: SpearSim-v0.1.0-Linux-Shipping.zip

Scene data