AI4CE Lab @ NYU

All

51 repositories

FusionSense
Public
Integrates the vision, touch, and common-sense information of foundational models, customized to the agent's perceptual needs.
robotics 3d-reconstruction tactile novel-view-synthesis tactile-sensor novel-viewpoint-synthesis tactile-perception tactile-sensing 3d-gaussian-splatting 3d-gaussian-splat
Python
•
Apache License 2.0
•1•24•0•0•Updated Nov 28, 2024Nov 28, 2024
CityWalker
Public
CityWalker: Learning Embodied Urban Navigation from Web-Scale Videos
imitation-learning robot-learning quadruped visual-navigation video-learning outdoor-navigation embodied-ai embodied-navigation urban-navigation scaling-law
Python
•
Apache License 2.0
•0•6•0•0•Updated Nov 28, 2024Nov 28, 2024
UNav-Server
Public
Python
•0•1•0•2•Updated Nov 27, 2024Nov 27, 2024
insta360_ros_driver
Public
A ROS driver for Insta360 cameras, enabling real-time image capture, processing, and publishing in ROS environments.
driver ros webcam 360-camera insta360 insta360-one-x2 insta360-one-x3 insta360-sdk
Python
•
Apache License 2.0
•4•37•3•0•Updated Nov 25, 2024Nov 25, 2024
MSG
Public
[NeurIPS2024] Multiview Scene Graph (topologically representing a scene from unposed images by interconnected place and object nodes)
computer-vision deep-learning scene-graph multiview visual-navigation scene-representations neurips-2024
Python
•2•55•0•1•Updated Nov 24, 2024Nov 24, 2024
LoQI-VPR
Public
For more information, please visit the project website
Python
•0•3•0•0•Updated Nov 24, 2024Nov 24, 2024
DPVO
Public
DPVO accompanying the CityWalker repository
C++
•
MIT License
•83•0•0•0•Updated Nov 23, 2024Nov 23, 2024
SeeDo
Public
Human Demo Videos to Robot Action Plans
robotics learning-from-demonstration task-planning vlm
Python
•6•32•0•0•Updated Nov 14, 2024Nov 14, 2024
vis_nav_game_public
Public
Public version of vis_nav_game
Python
•
MIT License
•0•0•0•0•Updated Oct 23, 2024Oct 23, 2024
NYC-Event-VPR
Public
nyc dataset vpr nyc-opendata event-camera
Python
•0•14•0•0•Updated Oct 21, 2024Oct 21, 2024
LUWA
Public
computer-vision archeology anthropology ai4science large-vision-language-model
Jupyter Notebook
•0•2•0•0•Updated Oct 18, 2024Oct 18, 2024
vis_nav_player
Public
[ROB-GY 6203] Example Visual Navigation Player Code for Course Project
robotics visual-navigation
Python
•16•5•0•0•Updated Oct 12, 2024Oct 12, 2024
EgoPAT3Dv2
Public
[ICRA 2024] Official Implementation of EgoPAT3Dv2: Predicting 3D Action Target from 2D Egocentric Vision for Human-Robot Interaction
computer-vision robotics dataset human-robot-interaction human-robot-collaboration egocentric-vision
Python
•0•2•1•0•Updated Oct 10, 2024Oct 10, 2024
Occ4cast
Public
Occ4cast: LiDAR-based 4D Occupancy Completion and Forecasting
machine-learning computer-vision point-cloud artificial-intelligence dataset lidar autonomous-driving autonomous-vehicles occupancy-grid-map occupancy-prediction
Python
•
Apache License 2.0
•8•125•2•0•Updated Oct 8, 2024Oct 8, 2024
folder2hdf5
Public
A sample codebase for converting folder dataset to a hdf5 dataset
Python
•0•0•0•0•Updated Oct 5, 2024Oct 5, 2024
SSCBench
Public
SSCBench: A Large-Scale 3D Semantic Scene Completion Benchmark for Autonomous Driving
machine-learning computer-vision artificial-intelligence dataset autonomous-driving autonomous-vehicles occupancy-grid-map semantic-scene-understanding 2d-to-3d 3d-perception
Python
•11•178•10•0•Updated Sep 24, 2024Sep 24, 2024
realsense_ROS2_interface
Public
This package interfaces the robot/joystick with the realsense ROS2 wrapper
Python
•0•0•0•0•Updated Sep 20, 2024Sep 20, 2024
joy_hand_eye_ROS2
Public
This minimal package can be used to perform hand-eye-calibration in a ROS2 environment with a joystick
robotics hand-eye-calibration ros2
Python
•0•0•1•0•Updated Sep 20, 2024Sep 20, 2024
ur_ros2
Public
This package is some additions to the official UR ROS2 driver that enables teleoperation and some more visualization. Developed at AI4CE Lab at NYU.
robotics universal-robots ros2 teleoperation
Python
•0•0•1•0•Updated Sep 18, 2024Sep 18, 2024
xarm_ros2
Public
This package is the official xarm ROS2 package with modifications from AI4CE lab at NYU
robotics ros2 teleoperation xarm ufactory
Python
•0•0•0•0•Updated Sep 11, 2024Sep 11, 2024
usbcam_ROS2_interface
Public
This package interfaces the robot/joystick with a USB cam
robotics ros2 usbcamera
Python
•0•0•0•0•Updated Aug 18, 2024Aug 18, 2024
ai4ce_robot_ROS2_drivers
Public
This repo contains all the ROS2 driver packages modified at AI4CE lab for working with various robots
robotics universal-robots ros2 ufactory
0•1•0•0•Updated Aug 10, 2024Aug 10, 2024
DeepMapping
Public
[CVPR2019 Oral] Self-supervised Point Cloud Map Estimation
mapping registration unsupervised-learning deep-learning point-cloud
Python
•
Other
•44•193•0•1•Updated Jul 25, 2024Jul 25, 2024
ai4ce_sensor_ROS2_interfaces
Public
This repo contains all the ROS2 packages developed at AI4CE lab for interfacing with various specialized sensors
robotics hand-eye-calibration sensors realsense ros2 tactile-sensor tactile-sensing gelsight gelsight-mini
0•0•0•0•Updated Jul 23, 2024Jul 23, 2024
UNav_demo
Public
Jupyter Notebook
•0•0•0•0•Updated Jul 22, 2024Jul 22, 2024
SPARE3D
Public
[CVPR2020] A Dataset for SPAtial REasoning on Three-View Line Drawings
reasoning spatial-reasoning line-drawings line-drawing pythonocc deep-learning
Python
•9•52•1•2•Updated Jul 18, 2024Jul 18, 2024
NYC-Indoor-VPR
Public
Python
•0•10•1•0•Updated Jul 5, 2024Jul 5, 2024
DeepMapping2
Public
[CVPR2023] DeepMapping2: Self-Supervised Large-Scale LiDAR Map Optimization
mapping lidar slam lidar-slam lidar-mapping training-as-optimization deepmapping large-scale-mapping
Python
•
MIT License
•17•158•0•1•Updated Jun 26, 2024Jun 26, 2024
LLM4VPR
Public
Can multimodal LLM help visual place recognition?
robotics visual-place-recognition vpr vision-and-language llm vision-language-model
Python
•1•32•0•0•Updated Jun 26, 2024Jun 26, 2024
MARS
Public
[CVPR2024] Multiagent Multitraversal Multimodal Self-Driving: Open MARS Dataset
dataset multiagent nerf self-driving multimodal-deep-learning collaborative-perception cvpr2024 3dgs coperception
Python
•0•43•2•0•Updated Jun 25, 2024Jun 25, 2024