360-degree cameras have a new superpower | The Verge
Overview
Tech Expand Amazon Apple Facebook Google Microsoft Samsung Business See all tech
Reviews Expand Smart Home Reviews Phone Reviews Tablet Reviews Headphone Reviews See all reviews
Details
Science Expand Space Energy Environment Health See all science
Entertainment Expand TV Shows Movies Audio See all entertainment
Policy Expand Antitrust Politics Law Security See all policy
Gadgets Expand Laptops Phones TVs Headphones Speakers Wearables See all gadgets
Verge Shopping Expand Buying Guides Deals Gift Guides See all shopping
Streaming Expand Disney HBONetflix You Tube Creators See all streaming
Transportation Expand Electric Cars Autonomous Cars Ride-sharing Scooters See all transportation
Tech Close Tech Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Tech
Posts from this topic will be added to your daily email digest and your homepage feed.
Gadgets Close Gadgets Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Gadgets
Posts from this topic will be added to your daily email digest and your homepage feed.
News Close News Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All News
Posts from this topic will be added to your daily email digest and your homepage feed.
Insta 360 cameras and Antigravity drones can use Gaussian splats to digitize little chunks of the world.
Insta 360 cameras and Antigravity drones can use Gaussian splats to digitize little chunks of the world.
Posts from this author will be added to your daily email digest and your homepage feed.
Posts from this author will be added to your daily email digest and your homepage feed.
Imagine Google Street View, except you can walk around like it’s a video game. Now imagine you don’t need to wait for Google to come film because it’s completely DIY. Insta 360, the leading maker of 360-degree cameras, is now partnered with a 12-person UK startup called Splatica to help creators do just that.
Last January, we wrote about Gaussian splatting, the tech that promises to someday let anyone digitally recreate chunks of the real world in photorealistic 3D. But Splatica is making it surprisingly easy to harness splats today — with nothing more than an off-the-shelf consumer 360-degree camera and a subscription service that handles everything else.
This is not a video. This is a 3D digital recreation of my backyard that I can explore like a video game level.
When I say “surprisingly easy,” I mean it — this is all I had to do:
Change two settings on an off-the-shelf Insta 360 camera or Antigravity drone
Record a video while walking (or flying) around the area
Wait a day for a miniature 3D world to appear in my web browser
I tried it with both an Insta 360 X5 camera and an Antigravity A1, and you can check out my results below. While they’re definitely not perfect — splats can often look a bit ethereal, like you’re stepping into a CG painting — I’m already convinced some creators and businesses will buy 360-degree cameras for this purpose alone. Insta 360 co-founder Max Richter tells me the company’s cameras were already in demand for real estate virtual tours, construction progress reports, and facility inspections — if I were a real-estate agent, I’d buy one for this feature right now.
Here’s my Antigravity A1 capture of a giant play structure in my local park (use the WASD keys on a keyboard to fly and a mouse to steer, or drag the on-screen controls on a phone):
And the beat-up basketball hoop at another park down the road. Splatica automatically edits out most people in the scene, so the park’s a little emptier than it was in reality.
If you tap the path button in the upper-right hand corner, underneath “SD” and “HD,” you should see the exact winding path I took with each camera (and the Insta 360 X5’s selfie stick) to create these results.
When I simply circle around the hoop once, as you can see below, it doesn’t look nearly as good. Splatica can only recreate what your camera sees, so you need to film from every place you might want to “stand” in the virtual world.
Below, I tried to simulate a basic bridge inspection at the same park, focusing on one pillar underneath the BART commuter rail. I’m not sure it has enough detail to satisfy real surveyors or safety inspectors — perhaps that’s because the drone’s overzealous obstacle avoidance kept pausing my flight.
But when I spent over five minutes capturing my own backyard with the X5, the results were so expansive my wife and I didn’t feel quite feel comfortable sharing the whole scan. Instead, check out how Splatica recreated all the objects in my backyard by generating a 3D point cloud:
You can summon point clouds for any Splatica scene by pressing X on a desktop keyboard, by the way.
All of these scans can be downloaded in PLY and USDZ format and associated with real-world measurements: Splatica co-founder Andrey Shelomentsev tells me there’s typically a one percent error every 100 centimeters, “good enough for surveying and some rough exploration of the space,” and says measurements can be more accurate by placing some markers around an area.
This actually isn’t the first time I’ve tried to 3D scan my backyard: in 2021, I did it with a Skydio self-flying drone. But back then, Skydio was charging $2,999 per year for the feature, not including a drone or a service to stitch the photos together, while Splatica claims its service does it all autonomously with a normal 360-degree video.
Splatica’s own sample scenes are even more interesting than mine, particularly now that it’s trying to prove companies can use its service to train robots before deploying them for real in factories around the world. Here’s the Imecar Elektronik factory in Antalya, Türkiye:
And for something completely different, here’s part of the Leighton House in London:
How is this possible just by walking around with a camera? Shelomentsev tells me his company’s built a proprietary version of SLAM (the Simultaneous Localization and Mapping technique that lets all kinds of robots, self-driving cars, and VR headsets know their position in 3D space) specifically designed to create accurate point clouds from 360-degree video. You can think of point clouds as the “bones” of 3D objects that then get painted with color.
And while Splatica says it can work with any 360-degree camera, it helps that Insta 360 and Antigravity’s cameras put all kinds of extra metadata into the video files themselves. “The files carry everything we need: lens distortion parameters, shutter speed, accelerometer and gyroscope data, and GPS — streamed from the Insta 360 mobile app directly to the camera during capture,” Splatica CEO and co-founder Eugene Nikolskii tells The Verge.
Above: Corridor Crew visually explains how splats work.
The Insta 360/Splatica combo does have its limitations. If you zoom into any of my embedded or linked examples to see fine details, you’ll probably see slightly translucent blobs of color rather than legible textures — that’s how splats are made, after all. Traditional high-res photogrammetry might do a better job if surfaces are what you care about most.
But that isn’t stopping Insta 360, Antigravity, and Splatica from launching a marketing campaign called Project Eternal, which the companies are touting as a “global initiative” to preserve cultural landmarks for future generations. It’s offering prizes for the best Gaussian splats, 1,000 free Splatica uploads (first-come first served), and a pilot project to scan Pompeii and the stunning Civita di Bagnoregio in Italy. They’re also “inviting creators worldwide” to scan sites like Roman theaters and Korea’s Jeju Island.
Beyond that, Insta 360’s Richter says his company already has enterprise customers piloting 3D reconstruction and digital twin workflows in the construction and facilities management realms, and hopes to provide richer data from the camera to 3D reconstruction services and make the process more seamless.
Right now, the biggest barrier to entry with Splatica might be that the service isn’t cheap. The company charges anywhere between 18 cents and 25 cents per second of processed video, and you have to pay a monthly subscription too. The company’s currently experimenting with pricing — last week it was
But if you want to give it a try, you might still be able to get one of the 1,000 free slots. Splatica says it’s waiving its subscription fee for those first 1,000 users, who should each be able to turn around 10 minutes of 360-degree footage into little 3D worlds. You can also explore over 100 additional splats in Splatica’s public gallery.
Sean Hollister Close Sean Hollister Senior Editor Posts from this author will be added to your daily email digest and your homepage feed. Follow Follow See All by Sean Hollister
Posts from this author will be added to your daily email digest and your homepage feed.
Cameras Close Cameras Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Cameras
Posts from this topic will be added to your daily email digest and your homepage feed.
Drones Close Drones Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Drones
Posts from this topic will be added to your daily email digest and your homepage feed.
Gadgets Close Gadgets Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Gadgets
Posts from this topic will be added to your daily email digest and your homepage feed.
Hands-on Close Hands-on Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Hands-on
Posts from this topic will be added to your daily email digest and your homepage feed.
News Close News Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All News
Posts from this topic will be added to your daily email digest and your homepage feed.
Report Close Report Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Report
Posts from this topic will be added to your daily email digest and your homepage feed.
Reviews Close Reviews Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Reviews
Posts from this topic will be added to your daily email digest and your homepage feed.
Tech Close Tech Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Tech
Posts from this topic will be added to your daily email digest and your homepage feed.
Microsoft brings Xbox back, scraps Microsoft Gaming
Leak reveals new Xbox Game Pass ‘Starter Edition’ that’s part of Discord Nitro
Microsoft offers voluntary retirement to long-serving employees
Key Takeaways
- Tech Expand Amazon Apple Facebook Google Microsoft Samsung Business See all tech
- Reviews Expand Smart Home Reviews Phone Reviews Tablet Reviews Headphone Reviews See all reviews
- Science Expand Space Energy Environment Health See all science
- Entertainment Expand TV Shows Movies Audio See all entertainment
- Policy Expand Antitrust Politics Law Security See all policy
