360 degree cameras have a new superpower

Imagine Google Street View, except you can walk around as if it were a video game. Now imagine that you don’t need to wait for Google Photography to come along because it is completely done by yourself. Insta360, the leading 360-degree camera manufacturer, has now partnered with a 12-person UK startup It’s called splatica To help content creators do just that.

last january, We’ve written about Gaussian sprayingtechnology that promises to one day allow anyone to digitally recreate parts of the real world in realistic 3D. But Splatica makes it surprisingly easy to harness strikes today — with nothing more than a ready-to-use consumer 360-degree camera and a subscription service that handles everything else.

When I say “surprisingly easy”, I mean it – that’s all I had to do:

I’ve tried it with both Insta360 X5 camera and Anti-Gravity A1And you can check out my results below. While it’s certainly not perfect – the spots can often look a bit ethereal, as if you’re stepping into a CG painting – I’m actually convinced that some creatives and companies will buy 360-degree cameras for that purpose alone. Max Richter, co-founder of Insta360, told me the company’s cameras were already in demand for real estate virtual tours, construction progress reports, and facility inspections — if I were a real estate agent, I’d buy one for that feature now.

Here’s my Antigravity A1 pickup Giant play structure At my local park (use the WASD keys on your keyboard to fly and your mouse to steer, or drag the on-screen controls on your phone):

and Basketball batting hoop In another park down the road. Splatica automatically edits out most of the people in the scene, so the park is a little emptier than it was in reality.

If you tap the Path button in the top right corner, below “SD” and “HD,” you should see the exact winding path I took with each camera (and the Insta360 X5’s selfie stick) to create these results.

When I simply am Circle the hoop onceAs you can see below, it doesn’t look nearly as good. Splatica can only recreate what your camera sees, so you need to shoot from everywhere you might want to “stand” in the virtual world.

Below, I tried to simulate a basic bridge inspection in the same park, Focus on one column Under BART commuter rail. I’m not sure it has enough detail to satisfy real surveyors or safety inspectors – perhaps it’s because the drone’s excessive obstacle avoidance temporarily halted my flight.

But when I spent more than five minutes taking photos of my backyard with the X5, the results were too expansive for my wife and I didn’t feel entirely comfortable sharing the entire scan. Alternatively, check out how Splatica recreates all the objects in my backyard by creating a 3D point cloud:

All of these scans can be downloaded in PLY and USDZ format and linked to real-world measurements: There’s usually an error of one percent every 100 centimetres, Andrei Shelomentsev, co-founder of Splatica, told me, “which is good enough for a scan and some rough exploration of the space,” and he says the measurements can be made more accurate by placing some marks around the area.

This actually isn’t the first time I’ve tried to 3D scan my backyard: in 2021, I did this using a Skydio self-flying drone. But at the time, Skydio was charging $2,999 a year for the feature, not including a drone or a service to stitch together images, while Splatica claims its service does it all autonomously using regular 360-degree video.

Splatica’s mock-ups are more interesting than mine, especially since it’s now trying to prove that companies can use its services to train robots before they’re actually deployed in factories around the world. here Imikar Electronics Factory In Antalya, Türkiye:

And for something completely different, here you go Part of Leighton House In London:

How is this possible just walking around with a camera? Shelomentsev told me that his company has built a special version of SLAM (Simultaneous localization and mapping technique (which lets all kinds of robots, self-driving cars, and virtual reality headsets know their location in 3D space) are specially designed to create precise point clouds from 360-degree video. You can think of point clouds as the “bones” of 3D objects that are then painted in color.

And while Splatica says it can work with any 360-degree camera, it’s useful that Insta360 and Antigravity cameras put all kinds of additional metadata into the video files themselves. “The files hold everything we need: lens distortion parameters, shutter speed, accelerometer and gyroscope data, and GPS – which are streamed from the Insta360 mobile app directly to the camera during capture,” says Eugene Nikolsky, CEO and co-founder of Splatica. Edge.

_{Above: Corridor Crew visually explains how stains work.}

The Insta360/Splatica combo has its limitations. If you zoom in on any of the included or linked examples to see fine detail, you’ll likely see slightly translucent blobs of color rather than readable textures—that’s how stains are made, after all. Traditional high-resolution photogrammetry may do a better job if surfaces are what you’re most concerned about.

But that doesn’t stop Insta360, Antigravity and Splatica from launching a marketing campaign It’s called the eternal projectwhich the companies are promoting as a “global initiative” to preserve cultural landmarks for future generations. It offers prizes for the best Gaussian spots, 1,000 free downloads of Splatica (first come first served), and a pilot project to survey Pompeii and the Amazing City Civita di Bagnoregio In Italy. They also “invite creatives around the world” to survey sites such as Roman theaters and the Korean island of Jeju.

(The companies didn’t tell us how much they invested in Project Eternal, and admitted they don’t help creators get permissions for those sites — but Splatica claims it will maintain indefinite public access to any scene submitted to the “Open Heritage Dataset,” and the company has Decent privacy policy Which shows that your content belongs to you.)

Beyond that, Insta360’s Richter says his company already has enterprise customers experimenting with 3D reconstruction and digital dual workflows in the construction and facilities management fields, and he hopes to bring richer data from the camera to 3D reconstruction services and make the process more seamless.

Right now, perhaps the biggest barrier to entry for Splatica is that the service isn’t cheap. The company charges between 18 cents and 25 cents per second of processed video, and you have to pay a monthly subscription as well. The company is currently experimenting with pricing – last week the price was $70, $200 or $385 per month depending on how much scanning you need, while this week the same levels are $50, $150 and $300.

But if you want to give it a try, you may still be able to get one of the 1,000 free slots. Splatica says it’s waiving subscription fees for the first 1,000 users, who should each be able to turn 10 minutes of 360-degree footage into mini 3D worlds. You can also explore over 100 additional spots Splatica Public Gallery.