3d holograms
ebuyer daily deals 40% off

Watching football in 3D from the comfort of your own home may still be a distant dream, but a team of US researchers have found a way to create 3D holograms using artificial intelligence to reconstruct games from video.

Scientists from University of Washington have designed an artificial intelligence system that can augment 2D videos in 3D – which can then be viewed on a flat surface like a large kitchen table, for example.

For their study, the researchers used around 12,000 images from the EA video game FIFA 2018.

They also gathered the corresponding 3D data for the images to train their algorithm to make the correlation. The video probably does a better job of explaining this.

Although real game footage wasn’t used in building the AI system, the hope is that the algorithm, when it is fully developed, will be able to seamlessly generate 3D holograms from 2D YouTube clips.

3D holograms and FIFA

Explaining why they used FIFA game data, the researchers wrote: “FIFA, similar to most games, uses deferred shading during gameplay. Having access to the GPU [Graphics Processing Unit] calls enables capture of the depth and colour buffers per frame.

“Once depth and colour are captured for a given frame, we process it to extract the players.”

Football 3D holograms
(Konstantinos Rematas/YouTube screenshot)

Microsoft’s HoloLens – the company’s augmented reality smart glasses – was used to test their system.

When shown unseen YouTube videos of real-life matches, the system was able to accurately reconstruct each player in 3D and superimpose them on a virtual soccer pitch, although there were glitches with recreating the ball and certain aspects of player interaction.

But the team is hopeful that they will be able to smooth out the kinks, saying additional improvements in player detection, tracking, and depth estimation could help reduce the glitches that reconstructing the ball in the field could “enable a more satisfactory viewing of an entire game”.

The research is being presented at the annual Computer Vision and Pattern Recognition (CVPR) conference in Utah.

* Prices correct at time of posting.


Please enter your comment!
Please enter your name here