The Foundational AIs in the Metaverse (Patreon)

AIs That’s Gonna Takeover The Metaverse

AI Camp is offer all of you a unique opportunity to apply with a custom scholarship link today at this link: https://ai-camp.org/partner/bycloud If you apply for their scholarship through this link (which only takes 15 minutes) you have a great chance of having your AI journey funded by the scholarship! Metaverse has been a very controversial topic in the recent months. But today I am not here to criticize the overall concepts or motive behind this "promotion" (or am I?), instead to discuss what could be and what will eventually be possible in the coming years related to the development of the "Metaverse" with the AI research potentially being the foundations. AI Research/Implementations In Order of Appearance: - Physics Simulations - IQ-MPM: An Interface Quadrature Material Point Method [Paper] https://dl.acm.org/doi/abs/10.1145/3386569.3392438 [Demo] https://vimeo.com/447725674 High-order Differentiable Autoencoder for Nonlinear Model Reduction [Paper] https://arxiv.org/abs/2102.11026 [Demo] https://ensemble.clemson.edu/hapi/v1/contents/permalinks/Sc95Ngy6/view A Scalable Galerkin Multigrid Method for Real-time Simulation of Deformable Objects [Paper] http://tiantianliu.cn/papers/xian2019multigrid/xian2019multigrid.pdf [Project Page] http://tiantianliu.cn/papers/xian2019multigrid/xian2019multigrid.html [Presentation] https://youtu.be/sG6aCZoc_2w [Demo] https://youtu.be/7HdVJraFQn0 ASFLIP: Revisiting Integration in the Material Point Method [Paper] http://yunfei.work/asflip/main.pdf [Project Page] http://yunfei.work/asflip/ [Demo] https://youtu.be/_zM3bXZerw8 Ships, Splashes, and Waves on a Vast Ocean [Paper] http://computationalsciences.org/publications/huang-2021-vast-ocean/huang-2021-vast-ocean.pdf [Project Page] http://computationalsciences.org/publications/huang-2021-vast-ocean.html [Presentation] https://youtu.be/XcrOE4GTMec - Generative Adversarial Networks (GANs) - VQGAN+CLIP [GitHub] https://github.com/nerdyrodent/VQGAN-CLIP StyleGAN2: Analyzing and Improving the Image Quality of StyleGAN [GitHub] https://github.com/NVlabs/stylegan2 [Paper] https://arxiv.org/abs/1912.04958 StyleGAN3: Alias-Free Generative Adversarial Networks [Github] https://github.com/NVlabs/stylegan3 [Paper] https://nvlabs-fi-cdn.nvidia.com/stylegan3/stylegan3-paper.pdf [Project Page] https://nvlabs.github.io/stylegan3/ - Pose Estimation - OpenPose [GitHub] https://github.com/CMU-Perceptual-Computing-Lab/openpose EasyMocap (Multiple-Cams) [GitHub] https://github.com/zju3dv/EasyMocap Through-Wall Human Pose Estimation Using Radio Signals [Paper] https://openaccess.thecvf.com/content_cvpr_2018/papers/Zhao_Through-Wall_Human_Pose_CVPR_2018_paper.pdf [Project Page] http://rfpose.csail.mit.edu/ [Demo] https://youtu.be/HgDdaMy8KNE - Object Detection - PaddleClas [GitHub] https://github.com/PaddlePaddle/PaddleClas DarkNET [GitHub] https://github.com/AlexeyAB/darknet [Project Page] https://pjreddie.com/darknet/ - Neural Radiance Fields (NeRF) - ADOP: Approximate Differentiable One-Pixel Point Rendering [Paper] https://arxiv.org/abs/2110.06635 [GitHub] https://github.com/darglein/ADOP NeRF: Neural Radiance Fields [Project Page] https://www.matthewtancik.com/nerf [Paper] https://arxiv.org/abs/2003.08934 [Demo] https://youtu.be/JuH79E8rdKc [GitHub] https://github.com/bmild/nerf Plenoxels: Radiance Fields without Neural Networks [GitHub] https://alexyu.net/plenoxels/ [Presentation] https://youtu.be/KCDd7UFO1d0 [Paper] https://arxiv.org/abs/2112.05131 MonoScene: Monocular 3D Semantic Scene Completion [GitHub] https://github.com/cv-rits/MonoScene [Project Page] https://cv-rits.github.io/MonoScene/ [Demo] https://cv-rits.github.io/MonoScene/imgs/monoscene_demo.mp4 [Paper] https://arxiv.org/abs/2112.00726 Footage In Order of Appearance: METAVERSE VIDEO EWWW https://youtu.be/gElfIo6uw4g Hyper Reality https://youtu.be/YJg02ivYzSs Do you know the way https://youtu.be/tJp_3-VZZjI NAISUNAISUNAISU https://youtu.be/iheznvcKXxc VQGAN+CLIP https://youtu.be/GwssGcrqKuc StyleGAN2 Face Interpolation https://youtu.be/6E1_dgYlifc StyleGAN2 Car Interpolation https://youtu.be/SZsiM8qo3rI VR Painting https://youtu.be/LBJPIgNXUDI OpenPose Demo https://youtu.be/HCpg4w_L7SI 2D OpenPose Estimation Test https://youtu.be/pW6nZXeWlGM Ready Player One Trailer https://youtu.be/cSp1dM2Vj48 Half-Alyx Game Play https://youtu.be/LTLotwKpLgk YOLO Demo https://youtu.be/69Ii3HjUiTM This video is supported by the kind Patrons & YouTube Members: 🙏Andrew Lescelius, Panther Modern, Sascha Henrichs, Jake Disco, Demilson Quintao, Tony Jimenez, dicefist, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Hongbo Men [Discord] https://discord.gg/NhJZGtH [Twitter] https://twitter.com/ytcloud_ [Patreon] https://www.patreon.com/bycloud [PayPal] https://paypal.me/cloudweather [Music] Zeeky - Lively [Thumbnail Art] https://twitter.com/sequ0iart [Profile & Banner Art] https://twitter.com/pygm7