GSoC 2025: Empowering Innovation with Catrobat & Arishna IoT Solutions
Generated 3D Models from Marine Animals
Project Overview
This project creates AI-powered 3D models of marine species for education and research. Text prompts or FathomNet images are converted into 2D visuals with Stable Diffusion 3.5, then into interactive 3D assets via Tencent Hunyuan3D. The .glb models, viewable in Blender, Unity, AR, or a web-based visualizer, are deployed on RunPod for scalable access, enabling immersive learning and scientific exploration.
Key Features
Dual-Mode Image Generation: Converts user input into 2D images via Stable Diffusion 3.5 or FathomNet for rare species.
Text-to-3D Conversion Pipeline: Renders 3D GLB models from 2D images with Tencent Hunyuan3D models, delivering assets that are ready to use within Blender, Unity, or AR/VR projects.
End-to-End Deployment: Complete containerization solution deployed on RunPod with API endpoints to allow easy model execution on the cloud.
Interactive Web Visualizer: Generates .glb models with Tencent Hunyuan3D for use in Blender, Unity, or AR/VR.
Cloud Deployment: Fully containerized on RunPod with API endpoints for scalable execution.
Data Extensibility: Framework prepared for eventual dataset generation—users can retrieve stored 3D assets from the server or create new ones dynamically.
AR-Based Marine Ecosystem Simulation and Module Builder
Project Overview
The project aims to revolutionize marine biology education through immersive AR! Our project named, mARine transforms abstract marine science concepts into tangible interactive experiences, enabling educators to create custom underwater learning environments where students explore marine ecosystems and experiment with environmental variables in real-time.
Key Features
Complete AR Framework: Modular system with 15+ integrated components for marine ecosystem simulation
Intuitive Module Builder: Drag-and-drop interface for educators to create custom learning scenarios without technical expertise
Realistic Marine Life Simulation: Authentic 3D models with natural swimming behaviors, predator-prey interactions, and species-specific characteristics
Environmental Control Interface: Real-time sliders for temperature, pH, and pollution levels with immediate visual feedback
Cross-platform compatibility: Unity-based, supporting Android with ARCore and iOS with ARKit
Human Pose Detection: MediaPipe-based natural gesture interactions with AR marine environments
QR Code Sharing System: Instant module distribution for classroom deployment
Immersive Effects: Realistic underwater atmosphere with volumetric water rendering and dynamic lighting
Complete AR Framework: Modular system with 15+ integrated components for marine ecosystem simulation
Intuitive Module Builder: Drag-and-drop interface for educators to create custom learning scenarios without technical expertise
Realistic Marine Life Simulation: Authentic 3D models with natural swimming behaviors, predator-prey interactions, and species-specific characteristics
Environmental Control Interface: Real-time sliders for temperature, pH, and pollution levels with immediate visual feedback
Cross-platform compatibility: Unity-based, supporting Android with ARCore and iOS with ARKit
Human Pose Detection: MediaPipe-based natural gesture interactions with AR marine environments
QR Code Sharing System: Instant module distribution for classroom deployment
Immersive Effects: Realistic underwater atmosphere with volumetric water rendering and dynamic lighting
