STEMUP: Multimodal UGC Creation & Exploration Platform
Led 0-to-1 product strategy and execution for a lightweight mobile AR creation platform. Lowered authoring friction for creators through template-driven editorial tooling, scaled engagement loops via speech recognition, and democratized spatial 3D media publication.
Ecosystem Friction & Creator Gaps
Unlocking authentic, grassroots multimedia creation where rigid publisher monopolies and prohibitive infrastructure costs previously blocked user contribution.
Creator Friction & Cost Barrier
Physical interactive spaces and VR solutions demanded prohibitive budgets and hardware. Creators lacked lightweight, accessible tools to build, publish, and iterate real-world scenario media on mobile.
Rigid Publisher Monopolies
Off-the-shelf course packages were closed-source and inflexible. Content creators (educators) were forced into passive consumer roles rather than authoring localized, community-tailored content.
Broken Contribution-Consumption Loop
Consuming static digital materials resulted in passive, low-engagement experiences. There was no direct feedback loop connecting creator publications to real-time consumer engagement metrics.
Platform KPIs & Performance Metrics
Demonstrating tangible efficiency gains in media authoring and significant uplifts in end-user engagement through iterative usability testing and funnel optimization.
Strategic Product & Editorial Insights
- Template-Driven Authoring Scales UGC Volume: In-field behavioral research revealed that blank-canvas tools paralyze non-technical creators. Standardizing decisions into 3 sequential steps unlocked rapid content creation at scale.
- Lightweight Phygital Anchor (QR + AR): Chose marker-based AR over costly headset ecosystems, reducing user onboarding drop-off by 85% and leveraging ubiquitous smartphone cameras.
- Automated Speech Evaluation Closes the Loop: Integrated Google Voice Recognition to provide instant phonetic validation, turning passive viewers into active vocal contributors while eliminating manual grading bottlenecks.
- Creator Analytics Drive Retention: Providing creators with real-time performance dashboards directly boosted subsequent content publication frequency by 40%.
Two-Sided Platform Dynamics: Creator vs. Consumer
Structuring a two-sided UGC platform: Empowering time-constrained creators with agile publishing tools while delighting consumers with engaging, gamified media consumption.
Elena - The Prosumer Creator (Educator)
Motivated to produce tailored interactive lessons but constrained by 45-minute prep limits
Jobs-to-be-Done: Needs to rapidly curate 3D situational scenes, define conversational challenge rules, and monitor student completion in real-time.
Critical Friction: Intimidated by complex 3D authoring suites, lacks 3D modeling skills, and burdened by manual paper-based evaluation workflows.
Product Enabler: Pre-indexed Google Poly 3D asset catalog, 3-step mobile publication wizard, and automatic CSV cohort analytics export.
Leo - The Immersive Learner (Student)
Digitally native, visual explorer; easily intimidated by traditional classroom speaking drills
Jobs-to-be-Done: Wants to explore gamified challenges, interact with spatial 3D objects, and receive instant, objective feedback on vocal performance.
Critical Friction: Social hesitation when speaking foreign phrases aloud; disengages during passive textbook instruction.
Product Enabler: Pokémon GO-style camera scan quest, tangible 3D discovery cues, and instant low-stakes voice recognition scoring.
Core Hypotheses & Strategic Framing
Translating ecosystem bottlenecks into prioritized product initiatives focused on creation velocity, media engagement, and end-to-end device integration.
How might we empower non-technical creators to author rich AR experiences in under 10
minutes?
Hypothesis: By modularizing 3D asset selection via cloud libraries and replacing complex coordinate
settings with predefined templates, we will reduce creation abandonment by >50%.
How might we transform passive media viewers into active audio-visual contributors?
Hypothesis: Combining tangible visual triggers (QR/AR) with real-time Speech Recognition feedback
loops will stimulate spontaneous spoken participation in low-confidence environments.
How might we close the authoring, publishing, and analytics loop entirely on mobile?
Hypothesis: Unifying creation, cohort deployment, and engagement analytics into a responsive
single-device workflow will eliminate desktop dependency and unlock agile content iterations.
Core Modules & Experience Architecture
Architected a full-funnel UGC ecosystem integrating guided creator editorial tooling, spatial AR consumption, and an automated analytics pipeline.
Guided Editorial Creator Suite
Engineered a 3-step structured authoring funnel: Class Metadata → 3D Model Catalog Selection (Google Poly API) → Task Rule Configuration. Reduced complex parameters into pre-configured schemas, enabling instant publishing without code.
Spatial AR Discovery Engine
Leveraged marker-based computer vision to map 3D assets to physical anchor points. Designed an exploratory "Scan-to-Reveal" mechanic inspired by location-based gaming, maximizing user immersion and spatial interaction.
Multimodal Speech Feedback Engine
Integrated Google Voice Recognition APIs to evaluate pronunciation accuracy directly on the device. Replaced high-stress human grading with automated, gamified scoring loops to boost user self-efficacy and response rates.
Cohort Management & Editorial Analytics
Built in-app group administration to prevent content misalignment. Implemented real-time performance visualization dashboards and automated CSV data ingestion for creators to assess engagement and iterate scenarios.
Product Roadmap & Scaling Strategy
Translating pilot validation into an extensible platform ecosystem, incorporating advanced interaction types, and establishing editorial moderation standards.
Interactive Format Diversification (Next Phase)
Expanding creator templates beyond single-turn voice prompts into multiple-choice branching, multi-marker situational challenges, and collaborative quests to offer creators richer editorial flexibility while maintaining high content quality.
Open Creator Ecosystem & Quality Governance
Scaling the platform from closed pilot cohorts to an open creator marketplace. Partnering with cross-functional Trust & Safety and Policy teams to establish robust UGC editorial guidelines, 3D asset upload verification, and creator incentive loops.