Voice-Controlled UI Design

Global Singularity is a tool for designing mobile app interfaces using spoken natural language. Powered by LLMs and speech recognition, it lets creators describe UI changes such as adding buttons, modifying text, or changing colors and see real-time updates across multiple screens.

The challenge was to convert spoken instructions into reliable UI updates while maintaining a consistent multi-screen layout. This required accurate speech-to-text conversion and real-time interpretation of vague or complex commands.

We combined state-of-the-art speech recognition with an LLM that parses spoken input into structured UI modifications. The frontend renders these updates dynamically, and backend logic manages state transitions and validations.