IoT Smart Home Automation — Voice interface & NLP

IoT Smart Home Automation — Voice Controlled Home Assistant

Voice-activated home controller that interprets natural-language commands and drives devices directly, no fixed grammar.

Parsing
Gemini API
Devices
Arduino
Result
Top 12 / 250+

What it had to solve

Voice control in the home usually means learning the system’s phrasing rather than the system learning yours — a fixed grammar of trigger words that fails the moment someone says the same thing a different way. Removing the grammar means something has to interpret intent from open language, and then turn that intent into a signal a microcontroller can act on.

The decisions that shaped it

An LLM instead of a command grammar

The Gemini API parses natural-language commands, so the system resolves intent rather than matching phrases. That removes the memorised vocabulary that makes most home automation feel brittle — a request works because it means something, not because it was worded correctly.

Straight through to the hardware

Parsed intent drives Arduino-controlled devices directly. Keeping the path from language to actuation short is what stops the round trip feeling like a query rather than a control action.

Media as a first-class target

The Spotify API is wired in alongside the physical devices so that playback is one of the things a command can address, rather than a separate app the same voice request cannot reach.

Built under hackathon constraints

The whole system was built and demonstrated at GDSC DevJams 2024 and placed in the top 12 of more than 250 teams — the scope was set by what could be made to work end to end in the time available.

How the pieces sit together

Input
Voice captured and passed as open natural language
Parsing
Google Gemini API resolving intent without a fixed grammar
Orchestration
Python mapping intent onto device and media actions
Devices
Arduino-controlled hardware; Spotify API for playback

Built into the product

Open-language commands

No trigger vocabulary to memorise.

Direct device control

Intent through to Arduino actuation.

Media control

Spotify addressable by the same voice path.

Competition-proven

Demonstrated end to end under hackathon conditions.

What it is built out of

Language
Google Gemini API, Python
Hardware
Arduino
Integrations
Spotify API

What it looks like

IoT Smart Home Automation — The output end: LEDs on the breadboard, lit from the Arduino.
The output end: LEDs on the breadboard, lit from the Arduino.
IoT Smart Home Automation — The build on the table — board and breadboard wired to the host running the parser.
The build on the table — board and breadboard wired to the host running the parser.
IoT Smart Home Automation — The same rig closer in, mid-session.
The same rig closer in, mid-session.
IoT Smart Home Automation — DevJams '24 — the shortlist read out for the final pitches.
DevJams '24 — the shortlist read out for the final pitches.

What it produced

Top 12
Of 250+ teams, GDSC DevJams 2024
Zero
Fixed command vocabulary to memorise
E2E
Voice through to hardware actuation