Game Tech Explorers: Understanding Humans, Machines, and Play
Game Tech Explorers: Understanding Humans, Machines, and Play
Explore game tech through senses, AI, gestures, voice, XR, and hands-on projects to understand how humans and machines interact in play.
Course Instructor
Prof. Gowdham Prabhakar
Duration
8 Weeks
Course Fee
500
-
Interested?
Enroll in this Course
About The Course
This course explores how games simulate human senses using sensors and feedback, how fast-response systems connect player actions to game outputs, and how simple AI with logic and decision trees powers game characters. You’ll discover how hand tracking enables gesture-based control, how eye-tracking supports gaze-driven gameplay, and how voice commands work through AI-powered speech recognition. The course also introduces VR, AR, and MR technologies, explains the hardware behind cameras and haptic motors, and includes hands-on activities using sensors, Teachable Machine, and p5.js. It concludes with a final project where learners build an interactive game feature using AI, gestures, voice, or XR tools.
Course Instructor
Prof. Gowdham Prabhakar
Assistant Professor, IIT Kanpur
Gowdham Prabhakar is Associate Professor in the Department of Design, IIT Kanpur.
Content Overview
Course Duration: 8 Weeks
Week 1: Gaming and Human Senses
- Objective: Explore how game technology simulates and interacts with human senses.
- Examples of Senses in Gaming: Learn how controllers, VR headsets, and motion sensors mimic human senses to make games more immersive.
- Enhancing Immersion: Understand how sensory technologies like rumble feedback and motion tracking improve the gaming experience.
- Tech Behind Sensors: Explore the basic working of microphones, cameras, and haptic motors that power modern gaming devices.
- Hands-On Demo: Compare a simple sensor (light/motion) with a human sense, similar to Wii motion tracking.
Week 2: Action and Response in Games
- Objective: Understand the principles of responsive game systems and player feedback.
- Fast Response Systems: See how reflex-based games, racing wheels, and vibration feedback test quick player responses.
- Role of Actuators: Learn how motors and haptic devices provide feedback that makes gameplay feel realistic.
- Feedback Loops in Games: Discover how input, processing, and output form the foundation of responsive game systems.
- Hands-On Project: Build a sensor-based trigger (e.g., a fan or LED lights up when a hand waves).
Week 3: Perception, Logic, and Game AI
- Objective: Introduce fundamental concepts of artificial intelligence and logic in game characters.
- Classic Game AI Examples: Study AI behavior in classics like Pac-Man and FPS games to see how simple logic drives characters.
- Logic in Game AI: Learn how if-then rules and decision trees create believable non-player characters (NPCs).
- Intro to AI Tech: Get a glimpse of decision tree structures and how they guide AI decision-making in games.
- Hands-On Activity: Code a simple decision tree for a game character using p5.js.
Week 4: Hand Tracking in Games
- Objective: Examine how hand gestures are used as a form of game control.
- Hand Tracking Examples: Discover how Wii controllers, Kinect, and VR systems use hand gestures to control gameplay.
- Mapping Gestures to Actions: Learn how hand movements are translated into specific in-game interactions.
- MediaPipe and Pose-Tracking: Get an introduction to modern pose-tracking tools that power hand gesture recognition.
- Practical Activity: Train a simple body-tracking model with Google Teachable Machine.
Week 5: Eye Tracking in Gaming
- Objective: Learn about the emerging field of eye tracking and its applications in gaming.
- Eye Tracking in Games: Explore how games use gaze for aiming, camera movement, and immersive horror experiences.
- Gaze-Based Interaction: Learn how controlling games with your eyes creates new gameplay possibilities.
- Eye-Tracking Technology: Understand the basic working of eye trackers and how they capture gaze movement.
- Practical Activity: Try a web-based gaze recorder demo.
Week 6: AI and Speech Recognition
- Objective: Explore how AI enables voice-based interaction and commands in games.
- Voice in Games: See how games like Hey You, Pikachu! and VRChat use speech for interaction.
- Voice Commands in Gaming: Learn how speech recognition enables control and communication in games.
- AI Speech Technology: Understand how AI handles accents, tone, and natural language to improve recognition.
- Hands-On Demo: Use Google Teachable Machine to try audio-based recognition.
Week 7: Extended Reality (XR)
- Objective: Get an introduction to the different forms of extended reality (VR, AR, MR) and their applications.
- VR in Gaming: Experience how VR games like Beat Saber and Half-Life: Alyx create full immersion.
- AR and MR in Gaming: Learn how Pokémon GO and HoloLens use AR/MR to add digital layers to the real world.
- XR Hardware and Software: Explore the basic principles of VR headsets, AR glasses, and MR platforms.
- Practical Activity: Try an AR app or AR filter and review the experience.
Week 8: Final Project
- Objective: Apply learned concepts to build a final project demonstrating a key game technology integration.
- Project 1: Build a voice-to-command action with p5.js (e.g., say “jump” to trigger an action).
- Project 2: Build a hand gesture-controlled bulb with p5.js (gesture turns bulb on/off).
Live Sessions: Weekly live interactive sessions on Saturdays
Course Eligibity
Students from partnered schools in any stream of Class X, XI and XII
Assessment Layout
Assignments: The course includes the release of 4 bi-weekly online assignments (every alternate week). Students need to attempt at least 3 of these assignments and must achieve a minimum score of 40 marks in each to be eligible for the certificate.
Take-Home Project: An optional project consisting of questions that cover all the topics from the theory videos, accompanied by a small project report.
Final Exam: An optional online final exam designed to assess the knowledge gained throughout the course, which can only be attempted after completing and submitting the required assignments and the take-home project.
Certificate Acquisition
Participation Certificate - Check Sample Certificate
To receive this participation certificate, a student must pass 3 out of 4 assignments with an average score of at least 40 marks.Completion Certificate - Check Sample Certificate
To receive this completion certificate, a student must fulfill the following criteria:
- A student must pass 3 out of 4 assignments with an average score of at least 40 marks.
- Submission of the take-home project is mandatory for the student.
- Once the above two conditions are satisfied, the student should attempt the final exam and must receive a minimum score of 40 marks.