SocialSense AR helps people with learning disabilities stay regulated, focused, and confident in real-world environments by giving them direct control over overwhelming sensory and social input. Through adaptive visual and audio filtering, it transforms chaotic spaces into manageable ones, allowing users to participate more comfortably in conversations, presentations, and daily activities without needing to withdraw or mask.
Tech Stack
Conversation Flow
Environmental Modification Flow
Use Cases
We've performed extensive tests on the accuracy of our model (from a computer vision and trajectory planning perspective) in order to determine its robustness. Below, we display 5 general cases of indoor-assisted navigation.
Mitigating Color-Driven Sensory Overload
Hiding distracting objects (object masking / blacking out)
Focus mode (background blur + audio suppression)
Reducing social visual load
Conversation mode (visual isolation, audio focus, sentiment support, conversation summary)
Acknowledgments
Special thanks to all contributors and collaborators who helped make SocialSense AR possible.
…to NexHacks for allowing us to breathe life into this