Mihara Dinusara Wickramarathna Dias Bandaranayaka | Voice Note AI | Rysera STEM

Added: 2026-05-11

[00:00:00]Hi, I am Mihar Bander and purpose of my project is breaking the barriers of traditional input output method in fields like surgery, mechanical repair or cooking or even chemical research.

[00:00:16]Using a mouse emote input out input method is impractical or sometimes even impossible. That's why I made this method to achieve a seamless hands-free bridge between human intent and computer action.

[00:00:33]In many high stakes fields from stellar operation to room to busy mechanical workshops, the traditional keyboard and mouse aren't just inconvenient, they are a barrier. So I created Javis AI to break that barrier.

[00:00:50]So let me show you. Hey Javis with a custom offline local work listener. The system is always ready protecting privacy while remaining instantly accessible.

[00:01:15]Javis I always prefer my system updates to be summarized in one short sentence.

[00:01:20]Please remember this.

[00:01:25]>> I've already saved your preference to summarize system updates in one short sentence. I'll be sure to do that for you.

[00:01:33]So unlike standard chatbots that forget everything when you close the tab, Javis AI has the processed JSON memory drive.

[00:01:43]It does how you like your task done across sessions.

[00:01:51]Show me my systems list space and then create a folder called on my desktop.

[00:02:08]I have successfully created the folder named Asets on your desktop.

[00:02:21]Inside that folder, create a text file and write all the currently running processes to it.

[00:02:35]I have created a text file named running processes.txt inside the assets folder on your desktop and it now contains a list of all currently running processes.

[00:02:47]Let's see if it is done.

[00:02:54]Notice what happened here. The AI didn't just give me text. It asked action, then reason that I need PowerShell, executed the command, checked for success, and actually modified my file system all handsree.

[00:03:11]And because of my preferences, it kept the confirmation brief.

[00:03:16]There is also a powerful web search agent built right in. Simply asking Java to search the web triggers an autonomous process that best and re summarize top result from the internet in real time with pulling external knowledge. But what if you have to take some notes while your hands are busy?

[00:03:41]a chatbot is the most efficient way.

[00:03:44]That's why I added a note takingaking feature for this AI.

[00:03:51]Javis, I need to take some notes.

[00:03:58]Sure. I'm opening the note takingaking interface for you now. Memo. You can speak or type your notes there and the AI will structure and format them automatically.

[00:04:11]Now let's look at the note module.

[00:04:14]Traditional voice notes are just messy transcript. This system uses Gemini to understand intent and structure.

[00:04:23]I am going to use a trick here to make this quick. So photosynthesis is the process by which green plants make their own food using sunlight. This process mainly takes place in the leaves. Chlorophyll, the green pigment in plants, absorbs sunlight. Carbon dioxide from the air and water from the soil are used to produce glucose and oxygen. This process is essential for life on Earth because it provides oxygen for animals and humans.

[00:05:02]Look at the result. It removed my filter words, recognized the priority, applied the heading to to style automatically.

[00:05:13]It's an editor that listens beyond just smart transcription. The notes module is complete interface. You can clear current sessions to start fresh. Save your notes directly to the local file system and even browse or reload fast saved notes seamlessly all with the voice command or single click. Keeping your knowledge base organized without typing. Actually what inspired me to add this feature is in online lectures I want to focus more on understanding the concept better but I can't do it while I am taking notes. So this will be one of my everyday tools.

[00:06:04]We also have a offline background scheduleuler for scheduleuling time precise task.

[00:06:12]Javis should schedule a task for 1 minute from now to check if I am connected to Wi-Fi and what network it is there.

[00:06:28]I've scheduled a task to check your Wi-Fi connection and network name for 1 minute from now.

[00:06:33]While we wait for that alarm to trigger, notice that the AI isn't just setting a timer prompt. It is actually scheduuling an autonomous background task in his internal Windows engine. We don't even have to keep this window open. If we close it, it will automatically open up and inform us.

[00:07:00]And there it is, a complete autonomous background execution of task. You can even say every Sunday at 12:30 p.m. do this or do that. You can use this as a alarm, a reminder, or even a completely automated task like submitting a report.

[00:07:22]But there is a little problem. Even if we could take notes and execute shadow commands and execute voice commands, there are some task we cannot or it's little bit harder to do with voice commands. So Javis activate hand gesture control.

[00:07:47]Activating hand gesture control. Hand with fingers displayed. Your camera will open shortly and you'll be able to control your computer using hand gestures.

[00:08:15]Finally, for the ultimate hands-free experience, gesture OS when voice isn't enough, we use computer vision.

[00:08:25]So using media pipe and open CV, I can control the mouse with sub pixel precision just by pointing a simple pinch performance can click and two fingers hold. But we can go lot further. The system execut with this and gesture. I can define custom gestures for any industry specific shortcut. One hand sign the system execute my premap actions. It transforms the AR around the user into the control surface. The UI lets you specify if the gesture applies to the left, right, or any hand.

[00:09:33]Oh, it also lets you configure actions as it is a PowerShell command, a cmd command or a keyboard shortcut.

[00:09:43]And let's say you are not a very technical person and you don't know the commands or the keyboard shortcuts to execute, but you can use AI to suggest the correct command for a plain English description for what you want to do.

[00:10:14]Javis AI and the gesture control OS aren't just tools. They are the future of how we interact with technology when our hands are busy, but our minds are busy. Thank you.