A blog about living with ALS - and more

Welcome to My Eye Gaze World

I took it for granted that you all know that I use eye gaze technology (I type with my eyes) to communicate in all forms: speaking, texting, and writing everything from emails to this blog post. That is, I took it for granted until my sister, Sephrah, said something that made me realize that only the people who have seen me within the past four years know my reality. In honor of ALS Awareness Month, I will now attempt to show you what it’s like to rely on eye gaze technology. 

I have to type with my eyes, because I’m completely paralyzed except for a little bit of movement in my legs. I can still feel everything, which makes itches a lot of fun. 

Before I continue, I want to clarify that I didn’t get ALS and immediately go to eye gaze. First, I was still able to type with my hands. As my right fingers became weaker, I did a modified version of touch typing with just my left hand. That lasted for about a year. When my hands got too weak to type, I used a voice to text software, which worked well, but I couldn’t use it around other people, both because the software wouldn’t work well with ambient noise, and because I was still teaching, and had to write confidential information about students. 

My next phase started when ALS affected my speech so much that the software wouldn’t work. Jackie, the tech specialist from the ALS Association, came to my house and attached a camera to my laptop and put a silver dot in the corner of my glasses. This system let me manipulate the cursor by moving my head around to select the letter or icon I wanted, and then click by waiting for a few seconds. It was my favorite accommodation. It was fast, and the process led to few mistakes. 

Eventually my neck got too weak for this system. Enter a tobii dynavox touch tablet with built-in eye gaze technology and a giant clicker button, which I held on my lap. I would use my eyes to select what I wanted, and press the button on my lap the way most people double click a mouse. Eventually, I couldn’t  do the button anymore. I’m 100% eye gaze now. 

Every time someone rolls me up to my device, the first thing we have to do is track my eyes. That means we line up the machine with my eyes. Here’s what the tracking screen looks like. 

The white circles are my eyes and they have to be centered, and the white arrow has to be level with the white eyes. Distance, height, angle…it is harder than it looks, because if it’s not just so, one or both eyes will disappear, and the person who is helping me has to move the device around until it gets fixed. The lights on the bottom are what track my eyes. If they are blocked, I can’t do anything.

Next, I calibrate my eyes, which synchronizes my eyes with the machine – ideally. I calibrate by following circles around to nine points on the screen. See below for what the end result should look like. If the tracking is not perfect or my eyes are tired or watering, my eyes won’t be synchronized, and I will have trouble typing or doing anything with the machine. This usually means starting over again from the top with tracking and calibration.

This is the keyboard (see below) I  use to type what I want to say and I often type other things and cut and paste into other documents, because it’s faster than the windows keyboard. I wanted to type “…I make mistakes all the time.”, but this is what I actually typed.  That’s why I don’t like people reading what I’m typing over my shoulder. I make a lot of mistakes. 

Notice that the question mark and other punctuation marks or numerals are not on this screen. For them, I have to switch to other screens.  However, my biggest complaint about this keyboard is that there is no caps lock anywhere. The only way to capitalize every letter in a word or acronym is to do it one letter at a time and hope that I don’t select the wrong letter on my way. Imagine selecting whatever you look at. That’s my world. 

It’s maddening when there is a video or animation on part of a website I’m looking at, because it is impossible for me to look away. You know the advertisements on YouTube that you can skip after four seconds? It takes me much longer than four seconds to skip the ads, because I can’t stop watching them. It’s like telling myself not to look at a car accident on the freeway; I can’t help but look anyway.

One more major complaint about eye gaze technology. No one has figured out how to get it to work with sunlight, so I can’t use it outside or in the car. That is the reason I don’t like to spend a lot of time outside, which is unfortunate, because I love nature. I need someone to create a collapsible awning, like the ones on baby strollers, to extend over my head and the device, shielding us from the sun.

I used to think that eye gaze technology had existed since the 1960s, because Stephen Hawking used it, but no. He used a muscle in his cheek to do all of his communication, including writing books! I don’t have any muscles in my face that I can control to communicate. I recently found out from Jason Becker, who has been living with ALS for 30 years, that 20 years ago, eye gaze technology was terrible. For all the complaining I do about my device, I am lucky to have access to the assistive technology available today. If I had been diagnosed even just 5 or 10 years earlier, I would be silent by comparison and certainly wouldn’t be able to write.

Previous

Mrs. Prezioso and Why I Loved Geometry

11 Comments

  1. Ilana

    This is fascinating Jessie! I really appreciate knowing more about how this works. I had no idea you had to calibrate the screen every time (although that makes perfect sense now that you explain it) and I also didn’t know that Tobii doesn’t work in the light. Would an umbrella work for a cover? Thank you for this and for helping us all to understand a little more about your world and ALS.

  2. Thank you for sharing the details of your experience. I can appreciate the effort and tenacity it has taken to keep communicating despite the debilitating effects of ALS. My uncle did not have the benefit of such technology while living with ALS, so I can appreciate even more the gift that it has been for you to be able to sustain your connection to others and continue to express yourself. My uncle did have the blessing of being given a trained support dog, a sweet golden retriever who would open the fridge to bring him things in the early stages when my aunt was at work, and was a faithful, patient, and affectionate companion through the inward silences that filled his later life. Although I know he was a prayerful meditative man who was comfortable with his own silence, I also know it was hard not to be able to communicate with family and friends. It seems that you are a teacher in every cell of your body and continue to defy your limitations to continue teaching in whatever way you can. Bravo. We are listening. And learning.

  3. Sara Esrick

    Thank you so much for sharing, Jessie. I’m so grateful that you have this technology to be able to communicate, despite its flaws. I had no idea about all of the eye tracking/calibration needed. I am also so happy that I still get to hear your real voice with many of the phrases you recorded before you lost your ability to speak. You continue to be such an inspiration to me! Love you. 🥰

  4. Linda Towbin

    Jess,
    This is amazing.
    We take for granted our ability to talk with one another. You allow us to experience what’s involved in compensating for the gradual loss of functions involved in communication.
    Your blog is inspirational because it shows what a person can accomplish under the most severe limitations .
    I hope your blog reaches a wide audience.
    Love Mom

    • Alicia McCormick

      I agree, Mrs. Towbin. Jessica and I were talking for months on messenger before I figured out that she didn’t speak. Of course I am thrilled by technology, however, it also confuses me as to why Jess can’t explain the difficulty she experiences and just have someone solve it. Much love!

  5. Stephanie Carmel

    Thank you for giving us this glimpse into your world, Jessie. Your perseverance is inspiring. Love you 💕

  6. Julia Chase

    Dear Jessie,
    Thank you for writing this beautiful and education blog. I have known you through all of the communication changes you mention, and thus it seems very natural to talk with you using your current Tobii! You always are very engaged in our discussions and have helpful insights and/or probing follow-up questions. Plus often very humorous comments! 🙂

    I know there are times it drives you crazy, like in early May when it froze up every time you closed your eyes! Grrrr. You had to re-boot AND re-calibrate that time. But you do know your Tobii well, and know how to get it calibrated relatively quickly.

    I am so thankful you have the benefits of gaze technology! Your friendship, kindness and teaching skills continue to make the world a better place! I so look forward to our conversations, and also looking at your photo albums with you, and admiring your Grandma’s china together!

    I hope your blog post is read by many people and inspires others to use gaze technology!

    We are camping for 5 days, but will be in touch when I get home. And will send you some photos of Pearrygin Lake!

    With love,
    Julia and Joe

  7. Judy

    Wow Jessie – your writing is so engaging and educational. It is amazing to me that this is all through eye gazing technology.

  8. Kirstan Williams

    Jessie- you are just an inspiration! I think we all take so much for granted on a daily basis, and this was so helpful how you explained it all so we could better understand. Your determination to not give up is what has always been amazing about you. You’re a true gift. Love you!

  9. Lisa

    I was just wondering how you could so easily text me this week. And then I saw your blog. Perfect timing. I love that your written voice has all the character of your spoken voice. When I read your messages, blog, texts, I feel like I am in a spoken conversation.

    I wonder how big that awning would need to be….

  10. Bryan Haynes

    Dear Jessie, You are a hope for me as a disabled/able-bodied person. I do not know how my bipolar and diabetes will affect me in the future, but I hope I can have the fortitude and attitude you show in your life.

    Bryan Haynes

    PS Jenny loves you too.

Leave a Reply

Your email address will not be published. Required fields are marked *

Powered by WordPress & Theme by Anders Norén