Not to mention that the screen is becoming a bigger and bigger part of the mass of the computer. I wouldn't expect to like this first product but 5-10 years down the line it isn't unreasonable to believe that your computer is your phone, you take it everywhere with you, and your monitor is your glasses (benefit if you already wear glasses). That sounds pretty cool. Keyboard is the next big thing imo, because virtual typing sucks and I need something tactile. We'll probably need to rethink the entire concept though.
My main concern is about collaboration. Specifically, a fear with Apple lockin. When you pair program you can just sit down at either computer. Will we have an open protocol to share screens (or specific apps in screens like modern screenshare does)? Will is be semi-open like the current MMS system where Apple makes you look at a potato? My concern is about how these can be used to further isolate ourselves and break our fundamental social structure. But part of that will be how we use them, along with the decisions these companies make. I just hope Apple doesn't lock everyone in, but I'm not going to hold my breath.
AFAIK it hasn’t been accurate enough until recently. I’ve heard OpenAI’s whisper is great text to speech and I think I read today iOS 17 is updating their speech-to-text as well.
Also, I’m not an office worker but I would imagine working with speech to text around everyone else using speech to text would be a hellish and annoying scenario. Work from home alleviates that.
It reads that a lot of the control of visionOS is speech based as well and Apple should be smart enough to know if it doesn’t work well the entire product will flop and Tim Apple’s entire legacy will likely be over.
I tested SwiftKey recently and works quite well with speech to text when whispering very silently when you put you lips close to microphone but worked even well with airpods. This still might be culturally weird to everyone whispering but in office with fans and aircon and other ambient sound i think would be hard to hear anyone whispering when 2m away.
Oh that sounds like hell to me if I'm being honest. It would be okay for stnadard routines "write a for loop that increments variable foobar" (LLMs help here) but be a fucking nightmare for debugging or fine grained work.
My main concern is about collaboration. Specifically, a fear with Apple lockin. When you pair program you can just sit down at either computer. Will we have an open protocol to share screens (or specific apps in screens like modern screenshare does)? Will is be semi-open like the current MMS system where Apple makes you look at a potato? My concern is about how these can be used to further isolate ourselves and break our fundamental social structure. But part of that will be how we use them, along with the decisions these companies make. I just hope Apple doesn't lock everyone in, but I'm not going to hold my breath.