How Apple's 'Reality Pro' Headset Will Work (9to5mac.com) 66
An anonymous reader quotes a report from 9to5Mac: Apple's first AR/VR headset could be unveiled sometime this spring, and rumors continue to offer more information about what Apple has in the works. A wide-ranging new report from Bloomberg now offers a slew of details on Apple's "Reality Pro" headset, including that the "eye- and hand-tracking capabilities will be a major selling point" for the product. Using external cameras, the headset will be able to analyze the user's hands, while internal sensors will be used to read the user's eyes.
The report explains: "The headset will have several external cameras that can analyze a user's hands, as well as sensors within the gadget's housing to read eyes. That allows the wearer to control the device by looking at an on-screen item -- whether it's a button, app icon or list entry -- to select it. Users will then pinch their thumb and index finger together to activate the task -- without the need to hold anything. The approach differs from other headsets, which typically rely on a hand controller."
More details on the hardware of the headset include that there will be a Digital Crown similar to the Apple Watch for switching between AR and VR. The VR mode will fully immerse the wearer, but when AR mode is enabled the "content fades back and becomes surrounded by the user's real environment." This is reportedly one of the features Apple hopes will be a "highlight of the product." To address overheating concerns, the Reality Pro headset will use an external battery that "rests in a user's pocket and connects over a cable." There will also be a cooling fan to further reduce the likelihood of the headset overheating. "The headset can last about two hours per battery pack," Bloomberg reports. The battery pack is "roughly the size of two iPhone 14 Pro Maxes stacked on top of each other, or about six inches tall and more than half an inch thick." Another tidbit from the report is that the headset will be able to serve as an external display for Mac. "Users will be able to see their Mac's display in virtual reality but still control the computer with their trackpad or mouse and physical keyboard," reports Bloomberg. Apple is also "developing technology that will let users type in midair with their hands."
Additionally, FaceTime on the headset will "realistically render a user's face and full body in virtual reality."
A team of more than 1,000 people have been reportedly working on the first version of the device for the past seven years. It's slated to cost "roughly $3,000" when it debuts sometime this spring.
The report explains: "The headset will have several external cameras that can analyze a user's hands, as well as sensors within the gadget's housing to read eyes. That allows the wearer to control the device by looking at an on-screen item -- whether it's a button, app icon or list entry -- to select it. Users will then pinch their thumb and index finger together to activate the task -- without the need to hold anything. The approach differs from other headsets, which typically rely on a hand controller."
More details on the hardware of the headset include that there will be a Digital Crown similar to the Apple Watch for switching between AR and VR. The VR mode will fully immerse the wearer, but when AR mode is enabled the "content fades back and becomes surrounded by the user's real environment." This is reportedly one of the features Apple hopes will be a "highlight of the product." To address overheating concerns, the Reality Pro headset will use an external battery that "rests in a user's pocket and connects over a cable." There will also be a cooling fan to further reduce the likelihood of the headset overheating. "The headset can last about two hours per battery pack," Bloomberg reports. The battery pack is "roughly the size of two iPhone 14 Pro Maxes stacked on top of each other, or about six inches tall and more than half an inch thick." Another tidbit from the report is that the headset will be able to serve as an external display for Mac. "Users will be able to see their Mac's display in virtual reality but still control the computer with their trackpad or mouse and physical keyboard," reports Bloomberg. Apple is also "developing technology that will let users type in midair with their hands."
Additionally, FaceTime on the headset will "realistically render a user's face and full body in virtual reality."
A team of more than 1,000 people have been reportedly working on the first version of the device for the past seven years. It's slated to cost "roughly $3,000" when it debuts sometime this spring.
Reality Pro Headset (Score:1, Troll)
It will magically separate you from your money! As you pull the bills out of your pocket, the headset will transform what you see - you'll believe you're providing meal vouchers to homeless veterans.
Re: (Score:2)
I think it will probably magically place more ifans in water fountains.
https://www.youtube.com/watch?... [youtube.com]
Re: (Score:2)
Re: (Score:2)
Re: (Score:1)
You do realize there are a LOT of people out there, that to them, $3K is merely pocket change...
Re: Reality Pro Headset (Score:2)
Re: (Score:2)
Re: (Score:1)
Well, maybe so...?
I mean, with EV's....they started out $$$, you had pricey versions to start with that were 'sexy' and pricey like the Tesla Roadster.
The people with $$ to spend on new cutting edge tech start first and eventually it spreads to the masses....
Maybe this is akin to this too?
Re: Reality Pro Headset (Score:2)
Here's hoping. (Score:4, Interesting)
Here's hoping.
I know it's popular to hate on Apple, and *I* am certainly not the target market for a $3,000 VR/AR headset.
BUT...
They are usually pretty good at turning existing technology into polished, popular products. Whose design the rest of the industry can then riff on to great effect.
If they think they can turn VR/AR from a nerdy niche product into something with mass appeal, I wouldn't bet against them.
Re: (Score:2)
Re: (Score:2)
If they think they can turn VR/AR from a nerdy niche product into something with mass appeal, I wouldn't bet against them.
You're not necessarily wrong, but that was under Jobs, who for all his failings didn't release products until they were ready, and the description of this headset sounds hilariously stupid.
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
I know it's popular to hate on Apple, and *I* am certainly not the target market for a $3,000 VR/AR headset.
BUT...
They are usually pretty good at turning existing technology into polished, popular products. Whose design the rest of the industry can then riff on to great effect.
$3,000 isn't going to make a popular product. Most people won't pay that for an Apple laptop any more, they're going to pay that for this even less. Apple's reputation for quality high-end hardware has been tarnished by flops like the butterfly keyboard. This doesn't affect lesser markets like iPhone, but those people aren't going to buy a product that expensive.
If they think they can turn VR/AR from a nerdy niche product into something with mass appeal, I wouldn't bet against them.
At $1,000 I might not. At $3,000 I absolutely will.
Re: (Score:2)
I was using popular in the sense of "desired", not necessarily "acquired". Like with sports cars or porn actresses.
Apple has never been about getting most people buying their products. They're more about making their products desirable enough to be perceived as a status symbol by people willing to fund their huge profit margins.
Re: (Score:2)
A cooling fan *and* an external battery pack? (Score:2)
A cooling fan *and* an external battery pack with a cable?
This sounds very un-Apple to me.
I might suggest that whoever has seen the headset in this state has only seen a working prototype. I can not see Apple going with extra cables and a noisy fan in a headset. I could be wrong, but it's more like Apple to wait another year or two for the tech to mature and build it all into a single piece of hardware.
Re: (Score:2)
Thing with Apple is a bet a significant number of those people working on it were involved in making it "not look stupid" and there was a breaking point where the designs with the battery integrated looked worse than the with the cable (which can be pretty easily hidden and i bet is similar to an iphone charge cable). I can absolutely see apple choosing a sleek design + cable over bulky and heavy, even if like you say they are are probably not happy about it and it'll be gone in a few generations. (and th
Re: (Score:1)
Re: (Score:2)
A cooling fan *and* an external battery pack with a cable?
This sounds very un-Apple to me.
I might suggest that whoever has seen the headset in this state has only seen a working prototype. I can not see Apple going with extra cables and a noisy fan in a headset. I could be wrong, but it's more like Apple to wait another year or two for the tech to mature and build it all into a single piece of hardware.
If it's Apple, the fan will be vewy, vewy qwiet.
A pocket/beltclip battery keeps the weight of the goggles down; which helps a lot with user fatigue. It is a "non-Apple" sort of a design; but that's where we are with batteries and the rest of the necessary hardware bits.
It’s about integration (Score:1)
If Apple brings their product lines together and the UI magic turns out to be real I’ve never used FaceTime before but I would give it a shot.
My question is what other use cases does it have?
Apple's Albatross (Score:2)
There is absolutely zero chance this product will be anything other than a gigantic money suck on Apple. They are 7 years too late and entering a completely saturated market. They haven't had a hit game since they let Halo slip away, and I just doubt they can catch up with the lessons learned by Oculus, Valve or Sony. It's destined to flop, hard... You can tell even Tim knows it! He's just too scared to kill the project, I don't really know why.
Re: (Score:2)
Never underestimate the power of apples propaganda machine and their paid shills on this site and others to polish this turd. apples headset will be a copy/clone of some other companies existing one and the cultists will cry out about how innovative apples crap is.
Gimme a break!
It doesn't take 1,000 Hardware and Software Engineers 7 years to copy someone's existing product! Not even Microsoft is that inept!
Re:Apple's Albatross (Score:4, Insightful)
Re: (Score:2)
The only thing Apple could learn from Meta, Valve, and Sony is how to make a headset that nobody wants.
That's apparently all they have learned, because one of the commonest complaints is the cost, and their headset is even more expensive. And what does it offer that the others don't, gaze tracking? That's just what I want an element of the panopticon to offer!
Re: (Score:1)
Re: (Score:2)
cost is only an issue in the context of gaming
What? Only gamers have to pay for hardware, everyone else gets it for free? I missed that memo.
Re: (Score:1)
Re: (Score:2)
What I'm saying is that gaming alone isn't enough to justify the supposedly high price point. However, consumers spend more than $3000 on all sorts of other goods and services when they see adequate value; that's the hurdle Apple has to clear with the headset. Anyway, all indications are that the mass-market version if this will be substantially cheaper.
The Reality SE!!!
Re: (Score:2)
--
We will soon have the option to harvest our farts, so we can post & comment on stats about them.
Re: (Score:2)
Saturated? The market hasn't even been tapped yet! Everyone on the planet is potential customer. The only thing Apple could learn from Meta, Valve, and Sony is how to make a headset that nobody wants.
Exactly!
Re: (Score:1)
Well, I don't recall the ipod costing 3K but sure... It's exactly like that. People will love to go jogging with their new headset, or drive in their car listening to their favorite music with it, or listening to podcasts....
Re: (Score:2)
There is absolutely zero chance this product will be anything other than a gigantic money suck on Apple. They are 7 years too late and entering a completely saturated market.
I don't know. .People have said that before about Apple products: "The iPhone will never be a success. . .", "A watch that requires a charge every day--no one will buy it."
Re: (Score:1)
We'll see. Meta was practically giving the Quest2 away to get where they are. Apple users are so enamored with fashion I don't see them rushing to get a big dopey box for their face. Especially not for 3K. But we'll see.
This is just like Stadia, Nvidia Shield, Apple TV, Zune, and Bitcoin were. All of those are/were clearly stinkers, right from the start... Same as this product nobody wants, from a company 7 years too late to the game.
The iPhone was clearly and obviously the right product. This is not t
Re: (Score:2)
This is just like Stadia, Nvidia Shield, Apple TV, Zune, and Bitcoin were
I am confused. Can you not buy an Apple TV these days? Why lump Apple TV in there when it is still a product that exists.
Same as this product nobody wants, from a company 7 years too late to the game.
Apple was more than 7 years late to the smart phone market.
The iPhone was clearly and obviously the right product. This is not that. Not by a mile. And you need look no further than Tim himself whenever the subject comes up. I don't see ol' Timmy walking out on stage triumphantly with this thing strapped to his face.
You can't strap a desktop Mac to your face. Nor an Apple TV. Nor an Apple HomePod. You could also say that about why Satya Nadella is not wearing an Xbox Series S these days. There are products that are not meant to be worn everywhere.
And the watch IS stupid. It's COMPLETELY stupid. Who the hell wants a watch that can't last a day?
According to estimates [statista.com], 60 million people in 2022 alone.
No, fashion is what the watch is. Not utility. People buy fashion. But a big box on your face is like anti-fashion so no... It's doomed.
And yet Apple sells more and more of thes
Re: (Score:2)
There is absolutely zero chance this product will be anything other than a gigantic money suck on Apple. They are 7 years too late and entering a completely saturated market. They haven't had a hit game since they let Halo slip away, and I just doubt they can catch up with the lessons learned by Oculus, Valve or Sony. It's destined to flop, hard... You can tell even Tim knows it! He's just too scared to kill the project, I don't really know why.
Apple plays the long game.
When this is released, it won't be some janky, nausea-inducing, claustrophobic, clusterfuck with a braindead UX. It will be smooth and responsive, with a gorgeous display and a list of features both useful and well-executed.
7 years of 1,000 Hardware and Software Engineers is a big-ass Project in anybody's estimation. I feel that this will show those other guys how it's done.
Re: (Score:2)
FTFY #OverpricedShit #AppleSux
Another Erudite Opinion. . .
Re: (Score:1)
Re: (Score:2)
https://www.defectivebydesign.org/apple [defectivebydesign.org]: better?
Nope.
Still ignorant and offtopic.
#AppleSux (Score:1)
So we're *that* far away from real AR glasses? (Score:2)
"Unlike other headsets" (Score:2)
[from the summary] Users will then pinch their thumb and index finger together to activate the task -- without the need to hold anything. The approach differs from other headsets, which typically rely on a hand controller.
Correction: "the approach is 100% copied from the Microsoft Hololens controller, which also uses pinched fingers. Arguably it's the inevitable and only feasible approach for an AR headset."
Re: (Score:1)
Well good thing Microsoft just abandoned VR and AR entirely [extremetech.com] so it's free for Apple to use...
Re: "Unlike other headsets" (Score:2)
Pretty much (Score:1)
So what you're saying is Microsoft is a genius at developing these things and Apple blatantly copies it,
Mostly yes.
Having used a HoloLens (do not actually own one), I can say that Microsoft's work on it was pretty excellent.
What is wrong with Apple copying good aspects of it, since you seem to present that in a negative light?
it's totally ok since it's Apple and Microsoft put the project on pause?
Well it was really OK anyway, but it's really even more OK because why should a good idea die just because the
Re: Pretty much (Score:2)
I want you to have to think and realize that other companies can be innovative, and it's not the "only Apple can innovative" narrative that you are always pushing here. Do you think it's a fluke that people here make fun of you for being so blindly pro-Apple? It's not.
As you mentioned, you've used a Holo-Len
Re: (Score:1)
You want humanity to stagnant unless it has Apple behind it,
I want humanity to advance by any and all means, don't care if Apple is involved... that's why I was pretty happy with what Microsoft did with HoloLens.
The ACTUAL difference is that you selectively acknowledge who is doing the advancing, so you will always be operating with incomplete data, and seem kind of mad that Apple has taken up the baton. A poor look.
knew about the battery being external was a Microsoft innovation.
Never claimed that was an
Re: (Score:1)
More to fatten kids (Score:1)
4K per eye is not enough for movies or desktop (Score:2)
No way you can have a reasonable and readable display without at least an 8K per eye display, minimum (the math is .. 20/20 vision = 60 pixels per degree. 4K spread out over a 120 degree FoV is only 32 ppd. Starting. Also, there's no way 4K per eye is enough for movies. I'd have to believe Apple tested their headset enough to know that, which makes me still hold out some hope that it will be 8K per eye. Note even 8K per eye is not optimal .. optimal is 12K per eye. The GPU requirement is less than HD though
Re: (Score:2)
You're talking about video game text, GP is talking about reading text like you would on a monitor. If it doesn't replace a monitor, then you have to use both at once in order to perform some kinds of tasks, and at this price it has to be able to function as your only display.
Re: (Score:2)
Screen door effect is the worst problem with headsets and low res displays. Being able to see lines or gaps between pixels is distracting.
Re: (Score:2)
No way you can have a reasonable and readable display without at least an 8K per eye display, minimum (the math is .. 20/20 vision = 60 pixels per degree. 4K spread out over a 120 degree FoV is only 32 ppd. Starting. Also, there's no way 4K per eye is enough for movies. I'd have to believe Apple tested their headset enough to know that, which makes me still hold out some hope that it will be 8K per eye. Note even 8K per eye is not optimal .. optimal is 12K per eye. The GPU requirement is less than HD though, if they can implement foveated rendering.
Well, they reportedly have pupil-tracking; so foveated rendering at that point is relatively straightforward.
And whatever resolution it takes, I can guarantee it will meet or exceed that threshold.
Remember, Apple has been bringing-up a Display Division; my guess is they aren't just Developing iPhone Displays.
Hand tracking is over rated (Score:2)
I suppose hand tracking might be fine in virtual meeting rooms or whatnot to wave your hands around. But if you using tools or playing a game then making pew pew shapes with your fingers will be stupid and simply won't work for anything remotely complex.