←
Ken Pfeuffer642 posts
Ken Pfeuffer avatar

Ken Pfeuffer

@KenPfeuffer

Prof @csaudk, #HCI #XR, eye-gaze UI. sharing things from research etc

◷ Joined June 2014▧ 101 Photos and videos
Ken Pfeuffer avatar
Ken Pfeuffer@KenPfeuffer·10 Aug 2025

Excited to finally announce that we got a bunch of new upcoming research papers on eye and hand HCI for XR! 👁️🖐️ 📝1 paper at #UIST2025 📝3 conference + 3 workshop papers at #ISMAR2025 Stay tuned for details. Thanks to the amazing students at XI lab + collaborators🙏

Post attachment
Ken Pfeuffer avatar
Ken Pfeuffer@KenPfeuffer·Oct 31

Direct and indirect interaction are becoming fundamental to 3D user interfaces, across input devices and XR headsets. Eye–hand coordination enables seamless transitions between these modes. This infographic illustrates the principles and their implementation in today's XR.

Ken Pfeuffer avatar
Ken Pfeuffer@KenPfeuffer·Sep 24

Gaze+Pinch: after Apple, Samsung, now apparently Meta. You're welcome! 3dvar.com/Pfeuffer2017Gaze.p…

This is exactly what I’ve been waiting for 🔥 Meta just announced its new VR Glasses. Basically an Apple Vision Pro-like experience, but MUCH smaller and lighter. • Only 100g • Micro-OLED displays • Snapdragon Reality Elite • Eye + hand tracking • External compute/battery puck • $1,299 This is the direction I want VR to go. Smaller, lighter, more comfortable, while keeping the full spatial computing experience. Launching Spring 2027. I’m getting these 100% 🙌

1:09
Ken Pfeuffer avatar
Ken Pfeuffer@KenPfeuffer·Jun 13

XR user input is fragmented across devices - but over time, standards emerged. This infographic summarizes the evolution of XR input over the last 12 years. Made this infogram while preparing talks on eye-hand symbiosis and thought it might be useful to share.

Ken Pfeuffer avatar
Ken Pfeuffer@KenPfeuffer·Feb 10

👁️✋Pinch-to-zoom, but where you look is where it zooms. This 2015 example explores multimodal-bimanual-direct-manipulation with gaze (mouthful!). The hand stays away in comfort zone, the pen at the center. They don't interfere, just symbiosis. From bit.ly/4rKnY2H

0:43
Ken Pfeuffer avatar
Ken Pfeuffer@KenPfeuffer·Feb 9

👁️🖐️What makes and breaks the gaze + pinch UI, what challenges remain? Here are 5 design issues, illustrated from the below article. #uiux #xr #spatialcomputing #hci #gesture #gaze

New article on 👀✋: Design Principles & Issues for Gaze and Pinch Interaction Inspired by HCI research and the upcoming @Apple #VisionPro release. Medium: bit.ly/48Ei75A LinkedIn: bit.ly/3SnH4g3 #arvr #uiux Below the 5 principles in short:

Ken Pfeuffer avatar
Ken Pfeuffer@KenPfeuffer·Jan 29

With a mouse or touchpad, this would require a lot of cursor dragging. In 2014, I explored fluid and simple gaze+touch UI (eye tracker under the table). Why don’t we have this on laptops yet, eg. using gaze + touchpads...?

1:14
Ken Pfeuffer avatar
Ken Pfeuffer@KenPfeuffer·Jan 20

New research incoming for #CHI2026 - on multimodal interaction in XR: - how to teleport with👀+✏️ - how we preshape our hands with 👀+🖐️ and 👀+ 🎮 - how to multi-select objects with 👀+🖐️+🎤 Huge thanks 🙏to all students & collabs @csaudk @Concordia @LancasterUni @GoogleARVR

Ritwik Pavan avatar
⟳ Ken Pfeuffer retweeted
Ritwik Pavan@ritwikpavan·9 Dec 2025

JUST IN: Google unveiled its smart glasses project with XREAL, called Project Aura. • 70° FOV for a giant virtual screen anywhere • run full Android apps in floating windows • Circle to Search on anything you look at • lightweight frame powered by a small compute puck • hand tracking for pinch, zoom and window control Launching in 2026.

2:26
Shahram Izadi avatar
⟳ Ken Pfeuffer retweeted
Shahram Izadi@izadi_shahram·8 Dec 2025

We're taking the next step to make #AndroidXR even more helpful and seamless in your daily life. So much to share from The Android Show | XR Edition today in partnership with @SamsungMobile and @Qualcomm. We introduced powerful new features for Galaxy XR, including Travel Mode for using your device on the go, PC Connect for streaming high fidelity desktop and laptop experiences to XR, and representing you as a photoreal avatar, with our Likeness feature. We also shared updates on our AI glasses which we are building with @SamsungMobile, @WarbyParker and @_GentleMonster_. The Developer Preview 3 of the Android XR SDK brings new tools to all developers and opens up development for AI Glasses! Finally, we also showed how we are expanding Android XR to the broader ecosystem, with Project Aura from @XREAL_Global. Read more on the blog: blog.google/products/android… Here’s a recap: youtu.be/oy_ayfHcVWA And you can watch the full keynote here: youtube.com/live/a9xPC_FoaG0

𝙏𝙝𝙧𝙞𝙡𝙡 avatar
⟳ Ken Pfeuffer retweeted
𝙏𝙝𝙧𝙞𝙡𝙡@Thrilluwu·12 Nov 2025

I know it's not exactly the "hottest" part of Valves announcement, but I am really excited for the Steam Frame's "Eye Tracked Foveated Streaming". Things like this are one of the many reasons why I've been obsessed with headsets shipping natively with eye tracking.

Post attachment
Brad Lynch avatar
⟳ Ken Pfeuffer retweeted
Brad Lynch@SadlyItsBradley·9 Nov 2025

When will Apple let you use gaze + chopsticks as input

0:25
Massimo avatar
⟳ Ken Pfeuffer retweeted
Massimo@Rainmaker1973·9 Nov 2025

Surfer takes us through what it looks like while riding a perfect wave [📹 gabrielmbenetton]

0:22