A tiny JS library for real-time localization of eye pupils
Dev tools
computer vision library
SHOW HN2019
A tiny JS library for real-time localization of eye pupils
A tiny JS library for real-time localization of eye pupils
tehnokv.com#pupil detection#eye tracking#webcam javascript#decision trees
How HN took it
4 positive, 20 neutral or asking, 3 mixed, 11 critical, out of 38 comments about the project. Thread score -0.21.
Idea: 3 for, 6 againstPerformance: 1 for, 3 againstPrivacy: 0 for, 2 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Impressive for a tiny browser-based demo
From 2 comments
I'm always curious about what it takes to confuse things like this (if for no other reason so that I will know how to make face recognition camouflage to hide from the autonomous…
rodw on HNIf it works, you will see a live feed of your webcam with your face encircled with your pupils highlighted as red dots... its pretty impressive! I'm guessing your browser is…
cstrat on HN
Works well for some users, even on low-end phones
From 2 comments
Worked pretty well for me on my low-end 2 year old Samsung!
osrec on HNWorks on firefox for me 67.0.4 (64-bit)
Estyn on HN
Interesting for eye-tracking research and UI ideas
From 2 comments
so, we use eye tracking in experiments to look at how people acquire information. For example, you can parameterize a drift diffusion model using input from gaze. But the…
your-nanny on HNNifty. I use PoseNet[1] on tensorflow.js to locate eyes for 3D UIs on a laptop. lploc seems much faster, but requires a more restricted head pose. Maybe I'll try using both. I've…
mncharity on HN
Objections
Privacy concerns about granting webcam access to random sites
From 2 comments
Sorry if I don't trust some random web page to use my camera because they promise they're not logging it to their server.
Lowkeyloki on HNI'm all for being paranoid but what exactly is the threat model here? Someone is going to have a few seconds of video of you?
errantspark on HN
Jitter and poor robustness to head pose, glasses and oblique angles
From 3 comments
It works pretty well, but it has the same issue I see with a lot of these object tracking algos - it jitters all over even when I’m holding as still as I can. Why are these…
cookingrobot on HNNot very good if you change head orientation or rotation but otherwise pretty cool!
emilfihlman on HNI'm always curious about what it takes to confuse things like this (if for no other reason so that I will know how to make face recognition camouflage to hide from the autonomous…
rodw on HN
Fears it will be used for ad attention tracking or employee monitoring
From 3 comments
Can't wait to integrate this with ad serving tech to make sure users are actually watching the ads. Imagine adding little "eye catchers" to ads, and if the pupils don't respond,…
umvi on HNThis is the kind of tech that managers might like to install on their employees computers. If you're smart enough to build interesting things, maybe spend that talent on…
mevile on HNVideo streaming is too slow to adapt, but I see a way for advertisers to check if you watched an ad even if you didn't interact. Specially if the site already uses the webcam.
ASalazarMX on HN
Requests
Reduce jitter in tracking output
From 1 comment
It works pretty well, but it has the same issue I see with a lot of these object tracking algos - it jitters all over even when I’m holding as still as I can. Why are these…
cookingrobot on HN
Support for gaze tracking beyond pupil location
From 2 comments
Nifty. I use PoseNet[1] on tensorflow.js to locate eyes for 3D UIs on a laptop. lploc seems much faster, but requires a more restricted head pose. Maybe I'll try using both. I've…
mncharity on HNThe author means real-time location of pupils. This is not gaze tracking though.
mbrookes on HN
Questions
Why it does not start after clicking the button
From 1 comment
What am I missing? "Click the button below and allow the page to access your webcam." ...and then?
haberdasher on HN
Whether it works on Firefox without canvas access
From 2 comments
Works on Chrome, but doesn't appear to work on Firefox. I can see my webcam feed, but the red indicators don't show up. Edit: Nevermind, it requires access to canvas data which…
Deukhoofd on HNWorks on firefox for me 67.0.4 (64-bit)
Estyn on HN
Alternatives named
WebGazer gaze tracking library
From 1 comment
Gaze tracking on browsers with webcams does exist though! https://webgazer.cs.brown.edu/
azhenley on HN
PoseNet on tensorflow.js
From 1 comment
Nifty. I use PoseNet[1] on tensorflow.js to locate eyes for 3D UIs on a laptop. lploc seems much faster, but requires a more restricted head pose. Maybe I'll try using both. I've…
mncharity on HN