lip-reading-deeplearning

AI

computer vision lipreading

SHOW HN2018

258points
31comments
#115of 2,155 in 2018
Top 6%of 2018 by points

How HN took it

CuriousMostly questions and neutral comments

3 positive, 5 neutral or asking, 0 mixed, 2 critical, out of 10 comments about the project. Thread score +0.09.

Idea: 3 for, 2 against

The thread, comment by comment

Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.

positive neutral or mixed critical about another commenter or something else the maker

What HN said

What people liked

  • Fascinating and potentially useful application such as sign language

    From 2 comments
    • This is fascinating. Has anyone considered repurposing this for something like sign language?
      meow_mix on HN
    • That's actually a really good application with some real potential for improving lives. High five mate
      Havoc on HN

Objections

  • Code matches audio to video rather than recognizing speech, so it isn't really lipreading

    From 2 comments
    • Maybe I'm misunderstanding the code, but it looks like it's matching audio to video, not actually recognizing speech given a video. That is, it could answer "does this audio line…
      gok on HN
    • Exactly. How is this "lipreading"? Clickbait.
      person_of_color on HN
  • Ethical and weaponization concerns about surveillance uses

    From 2 comments
    • OK. But WHY? All technology has moral implications. Did you create this to actually help people? Do you care if it is weaponized? Think before you create.
      orasis on HN
    • How many secret efforts are there to accomplish this already for the MIC? I can't imagine that there arent already some Palantir-like efforts to accomplish this. Imagine a REALLY…
      samstave on HN
  • No demonstration video provided

    From 1 comment

Requests

  • Demonstration video

    From 1 comment
  • Application to sign language

    From 1 comment
    • This is fascinating. Has anyone considered repurposing this for something like sign language?
      meow_mix on HN

Questions

  • Does training need paired audio and mouth video

    From 2 comments
    • in order to train doesn't it have to match audio output to a video of mouth movement? Doesn't deep learning imply training on sample result?
      pavs on HN
    • I didn't take a deep dive of the code but in order to train it's going to need to be fed audio files with the actual video/mouth shapes/etc. Essentially it needs it to tell the…
      derimagia on HN

Alternatives named

  • Oxford and DeepMind lipreading video work

    From 1 comment
    • Not the same project, but here's one from Oxford + Deepmind: https://www.youtube.com/watch?v=fa5QGremQf8
      ehsankia on HN
  • Laser microphone and vibration eavesdropping

    From 2 comments
    • For windows, they already have this, IIUC. You bound a laser beam of the window and measure the vibrations. Random guys can just do this in their garage.…
      asdfasgasdgasdg on HN
    • https://en.wikipedia.org/wiki/Laser_microphone
      s_m_t on HN

Category, keywords, summaries and labels on this page were made by AI (Thread Reader v2) and not checked by hand. Each point links to the comments it came from.

Add a badge to your READMEShown on HackerShow
[![Shown on HackerShow](https://hackershow.org/badge.svg)](https://hackershow.org/show/18265074)