back to article How your mouse could eavesdrop on you and rat you out

The mouse sitting next to you can be turned into a microphone thanks to some cunning use of its sensors to pick up vibrations from your voice in an attack dubbed Mic-E-Mouse. Researchers at UC Irvine have found that optical mice equipped with 20,000 DPI sensors and decent latency can be used as a basic microphone with software …

  1. zeos

    The biggest flaw in this attack is that you have to have someone to talk to for it to work.

    1. John Robson Silver badge

      Unless it's reading keystrokes...

      1. zeos

        Nooooooooooooooooo! This can't be happening. My clicky keyboard would never betray me.

        1. The Oncoming Scorn Silver badge
          Coffee/keyboard

          Reading keystrokes is mentioned in the article, I also recall a episode of Spooks (MI:5) doing something similar by getting a target to retype a CV or Resume with a "calibrated test phrase" so they could "read" what he was typing into documents & emails.

          Icon is not being used in its usual context.

      2. David Hicklin Silver badge

        > Unless it's reading keystrokes...

        If you have got this far in monitoring the mouse, would it not be a lot simpler to just add a keystroke logger ?

    2. Evil Auditor Silver badge

      No need to have someone to talk to; it's the frame for the next extortion business. Instead of asking for my money to not distribute footage of my inexistent webcam, it will be "we recorded the sound of you watching contemporary interactive adult entertainment and detected rhythmic hand movement...

      1. Evil Scot Silver badge

        That would be Flicking the magic track pad on my MAC???

        Or are you talking about my Lenovo laptop.

        1. Furious Reg reader John

          Don't you twiddle your nipple on a Lonovo laptop instead?

  2. Anonymous Custard Silver badge
    Trollface

    Nominative Determinism?

    The cynic in me wonders a bit whether they came up with the name first and then spent the time working out an attack vector that was a good fit for it...

    It is quite clever though, in a rather niche and specific way.

  3. Wellyboot Silver badge

    Amazon can help here!!!!!

    Their Basic mouse is only 1000DPI

    I doubt a mouse can move that far listening to voice or clicks

    1. DS999 Silver badge

      Re: Amazon can help here!!!!!

      Sounds like it just vibration, so the mouse will stay in the same position. They need 20000 dpi because the vibrations are very small. If you talk loud enough maybe the Amazon Basic mouse would do!

      Makes me wonder what DPI my mouse is - sometimes I'll see my display power up randomly when I'm away from the keyboard. I've always assumed the reason was that some subtle mouse event was registered. Never considered that as a viable attack vector lol

  4. Joe W Silver badge

    Is that written by Microsoft?! Apple?

    "all it takes is one malicious app – possibly disguised as open source software"

    Seriously?!

    1. b0llchit Silver badge
      Holmes

      Re: Is that written by Microsoft?! Apple?

      Please, consider the "sponsors" and paid "subscriptions" to wonderful places that no commoner else could afford. You gotta get your bribecollaboration funding from somewhere, don't you?

    2. I am David Jones Silver badge
      Devil

      Re: Is that written by Microsoft?! Apple?

      And avian flu is dangerous for humans, all it takes is one bird - such as a penguin.

      1. Evil Scot Silver badge

        Re: Is that written by Microsoft?! Apple?

        Penguins don't fly...

        1. Yet Another Anonymous coward Silver badge

          Re: Is that written by Microsoft?! Apple?

          They could he carried by a swallow

          1. notyetanotherid

            Re: Is that written by Microsoft?! Apple?

            African or European swallow?

            1. Yet Another Anonymous coward Silver badge

              Re: Is that written by Microsoft?! Apple?

              But African swallows aren't open source

      2. GNU Enjoyer
        Angel

        Re: Is that written by Microsoft?! Apple?

        Indeed - the kernel, Linux is disguised as "open source" software, but in fact it is proprietary software.

    3. GNU Enjoyer
      Angel

      Re: Is that written by Microsoft?! Apple?

      Yes, proprietary malware is often claimed to be "open source", as that encourages people to install it without thinking - many malicious companies use that trick.

      Still, I haven't yet seen any proprietary malware program claim to be free software that respect the users freedom and well; https://www.gnu.org/fun/jokes/evilmalware.html

  5. 45RPM Silver badge

    Presumably the mouse would have to be calibrated to a particular keyboard. So there’d have to be a known, repeated, key sequence to set up the mouse for keystroke recognition?

    1. I am David Jones Silver badge

      Just like cracking a substitution code, I don’t think it’d take long to identify keys by analysing usage frequency and identifying keystroke sequences for common words.

      1. C R Mudgeon Silver badge

        Exactly. It's an easy enough problem that some newspapers set examples as a weekend entertainment, i.e. cryptograms.

    2. DS999 Silver badge

      That's probably not that difficult, people will enter known text in response to a prompt to enter their name and address, or something like a CAPTCHA can choose the exact keys it wants you to enter.

    3. cosmodrome

      1234567! maybe?

  6. Pascal Monett Silver badge
    Meh

    "each key sounds different"

    Not to me, but I will acknowledge that my hearing isn't what it used to be.

    That said, if each key does sound different, then each keyboard sounds different as well. Seems to be a bit difficult to have a standard library, so it means calibrating the keys to specific frequencies.

    Okay, congrats on having found a new attack vector, even if it is only 60% reliable.

    Still, this whole thing stikes me as a bit of intellectual masturbation. If you can get malware onto a PC via an pseudo-open-source program, you've got better things to do than listen to mouse vibrations.

    1. Eclectic Man Silver badge
      Happy

      Re: "each key sounds different"

      come on, folks, we need to play some music to overwhelm the mouse:

      https://www.youtube.com/watch?v=apBWI6xrbLY

      1. David 132 Silver badge
        Happy

        Re: "each key sounds different"

        To stymie the keyboard-listening attack, perhaps this? Leroy Anderson - The Typewriter

    2. C R Mudgeon Silver badge

      Re: "each key sounds different"

      ' "each key sounds different"

      Not to me, '

      Every ski-lift tower sounds different. Each one has its own individual pattern of squeaks and chirps from the rotating pulleys.

      Given that human-scale observation, I'm quite willing to believe that keyboard keys have differences that happen to be below my ears' and nervous system's resolution.

      1. Joe W Silver badge

        Re: "each key sounds different"

        It's not only the key that sounds differnetly, due to the physical position on the resonant keyboard body (filll your keyboard with concrete! For saftety! Let's see my colleagues nicking a keyboard now![*]), but also the different way you hit them with the finger[+], maybe unless you are doing the eagle-circling-search-system. This has been a known attack vector (microphone based, but also by laser scanning windows) for several years, at least I recall having read a bunch of articles on ElReg about this. And let's face it: since I cannot hear the difference in magical audio connects I probalbly don't hear theat difference as well ;) I also prefer using a trackball, because I'm weird.

        And thanks, now I want to go skiing. Though I prefer actually walking up rather than lifts, it's what living in Norway does to you, fjellski for the win!

        [*] "You took my keyboard!" - "It's a company one, so they are all the same" - "no, not this one..."

        [+] we all know that certain keys just don't react the same way to key presses - in extreme cases this results in missing letters on shitty keyboards, I'm looking at the crap Fujitsu is pushing on the laptops, FFS, it's not that difficult!

    3. notyetanotherid
  7. Gary Stewart Silver badge

    Hello computer

    So Scotty was on to something after all.

  8. sabroni Silver badge
    Boffin

    Why make a mouse that sensitive?

    Does it help the user in any way or is it just so you jump to the top of the list sorted by resolution? I doubt any human can move their hand to within a 20000th of an inch.

    So stupid tech enables snooping while providing nothing of value to the user?

    Well done.

    No really, well done!

    1. bigphil9009

      Re: Why make a mouse that sensitive?

      It's for teh gamerz, innit. Can't no scope that headshot with at 1000DPI mouse now, can you? :)

  9. Wanting more

    No need to listen to keystokes if you have comprised the computer enough to get mouse data

    If you've already managed to breech the computer and are detecting mouse input, there's no need to listen for keystrokes, just intercept those too. But listening to general audio in the environment is another matter.

  10. Nifty

    If you can hack the mouse then you can hack the laptop's mic, I would have thought. OK in super secure environments there would be no mic connected to a PC.

    But the really interesting thing is the filtering & AI. For many decades there has been successful spying on in-room conversations by bouncing invisible laser light off a window, long before it was possible to fish meaning out of the noisy vibrations using the amount of compute mentioned in this article. It now looks like it will be child's play to do this and existing prevention measures may be well under-specified.

    These researchers should be offered jobs at GCHQ.

    1. Fruit and Nutcase Silver badge
  11. Will Godfrey Silver badge
    Boffin

    Good luck wih that.

    I usually have moderately loud music while on the 'puter and this with desktop speakers that are just a few inches from mouse and keyboard.

  12. DJV Silver badge

    If they listen in on me, most of the time it will be me telling the cat to get off the keyboard!

  13. Anonymous Coward
    Anonymous Coward

    All those smugglies with Dvorak keyboards

    might be immune to this attack.

    I have seen at least one bright young thing reprogram their keyboard to a completely idiosyncratic key mapping. One supposes at one extreme of a spectrum but I would not think one of the usual spectral suspects. Where's the E key today ? ;)

    My collection of mice is decidedly of the very cheap and nasty - more inches per dot than dpi - and only serve to move the text cursor between windows or panes.

    I should grasp the nettle and embrace CWM but too old or lazy. I recall in the early days of Windows part of the IBM CUA had key bindings for moving the cursor between windowing elements but I imagine MS dumped those eons ago — don't even know if alt·f4 still works.

    1. Nifty

      Re: All those smugglies with Dvorak keyboards

      Yeah did that with teenage son's keyboard to stop the S, E, and X keys from being worn out.

  14. Furious Reg reader John

    But what about devices created to listen, rather that make a device that wasn't be able to?

    I'm sure Alexa, Siri, Hey Google, etc must be able to hear the same voice, footsteps and key clicks that the mouse can, but much clearer and from a greater distance away.

  15. IGnatius T Foobar !

    New rule

    Once they collect the data, researchers run it through a Wiener filter to remove noise and then feed it into a transformer-based neural network to identify actual words.

    New rule: if your name is Wiener, please don't name anything after yourself.

    1. collinsl Silver badge

      Re: New rule

      Nice English-Language defaultism there.

      Next you'll be telling the Spanish to rename their black crayon colour because you don't like the Spanish word Negra.

  16. vincent himpe

    I Knew this old Bus Mouse card would come in handy

    Now to find a motherboard with ISA slot ....

  17. rob miller
    Stop

    "possibly disguised as open source software"

    Oi! WTF?!?!?! Was that really necessary?

POST COMMENT House rules

Not a member of The Register? Create a new account here.

  • Enter your comment

  • Add an icon

Anonymous cowards cannot choose their icon

Other stories you might like