In this episode of the AI + a16z podcast, Socket founder and CEO Feross Aboukhadijeh, and a16z partner Joel de la Garza, discuss the open-source software supply chain. Feross and Joel share their thoughts and insights on topics ranging from the recent xz Utils attack to how large language models can help overcome understaffed security teams and overwhelmed developers.
Despite some increasingly sophisticated attacks making headlines and compromising countless systems, they’re optimistic that LLMs, in particular, could be a turning point for security blue teams. Here are some highlights:
[14:25] Joel de la Garza: “The whole new microservices and decomposed development model has been awesome at making sure that whatever method developers are using is the correct method. Because the problem before that was that people would roll their own methods of implementing things. . . . This new methodology actually means that people, when they implement these things, they’re probably using an approved cryptographic method. It’s probably implemented mostly correctly. . . .
“I think it’s made a lot of things better, but it has just created a new attack surface, and it’s created a new set of issues around actually managing the things that are going in there and making sure that you’re validating the correctness of these things.”
[19:03] Feross Aboukhadijeh: “The way we think about gen AI on the defensive side is that it’s not as good as a human looking at the code, but it’s something. . . . Our challenge is that we want to scan all the open source code that exists out there. That is not something you can pay humans to do. That is not scalable at all. But, with the right techniques, with the right pre-filtering stages, you can actually put a lot of that stuff through LLMs and out the other side will pop a list of of risky packages.
“And then that’s a much smaller number that you can have humans take a look at. And so we’re using it as a tool . . . to find the needle in the haystack, what is worth looking at. It’s not perfect, but it can help cut down on the noise and it can even make this problem tractable, which previously wasn’t even tractable.”
[29:23] Feross Aboukhadijeh: “What we see . . . every day is that the bar is so low. It’s not like you’re not dealing with a two-year, state-backed kind of an attack. You’re dealing with somebody, they added five lines of code to the bottom of one of the files of the open source project that you’re using, and it just steals your environment variables and sends them off to the attacker. And it’s right there. And if anyone had looked, they would have seen it. It was right there in the file and literally no one looked. And it’s not just that your company didn’t look. It’s that no one in any company looked. That’s the kind of thing that we see hundreds of per week coming through the feeds. . . .
“And people have this mistaken assumption that, ‘Oh, it’s open source, so it’s safe.’ ‘Oh, I didn’t write that code; I wrote the app code and I just used this dependency, so it’s not my problem.’ But it is your problem. At the end of the day, it’s going to run in the same process as the rest of your app and it’s going to ship into products and it’s going to affect all your users. So, it is your problem.”
[36:05] Joel de la Garza: “I do think that a lot of the attackers, they do have cost constraints and they do have resource constraints that a lot of the blue teams don’t have. And, generally, the adage has always been that the red team always wins. But I do think that with this generative AI wave, and if we do believe that we can do meaningful, agentic-type products that will at least be the level of an intern, perhaps even a level-one analyst . . . I think that if you can deploy 10,000 of those and give them an infinite amount of time, things will get better. I do actually see a path here for things to get markedly better, even though the adversaries [also] have access to these tools.”
Sign up for our a16z newsletter to get analysis and news covering the latest trends reshaping AI and infrastructure.
Check your inbox for a welcome note.
The views expressed here are those of the individual AH Capital Management, L.L.C. (“a16z”) personnel quoted and are not the views of a16z or its affiliates. Certain information contained in here has been obtained from third-party sources, including from portfolio companies of funds managed by a16z. While taken from sources believed to be reliable, a16z has not independently verified such information and makes no representations about the enduring accuracy of the information or its appropriateness for a given situation. In addition, this content may include third-party advertisements; a16z has not reviewed such advertisements and does not endorse any advertising content contained therein.
This content is provided for informational purposes only, and should not be relied upon as legal, business, investment, or tax advice. You should consult your own advisers as to those matters. References to any securities or digital assets are for illustrative purposes only, and do not constitute an investment recommendation or offer to provide investment advisory services. Furthermore, this content is not directed at nor intended for use by any investors or prospective investors, and may not under any circumstances be relied upon when making a decision to invest in any fund managed by a16z. (An offering to invest in an a16z fund will be made only by the private placement memorandum, subscription agreement, and other relevant documentation of any such fund and should be read in their entirety.) Any investments or portfolio companies mentioned, referred to, or described are not representative of all investments in vehicles managed by a16z, and there can be no assurance that the investments will be profitable or that other investments made in the future will have similar characteristics or results. A list of investments made by funds managed by Andreessen Horowitz (excluding investments for which the issuer has not provided permission for a16z to disclose publicly as well as unannounced investments in publicly traded digital assets) is available at https://a16z.com/investments/.
Charts and graphs provided within are for informational purposes solely and should not be relied upon when making any investment decision. Past performance is not indicative of future results. The content speaks only as of the date indicated. Any projections, estimates, forecasts, targets, prospects, and/or opinions expressed in these materials are subject to change without notice and may differ or be contrary to opinions expressed by others. Please see https://a16z.com/disclosures for additional important information.
Artificial intelligence is changing everything from art to enterprise IT, and a16z is watching all of it with a close eye. This podcast features discussions with leading AI engineers, founders, and experts, as well as our general partners, about where the technology and industry are heading.