Systemic Bias in Data Makes AI a Stereotype Machine

InsightsPortfolio
Written By AB

INSIDEBIGDATA: Artificial intelligence (AI) software systems have been under attack for years for systematizing bias against minorities. Banks using AI algorithms for mortgage approvals are systematically rejecting minority applicants. Many recruiting tools using AI are biased against minority applicants. In health care, African Americans are victims of racial bias from AI-based hospital diagnostic tools. If you understand how data science research produces the models that power AI systems, you will understand why they perpetuate bias, and also how to fix it.

 

More News & Insights

News & Insights
Nick Adams Discusses How To Get Your Generative AI Startup Funded
Differential Ventures
Nick Adams Discusses How To Get Your Generative AI Startup Funded
Differential Ventures

AI and the Future of Work Podcast: Entrepreneurs wonder what it’s like to be a VC. And VCs without an operating background often don’t understand the grit required to turn an idea into a successful business. The best investors have been successful operators first.

Today’s guest is one of those. Nick Adams founded Differential Ventures in 2017 to invest in B2B, data-first seed-stage companies. Since then, Nick and the team have invested in an impressive group of companies including Private AI, Ocrolus, and Agnostiq.

Differential Ventures
Nick Adams: What Regulations Need to Be Put in Place to Ensure the Safe Use of AI in the U.S.?
Differential Ventures
Nick Adams: What Regulations Need to Be Put in Place to Ensure the Safe Use of AI in the U.S.?
Differential Ventures

Nick Adams on PM360: To get a better grasp on what eventual AI regulations could and should look like, PM360 spoke with Nick Adams, Founding Partner at Differential Ventures. In addition to starting the venture capital firm focused on AI/machine learning in 2018, Adams is also a member of the cybersecurity and national security subcommittee for the National Venture Capital Association and recently briefed members of Congress on AI policy and potential regulation.

Differential Ventures
Nick Adams: Where’s AI headed in the workplace? VCs weigh in
Differential Ventures
Nick Adams: Where’s AI headed in the workplace? VCs weigh in
Differential Ventures

Nick Adams on TECHBREW: For all the pixels spilled about the promises of generative AI, it’s starting to feel like we’re telling the same story over and over again. AI is serviceable at document summarization and shows promise in customer service applications. But it generates fictions (the industry prefers the euphemistic and anthropomorphizing term “hallucinates”) and is limited by the data on which it’s trained.

Differential Ventures
David Magerman: Artificial Intelligence’s Glass Ceiling
Differential Ventures
David Magerman: Artificial Intelligence’s Glass Ceiling
Differential Ventures

David Magerman on THEINFORMATION: OpenAI’s stated goal is to develop and promote a software system capable of artificial general intelligence. Toward that end, the company has released systems based on large-language models, which can respond to prompts with fluent conversation on many subjects. ChatGPT, Microsoft’s Bing chatbot and other new systems based on OpenAI’s GPT-3 and GPT-4 models are truly incredible and perform far beyond previous attempts at achieving AGI.

Differential Ventures
Nick Adams on Fox5: Artificial Intelligence Pros and Cons
Differential Ventures
Nick Adams on Fox5: Artificial Intelligence Pros and Cons
Differential Ventures

FOX5 WASHINGTON DC: Nick Adams discusses the pros and cons of Artificial intelligence.

Differential Ventures
Differential Ventures Specializes In Being Advisors For AI Companies
Differential Ventures
Differential Ventures Specializes In Being Advisors For AI Companies
Differential Ventures

PULSE 2.0: Differential Ventures is a seed-stage venture capital fund that was founded by data scientists and entrepreneurs for data-focused entrepreneurs. To learn more about the firm, Pulse 2.0 interviewed Differential Ventures’ managing partner and co-founder Nick Adams.

Differential Ventures
Quantum commercialization: softly, softly towards the inevitable future
Differential Ventures
Quantum commercialization: softly, softly towards the inevitable future
Differential Ventures

DIGINOMICA: What can an early-stage investor tell enterprises about the nascent quantum market?

The quantum tipping point – that fabled moment when quantum technologies break through to commercial adoption at scale – has been questioned in a previous diginomica report…

Differential Ventures
Why Investors Bank on Quantum Commercialization
Differential Ventures
Why Investors Bank on Quantum Commercialization
Differential Ventures

ENTER QUANTUM: Experts agree that commercial quantum computing at scale could be as much as 10 years away, but this hasn’t stopped investors from betting on it turning a profit in the near future. U.S. tech venture capital company Differential Ventures led the recent $6 million seed extension round for quantum software company Agnostiq which it will use to accelerate further development and commercialization of its enterprise-grade quantum and high-performance computing platform Covalent.

In this Q&A, Differential founding partner David Magerman explains why investors are throwing their weight behind commercial quantum now.

Differential Ventures
Banking in Venture Capital & the Tech Industry
All, Differential Ventures
Banking in Venture Capital & the Tech Industry
All, Differential Ventures

On Tuesday, April 25th, 2023, Differential Ventures hosted a webinar on “Banking in Venture Capital & the Tech Industry”. The panel was moderated by David Magerman, Managing Partner of Differential Ventures, and joined by guest speakers Michael Crook (Chief Investment Officer, Mill Creek Capital Advisers), Samir Kaji (CEO & Cofounder, Allocate), and Matt Streisfeld (General Partner, Oak HC/FT).

All, Differential Ventures
Nick Adams: What to Do When Your Balance Sheet Doesn’t
Differential Ventures
Nick Adams: What to Do When Your Balance Sheet Doesn’t
Differential Ventures

Sand Hill Road Podcast: Nick Adams joined the Sand Hill Road podcast to discuss the way startups can survive a downturn.

Differential Ventures
David Magerman: Why Sophistication Will Win Out In The Machine Learning Ops Sector
Differential Ventures, All
David Magerman: Why Sophistication Will Win Out In The Machine Learning Ops Sector
Differential Ventures, All

UniteAI: There’s no question that machine learning operations (MLOps) is a burgeoning sector. The market is projected to reach $700 million by 2025 – almost four times what it was in 2020.

Still, while technically sound and powerful, these solutions haven’t generated the expected revenue, which has raised concerns about future growth.

Differential Ventures, All
The Implications of Generative AI in Different Parts of Industry & Society
All, Differential Ventures
The Implications of Generative AI in Different Parts of Industry & Society
All, Differential Ventures

On Thursday, March 16th, Differential Ventures hosted our first webinar entitled Implications of Generative AI in Different Parts of Industry + Society. The panel was moderated by David Magerman, Managing Partner of Differential Ventures, and joined by guest speakers Sharon Zhang (Cofounder & CTO, Personal.ai), Erik Bernhardsson (Founder, Modal Labs), and Adam Oliner (Founder & CEO, Graft).

All, Differential Ventures
The Seed of Success
Differential Ventures, All
The Seed of Success
Differential Ventures, All

Welcome to the "Private Placement Perspective," a new pod storm series hosted by Matt Brown. In this first series of 2023, Matt dives deep into the world of venture capital and investing, speaking with investors and CEOs who have successfully helped scale start-ups.

Differential Ventures, All
How to Pitch Me
Differential Ventures, All
How to Pitch Me
Differential Ventures, All

TECHCRUNCH: How to pitch me—7 investors discuss what they’re looking for in March 2023

Differential Ventures, All
Systemic Bias in Data Makes AI a Stereotype Machine
Differential Ventures, All
Systemic Bias in Data Makes AI a Stereotype Machine
Differential Ventures, All

InsideBigData: Artificial intelligence (AI) software systems have been under attack for years for systematizing bias against minorities. Banks using AI algorithms for mortgage approvals are systematically rejecting minority applicants. Many recruiting tools using AI are biased against minority applicants. In health care, African Americans are victims of racial bias from AI-based hospital diagnostic tools. If you understand how data science research produces the models that power AI systems, you will understand why they perpetuate bias, and also how to fix it.

Differential Ventures, All
How global unrest will impact innovation in 2023
Differential Ventures, All
How global unrest will impact innovation in 2023
Differential Ventures, All

TECHCRUNCH: The global economic and political turmoil of the past year has had a meaningful impact on corporate innovation in the technology industry and beyond. All of these factors have led to belt-tightening in the corporate world, layoffs and hiring freezes and a more conservative investment posture from the investment community. Inevitably, these changes will have a chilling effect on innovation in the years to come.

However, there is perhaps a silver lining when it comes to the prospects for innovation. In some ways, these market forces might actually serve as an accelerant for creativity and advancement in technology.

Differential Ventures, All
David Magerman in Fast Company’s “The Biggest Tech Trends of 2023”
Differential Ventures
David Magerman in Fast Company’s “The Biggest Tech Trends of 2023”
Differential Ventures

FAST COMPANY: Fundraising as a business model is dead. Valuations in the tech industry will ultimately settle above pre-pandemic levels, but down from 2021. The top companies will be surprisingly closer to the record highs. There is still a significant amount of undeployed cash in venture funds at all stages. Investors and managers are still smarting from recent pain, and appropriately chastened by overly exuberant valuations, but they will have to deploy their capital eventually. Once markets and macroeconomic forces stabilize, we should see the strong companies returning to 2021 valuations.

Differential Ventures
Startup Hustle Podcast with David Magerman: The Limits of AI/ML
Differential Ventures, All
Startup Hustle Podcast with David Magerman: The Limits of AI/ML
Differential Ventures, All

n this episode of Startup Hustle, Matt DeCoursey and David Magerman, Managing Partner & CTO of Differential Ventures, talk about the limits of AI/ML. Learn about AI and ML learning modes, their limitations, and how you can maximize the use of data and machine learning to improve your own processes.

Differential Ventures, All
Alternative Fund Podcast with Renaissance veteran and venture capitalist David Magerman
Differential Ventures, All
Alternative Fund Podcast with Renaissance veteran and venture capitalist David Magerman
Differential Ventures, All

David Magerman, a venture capitalist with Differential Ventures and former quantitative hedge fund manager with Renaissance Technologies, was the guest on episode five of the Alternative Fund Insight podcast.

Differential Ventures, All
Q&A: Former Renaissance quant David Magerman on how VCs can use data
All, Differential Ventures
Q&A: Former Renaissance quant David Magerman on how VCs can use data
All, Differential Ventures

PITCHBOOK: After two decades inside Renaissance Technologies, the legendary quantitative hedge fund founded by James Simons, David Magerman was ready for something different.

All, Differential Ventures
Data-Driven Work Cultures
All, Differential Ventures
Data-Driven Work Cultures
All, Differential Ventures

Be open with your employees about how data is being used. People don’t like to be manipulated by tools or management. A few years ago, we looked at a startup that was using data generated by work tools, like email, Slack, and other communication tools, to evaluate how employees were collaborating. They planned to deploy this tool to help managers and human resources departments identify employees that weren’t integrating with their teams, weren’t being managed well, and might be likely to want to leave their jobs.

All, Differential Ventures
The Dynamics of Scaling with David Magerman
All, Differential Ventures
The Dynamics of Scaling with David Magerman
All, Differential Ventures

THE MODERN CFO PODCAST: Renowned computer scientist, investor, and current co-founder of Differential Ventures joins Andrew Seski on The Modern CFO to discuss the early intersection of computer science and investing at IBM, teaming up with Jim Simons at Renaissance, and why venture investors need to meet their founders where they are.

All, Differential Ventures
CyberWire Daily Podcast with Dave Bittner featuring Nick Adams
Differential Ventures, All
CyberWire Daily Podcast with Dave Bittner featuring Nick Adams
Differential Ventures, All

Our guest today is Nick Adams, a co-founder and managing partner at Differential Ventures. We chat about the definition of AI, Nick's skepticism of some AI concepts, AI's effect on employment, which jobs cannot be automated, and existential risk from AI.

Differential Ventures, All
David Magerman: Fixing the Supply Chain: How AI Can Help, and How it Can Hinder
Differential Ventures, All
David Magerman: Fixing the Supply Chain: How AI Can Help, and How it Can Hinder
Differential Ventures, All

SUPPLY CHAIN BRAIN: Over the past few decades, globalization has improved the efficiency of our economic system. Goods, labor, natural resources and even services are now sourced from every corner of the world, and delivered nearly anywhere at lightning speed.

Differential Ventures, All
Nick Adams: Startups Acquiring Startups
All, Differential Ventures
Nick Adams: Startups Acquiring Startups
All, Differential Ventures

CRUNCHBASE: By nearly every measure, 2021 was an astounding year for venture capital and tech startups. While VC mega rounds, massive IPOs and SPACs may have dominated the headlines, tech M&A transactions increased by more than 30 percent from 2020 and deal value increased more than 50 percent to nearly $900 billion.

All, Differential Ventures
David Magerman: How data fuels the evolving customer journey
All, Differential Ventures
David Magerman: How data fuels the evolving customer journey
All, Differential Ventures

VENTUREBEAT: Have you ever had one of those creepy experiences where you’re talking about something — a product or service like skinny jeans or car rentals — and then ads start showing up on Amazon, Google, and Facebook related to your conversation? No, big tech isn’t listening to you, or at least not all the time. You might not realize it, but your communications often leave trails of breadcrumbs behind — in your email, search history, credit card purchases, and other places within the digital universe. Whether its third-party cookies or data sharing arrangements between technology companies, it’s effortless for advertisers and ecommerce sites to design targeted ads eerily relevant to your day-to-day life.

All, Differential Ventures
Reverse Engineering Customer Journeys And Being At The Pulse Of Data Privacy Regulation
All, Differential Ventures
Reverse Engineering Customer Journeys And Being At The Pulse Of Data Privacy Regulation
All, Differential Ventures

FORBES: The topics of unprecedented growth and consumer data privacy are two areas that will continue to have a major impact on leading brands in the year ahead. The combination of accelerated digital transformation and more stringent rules around data privacy will be at the heart of customer experience (CX) innovation in 2022 and beyond. As a result, Chief Marketing Officers are quickly morphing into Chief Growth Officers who are now tasked with driving this type of CX enhancement, via superior data architectures and tightened alignment with their respective Chief Technology Officers.

All, Differential Ventures
No-Code, Low-Code Machine Learning Platforms Still Require People
All, Differential Ventures
No-Code, Low-Code Machine Learning Platforms Still Require People
All, Differential Ventures

INFORMATION WEEK: No-code, low-code (horizontal) machine learning platforms are useful at scaling data science in an enterprise. Still, as many organizations are now finding out, there are so many ways that data science can go wrong in solving new problems. Zillow experienced billions of dollars in losses buying houses using a flawed data-driven home valuation model. Data-driven human resources technology, especially when based off facial recognition software, has been shown to bias hiring decisions against protected classes.

All, Differential Ventures
The Best VC Pitches Gets Right to the Point with Nick Adams
All, Differential Ventures
The Best VC Pitches Gets Right to the Point with Nick Adams
All, Differential Ventures

Nick Adams, a co-founder at Differential Ventures, shares his perspective on what makes for the most compelling startup pitches.

All, Differential Ventures
Coruzant Technologies Digital Executive Podcast with Nick Adams
All, Differential Ventures
Coruzant Technologies Digital Executive Podcast with Nick Adams
All, Differential Ventures

Differential Venture's Co-Founder and Managing Partner, Nick Adams, joins Coruzant Technologies for the Digital Executive podcast. He shares his story as an athlete where preparation is key to your success. He adds that having risk tolerance gave him more opportunities and growth.

All, Differential Ventures
AB
Previous

How to Pitch Me
Next

On the Record with Deddy Lavid, CoFounder & CEO of Cyvers