Hello, Login
X

Forgot Password?

Join Us

to start. Not a member? Join Today!
LinkedIn Join us on
Investment Management Information
“Bridging the theory & practice of investment management”
Email
Advanced Search →
  • Home
  • Journal
    • About
    • Subscribe to the Journal
      • Subscriptions
      • Library Subscriptions
    • Harry M. Markowitz Award
    • Submit a Paper
      • Article Guidelines
      • Practitioner’s Guidelines
    • Reprints & Permissions
    • Advertising
  • Conferences
    • JOIM Conference Events
    • About
    • Membership
    • Board Members
    • Sponsorship
  • Library Access
  • Contact
  • Help

0 comments / 07/07/2020 / the JOIM / Archives, Articles

On the Stability of Machine Learning Models: Measuring Model and Outcome Variance

Volume 18, No. 2, 2020
Vasant Dhar and Haoyuan Yu

How do you know how much you should trust a model that is learned from data? We propose that a central criterion in measuring trust is the decision-making variance of a model. We call this “model variance.” Conceptually, it refers to the inherent instability machine learning models experience in their decision-making in response to variations in the training data. We report the results from a controlled study that measures model variance as a function of (1) the inherent predictability of a problem and (2) the frequency of the occurrence of the class of interest. The results provide important guidelines for what we should expect from machine learning methods for the range of problems that vary across different levels of predictability and base rates, thereby making the results of general scientific interest.

0 comments… add one
Cancel reply

Leave a Comment

Next Article: Can Machines “Learn” Finance?

Previous Article: Practitioner’s Digest

JOIM

    Library Access

    Subscribe to the Journal
    Submit a Paper
    Harry M. Markowitz Award
    Editorial Board
    Upcoming Conferences

    Edit Profile

Recent Comments

    JOIM

      About the JOIM
    • Library Access
    • Subscribe to the Journal
    • Submit a Paper
    • Editorial Board
    • Harry M. Markowitz Award
    • Reprints & Permissions
    • Advertising
    • Terms and Conditions

    JOIM Conference Series

    • About
    • Upcoming Conferences
    • Membership
    • Board Members
    • Sponsorship Opportunities
    • Terms & Conditions
    Speaker Reimbursement Policy

    Contact

    Journal Of Investment Management (JOIM)
    3658 Mt. Diablo Blvd., Suite 200
    Lafayette, CA 94549
    www.joim.com

    customerservice @ joim.com
    (925) 299-7800

    Copyright 2019 — Journal Of Investment Management design by SEO Web Designers