INET Blog

Cosma Shalizi: Why Economics Needs Data Mining

30 Ways to Be an Economist is INET's grantee interview series - INET grantees talk about how they do their work, and how they came to be doing it. This week: Cosma Shalizi - Why Economics Needs Data Mining.

Cosma Shalizi urges economists to stop doing what they are doing: Fitting large complex models to a small set of highly correlated time series data. Once you add enough variables, parameters, bells and whistles, your model can fit past data very well, and yet fail miserably in the future. Shalizi tells us how to separate the wheat from the chaff, how to compensate for overfitting and prevent models from memorizing noise. He introduces techniques from data mining and machine learning to economics -- this is new economic thinking.

Click here to watch the video

Comments

Post new comment

The content of this field is kept private and will not be shown publicly.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Lines and paragraphs break automatically.
  • Allowed HTML tags: <a> <blockquote> <br> <cite> <code> <dd> <div> <dl> <dt> <em> <h2> <h3> <h4> <img> <li> <ol> <p> <span> <strong> <sub> <sup> <table> <tbody> <td> <tr> <ul>
    Allowed Style properties: display, float, height, margin, margin-bottom, margin-left, margin-right, margin-top, width
  • You may insert videos using embed codes like these:
    • [video_large:KoqLu5CKx-o]
    • [popupvideo_mini:KoqLu5CKx-o right]
    • [lightboxvideo_mini:KoqLu5CKx-o]
    • [text_popupvideo:KoqLu5CKx-o nostart noicon|Click here to open the video.]
    • [text_lightboxvideo:KoqLu5CKx-o|Open this video in a lightbox.]
    To learn more, please click on the "More information..." link below.

More information about formatting options

Type the characters you see in this picture. (verify using audio)
Type the characters you see in the picture above; if you can't read them, submit the form and a new image will be generated. Not case sensitive.