Screening of Informed and Uninformed Experts

12/12/2019
by   Jorge Barreras, et al.
0

Testing the validity of claims made by self-proclaimed experts can be impossible when testing them in isolation, even with infinite observations at the disposal of the tester. However, in a multiple expert setting it is possible to design a contract that only informed experts accept and uninformed experts reject. The tester can pit competing forecasts of future events against each other and take advantage of the uncertainty experts have about the other experts' knowledge. This contract will work even when there is only a single data point to evaluate.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/03/2021

Strictly Proper Contract Functions Can Be Arbitrage-Free

We consider mechanisms for truthfully eliciting probabilistic prediction...
research
10/02/2017

On Comparison Of Experts

A policy maker faces a sequence of unknown outcomes. At each stage two (...
research
11/04/2021

Are You Smarter Than a Random Expert? The Robust Aggregation of Substitutable Signals

The problem of aggregating expert forecasts is ubiquitous in fields as w...
research
03/10/2021

CUAD: An Expert-Annotated NLP Dataset for Legal Contract Review

Many specialized domains remain untouched by deep learning, as large lab...
research
03/26/2017

Who Said What: Modeling Individual Labelers Improves Classification

Data are often labeled by many different experts with each expert only l...
research
02/16/2023

"There's so much responsibility on users right now:" Expert Advice for Staying Safer From Hate and Harassment

Online hate and harassment poses a threat to the digital safety of peopl...
research
04/16/2023

Convolution of Scale Invariant Continuous Ranked Probability Scores for Testing Experts' Statistical Accuracy

Computable solutions for expectations of Continuous Ranked Probability S...

Please sign up or login with your details

Forgot password? Click here to reset