The report package has quite a large API footprint. We should only expose SetupMetrics and move everything else to internal packages. Options should be the way to configure reporters.