We're excited to announce the official release of Qualified Reports, a flexible suite of reporting tools that allow you to create custom reports rich with insights into the performance and effectiveness of your assessment content. This new feature allows you to easily pivot and chart your data, making it easy to surface opportunities for improvement. Start by building a set of reports to give your team actionable insights that can be used to improve program outcomes whether you’re certifying, educating, or hiring developers.
We've outlined some of the more common use cases for Qualified Reports below, but as always we'd welcome the opportunity to discuss your reporting needs with you directly. Here are some ideas on how you can best make use of this new feature!
Easily identify which questions, challenges, and assessments are effective
While Qualified's reporting tools give you the flexibility to report on a broad range of metrics, the most common reporting use cases focus on the effectiveness of your assessment content. By closely monitoring the effectiveness of your assessment content, your organization can benchmark its own performance and take a data driven approach to improving your success metrics and program outcomes. Here are a few examples of questions that Qualified Reports can help you answer.
How are developers performing on each of your assessments?
This report provides insights into the average score that developers are earning on each of your different assessments.
Are your assessment questions too easy, too difficult, or just right?
This report drills down beyond the assessment level, looking at the relative difficulty of each of your Q&A style questions. Dive in deeper and understand how each candidate performed on a per question basis.
Assess developer performance based on challenge topic
If you're looking to report on the strengths and weaknesses of individual developers, this style of report allows you to look at each developer's competencies and demonstrated skills across languages, frameworks, & topics.
Visualize how many assessments you are sending and their status
Any pivot table can easily be turned into various types of charts. Check out how you can view the status of assessment results, created over a period of time.
Customize report filters and fields and then export to multiple formats
All data that you see within the reporting UI can be exported to multiple formats. Use Excel or CSV formats to export your data into external tools for additional reporting. Export to PDF, Image, or HTML to share your reports with colleagues.
Other common reporting criteria and use cases
Qualified Reports give you the ability to create custom pivot charts from dozens of different data fields. All reports can be exported to CSV or Excel format, making it easy to import assessment data into other systems.
Common criteria used to build reports
- Number of solutions submitted
- Average score
- Completion time
- Pass count
- Pass rate
- Review score
- Plagiarism risk level
- Code similarity match %
- Cyclomatic complexity
Other common reporting use cases to improve your program outcomes
- Identify reviewers who are overly biased
- Benchmark target cut scores for assessments based on pass/fail rates
- Identify coding tasks that effectively filter our poor performers
- Monitor which cohorts are performing best and worst
These are just a few of the many custom reports that you can create using this new functionality.
What metrics does your organization want to report on?
Let us know by shooting us an email at team(at)qualified.io. We'd be happy to set up a 1-on-1 reporting consultation with your team today!