We're excited to announce the official release of Qualified Reports, a flexible suite of reporting tools that allow you to create custom reports rich with insights into the performance and effectiveness of your assessment content. This new feature allows you to easily pivot and chart your data, making it easy to surface opportunities for improvement. Start by building a set of reports to give your team actionable insights that can be used to improve program outcomes whether you’re certifying, educating, or hiring developers.

We've outlined some of the more common use cases for Qualified Reports below, but as always we'd welcome the opportunity to discuss your reporting needs with you directly. Here are some ideas on how you can best make use of this new feature!

Easily identify which questions, challenges, and assessments are effective

While Qualified's reporting tools give you the flexibility to report on a broad range of metrics, the most common reporting use cases focus on the effectiveness of your assessment content. By closely monitoring the effectiveness of your assessment content, your organization can benchmark its own performance and take a data driven approach to improving your success metrics and program outcomes. Here are a few examples of questions that Qualified Reports can help you answer.

How are developers performing on each of your assessments?

This report provides insights into the average score that developers are earning on each of your different assessments.

Reports Submitted Assessment Results

Are your assessment questions too easy, too difficult, or just right?

This report drills down beyond the assessment level, looking at the relative difficulty of each of your Q&A style questions. Dive in deeper and understand how each candidate performed on a per question basis.

Are your assessment questions too easy, too difficult, or just right?

Assess developer performance based on challenge topic

If you're looking to report on the strengths and weaknesses of individual developers, this style of report allows you to look at each developer's competencies and demonstrated skills across languages, frameworks, & topics.

Assess developer performance based on challenge topic

Visualize how many assessments you are sending and their status

Any pivot table can easily be turned into various types of charts. Check out how you can view the status of assessment results, created over a period of time.

Identify current aggregate status of assessment results, based off of when they were sent

Customize report filters and fields and then export to multiple formats

All data that you see within the reporting UI can be exported to multiple formats. Use Excel or CSV formats to export your data into external tools for additional reporting. Export to PDF, Image, or HTML to share your reports with colleagues.

Other common reporting criteria and use cases

Qualified Reports give you the ability to create custom pivot charts from dozens of different data fields. All reports can be exported to CSV or Excel format, making it easy to import assessment data into other systems.

Common criteria used to build reports

  • Number of solutions submitted
  • Average score
  • Completion time
  • Pass count
  • Pass rate
  • Review score
  • Plagiarism risk level
  • Code similarity match %
  • Cyclomatic complexity

Other common reporting use cases to improve your program outcomes

  • Identify reviewers who are overly biased
  • Benchmark target cut scores for assessments based on pass/fail rates
  • Identify coding tasks that effectively filter our poor performers
  • Monitor which cohorts are performing best and worst

These are just a few of the many custom reports that you can create using this new functionality.

What metrics does your organization want to report on?

Let us know by shooting us an email at team(at)qualified.io. We'd be happy to set up a 1-on-1 reporting consultation with your team today!