Navigating Blackboard

Generate Test Questions: Blackboard's AI Design Assistant

What is Blackboard’s AI Design Assistant?

Blackboard Ultra has integrated AI into a tool known as the AI Design Assistant, to assist instructors with setting up and creating a course. The AI Design Assistant can:

 

Before and after creating content using the AI Design Assistant, please note: Faculty must review all AI-generated content before use, because AI may generate inaccurate or culturally insensitive information!

 

Is the AI Design Assistant Safe to Use?

The AI Design Assistant uses Microsoft Responsible AI framework. Anthology assured us that while our input data is used to train and improve AI Design Assistant, the data stays within Humber and isn’t shared with external organizations (Data Privacy Approach | Anthology). For more information about Anthology’s AI Approach, read their Trust Worthy AI Approach, which includes the following principles:
  • humans in control,
  • fairness,
  • privacy,
  • security, and
  • safety.

 

How do I generate Test Questions in Blackboard?

Creating test questions takes a significant amount of time. The AI Design Assistant can offer suggestions for test questions, giving you extra time to focus on more complicated tasks. The AI Design Assistant is beneficial for both formative and summative assessments. Test questions are generated based on the course context that you select. Learn more about AI Generated Test Questions on Blackboard’s website, or watch the video that follows:

  • In the test creation panel, select  Auto-generate question from the new question menu. Once it is open, it will look like this:
  • You have several ways to refine the test questions that the AI Design Assistant generates.
    • Enter an optional description (limited to 2000 characters) to narrow the focus of the questions
    • Adjust the complexity of the questions
      • There are ten levels included in the complexity level slider:
        • Early primary school
        • Late primary school
        • Early middle school
        • Late middle school
        • Early high school
        • Late high school
        • Undergraduate lower division
        • Undergraduate upper division
        • Graduate level
        • Advanced PhD level
    • Select the number of questions to generate (up to 20)
      • If you would like to generate more, you can always enter back into this menu and generate another 20.
    • Select Advanced options to change the output language You can select from the following question types, or you can learn more about the different types of question types by reading Blackboard’s article about test question types:
      • Inspire me!
        • This option generates various types of questions listed that follow.
      • Essay
      • Fill in the blank
      • Matching
      • Multiple choice
      • True/False
      • Jumbled Sentence
  • You can select which course items you’d like the AI Design Assistant to provide context for test questions. Select Select course items to start. Select any course content item to include it in the context for your test. When you’ve finished choosing items for context, select Select items to return to question generation.
  • Once you’ve finalized all of your settings, select  Generate. Choose the questions that you’d like to add to your assessment, then select  Add to Assessment. Make sure to review each question for accuracy and bias!

 

What are Innovative Learning’s recommendations for using the module generation feature in Blackboard’s AI Design Assistant?

  • Providing a sufficient amount of information in the “Description” section can result in effective question generation. Providing an insufficient amount of information may result in odd question generation behaviour.
  • The “Inspire Me!” option may produce more of one type of question based on the course content you’ve attached in the context picker.
    • If you’d like this to change, you can put this information into the ‘Description’ section, or select the kinds of question you would like to use in the question type drop-down menu.
  • Answers to “Fill in the Blank” questions may be blank, and answers to some questions could be incorrect. It is also necessary to double-check all question content generated by AI.
  • Multiple attempts to generate questions may be required. It may also generate less than the requested Number of Questions from time to time.
  • AI may pull definitions from outside of your course content (may be pulling from its training data), so please review definitions and terms carefully.