Evaluation Sets

 

 

 

 

Reminder: Merging questions and converting them to an Evaluation Set is done in the Import Edit Mode.

 

Evaluation Sets are a group of related questions that apply to more than one item.
For example, there could be a set of questions asked about a set of cars or commercials. Responses to one question are related to the responses of the other questions.

Not all datasets will include evaluation set questions.

 

Evaluation Set Question Usage

 

 

The evaluation set questions are typically arranged in a grid orientation in the questionnaire.

When an evaluation set is created in the Edit Mode of Analyze, individual questions will be merged and one question will be created for the items (questions located at the top).

A second question will be created from the merged individual questions and will include the attributes or ratings (questions located on the left).

 

For this reason, questions that are part of an evaluation set are treated differently than other questions in the survey.

Questions belonging to one evaluation set cannot be run in the same tab as questions from a different evaluation set.

 

Questions that are set up as Evaluation Sets include {   } brackets around the question icon.

 

 

 

This example includes questions that asked each respondent to rate their level of familiarity for each brand.

Each individual question includes “familiarity of a brand”

(Brand A, Brand B, Brand C, etc.)

 

To convert individual questions to an evaluation set, select all the individual questions that will make up the responses of the new evaluation set question, then click the Merge button.

 

The merge options will be listed, select the Evaluation Set option.

 

 

The selected questions will appear on the left in a window for inclusion in an evaluation set.

Any questions that should not be included can be removed by clicking the X.

 

 

Hover over any of the questions on the left for the complete question label text.

 

 

 

Hover over any of the questions on the right for the complete question label text.

 

Confirm each question under the Selected Variables list has been included and defined in the Evaluation Set.

 

 

 

 

 

 

 

 

 

To go back and make additional edits to the existing evaluation sets question, click the Edit button, located at the bottom of the page.

To undo the evaluation set and return to the individual questions, click the Unmerge option.

 

 

To save the changes and exit Edit Mode, click the Apply Changes button, located in the top-right of the Edit Mode window.

 

 

The newly merged evaluation set is available in the list of questions where the individual questions were previously.
2 questions were created for the evaluation set. One question that includes the brands that are being rated and a second question that includes the level of familiarity.

 

Include the questions in the Analyze query.

 

 

(The results of the evaluation set)

 

 

 

Some surveys may include multichoice questions that can be merged into an evaluation set.

 

 

 

In this example, there are 15 questions per brand.

The respondent answering the questionnaire is asked to look at these 15 attributes (features) and to "check all that apply" if they are associated with the mentioned brand.

For this example, the respondent is asked to evaluate 10 brands.

The same list of 15 attributes (features) are being asked per brand.

 

Because of the way the questions are structured in the dataset, an evaluation set can be created that will include the 10 brands and the 15 attributes.

However, before an evaluation set can be created, the 15 individual attribute questions per brand will need to be merged into multichoice questions.

 

 

One multichoice question that includes a list of the 15 attributes will need to be created per brand.

Refer to the multichoice questions pages in the previous sections of this manual for detailed instructions on creating a multichoice question.

 

Example of multichoice questions completed per brand.

 

Each newly created multichoice question that will be part of the evaluation set needs to be consistent in structure, coding, and include the same number of questions with the same question labels as the other questions.

 

 

Proceed with merging the multichoice questions into an evaluation set.

 

The 10 multichoice questions are listed on the left under the Selected Variables section.

 

Type in a name for Set 1 and drag the first question into the remaining Set 1 cell.
Repeat these steps for the remaining multichoice questions.

 

 

After defining each set and confirming that no questions remain in the selected variables list, type in a name for each of the set columns.
In this example, Brand Evaluated and Associated Features are entered.

The names typed in for the set columns will be the evaluation set question labels that appear in the question list of Analyze.

The Evaluation Set Name field is populated with a unique name by default, but can be optionally changed.

Confirm each set has a green checkmark, then click the Apply button.

 

 

The newly created evaluation set questions will now appear in Analyze.

 

Include the questions in the Analyze query.

 

 

View the results of the evaluation set.

10 brands (columns) x 15 questions per brand (rows).

With this evaluation set, 150 separate questions have been included in one query.

 

 

 

 

Evaluation sets might seem a little complex initially, but there are advantages of working with evaluation sets versus individual questions.