Survey FAQs

Data & Analytics administers a number of surveys on a regular or cyclical schedule (e.g., surveys of alumni, graduate students, and graduating seniors; campus climate; administrator appraisal) and client-requested surveys on special topics or for special populations on an ad hoc basis (e.g., determining the needs and preferences of students interested in taking Summer Session classes, instructional technology use, improving the usability of the Buff Portal).

Survey respondents sometimes contact Data & Analytics with questions and concerns they have about taking part in a survey. Answers to such questions and concerns are presented here.

Confidentiality/Anonymity

People who fill out our surveys may be concerned about the confidentiality of the information they give us, and they want to know who will have access to that information. Survey participants' privacy is of utmost importance to us, and strict internal safeguards are in place to ensure that privacy. The data we collect from people are confidential. No one outside Data & Analytics staff responsible for the survey administration—no students or students’ parents or faculty members or administrators—has access to survey respondents’ identities or to files that may connect names or email addresses with answers to survey questions.

Data & Analytics staff members manage each survey database, wherein is recorded who has and has not completed the survey questionnaire. Members of our staff carry out all of the analyses of the data, and we organize and write up the results. Questionnaire responses are aggregated for statistical analysis and reporting; for example, it may be reported that X% of seniors were satisfied with their academic experience at CU Boulder and that Y% were dissatisfied.

In cases where the data are particularly sensitive (e.g., faculty members’ evaluations of a dean), we take extra precautions to safeguard the data. When data collection has been completed, we remove from the final data file the identifying information that permitted the database manager to keep track of who did and did not respond to the questionnaire. In other words, each case in the final data file is an anonymous case. In addition, the data files are only stored on secure platforms approved by OIT. 

Data from some surveys include written comments made in response to open-ended questions, such as this question from the 2009 Graduate Student Survey: "If you think it is unlikely or you are uncertain that you will complete your degree, please tell us why." Here is how we treat such data:

  • We collect these comments into a text file and generate data tables that summarize the aggregated responses. Such a table may report, for example, that X% of those answering the question reported financial reasons, Y% reported family issues, and Z% reported academic difficulties.
  • We provide these tables and the text file of the verbatim comments to the appropriate audience, e.g., the Graduate School, the Admissions Office, the chair of the Administrator Appraisal Program committee. Prior to release, the text files of comments are stripped of any identifying information used by our office, e.g., a randomly assigned survey identification number. It is possible, however, that in the written comment(s), a person may unintentionally include information that reveals their identity, e.g., "As the only minority female doctoral student in department X, I …." We do not remove such comments.
  • In some cases, comments will meet the criteria of CU Boulder's mandatory reporting policy (e.g., comments including protected class discrimination or harassment). We will report such comments to the Office of Institutional Equity & Compliance (OIEC), along with the respondent's identifying information.
Data Security

Data & Analytics safeguards any sensitive employment and student data it accesses by using state-of-the-art data security protocols. The survey platform, Qualtrics, meets Vendor Security Assessment Questionnaire (VSAQ) data standards. Data are encrypted in transit and at rest (Read more about Qualtrics security). Once the survey has closed, data will also be encrypted in transit to Data & Analytics. The full database of anonymized responses will then be held in encrypted form on the secure Data & Analytics server. The de-identified data will be stored to allow investigation of trends by comparison with future surveys.

Drawings for Cash Awards

Some surveys we administer include financial incentives, typically a random drawing for one or more cash awards. As part of our procedures to ensure confidentiality, we do not ask for any identifying information in the survey. Because there is no place to enter their contact information (name, email) in the survey, participants sometimes wonder how we determine what names to include in the drawing.

When a person submits a survey, they are automatically entered in the pool of people eligible for the awards. Here’s how it works. When someone accesses and fills in the online survey, the survey management system uses a random survey-specific identification (ID) number to keep track of that response. For example, when Hermione Granger submits her survey, the survey management system will register that survey 5555555 (sent to Hermione’s email) has been received. The random ID numbers of individuals who have responded to the survey can then be linked with email addresses in the database to distinguish those who have responded from those who have not. We can then send reminders only to those people who have not yet responded to the survey (no further reminders will be sent to Hermione, for example). We can also keep track of the people who are eligible for the awards drawing (5555555 will be included in the pool for the awards drawing). At the close of the survey, we randomly select the award winners from that pool of ID numbers, and we use the linked email addresses to notify the owners of each that they have won one of the awards.

Why was I selected to participate in a survey?

Different surveys have different purposes and are administered to different groups of people; for example, CU Boulder alumni, graduate students, graduating seniors, or incoming freshman students. Such a group is called a "survey population."

For certain surveys, the population is small enough that it is practical to invite all members to participate. This was the case, for example, in the CU Boulder Senior Exit Survey in spring 2021. All CU Boulder seniors were emailed and asked to complete a survey to share their opinions and feedback on their experiences at CU Boulder to help the university improve the undergraduate experience for others.

For other surveys, the population is too large for us to efficiently survey all of its members, or it may be unnecessary to survey all members of the population. For example, the population for the CU Boulder Campus Climate Survey in 2006 included all undergraduate and graduate students. In this case, only some of the people in the population were invited to complete a survey. These people were randomly sampled from the population using selection criteria designed to best ensure proportional representation of population subgroups based on characteristics of interest; for example, gender, academic department, race/ethnicity.

Sometimes people are excluded from a survey population. For example, if a student has placed a privacy flag on their records, we won’t include that person in the survey population. Some surveys will only invite students to participate who are full-time or degree-seeking students.

What did we find out from a survey?

Data & Analytics offers survey results in interactive dashboards, where customers can filter data based on their needs (e.g., viewing results by school/college or class level), as well as static reports. These resources can be found on the Data Reports page. If you are interested in survey results that are not available there, please feel free to contact us.

Who uses the survey data?

Various members of the CU Boulder campus community use data generated by surveys, and some data are useful to a broader audience, such as other colleges and universities or the general public. Following are some examples of how various audiences use survey data:

  • A single CU Boulder office or unit. For example, findings from the New Student Survey help the Admissions Office staff improve the information and services they provide to prospective students and their parents.
  • A broader array of CU Boulder units.
    • Findings from the Senior Survey may be used by department chairs and faculty to modify teaching practices or to improve student advising services.
    • Findings from the Campus Culture Survey may be used by departments, classroom instructors, Disabilities Services, the Office of International Education, and the Office of the Vice Chancellor for Diversity, Equity, & Community Engagement (among others)—to monitor and improve policies and practices that make CU Boulder a supportive environment for all members of the campus community.
  • Staff members in Data & Analytics. In D&A we incorporate some survey findings in reports to various constituencies, including the Board of Regents, accrediting agencies, and annual college guides such as the Princeton Review Best Colleges guides and the Fiske Guide to Colleges.
  • CU Boulder Academic Review and Planning committee. Relevant findings from several major surveys (e.g., National Survey of Student Engagement, Senior Exit Survey, gradSERU) are routinely reported as part of the CU Boulder Academic Review and Planning process, the regular review of all academic programs required by the University of Colorado Board of Regents and the Colorado Commission on Higher Education.
  • The general public. As noted above, findings from surveys are posted on the Data & Analytics website and available to the public. This information may be used, for example, by other colleges or universities to compare themselves with CU Boulder.