https://handbook.gradientmetrics.com/research-team/survey/ Recent content in Survey on Handbook Hugo -- gohugo.io https://handbook.gradientmetrics.com/research-team/survey/survey-workflow/ Mon, 01 Jan 0001 00:00:00 +0000 https://handbook.gradientmetrics.com/research-team/survey/survey-workflow/ Purpose Workflow at a Glance Survey: Writing Structural Setup and Internal Alignment Survey Outlines What Makes a Strong Survey Outline Moving From Outline to Full Survey Sample Parameters Variable Naming and Programming Instructions Review, Client Approval, and Survey Lock Survey: Programming Survey: Soft Launch Survey: Data Collection Survey: Data Cleaning Vendor Keep/Drop Files Standard Policy Why We Do Not Routinely Provide Interim Keep/Drop Files Longer Field Periods and Vendor Payout Cycles Exceptions Boilerplate Language For Vendor Requests Purpose This page documents Gradient’s standard, end-to-end workflow for survey projects, from initial research question through to final, analysis-ready data. https://handbook.gradientmetrics.com/research-team/survey/survey-panels/ Mon, 01 Jan 0001 00:00:00 +0000 https://handbook.gradientmetrics.com/research-team/survey/survey-panels/ Tl;dr Checklist Introduction Step-by-Step Guide Step 1: Acquire feasibility, cost, and timeline estimates Desired sample parameters Description of target population and targeting specs Desired N Quotas Length of interview Timeline Request the following… Panel contact information Step 2: Update Qualtrics survey Important embedded data fields Request & update redirect links Update quotas Tracking qualified completes Step 3: Test survey links Step 4: Share the quota dashboard Step 5: Approve soft launch Step 6: Approve full launch & monitor data collection Tl;dr Checklist Acquire feasibility, cost, and timeline estimates Update Qualtrics survey Embedded data fields Redirect links Quotas Test survey links Share quota dashboard Approve soft launch Approve full launch & monitor data collection Introduction Are you fielding a survey through a panel? https://handbook.gradientmetrics.com/research-team/survey/survey_rules/ Mon, 01 Jan 0001 00:00:00 +0000 https://handbook.gradientmetrics.com/research-team/survey/survey_rules/ Introduction TL;DR - Example Naming Rules Generic Module Variables Product Variables Conjoint MaxDiff Segmentation Brand Tracker List Experiment Other naming conventions & rules: Multiple products in a single study Variable Naming Rules Prefixing Module Names Naming Variables Explicitly No Trailing Numbers Open-ended responses Introduction Gradient approaches survey writing a little different than most research companies. https://handbook.gradientmetrics.com/research-team/survey/population-benchmarks/ Mon, 01 Jan 0001 00:00:00 +0000 https://handbook.gradientmetrics.com/research-team/survey/population-benchmarks/ Introduction Interfaces to Explore the U.S. Census Data Resources for Additional Population Benchmarks Introduction When developing surveys, we often need to create quotas using population benchmarks. Although the U.S. Census Bureau has the most exhaustive repository of population benchmarks, the website can be difficult to use and, in some circumstances, does not contain the specific benchmarks we are looking for. Luckily, there are interfaces that make exploring census data easier and additional resources available to explore population benchmarks that are not in the census. https://handbook.gradientmetrics.com/research-team/survey/survey-weighting/ Mon, 01 Jan 0001 00:00:00 +0000 https://handbook.gradientmetrics.com/research-team/survey/survey-weighting/ Motivation What are survey weights? Weighting methods Trade-offs Example Inverse probability weighting Using models other than glm Oversample weights Example Motivation Oftentimes in market research, we try to make inferences about a population. What proportion of American voters agree with a statement? But of course, we can’t conduct a census. For most populations, that’s much too expensive, infeasible, and just downright silly. https://handbook.gradientmetrics.com/research-team/survey/penalty-score-data-quality/ Mon, 01 Jan 0001 00:00:00 +0000 https://handbook.gradientmetrics.com/research-team/survey/penalty-score-data-quality/ Purpose Core Principles Ownership & Responsibilities When Penalty Scores are Specified Where Penalty Scores are Documented Required Checklist Items (RM-Owned) Standard Penalty Score Components 1. Speeding Default Rule 2. Module-Specific Speeding (Optional) 3. Straightlining Default Rule 4. Low-Quality Open-Ends Default Rule 5. Inconsistent or Implausible Responses (Optional) Suggested calibration Removal Thresholds Default Rule Important Notes Purpose This page documents Gradient’s standard approach to penalty scores: how we define, communicate, and apply penalties to identify and remove low-quality survey responses. https://handbook.gradientmetrics.com/research-team/survey/survey-mrp/ Mon, 01 Jan 0001 00:00:00 +0000 https://handbook.gradientmetrics.com/research-team/survey/survey-mrp/ Introduction & the goal How does MRP work? Example of MRP Applications Multi-level Regression Accuracy Poststratification Step 1 Step 2 Extending the simulation Summary Source: vignettes/mrp.Rmd Content based on: Introduction & the goal Multi-Level Regression and Poststratification (MRP) is a technique that is used to adjust model estimates for known differences between your sample and the target population. https://handbook.gradientmetrics.com/research-team/survey/cloud-research/ Mon, 01 Jan 0001 00:00:00 +0000 https://handbook.gradientmetrics.com/research-team/survey/cloud-research/ Introduction Getting started with CloudResearch Step 1. Basic Information Step 2. Describe HIT Step 3. Setup & Payment Step 4. Demographics Step 5. Data Quality Step 6. Worker Approval Step 7. Worker Requirements Launching your survey Step 8. Monitor Launch Introduction In the past, testing our Qualtrics surveys was easy—we would simply press the Generate Test Responses button and have a bunch of test cases to work with. https://handbook.gradientmetrics.com/research-team/survey/survey-crunch/ Mon, 01 Jan 0001 00:00:00 +0000 https://handbook.gradientmetrics.com/research-team/survey/survey-crunch/ Introduction to Crunch - An Interactive Survey Dashboard Platform Crunch.io tutorials A typical Crunch workflow at Gradient Example dataset Logging in Managing Datasets Locking and unlocking Hiding variables Merging variables into an array Changing names and descriptions Arranging variables and directories Forking and Merging Interaction through web interface Crunch Tips & Tricks Non-standard Crunch Functions Opening a crunch dashboard from an R session Sorting variables inside a folder Managing rows Managing columns Forking and merging Source: vignettes/crunch.