Quantitative Research

Quantitative Research Help: Design, Sampling, Measurement and Analysis

The decisions behind a sound quantitative study, from choosing a design and calculating a sample size to protecting validity and picking the analysis.

Updated October 2026 · 9 min read

Quantitative research answers questions with numbers: how much, how many, how strongly related, and whether a difference is larger than chance would produce.

Its strength is precision and generalisability. Its weakness is that every number depends on decisions made before data collection, and a poor design cannot be rescued by sophisticated statistics afterwards.

This guide covers the decisions a methods chapter or research proposal has to justify: the research design, the sample and its size, how variables are measured, how validity and reliability are protected, and which analysis answers each question. It is written for students designing a study for a thesis, dissertation, capstone or research methods assignment.

What a quantitative study needs

A quantitative study needs measurable research questions or hypotheses, a design that matches them (experimental, quasi-experimental, correlational or descriptive survey), a sample large enough to detect the effect you expect (calculated with a power analysis), valid and reliable instruments, and an analysis plan linking each question to a statistical test. Your methods section must justify each of these choices and acknowledge the threats to validity that remain.

Writing Quantitative Research Questions

Quantitative questions name variables and the relationship between them. They usually take one of three forms.

TypeAsksExample
DescriptiveHow much or how often?What proportion of first-year students report moderate or severe anxiety?
RelationalHow are variables related?Is weekly hours of paid work associated with GPA among part-time students?
Causal or comparativeDoes X affect Y? Do groups differ?Does a peer-mentoring program reduce first-year dropout compared with usual support?

Each relational or causal question should have a testable hypothesis, stated as a null and an alternative, and the variables must be defined in measurable terms (operationalized): "anxiety, measured by the GAD-7 total score".

Choosing a Design

DesignKey featureCan show causation?Typical use
True experiment (RCT)Random assignment to conditionsYes, strongest evidenceInterventions where randomization is ethical and practical
Quasi-experimentalComparison groups without random assignment, or before and after measuresPartly; must address confoundingProgram evaluations, classroom and clinical settings
CorrelationalMeasures variables as they occurNo; shows associationExploring relationships, prediction
Descriptive surveyMeasures characteristics of a populationNoPrevalence, attitudes, needs assessment
Longitudinal or cohortSame people measured over timeStronger than cross-sectional for temporal orderDevelopment, outcomes over time

Students often over-claim. A cross-sectional survey can show that two variables move together, but not which causes which. Use language that matches the design: "associated with", not "leads to".

Sampling and Sample Size

Sampling Methods

Probability sampling (simple random, stratified, cluster) lets you generalize to a population. Non-probability sampling (convenience, purposive, snowball) is common in student research because it is practical, but it limits generalization, which you should state as a limitation.

Power Analysis

Sample size should come from a power analysis, not a guess. You need four inputs: the test you will use, the significance level (usually .05), the desired power (usually .80), and the expected effect size, ideally taken from previous studies. Free software such as G*Power does the calculation.

Analysis (alpha .05, power .80)Expected effectApproximate total sample
Independent t-testMedium (d = 0.5)About 128 (64 per group)
Independent t-testSmall (d = 0.2)About 788
Pearson correlationMedium (r = .30)About 84
Multiple regression, 5 predictorsMedium (f squared = .15)About 92

If you cannot reach the required sample, say so and frame the study as exploratory or a pilot. Then plan for non-response: if you expect a 30% response rate, invite enough people to reach your target.

Using Secondary Data Instead of Collecting Your Own

Collecting your own data is not the only route to a quantitative thesis. Large public datasets, such as national health surveys, labor force surveys, education statistics or open data from international organizations, offer sample sizes no student could reach alone, and many need no ethics approval beyond a short exemption.

The trade-off is that you cannot choose the questions that were asked, so your research question must fit the variables available.

If you take this route, describe the dataset's sampling and collection methods in your methods section, explain how you selected cases and variables, and note any weighting the dataset requires. Secondary analysis is a respected design in its own right, not a shortcut, and it is often the most realistic option for a one-semester project.

Measurement: Levels, Instruments, Reliability and Validity

The level of measurement decides which statistics you can use: nominal (categories), ordinal (ranked), interval and ratio (continuous). Collect data at the highest level that makes sense; you can always group ages into bands later, but not the reverse.

Use established, validated instruments where possible, and report their reliability and validity evidence from previous studies and from your own data.

ConceptMeaningHow it is shown
Internal consistencyItems in a scale measure the same thingCronbach's alpha, usually .70 or above
Test-retest reliabilityStable scores over timeCorrelation between two administrations
Content validityItems cover the whole constructExpert review
Construct validityThe instrument measures the intended constructFactor analysis, correlations with related measures
Criterion validityScores predict or match an external standardCorrelation with an established measure or outcome

Protecting Internal and External Validity

Internal validity is confidence that the result reflects the relationship you studied rather than something else. External validity is confidence that it applies beyond your sample. Name the threats that apply to your design and what you did about them.

ThreatExampleMitigation
Selection biasVolunteers for a wellbeing program are already more motivatedRandom assignment, or measure and control for motivation
ConfoundingOlder students both work more and study lessInclude confounders as covariates
History and maturationScores improve over a term regardless of the interventionComparison group
AttritionStruggling participants drop out before the post-testReport attrition; intention-to-treat analysis
Response biasSocially desirable answers on sensitive questionsAnonymous surveys, validated scales

Descriptive Statistics Every Study Should Report

Before testing hypotheses, describe your sample and variables. Readers use these figures to judge who your findings apply to and whether the data looks sensible.

Variable typeReportExample
Categorical (gender, program, ethnicity)Frequencies and percentagesWomen, n = 142 (67.3%)
Continuous and roughly normal (scale scores)Mean and standard deviationSelf-efficacy, M = 3.62, SD = 0.71
Continuous and skewed (income, hours, days absent)Median and interquartile rangeHours worked, Mdn = 16, IQR = 8 to 24
ScalesReliabilityCronbach's alpha = .84

Present participant characteristics in a single table (often called Table 1), and compare your sample with the population where you can. If 68% of your respondents are women but the population is evenly split, say so; it affects how far the results generalize.

Planning the Analysis

Link each research question to its analysis before data collection. Descriptive questions use frequencies, means and standard deviations. Comparisons use t-tests or ANOVA (or their non-parametric alternatives); relationships use correlation and regression; categorical associations use chi-square.

Plan how you will check assumptions and handle missing data. Our guide to dissertation data analysis walks through test selection and reporting in detail.

Worked Example: Designing a Small Study

Problem: A nursing school wants to know whether simulation-based training improves students' confidence in managing deteriorating patients.

Question and hypothesis: Do students who complete four simulation sessions report higher self-confidence than students who receive lecture-based teaching only? H1: the simulation group will report higher mean confidence scores.

Design: quasi-experimental, two existing class groups (randomizing individual students is not practical), with pre- and post-tests.

Sample: power analysis for a mixed ANOVA, medium effect, alpha .05, power .80, suggests around 34 per group; both cohorts have about 45 students, allowing for attrition.

Measure: a published self-confidence scale with reported alpha above .80, administered in week 1 and week 8.

Analysis: mixed (group by time) ANOVA; the key result is the interaction effect. Baseline differences between cohorts are checked and controlled.

Limitations stated: no randomization, self-reported confidence rather than observed performance, one institution.

Every decision in this example is justified by the question and the setting. That chain of justification is what a methods chapter is really for.

Common Design Mistakes in Student Projects

Most of the problems examiners raise in quantitative theses and capstones trace back to the design stage. Fix them in the proposal and the rest of the project becomes far easier.

MistakeConsequenceBetter approach
Questions that are really qualitative ("How do nurses experience...")Numbers cannot answer themRewrite as a measurable relationship, or switch to a qualitative or mixed design
Home-made questionnaires with no validationUnknown reliability and validityUse established scales; pilot any new items
Sample size chosen by convenienceUnderpowered study, inconclusive resultsRun a power analysis and recruit accordingly
Too many variables for the sampleUnstable regression modelsLimit predictors; a common guide is at least 10-15 cases per predictor
Causal language for correlational dataOverstated conclusionsMatch the claims to the design
No plan for missing dataBiased results and lost casesDecide the approach in advance and report it

Ethics in Quantitative Research

Even an anonymous online survey usually needs ethics approval when it is part of a university project. Committees look for informed consent that participants can understand, the right to withdraw, secure data storage, and care with sensitive topics.

If you survey your own students, patients or employees, address the power relationship directly, for example by having someone else distribute the survey and keeping responses anonymous. Never collect data before approval is confirmed in writing; data gathered without approval usually cannot be used.

Writing the Methods Section

A quantitative methods section should let another researcher repeat your study. Use these sub-headings, adapted to your program's template:

  1. Research design and why it fits the questions.
  2. Population, sample and sampling, including the power analysis and inclusion criteria.
  3. Instruments, with reliability and validity evidence.
  4. Procedure: recruitment, data collection steps and timing.
  5. Data analysis: tests for each question, software, assumption checks, missing data.
  6. Ethical considerations: approval, consent, confidentiality, data storage.
  7. Limitations of the design that you could not remove.

Get Your Quantitative Study Right from the Start

Send your proposal or methods chapter. A methodologist reviews design, sampling, measures and analysis, and helps you write a methods section that holds up.

Get Quantitative Research Help

Free revisions · Full refund if late · Written from scratch for your order

Frequently Asked Questions

What is the difference between quantitative and qualitative research?

Quantitative research measures variables numerically and tests relationships or differences, aiming to generalize. Qualitative research explores experiences and meanings through words, aiming for depth. Mixed-methods studies combine both.

How big should my sample be?

Use a power analysis based on your test, alpha (.05), power (.80) and expected effect size. For example, detecting a medium difference between two groups needs roughly 64 participants per group.

Can a survey prove cause and effect?

A one-time survey cannot establish causation; it shows associations. Causal claims need experimental or strong quasi-experimental designs with controls for confounding.

What is the difference between reliability and validity?

Reliability is consistency: an instrument gives similar results under similar conditions. Validity is accuracy: it measures what it claims to measure. An instrument can be reliable without being valid.

Can you help design my questionnaire?

Yes. We can help select validated scales, write additional items, structure the questionnaire and plan how each item will be analyzed, so your data can answer your research questions.

Do I need ethics approval for a quantitative survey?

Usually yes, if you collect data from people for a university project. Check with your institution's ethics committee before collecting any data.

What is a pilot study and do I need one?

A pilot is a small trial run of your procedures and instruments with a handful of participants. It reveals confusing questions, timing problems and technical issues before the main study. Many programs expect one when you create or adapt a questionnaire.

Which software should I use for quantitative analysis?

SPSS is the most common choice in social science, education, nursing and business programs. R and Python are free and preferred in many quantitative fields. Use whatever your supervisor and department support, and save your syntax or scripts so the analysis can be reproduced.