Difficulty: Beginner | Prerequisites: None
Statistics is the foundational course for nearly every quantitative field, from business and healthcare to engineering and social science. This first section sets the stage by defining what statistics is, what data looks like, and how populations differ from samples. If you can nail these distinctions now, every later chapter (probability, hypothesis testing, regression) will click faster. You do not need any prior maths beyond basic arithmetic to follow this material.
Statistics is the science of collecting, organising, analysing, and interpreting data to make decisions. The two things you must be able to distinguish immediately are populations (every member of the group you care about) and samples (a subset you actually measure), along with the numbers that describe each: parameters for populations, statistics for samples.
Statistics
The science of collecting, organising, analysing, and interpreting data in order to make decisions. In simple terms, it is the toolkit you use whenever you need to turn raw numbers or observations into a meaningful conclusion.
Data
A collection of facts or information from which conclusions may be drawn, consisting of observations, counts, measurements, or responses. Think of it as the raw material: before you do any statistics, you need data to work with.
Population
The collection (set) of all outcomes, responses, measurements, or counts that are of interest. In simple terms, this is the entire group you want to know something about, e.g. all students at UCF.
Sample
A subset, or part, of the population. Think of it as a smaller slice you actually collect data from because measuring the whole population is usually impractical, e.g. 20 UCF students drawn from the full student body.
Parameter
A numerical description of a population characteristic. In simple terms, it describes the whole group. Example: the average age of all people in the US.
Statistic
A numerical description of a sample characteristic. Think of it as the number you compute from your smaller slice. Example: the average age of people surveyed in three states.
Descriptive statistics
Methods of summarising or describing a set of data. It consists of three main parts: collection, presentation, and description of sample data. In simple terms, this is the "what happened" side of statistics: tables, charts, averages, counts.
Inferential statistics
Methods of generalising about a large group based on a smaller one. Involves using sample data to draw conclusions about a population. Think of it as the "what can we conclude" side: taking what the sample tells you and applying it to the bigger picture.
Before any drug is prescribed, scientists must demonstrate a statistically valid rate of effectiveness.
Weather forecasting relies on statistical models.
Insurance companies use statistical models to calculate risk, whether for medical, home, or any other type of cover.
Traders and investors rely on statistics to guide financial decisions.
Manufacturers use statistical sampling to ensure product quality.
The population is always defined by the research question. If you are studying UCF students' scholarship status, the population is all UCF students, not all university students everywhere.
The sample must be drawn from the population. Thirty UCF students surveyed about scholarships is the sample; all UCF students is the population.
Getting the population/sample distinction right is the single most important skill in this section, because every later concept (confidence intervals, hypothesis tests) depends on knowing which one you are working with.
If the number describes the entire population, it is a parameter.
Example: the average SAT combined score of 1332 for the entire UCF freshman class is a parameter, because it covers every member of that group.
If the number describes a sample, it is a statistic.
Example: a survey of several hundred collegiate student-athletes found an average of 50 hours per week spent on athletics. Because this is based on a subset, not every student-athlete in the country, it is a sample statistic.
Descriptive: "60% of the 30 UCF students we surveyed have scholarships." You are describing what you found in the sample.
Inferential: "UCF students may be more likely to hold scholarships than UF students." You are drawing a conclusion beyond the sample, comparing to a known population parameter (50% at UF).
Drug approval, election polling, insurance pricing, quality control in manufacturing, and sports analytics all depend on the population-vs.-sample distinction. Whenever you see a news headline that says "a study found that...", the researchers almost certainly measured a sample and used inferential statistics to say something about a population.
Students often confuse a parameter with a statistic. The deciding factor is whether the number describes the whole population or just a sample. If every member was measured, it is a parameter.
Students sometimes think a population must be very large. A population can be small (e.g. all 25 employees in one office) as long as it is the complete group of interest.
Descriptive and inferential statistics are not separate topics you choose between. In practice you do descriptive work first (summarise the sample), then inferential work second (generalise to the population).
⚠️ Expect exam questions that give you a scenario and ask: "Is this a parameter or a statistic?" The trick is always the same: was the entire population measured, or just a subset?
⚠️ You will likely be asked to identify the population and the sample from a described study. Read the scenario carefully for words like "all", "every", or "entire" (population) vs. "surveyed", "selected", or a specific number of participants (sample).
⚠️ Know the difference between descriptive and inferential statistics and be able to classify a statement as one or the other.
True or False: A statistic describes an entire population.
Fill in the blank: The average GPA of all students at a university is a ______.
True or False: Inferential statistics involves using sample data to draw conclusions about a population.
Fill in the blank: A ______ is a subset of the population.
True or False: Descriptive statistics allows you to make predictions about a population.
Answers: 1. False (that is a parameter). 2. Parameter. 3. True. 4. Sample. 5. False (that is inferential statistics).
Q: In a recent survey, 834 employees in the United States were asked if they thought their jobs were highly stressful. Of the 834 respondents, 517 said yes. Identify the population and the sample.
A: The population is the responses of all employees in the US. The sample is the responses of the 834 employees who were actually surveyed.
Q: We ask 30 UCF students if they have scholarships, and 60% said yes. What proportion of UCF students have scholarships? Identify the population and the sample.
A: The population is all UCF students. The sample is the 30 UCF students surveyed. The 60% figure describes the sample; you would need inferential statistics to estimate the proportion for the full population.
Q: The freshman class at UCF has an average SAT combined score of 1332. Is this a parameter or a statistic?
A: It is a population parameter, because it is based on the entire freshman class, not a subset.
Q: A survey of several hundred collegiate student-athletes found an average of 50 hours per week spent on athletics during the season. Is this a parameter or a statistic?
A: It is a sample statistic, because the value is based on a subset of all collegiate student-athletes, not the entire population.
This section connects directly to Section 1.3 (Data Collection), where you will learn how to properly draw a sample from a population. The population/sample and parameter/statistic distinctions also form the basis for probability (Chapter 3+) and hypothesis testing (later chapters), where you will formally measure how confident you can be that a sample statistic reflects the true population parameter.
statistics definition, what is statistics, population vs sample, parameter vs statistic, descriptive statistics, inferential statistics, intro to statistics, principles of statistics chapter 1, UCF statistics, data definition statistics, sample vs population examples