Linear Regression

\[ \begin{align}\begin{aligned}\newcommand\blank{~\underline{\hspace{1.2cm}}~}\\% Bold symbols (vectors) \newcommand\bs[1]{\mathbf{#1}}\\% Differential \newcommand\dd[2][]{\mathrm{d}^{#1}{#2}} % use as \dd, \dd{x}, or \dd[2]{x}\\% Poor man's siunitx \newcommand\unit[1]{\mathrm{#1}} \newcommand\num[1]{#1} \newcommand\qty[2]{#1~\unit{#2}}\\\newcommand\per{/} \newcommand\squared{{}^2} \newcommand\cubed{{}^3} % % Scale \newcommand\milli{\unit{m}} \newcommand\centi{\unit{c}} \newcommand\kilo{\unit{k}} \newcommand\mega{\unit{M}} % % Percent \newcommand\percent{\unit{{\kern-4mu}\%}} % % Angle \newcommand\radian{\unit{rad}} \newcommand\degree{\unit{{\kern-4mu}^\circ}} % % Time \newcommand\second{\unit{s}} \newcommand\s{\second} \newcommand\minute{\unit{min}} \newcommand\hour{\unit{h}} % % Distance \newcommand\meter{\unit{m}} \newcommand\m{\meter} \newcommand\inch{\unit{in}} \newcommand\foot{\unit{ft}} % % Force \newcommand\newton{\unit{N}} \newcommand\kip{\unit{kip}} % kilopound in "freedom" units - edit made by Sri % % Mass \newcommand\gram{\unit{g}} \newcommand\g{\gram} \newcommand\kilogram{\unit{kg}} \newcommand\kg{\kilogram} \newcommand\grain{\unit{grain}} \newcommand\ounce{\unit{oz}} % % Temperature \newcommand\kelvin{\unit{K}} \newcommand\K{\kelvin} \newcommand\celsius{\unit{{}^\circ C}} \newcommand\C{\celsius} \newcommand\fahrenheit{\unit{{}^\circ F}} \newcommand\F{\fahrenheit} % % Area \newcommand\sqft{\unit{sq\,\foot}} % square foot % % Volume \newcommand\liter{\unit{L}} \newcommand\gallon{\unit{gal}} % % Frequency \newcommand\hertz{\unit{Hz}} \newcommand\rpm{\unit{rpm}} % % Voltage \newcommand\volt{\unit{V}} \newcommand\V{\volt} \newcommand\millivolt{\milli\volt} \newcommand\mV{\milli\volt} \newcommand\kilovolt{\kilo\volt} \newcommand\kV{\kilo\volt} % % Current \newcommand\ampere{\unit{A}} \newcommand\A{\ampere} \newcommand\milliampereA{\milli\ampere} \newcommand\mA{\milli\ampere} \newcommand\kiloampereA{\kilo\ampere} \newcommand\kA{\kilo\ampere} % % Resistance \newcommand\ohm{\Omega} \newcommand\milliohm{\milli\ohm} \newcommand\kiloohm{\kilo\ohm} % correct SI spelling \newcommand\kilohm{\kilo\ohm} % "American" spelling used in siunitx \newcommand\megaohm{\mega\ohm} % correct SI spelling \newcommand\megohm{\mega\ohm} % "American" spelling used in siunitx % % Capacitance \newcommand\farad{\unit{F}} \newcommand\F{\farad} \newcommand\microfarad{\micro\farad} \newcommand\muF{\micro\farad} % % Inductance \newcommand\henry{\unit{H}} \newcommand\H{\henry} \newcommand\millihenry{\milli\henry} \newcommand\mH{\milli\henry} % % Power \newcommand\watt{\unit{W}} \newcommand\W{\watt} \newcommand\milliwatt{\milli\watt} \newcommand\mW{\milli\watt} \newcommand\kilowatt{\kilo\watt} \newcommand\kW{\kilo\watt} % % Energy \newcommand\joule{\unit{J}} \newcommand\J{\joule} % % Composite units % % Torque \newcommand\ozin{\unit{\ounce}\,\unit{in}} \newcommand\newtonmeter{\unit{\newton\,\meter}} % % Pressure \newcommand\psf{\unit{psf}} % pounds per square foot \newcommand\pcf{\unit{pcf}} % pounds per cubic foot \newcommand\pascal{\unit{Pa}} \newcommand\Pa{\pascal} \newcommand\ksi{\unit{ksi}} % kilopound per square inch % NOTE: do NOT define \bar -- it is the built-in LaTeX accent used by \bar{x}, % \bar{y} (sample means). Redefining it made those render as the word "bar". \newcommand\barunit{\unit{bar}} \end{aligned}\end{align} \]

Nov 16, 2026 | 447 words | 4 min read

6. Linear Regression#

This module builds on prior data analysis experience by introducing linear regression as a method to model relationships between variables. Students will learn to construct empirical models from experimental data and use these models to make predictions and engineering recommendations.

Engineers often need to identify cause-and-effect relationships from experimental data. For example, testing how electrical resistance changes with wire length or analyzing the tradeoff between energy and water use in cooling systems. Linear regression allows engineers to quantify these relationships and evaluate how well a linear model fits the observed data.

In this module, students will learn to calculate regression model parameters (slope and y-intercept) using least-squares methods, evaluate model fit using R-squared and residual analysis, and communicate data-supported recommendations through professionally formatted charts. Students will use Excel to perform regression analysis and interpret statistical measures to justify their engineering conclusions.

Topics Covered

  • Least-squares regression and model parameters

  • Slope and y-intercept interpretation

  • Sum of squared errors and model fit

  • Coefficient of determination (R-squared)

  • Regression trendlines in Excel

  • Residual analysis

  • Model limitations and assumptions

  • Engineering recommendations from regression models

Skills and Learning Objectives

At the end of this module, you will be able to:

  • Calculate regression model parameters (slope and y-intercept) from a dataset

  • Interpret the physical meaning of slope and y-intercept in engineering context

  • Compute and apply the least-squares method to construct best-fit lines

  • Use Excel functions and chart tools to perform regression analysis

  • Evaluate model fit using R-squared and assess prediction uncertainty

  • Analyze residuals to validate regression model assumptions

  • Construct professional scatter plots with multiple data series and trendlines

  • Write evidence-based engineering recommendations supported by regression analysis

These skills are directly connected to the following Learning Objectives:

PR02:

Data Storage - Store and access data appropriately.

PR03:

Calculations - Perform algebraic, array, relational, and logical operations using a programming language. Effectively utilize built-in functions.

DV01:

Table and Plot Formatting - Prepare tables and plots for technical presentation with proper formatting. Include descriptive titles, axis labels with units, appropriately scaled axes, and visible legends.

DV03:

Graphical Comparison of Data - Select, interpret, and justify appropriate graphical representations of data based on data type and structure. Use plots to compare distributions and identify patterns.

DV04:

Regression Model Construction - Construct regression models that describe relationships between variables and support prediction.

DV05:

Regression Model Evaluation - Evaluate and compare regression models using quantitative metrics (SSE, SST, and R²) and contextual reasoning.

EC02:

Recognize Limits, Trade-offs, and Confidence - Recognize limitations, trade-offs, and uncertainty in engineering work and communicate appropriate levels of confidence in conclusions.

EC03:

Make Honest and Responsible Recommendations - Make recommendations that are honest, responsible, and consistent with evidence, while acknowledging broader impacts and professional responsibility.

PC02:

Communicating Results from Analysis - Clearly state conclusions or results derived from code, models, or data analysis.

PC05:

Meeting Assignment Expectations - Fully complete all parts of each assignment according to provided instructions.