\[ \begin{align}\begin{aligned}\newcommand\blank{~\underline{\hspace{1.2cm}}~}\\% Bold symbols (vectors)
\newcommand\bs[1]{\mathbf{#1}}\\% Differential
\newcommand\dd[2][]{\mathrm{d}^{#1}{#2}} % use as \dd, \dd{x}, or \dd[2]{x}\\% Poor man's siunitx
\newcommand\unit[1]{\mathrm{#1}}
\newcommand\num[1]{#1}
\newcommand\qty[2]{#1~\unit{#2}}\\\newcommand\per{/}
\newcommand\squared{{}^2}
\newcommand\cubed{{}^3}
%
% Scale
\newcommand\milli{\unit{m}}
\newcommand\centi{\unit{c}}
\newcommand\kilo{\unit{k}}
\newcommand\mega{\unit{M}}
%
% Percent
\newcommand\percent{\unit{{\kern-4mu}\%}}
%
% Angle
\newcommand\radian{\unit{rad}}
\newcommand\degree{\unit{{\kern-4mu}^\circ}}
%
% Time
\newcommand\second{\unit{s}}
\newcommand\s{\second}
\newcommand\minute{\unit{min}}
\newcommand\hour{\unit{h}}
%
% Distance
\newcommand\meter{\unit{m}}
\newcommand\m{\meter}
\newcommand\inch{\unit{in}}
\newcommand\foot{\unit{ft}}
%
% Force
\newcommand\newton{\unit{N}}
\newcommand\kip{\unit{kip}} % kilopound in "freedom" units - edit made by Sri
%
% Mass
\newcommand\gram{\unit{g}}
\newcommand\g{\gram}
\newcommand\kilogram{\unit{kg}}
\newcommand\kg{\kilogram}
\newcommand\grain{\unit{grain}}
\newcommand\ounce{\unit{oz}}
%
% Temperature
\newcommand\kelvin{\unit{K}}
\newcommand\K{\kelvin}
\newcommand\celsius{\unit{{}^\circ C}}
\newcommand\C{\celsius}
\newcommand\fahrenheit{\unit{{}^\circ F}}
\newcommand\F{\fahrenheit}
%
% Area
\newcommand\sqft{\unit{sq\,\foot}} % square foot
%
% Volume
\newcommand\liter{\unit{L}}
\newcommand\gallon{\unit{gal}}
%
% Frequency
\newcommand\hertz{\unit{Hz}}
\newcommand\rpm{\unit{rpm}}
%
% Voltage
\newcommand\volt{\unit{V}}
\newcommand\V{\volt}
\newcommand\millivolt{\milli\volt}
\newcommand\mV{\milli\volt}
\newcommand\kilovolt{\kilo\volt}
\newcommand\kV{\kilo\volt}
%
% Current
\newcommand\ampere{\unit{A}}
\newcommand\A{\ampere}
\newcommand\milliampereA{\milli\ampere}
\newcommand\mA{\milli\ampere}
\newcommand\kiloampereA{\kilo\ampere}
\newcommand\kA{\kilo\ampere}
%
% Resistance
\newcommand\ohm{\Omega}
\newcommand\milliohm{\milli\ohm}
\newcommand\kiloohm{\kilo\ohm} % correct SI spelling
\newcommand\kilohm{\kilo\ohm} % "American" spelling used in siunitx
\newcommand\megaohm{\mega\ohm} % correct SI spelling
\newcommand\megohm{\mega\ohm} % "American" spelling used in siunitx
%
% Capacitance
\newcommand\farad{\unit{F}}
\newcommand\F{\farad}
\newcommand\microfarad{\micro\farad}
\newcommand\muF{\micro\farad}
%
% Inductance
\newcommand\henry{\unit{H}}
\newcommand\H{\henry}
\newcommand\millihenry{\milli\henry}
\newcommand\mH{\milli\henry}
%
% Power
\newcommand\watt{\unit{W}}
\newcommand\W{\watt}
\newcommand\milliwatt{\milli\watt}
\newcommand\mW{\milli\watt}
\newcommand\kilowatt{\kilo\watt}
\newcommand\kW{\kilo\watt}
%
% Energy
\newcommand\joule{\unit{J}}
\newcommand\J{\joule}
%
% Composite units
%
% Torque
\newcommand\ozin{\unit{\ounce}\,\unit{in}}
\newcommand\newtonmeter{\unit{\newton\,\meter}}
%
% Pressure
\newcommand\psf{\unit{psf}} % pounds per square foot
\newcommand\pcf{\unit{pcf}} % pounds per cubic foot
\newcommand\pascal{\unit{Pa}}
\newcommand\Pa{\pascal}
\newcommand\ksi{\unit{ksi}} % kilopound per square inch
% NOTE: do NOT define \bar -- it is the built-in LaTeX accent used by \bar{x},
% \bar{y} (sample means). Redefining it made those render as the word "bar".
\newcommand\barunit{\unit{bar}}
\end{aligned}\end{align} \]
Nov 16, 2026 | 336 words | 3 min
read
12. Linear Regression
Topics Covered
Applications of linear regression in engineering
Exploratory scatter plots
The numpy.polyfit() function and polynomial degree
Slope, intercept, and the model equation
Predicted values and residuals
Sum of squared errors (SSE), sum of squares total (SST), and the coefficient of determination (r²)
Plotting regression lines with np.linspace()
Grouping data with .groupby() for multi-category plots
Professional regression plot formatting and legends
Interpreting regression results and model limitations (extrapolation and nonlinear trends)
Skills and Learning Objectives
At the end of this module, you will be able to:
Explain when and why engineers use linear regression to describe relationships, make predictions, and evaluate fit
Create scatter plots to check whether data have a linear relationship before modeling
Fit a linear regression model to data using NumPy’s polyfit() function
Calculate predicted values, SSE, SST, and r² to evaluate how well a model fits the data
Plot a regression line with the original data, including a legend showing the model equation and r²
Visualize grouped data by category while fitting a single model to all observations
Interpret the physical meaning of a model’s slope and r² value
Recognize the limits of a linear model, including extrapolation and when a nonlinear model may fit better
Use a regression model to support engineering decisions
These skills are directly connected to the following Learning Objectives:
- PR01:
Programming Standards - Develop code that follows established programming standards and conventions.
- PR02:
Data Storage - Store and access data appropriately.
- PR03:
Calculations - Perform algebraic, array, relational, and logical operations using a programming language. Effectively utilize built-in functions.
- PR08:
Debugging - Debug and refine code so that it achieves its objective without dynamic or semantic errors.
- DV01:
Table and Plot Formatting - Prepare tables and plots for technical presentation with proper formatting. Include descriptive titles, axis labels with units, appropriately scaled axes, and visible legends.
- DV02:
Summary Statistics - Describe the central tendency (mean, median, mode) and variability (standard deviation, variance) of data using appropriate tools or methods.
- DV03:
Graphical Comparison of Data - Select, interpret, and justify appropriate graphical representations of data based on data type and structure. Use plots to compare distributions and identify patterns.