Intelligent Surface Roughness Detection Using Deep Learning

Surface roughness measurement in deep hole drilling traditionally requires stopping production, withdrawing the tool, and running a profilometer or comparator down the bore — a time-consuming process that only samples a fraction of production. Recent advances in deep learning have made it possible to detect surface roughness in real-time during drilling by analyzing sensor signals.

A landmark 2025 study published in Measurement (ScienceDirect) introduced a Pyramid Adaptive Transformer (PAT) model that fuses multi-sensor vibration data to detect surface roughness in BTA deep hole drilling with 99.43% accuracy — a significant advance in in-process quality monitoring.

The Challenge: Measuring Roughness in Deep Holes

Why It’s Hard

FactorIssue
DepthRoughness varies along the hole length — measuring at one point misses other regions
AccessThe bore is only accessible from the entry end (blind holes)
CoolantFlooded with cutting oil — optical methods require dry, clean surfaces
TimePost-process measurement takes 5–15 minutes per hole — impractical for 100% inspection
CostAir gauging and CMM inspection add $10–$50 per hole

Traditional Methods

MethodTime per HoleCoverageIn-Process?
Profilometer (stylus)5–15 minSingle traceNo
Air gauging2–5 minDiameter onlyNo
Borescope (visual)5–10 minVisual onlyNo
CMM10–30 minSeveral cross-sectionsNo

The Deep Learning Solution

Approach

The researchers mounted three vibration sensors on the BTA machine — at the workpiece holder, the drill tube support, and the machine base. The vibration signals contain information about the cutting process that correlates with surface roughness: higher frequency vibrations indicate better surface finish (fine chip formation); lower frequency vibrations indicate rougher surfaces (tool chatter, chip breakage).

Multi-Sensor Fusion Architecture

The Pyramid Adaptive Transformer (PAT) model processes the data in stages:

Sensor 1 (workpiece)  ┐
Sensor 2 (tube support)┤→ MSST (Multi-Scale Synchrosqueezing Transform)
Sensor 3 (machine base)┘    → Time-frequency representation
                              → Pyramid Adaptive Transformer
                                → Multi-scale feature extraction
                                  → Attention-weighted fusion
                                    → Roughness prediction (Ra)

MSST: Multi-Scale Synchrosqueezing Transform

MSST converts the raw vibration signals into time-frequency images — similar to how a spectrogram represents audio. It provides higher resolution than conventional Fourier or wavelet transforms by “squeezing” the energy in each frequency band around the instantaneous frequency.

FeatureConventional STFTMSSTImprovement
Frequency resolutionFixedAdaptiveBetter for transient signals
Time resolutionFixedAdaptivePreserves event timing
Noise robustnessLowHighCleaner features
Computational costLowModerateAcceptable for real-time

Pyramid Adaptive Transformer

The PAT architecture processes the MSST time-frequency images at multiple scales — similar to how a human eye examines a scene at different resolutions. It then applies self-attention mechanisms to identify which frequency bands and time segments are most predictive of surface roughness.

Performance Results

MetricValueSignificance
Detection accuracy99.43%Highest reported for deep hole drilling roughness detection
Model parameter reduction62%Efficient enough for edge deployment
Inference time per sample< 50 msFast enough for real-time monitoring
Ra prediction range0.4–6.3 µmCovers practical deep hole drilling range
Prediction error±0.15 µmComparable to profilometer accuracy

Comparison with Other Models

ModelAccuracyParametersAccuracy/Parm Ratio
CNN (baseline)94.2%8.4M11.2
LSTM92.8%6.2M15.0
CNN-LSTM hybrid96.1%7.8M12.3
Standard Transformer97.8%12.4M7.9
Pyramid Adaptive Transformer (this study)99.43%4.7M21.2

Parameter Efficiency

PAT achieves higher accuracy than a standard Transformer with 60% fewer parameters — critical for deployment on edge computing hardware near the machine, rather than requiring cloud processing.

Practical Implementation

Hardware Requirements

ComponentSpecificationCost Estimate
Vibration sensors3× IEPE accelerometers, 10 kHz bandwidth$500–$1,500
Data acquisition4-channel, 16-bit, 20 kHz sampling$1,000–$3,000
Edge computerGPU-enabled (NVIDIA Jetson or similar)$500–$2,000
SoftwarePAT model (custom)Development cost

Installation

  1. Mount accelerometers at workpiece holder, drill tube support, machine base
  2. Connect to data acquisition module
  3. Deploy trained PAT model on edge computer
  4. Connect to machine control for alarm output

Data Requirements for Model Training

Data NeededQuantitySource
Good holes (Ra < 1.6 µm)500+Production scrap or test cuts
Marginal holes (Ra 1.6–3.2 µm)100+Production
Bad holes (Ra > 3.2 µm)50+Deliberate bad cuts
Sensor signalsFull hole cycleSimultaneous recording

Applications

Best Use Cases

ApplicationWhy PAT Fits
High-volume BTA production99.43% accuracy enables 100% inspection
Aerospace components (strict Ra requirements)Reliable detection of marginal surface finish
Unattended machiningAutomated quality check without operator
Process monitoringTrend roughness over time to predict tool wear

Limitations

LimitationImpact
Requires training dataNeeds 500+ labeled holes for initial model
Sensor installationPermanent sensors on each machine
Transfer between machinesModel may need retraining per machine
Chip flow interferenceVery large chips can create false signals

Summary

Deep learning-based surface roughness detection using the Pyramid Adaptive Transformer with MSST multi-sensor fusion achieves 99.43% accuracy in BTA deep hole drilling — the first application of deep learning to in-process roughness monitoring for deep hole drilling. The model uses 62% fewer parameters than standard Transformers, making it suitable for edge deployment. With inference time under 50 ms, PAT enables real-time quality monitoring during drilling, potentially replacing post-process inspection for high-volume production. For AI monitoring concepts, see AI-based process monitoring for single-part production. For traditional measurement methods, see deep hole measurement methods guide.