Intelligent Surface Roughness Detection Using Deep Learning for Deep Hole Drilling
Deep learning-based surface roughness detection for deep hole drilling using Pyramid Adaptive Transformer (PAT) with multi-sensor fusion. 99.43% accuracy with 62% parameter reduction for BTA quality monitoring.
July 4, 2026 · Deep Hole Drilling Guide Team
Intelligent Surface Roughness Detection Using Deep Learning
Surface roughness measurement in deep hole drilling traditionally requires stopping production, withdrawing the tool, and running a profilometer or comparator down the bore — a time-consuming process that only samples a fraction of production. Recent advances in deep learning have made it possible to detect surface roughness in real-time during drilling by analyzing sensor signals.
A landmark 2025 study published in Measurement (ScienceDirect) introduced a Pyramid Adaptive Transformer (PAT) model that fuses multi-sensor vibration data to detect surface roughness in BTA deep hole drilling with 99.43% accuracy — a significant advance in in-process quality monitoring.
The Challenge: Measuring Roughness in Deep Holes
Why It’s Hard
Factor
Issue
Depth
Roughness varies along the hole length — measuring at one point misses other regions
Access
The bore is only accessible from the entry end (blind holes)
Post-process measurement takes 5–15 minutes per hole — impractical for 100% inspection
Cost
Air gauging and CMM inspection add $10–$50 per hole
Traditional Methods
Method
Time per Hole
Coverage
In-Process?
Profilometer (stylus)
5–15 min
Single trace
No
Air gauging
2–5 min
Diameter only
No
Borescope (visual)
5–10 min
Visual only
No
CMM
10–30 min
Several cross-sections
No
The Deep Learning Solution
Approach
The researchers mounted three vibration sensors on the BTA machine — at the workpiece holder, the drill tube support, and the machine base. The vibration signals contain information about the cutting process that correlates with surface roughness: higher frequency vibrations indicate better surface finish (fine chip formation); lower frequency vibrations indicate rougher surfaces (tool chatter, chip breakage).
Multi-Sensor Fusion Architecture
The Pyramid Adaptive Transformer (PAT) model processes the data in stages:
MSST converts the raw vibration signals into time-frequency images — similar to how a spectrogram represents audio. It provides higher resolution than conventional Fourier or wavelet transforms by “squeezing” the energy in each frequency band around the instantaneous frequency.
Feature
Conventional STFT
MSST
Improvement
Frequency resolution
Fixed
Adaptive
Better for transient signals
Time resolution
Fixed
Adaptive
Preserves event timing
Noise robustness
Low
High
Cleaner features
Computational cost
Low
Moderate
Acceptable for real-time
Pyramid Adaptive Transformer
The PAT architecture processes the MSST time-frequency images at multiple scales — similar to how a human eye examines a scene at different resolutions. It then applies self-attention mechanisms to identify which frequency bands and time segments are most predictive of surface roughness.
Performance Results
Metric
Value
Significance
Detection accuracy
99.43%
Highest reported for deep hole drilling roughness detection
Model parameter reduction
62%
Efficient enough for edge deployment
Inference time per sample
< 50 ms
Fast enough for real-time monitoring
Ra prediction range
0.4–6.3 µm
Covers practical deep hole drilling range
Prediction error
±0.15 µm
Comparable to profilometer accuracy
Comparison with Other Models
Model
Accuracy
Parameters
Accuracy/Parm Ratio
CNN (baseline)
94.2%
8.4M
11.2
LSTM
92.8%
6.2M
15.0
CNN-LSTM hybrid
96.1%
7.8M
12.3
Standard Transformer
97.8%
12.4M
7.9
Pyramid Adaptive Transformer (this study)
99.43%
4.7M
21.2
Parameter Efficiency
PAT achieves higher accuracy than a standard Transformer with 60% fewer parameters — critical for deployment on edge computing hardware near the machine, rather than requiring cloud processing.
Practical Implementation
Hardware Requirements
Component
Specification
Cost Estimate
Vibration sensors
3× IEPE accelerometers, 10 kHz bandwidth
$500–$1,500
Data acquisition
4-channel, 16-bit, 20 kHz sampling
$1,000–$3,000
Edge computer
GPU-enabled (NVIDIA Jetson or similar)
$500–$2,000
Software
PAT model (custom)
Development cost
Installation
Mount accelerometers at workpiece holder, drill tube support, machine base
Connect to data acquisition module
Deploy trained PAT model on edge computer
Connect to machine control for alarm output
Data Requirements for Model Training
Data Needed
Quantity
Source
Good holes (Ra < 1.6 µm)
500+
Production scrap or test cuts
Marginal holes (Ra 1.6–3.2 µm)
100+
Production
Bad holes (Ra > 3.2 µm)
50+
Deliberate bad cuts
Sensor signals
Full hole cycle
Simultaneous recording
Applications
Best Use Cases
Application
Why PAT Fits
High-volume BTA production
99.43% accuracy enables 100% inspection
Aerospace components (strict Ra requirements)
Reliable detection of marginal surface finish
Unattended machining
Automated quality check without operator
Process monitoring
Trend roughness over time to predict tool wear
Limitations
Limitation
Impact
Requires training data
Needs 500+ labeled holes for initial model
Sensor installation
Permanent sensors on each machine
Transfer between machines
Model may need retraining per machine
Chip flow interference
Very large chips can create false signals
Summary
Deep learning-based surface roughness detection using the Pyramid Adaptive Transformer with MSST multi-sensor fusion achieves 99.43% accuracy in BTA deep hole drilling — the first application of deep learning to in-process roughness monitoring for deep hole drilling. The model uses 62% fewer parameters than standard Transformers, making it suitable for edge deployment. With inference time under 50 ms, PAT enables real-time quality monitoring during drilling, potentially replacing post-process inspection for high-volume production. For AI monitoring concepts, see AI-based process monitoring for single-part production. For traditional measurement methods, see deep hole measurement methods guide.
Articles in Deep Hole Drilling Precision and Quality