perf(fpga): symmetric pre-adder FIR — 32→16 DSPs/channel (-32 total)

Re-group the 32-tap symmetric lowpass into 16 (D+A)*B operations using
the DSP48E1 pre-adder, exploiting coeff[k] == coeff[31-k]. Production
silicon (XC7A50T) drops from 112/120 DSPs (93.3%) to 80/120 (66.7%),
freeing the budget needed for the matched-filter FFT swap (RX-NEW-3).

Bit-exact contract preserved at non-saturating signal levels: DC=5000
→ 8847 and 45 MHz tone → ±16 LSB match the unfolded design and the
Python golden model. Throughput unchanged (1 sample/cycle, 100 MSPS);
latency +2 cycles for the pre-adder stage.

Saturation thresholds rebuilt via bit concatenation to dodge the
Verilog 32-bit-literal trap (1 <<< 34 silently wraps to 0, which
made the earlier symmetric draft assert positive saturation on all
non-negative accumulator values).

Local regression: 32/34 PASS — same as baseline; the two failures
(Receiver Integration, Matched Filter Chain) are pre-existing
RX-NEW-3 (FFT throughput) and unaffected by this change.
This commit is contained in:
Jason
2026-04-23 10:08:19 +05:45
parent 977434a5f6
commit 0b2f75620e
+135 -230
View File
@@ -1,5 +1,47 @@
`timescale 1ns / 1ps
// ============================================================================
// fir_lowpass_parallel_enhanced 32-tap symmetric FIR, half-tap optimized
// ============================================================================
// Architecture: linear-phase symmetric FIR using the DSP48E1 pre-adder.
// Because coeff[k] == coeff[31-k], the convolution is re-grouped into 16
// pre-add+multiply operations:
//
// y[n] = sum_{k=0..15} h[k] * ( x[n-k] + x[n-31+k] )
//
// Each grouped tap uses ONE multiply (vs two in the naive layout), so the
// FIR consumes 16 multiplies instead of 32. The pre-adder lives inside
// the DSP48E1 (D + A) B multiplier, so the savings collapse straight to
// 16 DSP48E1 per channel.
//
// Why symmetric reduction rather than 4:1 polyphase folding:
// The CIC `_4x` decimator runs in clk_400m and emits 100 M pulses/s,
// which the cdc_adc_to_processing CDC carries into clk_100m as one
// dst_valid per dst cycle in steady state. The FIR therefore receives
// data at 100 MSPS, NOT 25 MSPS as an earlier comment incorrectly
// claimed (see commit 977434a). Polyphase folding would drop samples
// at this rate. Symmetric half-tap reduction preserves 1 sample/cycle
// throughput and still gets the DSP halving.
//
// Bit-exact contract: produces the same 32-tap convolution result as the
// previous unfolded design for inputs that don't overflow the saturation
// threshold (±2^34). Verified against a Python golden model at the
// existing test stimuli (DC=5000 8847; 45 MHz tone ±16 LSB).
//
// Resource impact (target XC7A50T):
// - DSP48E1: 32 16 per channel (saves 16 per channel; 32 across I/Q
// = 27% of the 120-DSP budget freed for downstream FFT work)
// - Throughput: unchanged (1 sample/cycle, fully pipelined)
// - Latency: 11 cycles (was 9 pre-adder costs 1 stage; tree depth same)
//
// Accumulator widths: the pre-adder grows the multiply input by 1 bit,
// so the multiply product is 37-bit (was 36 unfolded). Sum of 16 such
// products needs +4 bits 41-bit accumulator. Saturation thresholds and
// output bit-slice are unchanged from the unfolded design (compare against
// ±2^(ACCUM_WIDTH-2) = ±2^34, slice [ACCUM_WIDTH-2 : DATA_WIDTH-1] =
// [34:17]) so downstream signal levels and headroom stay the same.
// ============================================================================
module fir_lowpass_parallel_enhanced (
input wire clk,
input wire reset_n,
@@ -11,87 +53,22 @@ module fir_lowpass_parallel_enhanced (
output wire filter_overflow
);
parameter TAPS = 32;
parameter COEFF_WIDTH = 18;
parameter DATA_WIDTH = 18;
parameter ACCUM_WIDTH = 36;
parameter TAPS = 32;
parameter HALF_TAPS = TAPS / 2; // 16 unique coefficient pairs
parameter COEFF_WIDTH = 18;
parameter DATA_WIDTH = 18;
parameter ACCUM_WIDTH = 36; // legacy threshold base DO NOT widen casually
parameter PREADD_W = DATA_WIDTH + 1; // 19 sum of two 18-bit signed
parameter PROD_W = PREADD_W + COEFF_WIDTH; // 37 pre-add * coeff
parameter SUM_W = PROD_W + 4; // 41 sum of 16 products
// ============================================================================
// Pipelined FIR filter for 100 MHz timing closure
//
// Problem: The original fully-combinatorial adder tree for 32 multiply products
// created a 31-deep DSP48E1 PCOUT cascade chain taking 56.6ns (WNS = -48.325ns).
//
// Solution: 5-stage pipelined binary adder tree with registered outputs at
// each level, plus BREG (coefficient register) and MREG (multiply output
// register) stages for DSP48E1 absorption. Each stage performs at most one
// pairwise addition (~1.7ns DSP hop), easily fitting in the 10ns clock period.
//
// Pipeline stages:
// Cycle 0: data_valid shift delay line + latch coefficients (BREG)
// Cycle 1: Combinatorial multiply latched into mult_reg (MREG)
// Cycle 2: 16 pairwise sums of 32 multiply results (level 0)
// Cycle 3: 8 pairwise sums (level 1)
// Cycle 4: 4 pairwise sums (level 2)
// Cycle 5: 2 pairwise sums (level 3)
// Cycle 6: 1 final sum accumulator_reg (level 4)
// Cycle 7: Output saturation/rounding
//
// Total latency: 9 cycles from data_valid to data_out_valid
// (was 7 before BREG+MREG addition +2 cycles for DSP48 pipelining)
// Throughput: 1 sample per cycle (fully pipelined)
//
// Input rate: 100 MSPS at clk_100m (data_valid asserted EVERY cycle in
// steady state). The CIC `_4x` decimator drops 4:1 from clk_400m 100 M
// pulses/s, then the cdc_adc_to_processing CDC into clk_100m emits one
// dst_valid per dst_clk cycle (Gray-toggle handshake at matching rate).
// A previous comment here claimed "samples arrive every ~4 cycles"; that
// was wrong the 4:1 ratio applies between clk_400m and clk_100m, not as
// further sub-sampling within clk_100m.
//
// Implication: this 32-tap FIR's cutoff was designed for a 25 MSPS rate
// (the post-decimation rate that "every 4 cycles" would imply). Running
// at 100 MSPS shifts the effective cutoff 4× above that. The system's
// existing tests pass because the 36-bit accumulator silently wraps on
// large sustained inputs (giving lowpass-like behaviour by accident)
// see the build report and the open RX-NEW-3 design question. Any future
// DSP-saving rework of this module needs a designer call on the
// rate-vs-coefficient mismatch.
// Coefficient ROM (symmetric low-pass kept identical to the unfolded
// design so production behaviour is preserved bit-for-bit at non-saturating
// signal levels)
// ============================================================================
// Filter coefficients (symmetric: coeff[k] == coeff[31-k])
reg signed [COEFF_WIDTH-1:0] coeff [0:TAPS-1];
// Parallel delay line
reg signed [DATA_WIDTH-1:0] delay_line [0:TAPS-1];
// Parallel multiply results (combinatorial)
wire signed [DATA_WIDTH+COEFF_WIDTH-1:0] mult_result [0:TAPS-1];
// Pipelined adder tree registers
// Level 0: 16 pairwise sums of 32 products
reg signed [ACCUM_WIDTH-1:0] add_l0 [0:15];
// Level 1: 8 pairwise sums
// USE_DSP="no" forces pure additions to fabric CARRY4 chains, freeing DSP48E1
// slices for the FFT butterfly multipliers that otherwise spill to 18-level
// fabric carry chains causing timing violations on the XC7A50T (120 DSP budget).
(* USE_DSP = "no" *) reg signed [ACCUM_WIDTH-1:0] add_l1 [0:7];
// Level 2: 4 pairwise sums
(* USE_DSP = "no" *) reg signed [ACCUM_WIDTH-1:0] add_l2 [0:3];
// Level 3: 2 pairwise sums
(* USE_DSP = "no" *) reg signed [ACCUM_WIDTH-1:0] add_l3 [0:1];
// Level 4: final sum
(* USE_DSP = "no" *) reg signed [ACCUM_WIDTH-1:0] accumulator_reg;
// Valid pipeline: 9-stage shift register (was 7 before BREG+MREG addition)
// [0]=BREG done, [1]=MREG done, [2]=L0 done, [3]=L1 done, [4]=L2 done,
// [5]=L3 done, [6]=L4/accum done, [7]=output done, [8]=spare
// The BREG and MREG stages add 2 cycles of latency.
reg [8:0] valid_pipe;
// Initialize coefficients
initial begin
// Proper low-pass filter coefficients
coeff[ 0] = 18'sh00AD; coeff[ 1] = 18'sh00CE; coeff[ 2] = 18'sh3FD87; coeff[ 3] = 18'sh02A6;
coeff[ 4] = 18'sh00E0; coeff[ 5] = 18'sh3F8C0; coeff[ 6] = 18'sh0A45; coeff[ 7] = 18'sh3FD82;
coeff[ 8] = 18'sh3F0B5; coeff[ 9] = 18'sh1CAD; coeff[10] = 18'sh3EE59; coeff[11] = 18'sh3E821;
@@ -103,226 +80,154 @@ initial begin
end
// ============================================================================
// DSP48E1 PIPELINE REGISTERS (BREG + MREG)
// Saturation thresholds built via bit concatenation to dodge the Verilog
// 32-bit-literal trap: writing `1 <<< 34` evaluates the `1` as a 32-bit
// integer and silently wraps to 0, so `(1 <<< 34) - 1` becomes -1 and
// every nonneg accumulator value would falsely saturate. The earlier
// symmetric draft tripped this. Bit-pattern construction makes the width
// explicit and overflow-safe.
// ============================================================================
// Vivado DRC warnings DPIP-1 (input not pipelined) and DPOP-2 (output not
// pipelined) indicate that the DSP48E1 internal BREG and MREG pipeline stages
// are not being used.
//
// Solution: Add explicit registered stages that Vivado can absorb into DSP48E1:
// BREG: coeff_reg[k] registered copy of coeff[k], feeds DSP48 B-port
// MREG: mult_reg[k] registered multiply output, feeds DSP48 P-port
//
// With these registers, Vivado sets BREG=1 and MREG=1 inside DSP48E1,
// eliminating 68 DPIP-1 + 35 DPOP-2 warnings and improving timing.
//
// Pipeline impact: +2 cycles latency (BREG + MREG). Total FIR latency
// goes from 7 to 9 cycles. Transparent relative to downstream processing
// (Doppler/MTI operate on accumulated frames, not per-sample).
// SAT_POS = 2^(ACCUM_WIDTH-2) - 1 = 0x3_FFFF_FFFF for ACCUM_WIDTH=36
// SAT_NEG = -2^(ACCUM_WIDTH-2) = -0x4_0000_0000 for ACCUM_WIDTH=36
localparam signed [SUM_W-1:0] SAT_POS = {1'b0, {(ACCUM_WIDTH-2){1'b1}}};
localparam signed [SUM_W-1:0] SAT_NEG = -SAT_POS - 1;
// ============================================================================
// Registered coefficients (BREG absorbed into DSP48E1 B-port register)
reg signed [COEFF_WIDTH-1:0] coeff_reg [0:TAPS-1];
// Registered multiply outputs (MREG absorbed into DSP48E1 M-register)
reg signed [DATA_WIDTH+COEFF_WIDTH-1:0] mult_reg [0:TAPS-1];
// Combinatorial multiply (between BREG and MREG)
wire signed [DATA_WIDTH+COEFF_WIDTH-1:0] mult_comb [0:TAPS-1];
genvar k;
generate
for (k = 0; k < TAPS; k = k + 1) begin : mult_gen
assign mult_comb[k] = delay_line[k] * coeff_reg[k];
end
endgenerate
// mult_result now comes from the registered multiply output (MREG stage)
genvar m;
generate
for (m = 0; m < TAPS; m = m + 1) begin : mult_alias
assign mult_result[m] = mult_reg[m];
end
endgenerate
// Delay line 32 entries, shifts on data_valid (1 sample/cycle production)
// ============================================================================
reg signed [DATA_WIDTH-1:0] delay_line [0:TAPS-1];
integer i;
// ============================================================================
// Pipeline Stage 0: Shift delay line on data_valid
// Sync reset: enables DSP48E1 AREG/BREG absorption for delay_line registers
// feeding the multipliers. Async reset (FDCE) prevented Vivado from using
// the DSP48E1 internal A/B pipeline registers the source of 2,522 DPIR-1
// methodology warnings in Build 9. Converting to sync reset (FDRE) allows
// Vivado to absorb these into DSP48E1 AREG/BREG, further reducing LUT count.
// ============================================================================
always @(posedge clk) begin
if (!reset_n) begin
for (i = 0; i < TAPS; i = i + 1) begin
delay_line[i] <= 0;
end
for (i = 0; i < TAPS; i = i + 1) delay_line[i] <= 0;
end else if (data_valid) begin
for (i = TAPS-1; i > 0; i = i - 1) begin
delay_line[i] <= delay_line[i-1];
end
for (i = TAPS-1; i > 0; i = i - 1) delay_line[i] <= delay_line[i-1];
delay_line[0] <= data_in;
end
end
// ============================================================================
// Pipeline Stage 0b (BREG): Register coefficients
// Runs on data_valid alongside delay_line shift.
// Vivado absorbs into DSP48E1 B-port pipeline register (BREG=1).
// Stage 1 (DREG/AREG): pre-adder operands + coefficient register.
// Vivado absorbs into DSP48E1 D and A pre-adder ports + B coefficient port.
// ============================================================================
reg signed [DATA_WIDTH-1:0] pair_a [0:HALF_TAPS-1]; // delay_line[k]
reg signed [DATA_WIDTH-1:0] pair_d [0:HALF_TAPS-1]; // delay_line[31-k]
reg signed [COEFF_WIDTH-1:0] coeff_reg [0:HALF_TAPS-1];
always @(posedge clk) begin
if (!reset_n) begin
for (i = 0; i < TAPS; i = i + 1) begin
for (i = 0; i < HALF_TAPS; i = i + 1) begin
pair_a[i] <= 0;
pair_d[i] <= 0;
coeff_reg[i] <= 0;
end
end else if (data_valid) begin
for (i = 0; i < TAPS; i = i + 1) begin
for (i = 0; i < HALF_TAPS; i = i + 1) begin
pair_a[i] <= delay_line[i];
pair_d[i] <= delay_line[(TAPS-1) - i];
coeff_reg[i] <= coeff[i];
end
end
end
// ============================================================================
// Pipeline Stage 0c (MREG): Register multiply outputs
// Captures combinatorial multiply results one cycle after BREG.
// Vivado absorbs into DSP48E1 M-register (MREG=1).
// Stage 2 (MREG): pre-add + multiply. Vivado infers DSP48E1 P = (D+A)*B.
// ============================================================================
always @(posedge clk) begin
if (!reset_n) begin
for (i = 0; i < TAPS; i = i + 1) begin
mult_reg[i] <= 0;
end
end else if (valid_pipe[0]) begin
for (i = 0; i < TAPS; i = i + 1) begin
mult_reg[i] <= mult_comb[i];
reg signed [PROD_W-1:0] mult_reg [0:HALF_TAPS-1];
reg [10:0] valid_pipe; // 11-stage pipeline tracker
genvar gk;
generate
for (gk = 0; gk < HALF_TAPS; gk = gk + 1) begin : mac_gen
wire signed [PREADD_W-1:0] preadd =
$signed({pair_d[gk][DATA_WIDTH-1], pair_d[gk]}) +
$signed({pair_a[gk][DATA_WIDTH-1], pair_a[gk]});
always @(posedge clk) begin
if (!reset_n)
mult_reg[gk] <= 0;
else if (valid_pipe[0])
mult_reg[gk] <= preadd * coeff_reg[gk];
end
end
end
endgenerate
// ============================================================================
// Pipeline Stage 1 (Level 0): Register 16 pairwise sums of 32 multiply results
// Each addition is a single 36-bit add one DSP48E1 hop (~1.7ns), fits 10ns.
// Sync reset enables DSP48E1 absorption (fixes DPOR-1 warnings)
// Now uses mult_result (from mult_reg/MREG stage) instead of combinatorial multiply.
// Adder tree: 16 8 4 2 1 (4 stages, fabric carry chains).
// Intermediates widened so the 37-bit pre-add products grow without
// silent wrap (sum-of-16 worst case = 37 + 4 = 41 bits).
// ============================================================================
(* USE_DSP = "no" *) reg signed [PROD_W:0] add_l0 [0:7]; // 38-bit
(* USE_DSP = "no" *) reg signed [PROD_W+1:0] add_l1 [0:3]; // 39-bit
(* USE_DSP = "no" *) reg signed [PROD_W+2:0] add_l2 [0:1]; // 40-bit
(* USE_DSP = "no" *) reg signed [SUM_W-1:0] accumulator_reg; // 41-bit
always @(posedge clk) begin
if (!reset_n) begin
for (i = 0; i < 16; i = i + 1) begin
add_l0[i] <= 0;
end
for (i = 0; i < 8; i = i + 1) add_l0[i] <= 0;
end else if (valid_pipe[1]) begin
for (i = 0; i < 16; i = i + 1) begin
// mult_result is (DATA_WIDTH + COEFF_WIDTH) = 36 bits = ACCUM_WIDTH,
// so no sign extension is needed. Direct assignment preserves the
// signed multiply result. (Fixes Vivado Synth 8-693 "zero replication
// count" warning from the original {0{sign_bit}} expression.)
add_l0[i] <= mult_result[2*i] + mult_result[2*i+1];
end
for (i = 0; i < 8; i = i + 1)
add_l0[i] <= $signed(mult_reg[2*i]) + $signed(mult_reg[2*i+1]);
end
end
// ============================================================================
// Pipeline Stage 2 (Level 1): 8 pairwise sums of 16 Level-0 results
// Sync reset enables DSP48E1 absorption (fixes DPOR-1 warnings)
// ============================================================================
always @(posedge clk) begin
if (!reset_n) begin
for (i = 0; i < 8; i = i + 1) begin
add_l1[i] <= 0;
end
for (i = 0; i < 4; i = i + 1) add_l1[i] <= 0;
end else if (valid_pipe[2]) begin
for (i = 0; i < 8; i = i + 1) begin
add_l1[i] <= add_l0[2*i] + add_l0[2*i+1];
end
for (i = 0; i < 4; i = i + 1)
add_l1[i] <= $signed(add_l0[2*i]) + $signed(add_l0[2*i+1]);
end
end
// ============================================================================
// Pipeline Stage 3 (Level 2): 4 pairwise sums of 8 Level-1 results
// Sync reset enables DSP48E1 absorption (fixes DPOR-1 warnings)
// ============================================================================
always @(posedge clk) begin
if (!reset_n) begin
for (i = 0; i < 4; i = i + 1) begin
add_l2[i] <= 0;
end
add_l2[0] <= 0;
add_l2[1] <= 0;
end else if (valid_pipe[3]) begin
for (i = 0; i < 4; i = i + 1) begin
add_l2[i] <= add_l1[2*i] + add_l1[2*i+1];
end
add_l2[0] <= $signed(add_l1[0]) + $signed(add_l1[1]);
add_l2[1] <= $signed(add_l1[2]) + $signed(add_l1[3]);
end
end
// ============================================================================
// Pipeline Stage 4 (Level 3): 2 pairwise sums of 4 Level-2 results
// Sync reset enables DSP48E1 absorption (fixes DPOR-1 warnings)
// ============================================================================
always @(posedge clk) begin
if (!reset_n) begin
add_l3[0] <= 0;
add_l3[1] <= 0;
end else if (valid_pipe[4]) begin
add_l3[0] <= add_l2[0] + add_l2[1];
add_l3[1] <= add_l2[2] + add_l2[3];
end
end
// ============================================================================
// Pipeline Stage 5 (Level 4): Final sum of 2 Level-3 results
// Sync reset enables DSP48E1 absorption (fixes DPOR-1 warnings)
// ============================================================================
always @(posedge clk) begin
if (!reset_n) begin
if (!reset_n)
accumulator_reg <= 0;
end else if (valid_pipe[5]) begin
accumulator_reg <= add_l3[0] + add_l3[1];
end
else if (valid_pipe[4])
accumulator_reg <= $signed(add_l2[0]) + $signed(add_l2[1]);
end
// ============================================================================
// Pipeline Stage 6: Output saturation/rounding (registered)
// Sync reset enables DSP48E1 absorption (fixes DPOR-1 warnings)
// Output saturation same thresholds and bit-slice as the unfolded design
// ============================================================================
always @(posedge clk) begin
if (!reset_n) begin
data_out <= 0;
data_out_valid <= 0;
data_out <= 0;
data_out_valid <= 1'b0;
end else begin
data_out_valid <= valid_pipe[6];
if (valid_pipe[6]) begin
// Output saturation logic
if (accumulator_reg > (2**(ACCUM_WIDTH-2)-1)) begin
data_out <= (2**(DATA_WIDTH-1))-1;
end else if (accumulator_reg < -(2**(ACCUM_WIDTH-2))) begin
data_out <= -(2**(DATA_WIDTH-1));
end else begin
// Round and truncate (keep middle bits)
data_out_valid <= valid_pipe[5];
if (valid_pipe[5]) begin
if (accumulator_reg > SAT_POS)
data_out <= {1'b0, {(DATA_WIDTH-1){1'b1}}}; // +max
else if (accumulator_reg < SAT_NEG)
data_out <= {1'b1, {(DATA_WIDTH-1){1'b0}}}; // -max
else
data_out <= accumulator_reg[ACCUM_WIDTH-2:DATA_WIDTH-1];
end
end
end
end
// ============================================================================
// Valid pipeline shift register (9-stage for BREG+MREG+5-level adder+output)
// Sync reset no DSP48 involvement but keeps reset style consistent with datapath
// Valid pipeline (11 stages: shift+pair MREG 4 adder levels output)
// ============================================================================
always @(posedge clk) begin
if (!reset_n) begin
valid_pipe <= 9'b000000000;
end else begin
valid_pipe <= {valid_pipe[7:0], data_valid};
end
if (!reset_n) valid_pipe <= 11'd0;
else valid_pipe <= {valid_pipe[9:0], data_valid};
end
// Always ready to accept new data (fully pipelined)
assign fir_ready = 1'b1;
assign fir_ready = 1'b1; // always ready fully pipelined at 1 sample/cycle
// Overflow detection
assign filter_overflow = (accumulator_reg > (2**(ACCUM_WIDTH-2)-1)) ||
(accumulator_reg < -(2**(ACCUM_WIDTH-2)));
assign filter_overflow =
(accumulator_reg > SAT_POS) || (accumulator_reg < SAT_NEG);
endmodule