../

SANGAM: SystemVerilog Assertion Generation via Monte Carlo Tree Self-Refine

Year
2025
Authors
Adarsh Gupta, Bhabesh Mali, Chandan Karfa
DOI
10.1109/ICLAD65226.2025.00024

Related

Persistent Notes

  • Their approach essentially involves a lot of prompt enginerring.
  • They have these “different” LLMs, like in fangAssertLLMGeneratingEvaluating2024, which perform a specific task
  • Test on I2C and rv-timer
  • I am assuming that the number of assertions generated are all correct as I cannot find the correct %
  • The have listed the following coverage metrics
    • Branch
    • Property
    • Toggle
  • They used Deepseek-R1

In-text annotations

“industry-level specifications” Page 180

“I. INTRODUCTION” Page 180

“It involves three custom LLMs: Spec Analyzer, Signal Mapper, and Waveform Analyzer." Page 180

“II. BACKGROUND AND RELATED WORKS” Page 180

“B. LLM for Assertion Generation” Page 181

“The authors of [13] have generated hardware security assertions using LLM and also contributed to providing a comprehensive benchmark suite consisting of real-world hardware designs and corresponding golden assertions." Page 181

“C. Monte Carlo Tree Search (MCTS)" Page 181

“open-source DeepSeek-R1 model” Page 181

“III. SANGAM” Page 181

“A. Stage 1: Specification Processing” Page 181

“This stage involves the utilization of three different LLMs for specification processing. They are: Signal Mapper, Spec Analyzer, and Waveform Analyzer." Page 181

“The design specification file is provided as an input file to the LLM in PDF format." Page 181

“B. Stage 2: Assertion Generation” Page 182

“C. Stage 3: Assertion Combination” Page 183

“IV. EXPERIMENTATION, RESULTS AND DISCUSSION” Page 183

“nter-Integrated Circuit (I2C), and RISC-V Timer (RV-Timer) to compare our results with the state-of-the-art methods, AssertLLM [12] and ChIRAAG [2]. We have used the DeepSeek-R1 model to create all the LLM agents for experimentation." Page 183

“A. Implementation Details” Page 184

“B. Results and Discussion” Page 184

“Coverage Application." Page 184

“V. CONCLUSION AND FUTURE WORK” Page 185

%% Import Date: 2026-01-02T17:15:34.251-05:00 %%