Publications

Papers on code, tests, and trust.

Conference papers, journal articles, and preprints across AI for SE, code intelligence, testing, and defect prediction.

Google Scholar ↗
  • 2026
    Demystifying Checker Bugs in Deep Learning Libraries
    Nima Shiri Harzevili, Mohammad Mahdi Mohajer, Jiho Shin, Moshi Wei, Gias Uddin, Jinqiu Yang, Junjie Wang, Song Wang, Zhen Ming (Jack) Jiang, Nachiappan Nagappan
    ICSME 2026to appear
    ↗
  • 2026
    SecVulEval: Benchmarking LLMs for Real-World C/C++ Vulnerability Detection
    Md Basim Uddin Ahmed, Nima Shiri Harzevili, Jiho Shin, Hung Viet Pham, Song Wang
    AIware 2026🏆 Best Benchmark & Dataset Award
    ↗
  • 2026
    Retrieval-Augmented Test Generation: How Far Are We?
    Jiho Shin, Nima Shiri Harzevili, Reem Aleithan, Hadi Hemmati, Song Wang
    ICSE 2026
    ↗
  • 2026
    StaAgent: An Agentic Framework for Testing Static Analyzers
    Elijah Nnorom, Md Basim Uddin Ahmed, Jiho Shin, Hung Viet Pham, Song Wang
    TOSEM 2026to appear
    ↗
  • 2026
    From Cool Demos to Production-Ready FMware: Core Challenges and a Technology Roadmap
    Gopi Krishnan Rajbahadur, Gustavo A. Oliva, Dayi Lin, Jiho Shin, Ahmed E. Hassan
    TOSEM 2026
    ↗
  • 2026
    Surveying the Benchmarking Landscape of Large Language Models in Code Intelligence
    Mohammad Abdollahi, Ruixin Zhang, Nima Shiri Harzevili, Jiho Shin, Song Wang, Hadi Hemmati
    TOSEM 2026
    ↗
  • 2026
    Toward Automated Validation of Language Model Synthesized Test Cases using Semantic Entropy
    Hamed Taherkhani, Jiho Shin, Muhammad Ammar Tahir, Md Rakib Hossain Misu, Vineet Sunil Gattani, Hadi Hemmati
    TSE 2026
    ↗
  • 2026
    Trajectory-Aware Benchmark Subset Selection for Cost-Efficient Software Engineering Agent Regression Testing
    Mahmoud Ayyad, Zehao Wang, Jiho Shin, Ying Zou, Bram Adams
    arXiv 2026under review
    ↗
  • 2026
    NeuroTestGen: Neuro-Symbolic Guided Test Generation with Large Language Models
    Ruixin Zhang, Jiho Shin, Hung Viet Pham, Song Wang
    arXiv 2026under review
    ↗
  • 2026
    A Large-Scale Empirical Study of Quality Assurance Practices and Gaps in AI Agents
    Wuyang Dai, Moses Openja, Jiho Shin, Hung Viet Pham, Song Wang
    arXiv 2026under review
    ↗
  • 2026
    Testing Large Vision-Language Models: A Systematic Review
    Moses Openja, Wuyang Dai, Jiho Shin, Nikta Akbarpour, Claire Davies, Alvine Boaye Belle, Hung Viet Pham, Gias Uddin, Song Wang
    HAL 2026under review
    ↗
  • 2025
    Pre-trained Models for Bytecode Instructions
    Donggyu Kim, Taemin Kim, Jiho Shin, Song Wang, Heeyoul Choi, Jaechang Nam
    ICST 2025short paper
    ↗
  • 2025
    Prompt Engineering or Fine-Tuning: An Empirical Assessment of LLMs for Code
    Jiho Shin, Clark Tang, Tahmineh Mohati, Maleknaz Nayebi, Song Wang, Hadi Hemmati
    MSR 2025
    ↗
  • 2025
    BloomAPR: A Bloom’s Taxonomy-based Framework for Assessing the Capabilities of LLM-Powered APR Solutions
    Yinghang Ma, Jiho Shin, Leuson Da Silva, Zhen Ming (Jack) Jiang, Song Wang, Foutse Khomh, Shin Hwei Tan
    arXiv 2025under review
    ↗
  • 2024
    Domain Adaptation for Code Model-Based Unit Test Case Generation
    Jiho Shin, Sepehr Hashtroudi, Hadi Hemmati, Song Wang
    ISSTA 2024
    ↗
  • 2024
    Assessing Evaluation Metrics for Neural Test Oracle Generation
    Jiho Shin, Hadi Hemmati, Moshi Wei, Song Wang
    TSE 2024ICSE-JF 2025
    ↗
  • 2023
    An Empirical Study on the Stability of Explainable Software Defect Prediction
    Jiho Shin, Reem Aleithan, Jaechang Nam, Junjie Wang, Nima Shiri Harzevili, Song Wang
    APSEC 2023🏆 Distinguished Paper Award
    ↗
  • 2023
    Automatic Static Vulnerability Detection for Machine Learning Libraries: Are We There Yet?
    Nima Shiri Harzevili, Jiho Shin, Junjie Wang, Song Wang, Nachiappan Nagappan
    ISSRE 2023
    ↗
  • 2023
    Characterizing and Understanding Software Security Vulnerabilities in Machine Learning Libraries
    Nima Shiri Harzevili, Jiho Shin, Junjie Wang, Song Wang, Nachiappan Nagappan
    MSR 2023
    ↗
  • 2023
    The Good, the Bad, and the Missing: Neural Code Generation for Machine Learning Tasks
    Jiho Shin, Moshi Wei, Junjie Wang, Lin Shi, Song Wang
    TOSEM 2023
    ↗
  • 2022
    API Recommendation for Machine Learning Libraries: How Far Are We?
    Moshi Wei, Yuchao Huang, Junjie Wang, Jiho Shin, Nima Shiri Harzevili, Song Wang
    ESEC/FSE 2022
    ↗
  • 2021
    A Survey of Automatic Code Generation from Natural Language
    Jiho Shin, Jaechang Nam
    JIPS 2021
    ↗
  • 2020
    Similar Patch Recommendation for Actionable Defect Prediction
    Jiho Shin, Jaechang Nam
    KCSE 2020🏆 Distinguished Paper Award
    ↗