Human–agent collaboration
How developers interact with coding agents, and how multiple agents and tools coordinate to finish complex engineering tasks.
Postdoctoral Research Fellow · York University
Building trustworthy AI agents for software engineering.
I’m Jiho Shin, a postdoc at York University’s Lassonde School of Engineering. I study agentic software engineering: how humans work with agents, how agents and tools collaborate, and how reliable LLMs really are at generating, testing, and repairing code.
Toronto, ON · Canada
Research focus
From AI4SE to agentic SE
Can agents do real software engineering, can people work with them well, and can we trust what comes out?
Testing & evaluation
Unit test and oracle generation, retrieval-augmented testing, benchmarks for vulnerability detection, and metrics that actually mean something.
Repair, prediction, translation
Program repair, explainable defect prediction, code summarization and translation, and the quality of the ML libraries underneath.
- 0Peer-reviewed papers
- 0Paper awards
- 0Preprints under review
- 0Venues served as PC / reviewer
Currently
Where I am
Research · May 2026 –
York University — Postdoctoral Research Fellow
Lassonde School of Engineering. Agentic SE: human–agent interaction and multi-agent, multi-tool collaboration on real engineering work.
↗Service · 2026 – 27Web Chair, ICSME’27 · PC at ASE, ICST, MSR, FSE
Organizing and reviewing across the main SE venues, plus journal reviewing for TSE, TOSEM, EMSE, JSS, and others.
↗Selected work
Papers I’d start with
- 2026↗Retrieval-Augmented Test Generation: How Far Are We?ICSE 2026
- 2026↗SecVulEval: Benchmarking LLMs for Real-World C/C++ Vulnerability DetectionAIware 2026🏆 Best Benchmark & Dataset Award
- 2026↗StaAgent: An Agentic Framework for Testing Static AnalyzersTOSEM 2026to appear
- 2024↗Assessing Evaluation Metrics for Neural Test Oracle GenerationTSE 2024ICSE-JF 2025
Explore
Everything else
Career
Experience
Research, industry, and teaching roles.
↗AcademicEducation
Ph.D. at York; M.Sc. & B.Sc. at Handong.
↗RecognitionAwards
Thesis award, paper awards, fellowships.
↗TalksTalks & Conferences
Invited talks and conferences attended.
↗CommunityService
Program committees, reviewing, volunteering.
↗PhotosGallery
Moments from conferences and bootcamps.
↗