AbstractImplementing tighter intensity modulated radiation therapy (IMRT) quality assurance (QA) tolerances initially resulted in high numbers of marginal or failing QA results and motivated a number of improvements to our calculational processes. This work details those improvements and their effect on results. One hundred eighty IMRT plans analyzed previously were collected and new gamma criteria were applied and compared to the original results. The results were used to obtain an estimate for the number of plans that would require additional dose volume histogram (DVH)‐based analysis and therefore predicted workload increase. For 2 months and 133 plans, the established criteria were continued while the new criteria were applied and tracked in parallel. Because the number of marginal or failing plans far exceeded the predicted levels, a number of calculational elements were investigated: IMRT modeling parameters, calculation grid size, and couch top modeling. After improvements to these elements, the new criteria were clinically implemented and the frequency of passing, questionable, and failing plans measured for the subsequent 15 months and 674 plans. The retrospective analysis of selected IMRT QA results demonstrated that 75% of plans should pass, while 19% of IMRT QA plans would need DVH‐based analysis and an additional 6% would fail. However, after applying the tighter criteria for 2 months, the distribution of plans was significantly different from prediction with questionable or failing plans reaching 47%. After investigating and improving several elements of the IMRT calculation processes, the frequency of questionable plans was reduced to 11% and that of failing plans to less than 1%. Tighter IMRT QA tolerances revealed the need to improve several elements of our plan calculations. As a consequence, the accuracy of our plans have improved, and the frequency of finding marginal or failing IMRT QA results, remains within our practical ability to respond.
A clinically relevant IMRT QA workflow: Design and validation
PurposeThe purpose of this study was to determine clinically relevant pass/question/fail criteria for gamma analysis of intensity‐modulated radiation therapy quality assurance (IMRT QA) plans, identify which plans should be further analyzed with dose–volume histogram (DVH) metrics, and create a workflow for performing that DVH‐based analysis.MethodsA total of 11 plans, 5 prostate and 6 head/neck, were selected to represent known good plans based on their high‐passing rate using conventional IMRT QA criteria. These were modified by moving the programmed MLC positions to underdose the target or overdose important structures by varying amounts. Commercially available hardware/software was used to measure and analyze all plans (76 total) using 4%/3 mm, 3%/3 mm, 3%/2 mm, and 2%/2 mm gamma criteria. Two receiver operator characteristic (ROC) curves per criterion were created to assess effective passing rates. One ROC curve was to find a higher threshold that determined a clear pass and the second to find a lower threshold to determine a clear failure. Plans between these two thresholds need DVH‐based analysis to assess the clinical consequence of the dose difference. The modified plans were analyzed in the planning system and reconstructed in commercially available DVH‐based analysis software to access the accuracy and usefulness of the software.ResultsAnalysis of the ROC curves showed optimal pass and fail thresholds for plan error detection per criterion to achieve clinically relevant sensitivity and specificity. Based on measurement uncertainty and pass/fail ranges, 3%/2 mm gamma criteria with a pass threshold of 95% and a fail threshold of 90% were most optimal. DVH analysis showed good agreement with all reconstructed plans except where the changes to the MLC patterns caused the periphery of the target to be underdosed. For questionable plans, comparing the organ‐specific DVHs to the physician‐provided planning constraints proved to be an efficient and effective workflow since plans for which the target dose was slightly high or where organs at risk were underdosed could be released for the treatment without consulting the physician for a clinical decision.ConclusionThis work indicates the potential for appreciable improvement in error detection for IMRT QA. Using effective pass/fail thresholds to determine plans that need DVH‐based analysis minimizes the need for excessive, time‐consuming, analysis, and making use of the dosimetric constraints of the plan minimizes the burden on physicians. Overall, DVH‐based analysis is a powerful tool that can provide substantial insight over the traditional approach that does not provide structure‐specific data.