GenAI Utilization and Impact
Overview: Monitor the adoption, engagement, and outcomes of each GenAI tool separately and measure the overall ROI of your GenAI investment.
| Feature | Source | POC | Description | Actionable Insight |
|---|---|---|---|---|
| GenAI Adoption Rate | GenAI API | ✅ | % of devs using tools (Copilot, Codium, Augment) | Target low-usage teams |
| Activities Impacted by GenAI tools | Git + GenAI API | ✅ | Code, test commits and reviews impacted by GenAI tools | Quantify real GenAI contribution |
| Active Users | GenAI API | ✅ | Number of monthly/weekly unique users | Promote deeper adoption |
| Usage Distribution | GenAI API | ✅ | Frequency breakdown (Rare–Regular) | Move users up the curve |
| Engagement Patterns | GenAI API | ✅ | Usage by language/command | Tailor training/adoption plans |
| Developers per Product | GenAI API | ✅ | Adoption by product/team | Prioritize enablement by area |
| Accepted Code Completion Suggestions | GenAI API | ✅ | Percentage of acceptances out of total suggestions | Measure suggestion quality and developer trust |
| Commits Impacted by GenAI | GenAI API | ✅ | Code blend of GenAI impacted commits out of all commits over time | Assess adoption growth over time |
| Qodo Gen: Impacted PRs | Qodo | ✅ | Percentage of PRs impacted by Qodo out of all PRs | Understand reach of GenAI on review workflows |
| Qodo Gen: Impacted LOCs | Qodo | ✅ | Percentage of LOCs written by/with the assistance of Qodo Gen out of total | Evaluate deeper tool engagement |
| Productivity Impact | GenAI API + Git | ✅ | Impact on cycle time, bugs, code longevity | Prove value or adjust |