As the world moves towards 21st-century education, it’s not surprising more schools and jurisdictions adopting digital math tools or applications for various purposes. Usually, when these tools are adopted for the first time, they are being used to systematically pilot them. Since adopting these tools have associated costs, it’s necessary to determine whether such tools represent a valuable use of resources. This also highlights the importance of rigorously evaluating them if they promote better student outcomes. Valuable insights are needed before deciding whether to scale up or completely abandon the technology.