Google-MTA collaboration leverages smartphone tech for subway improvements
The Metropolitan Transportation Authority (MTA) in New York City has partnered with Google for a groundbreaking pilot program focused on enhancing the reliability of its old subway network. Utilizing Google’s mobile technology, the effort aims to detect and resolve rail problems before they cause service interruptions. Named “TrackInspect,” the project signifies a considerable advancement in applying artificial intelligence and contemporary technology to public transportation.
Beginning in September 2024 and wrapping up in January 2025, the pilot project involved equipping certain subway cars with Google Pixel smartphones. These phones were responsible for gathering sound and vibration information to identify possible track issues. This data was subsequently evaluated by Google’s AI systems in the cloud, which identified zones that needed further examination by MTA staff.
“In recognizing the initial indicators of track deterioration, we not only decrease maintenance expenses but also lessen disruptions experienced by passengers,” stated Demetrius Crichlow, the president of New York City Transit, in a statement issued in late February.
The collaboration between the MTA and Google forms part of a wider initiative to update New York’s 120-year-old subway network, which still struggles with issues tied to its outdated infrastructure and regular delays. Although the pilot program showed encouraging outcomes, uncertainties persist regarding the potential expansion of TrackInspect due to the MTA’s budgetary limitations.
Addressing delays through AI and smartphones
Tackling delays with AI and smartphones
El programa TrackInspect se centra en abordar un aspecto crucial del problema: detectar y solucionar problemas mecánicos antes de que se agraven. Durante la prueba piloto, se instalaron seis teléfonos Google Pixel en cuatro vagones R46 del metro, reconocidos por sus asientos de color naranja y amarillo. Los dispositivos registraron 335 millones de lecturas de sensores, más de un millón de datos de GPS y 1,200 horas de audio.
Los teléfonos inteligentes se colocaron estratégicamente tanto dentro como debajo de los vagones del metro. Los dispositivos externos estaban equipados con micrófonos para captar sonidos y vibraciones, mientras que los internos tenían los micrófonos desactivados para evitar grabar conversaciones de los pasajeros. En cambio, estos dispositivos se concentraban únicamente en las vibraciones para identificar anomalías en las vías.
Rob Sarno, serving as an assistant chief track officer for the MTA, was integral to the project. His duties involved examining audio clips that the AI system flagged for potential track issues. “The system pinpoints zones with unusual decibel levels, possibly signaling loose joints, damaged rails, or other defects,” Sarno elaborated.
The A train line was selected for the pilot, providing a varied testing environment with both subterranean and elevated tracks. It also featured segments of newly built infrastructure, which served as a benchmark for analysis. Although not every delay on the A line is due to mechanical issues, the data gathered during the pilot could assist in resolving persistent problems and enhancing overall service.
The A train line, chosen for the pilot, offered a diverse testing environment with both underground and above-ground tracks. It also included sections of recently constructed infrastructure, providing a baseline for comparison. While not all delays on the A line are caused by mechanical issues, the data captured during the pilot could help address recurring problems and improve overall service.
The TrackInspect initiative produced promising results, as the AI system accurately identified 92% of defect locations that were confirmed by MTA inspectors. Sarno estimated his own accuracy rate in anticipating track defects from audio data to be approximately 80%.
The initiative also featured an AI-driven tool based on Google’s Gemini model, enabling inspectors to inquire about maintenance procedures and repair records. This conversational AI furnished inspectors with straightforward, actionable insights, which further streamlined the maintenance workflow.
The program also included an AI-powered tool based on Google’s Gemini model, which allowed inspectors to ask questions about maintenance protocols and repair history. This conversational AI provided inspectors with clear, actionable insights, further streamlining the maintenance process.
Google participated in the pilot as part of a proof-of-concept initiative that was provided at no expense to the MTA. However, broadening the program would probably demand substantial investment, making financing a key factor for those making decisions.
Google’s involvement in the pilot was part of a proof-of-concept initiative developed at no cost to the MTA. However, expanding the program would likely require significant investment, making funding a major consideration for decision-makers.
A growing trend in transit innovation
New York’s partnership with Google is part of a broader trend in which cities worldwide are adopting artificial intelligence and smart technologies to improve public transit systems. For example, New Jersey Transit has used AI to analyze passenger flow and crowd management, while the Chicago Transit Authority has implemented AI-driven security measures to detect weapons. In Beijing, facial recognition technology has been introduced as an alternative to traditional transit tickets, reducing wait times during peak hours.
La red de metro de la MTA es la más grande de Estados Unidos, brindando servicio las 24 horas en muchas de sus líneas. Este funcionamiento continuo añade otra capa de complejidad a los esfuerzos de mantenimiento, ya que las reparaciones y mejoras a menudo deben realizarse junto al servicio activo. Con el uso de tecnología de inteligencia artificial y teléfonos inteligentes, el programa TrackInspect podría ayudar a la MTA a enfrentar estos desafíos de manera más eficiente.
The MTA’s subway network is the largest in the United States, with 24-hour service on many lines. This round-the-clock operation adds another layer of complexity to maintenance efforts, as repairs and upgrades often need to be conducted alongside active service. By using AI and smartphone technology, the TrackInspect program could help the MTA address these challenges more efficiently.
Although the TrackInspect pilot has concluded, the MTA is investigating collaborations with additional technology providers to further improve its maintenance procedures. The agency is also evaluating data from the pilot to assess its effects on minimizing delays and enhancing service. Initial signs indicate that specific types of delays, including those from braking problems and track defects, declined on the A line during the pilot. However, the MTA warns that more analysis is required to verify a direct connection to the program.
While the TrackInspect pilot has ended, the MTA is exploring partnerships with other technology providers to further enhance its maintenance processes. The agency is also analyzing data from the pilot to determine its impact on reducing delays and improving service. Early indications suggest that certain types of delays, such as those caused by braking issues and track defects, decreased on the A line during the pilot period. However, the MTA cautions that further analysis is needed to confirm a direct link to the program.
Reflecting on the project, Sarno highlights the promise of AI-driven solutions to revolutionize public transit. “This technology enables us to identify issues sooner, act more swiftly, and ultimately offer improved service to our passengers,” he stated.
As Sarno reflects on the project, he emphasizes the potential of AI-driven solutions to transform public transportation. “This technology allows us to detect problems earlier, respond faster, and ultimately provide better service to our customers,” he said.
The MTA’s collaboration with Google underscores the potential of public-private partnerships to drive innovation in critical infrastructure. Whether TrackInspect becomes a permanent fixture in New York’s subway system remains to be seen, but its success highlights the possibilities of integrating cutting-edge technology into the daily lives of commuters.