Software Engineer, Metrics Frameworks

The Role  

As a Software Engineer on the Metrics Frameworks team, you will lead the development of tooling to monitor and improve our pipelines’ data quality. These pipelines support road event monitoring, data mining and training, and simulation metrics.  We are seeking an experienced software/data engineer to build telemetry, data quality inspection tooling, dashboards, and alerting that establish guardrails on data quality (e.g., delay, accuracy, completeness). Your work will increase confidence in our data and downstream metrics for internal customers. These metrics will support and accelerate feature design, prioritization, and development, as well as evaluate the impact of newly released features.   

About the Organization:  The Metrics Frameworks team falls within the Simulation, Evaluation, and Data organization, which is dedicated to advancing the development of autonomous vehicles through cutting-edge simulation technologies. The Metrics Frameworks team focuses on creating, maintaining, and evolving the analytics framework that supports GM's goal of safe, high-performing, and scalable driverless technology. The team delivers robust and scalable tools that facilitate data-driven decision-making throughout the AV feature development lifecycle. We collaborate closely with Simulation Evaluation, Embodied AI, and System and Test Engineering teams, enhancing productivity across the organization by developing automation tools and shared libraries. We are accountable for the performance, reliability, and scalability OKRs of the analytics framework. This includes, but is not limited to: developing customized analytics workflows; improving operational telemetry and dashboards to track relevant KPIs for prioritization; and identifying, designing, and implementing solutions to achieve key results.  

What You’ll Do

• Lead the design, implementation, and roadmap development for tooling that monitors data quality from various sources (simulation, road, etc.) and empowers users to debug data issues and build quantitative analysis pipelines.  

• Accelerate the team’s effectiveness by designing and implementing scalable automation tools for inspecting data ingestion, processing, inspection, debugging, and performance monitoring.  

• Build and optimize data processing pipelines to handle large volumes of testing data, enabling low-latency insights for AV testing performance. 

• Collaborate with other frameworks and data infra teams to build and deploy tools that improve developer productivity and data reliability.  

• Work closely with autonomous vehicle engineering teams to enable rapid iteration, model feedback, and metrics-driven decision-making. 

• Maintain a high technical bar for code quality and system design through architectural and code reviews. 

Your Skills & Abilities

• Experience with writing Python in a production environment (unit testing, code review, algorithm performance and tradeoffs, etc.) 

• Experience with OLAP databases and SQL related technologies (e.g., Big Query, Databricks, DuckDB, etc) 

• Experience with data orchestration and transformation tools like Airflow, DBT, etc 

• Experience developing scalable software and data solutions used by many developers and stakeholders and capable of processing petabytes of data  

• Experience with time-series data analysis and online performance monitoring tools 

• Experience developing automation scripts (Python and Bash scripts)  

• BS in Computer Science, Computer Engineering, Electrical Engineering, Mechanical Engineering, or Aerospace Engineering  

• 5+ years of industry experience  

• Strong organizational and communication skills  

What Will Give You A Competitive Edge

• Familiarity with ROS, Python bindings for C++, and plotting/visualization libraries 

• Experience working in the Autonomous Vehicle or Robotics industry  

• Experience with full-stack languages and frameworks, such as Nest.js, React, Django, etc.  

• Knowledge of machine learning frameworks and their application in testing automation and metrics generation. 

• Experience building high performance framework / infrastructure and performance optimization in C++ 

• Experience working within a monorepo and using Bazel 

Compensation