Description

As a Senior Data Engineer within our Delivery Intelligence Group, you will be responsible for designing, developing, and maintaining efficient data workflows and associated cloud infrastructure that support BrightDrop’s core analytic products and services. You will work closely with our data scientists, DevOps, and software engineers to automate pipelines that transform data in the BrightDrop data lakehouse into deployable data models that power our automated fleet insights and visualizations as well as emerging machine learning, optimization, and AI applications. The ideal candidate will have experience standing up ELT pipelines to handle massive volumes of spatiotemporal data, designing enterprise data warehouse models, implementing robust data quality tests, and using data pipeline-as-code integration systems to ensure the smooth and efficient orchestration of the workflows powering our analytics platform.

Responsibilities:

Architect, implement, and maintain ELT pipelines in our cloud-native data lakehouse platform.
Work with data scientists to turn exploratory analyses into production data transformation workflows within our multihop data lakehouse architecture.
Support enterprise-wide use of BI tools and assist in developing internal and external analytics products (e.g., dashboards).
Generate and deploy feature engineering pipelines to power internal and customer-facing machine learning-based products.
Maintain data quality testing and monitoring tools.
Work with information security, DevOps, and DataOps to maintain data classification, auditing, and access and cost control policies.

Additional Description

Required:

Bachelors degree (Master’s preferred) or equivalent experience in computer science, data science, engineering, or related quantitative field
5+ years of industry experience developing, implementing, and maintaining solutions for Big Data or data warehousing systems
3+ years of industry experience working in a cloud environment (Azure preferred)
3+ years experience working with SQL query authoring for automated data transformation (familiarity with dbt preferred, but not required).
2+ years of experience developing streaming data loading pipelines (use of Spark/pySpark preferred)
Basic understanding of machine learning/statistical learning principles
Experience implementing and maintaining data workflow orchestration and integration tools (e.g. Airflow/Astro, Prefect, dbt cloud, etc.)
Understanding of and experience with application of data quality tools integrated with CI/CD automation frameworks in functional deployment environments (e.g., Github Actions/Azure DevOps pipelines).
Familiarity with data quality testing frameworks (Great Expectations, Deequ)
Self-driven with an interest in on-the-job learning.

Preferred:

Familiarity with enterprise warehouse data modeling techniques (e.g., Kimball)
Experience integrating simulation systems with distributed, data-intensive processing or analytics applications

Desired:

Working familiarity with terraform
Domain knowledge in transportation and energy systems, graph algorithms, convex optimization, and/or reinforcement learning
Engagement with modern data stack community (open source and commercial)
Passion for transportation decarbonization
High degree of attention to software craftsmanship and professionalism
Experience working with containerization technologies and orchestration platforms (specifically Docker and Kubernetes)

#LI - Hybrid

The expected base compensation for this role is: ($106,460 - $161,240 USD Annual). Actual base compensation within the identified range will vary based on factors relevant to the position.

Bonus Potential: An incentive pay program offers payouts based on company performance, job level, and individual performance.

Benefits: GM offers a variety of health and wellbeing benefit programs. Benefit options include medical, dental, vision, Health Savings Account, Flexible Spending Accounts, retirement savings plan, sickness and accident benefits, life insurance, paid vacation & holidays, tuition assistance programs, employee assistance program, GM vehicle discounts and more.

About GM

Our vision is a world with Zero Crashes, Zero Emissions and Zero Congestion and we embrace the responsibility to lead the change that will make our world better, safer and more equitable for all.

Why Join Us

We aspire to be the most inclusive company in the world. We believe we all must make a choice every day – individually and collectively – to drive meaningful change through our words, our deeds and our culture. Our Work Appropriately philosophy supports our foundation of inclusion and provides employees the flexibility to work where they can have the greatest impact on achieving our goals, dependent on role needs. Every day, we want every employee, no matter their background, ethnicity, preferences, or location, to feel they belong to one General Motors team.

Total Rewards | Benefits Overview

From day one, we're looking out for your well-being–at work and at home–so you can focus on realizing your ambitions. Learn how GM supports a rewarding career that rewards you personally by visiting Total Rewards resources.

Diversity Information

General Motors is committed to being a workplace that is not only free of discrimination, but one that genuinely fosters inclusion and belonging. We strongly believe that workforce diversity creates an environment in which our employees can thrive and develop better products for our customers. We understand and embrace the variety through which people gain experiences whether through professional, personal, educational, or volunteer opportunities. GM is proud to be an equal opportunity employer.

We encourage interested candidates to review the key responsibilities and qualifications and apply for any positions that match your skills and capabilities.

Equal Employment Opportunity Statements

The policy of General Motors is to extend opportunities to qualified applicants and employees on an equal basis regardless of an individual's age, race, color, sex, religion, national origin, disability, sexual orientation, gender identity/expression or veteran status. Additionally, General Motors is committed to being an Equal Employment Opportunity (EEO) Employer and offers opportunities to all job seekers including individuals with disabilities. If you need a reasonable accommodation to assist with your job search or application for employment, email us at Careers.Accommodations@GM.com or call us at 800-865-7580. In your email, please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying.