Principal Engineers, Systems Reliability

T-Mobile USA, Inc.   Bothell, WA   Full-time     Engineering
Posted on June 10, 2024
Apply Now

T-Mobile USA, Inc. seeks Principal Engineers, Systems Reliability in Bothell, WA will improve and protect the software and systems behind all of T-Mobile's IT services, including management of scalability, availability, latency, performance, security, and capacity. Design and maintain CICD Pipelines to build the next generation of T-Mobile applications on cloud native platforms. Assist in creating new designs, architectures, standards, repeatable processes and methods for delivering software faster, better, and cheaper, and managing operations better, resulting in increased customer experience by continuous improvement of the operations of the applications. Demonstrate fluency in emerging DevOps-centric automation tools and technologies for CICD, configuration management, etc. for non-prod environments. Perform environment management and automated server provisioning (VMs). Deliver software to improve the availability, scalability, latency, and efficiency of T-Mobile's services. Create, manage, and use dashboard for continuous monitoring and health check of applications, and the underlying infrastructure. Contribute to future improvement of software delivery processes and operations, e.g., cloud enablement. Lead and instruct a team of Software Reliability Engineers. Manage improvement work or POCs as projects. Utilize experience in Continuous Integration/Continuous Delivery tools such as Jenkins, Cloudbees, and other automation tools. Utilize experience with DevOps tools such as Ansible, Chef, and Puppet. Utilize experience in APM tools like AppDynamics and logging tools like Splunk. Work in a cloud environment (public/private). Conduct end to end incident management: reduce the MTTD, MTTE and MTTR. Improve communication to stakeholders on impacts, mitigation, and corrective action. Conduct blameless postmortem and provide feedback to developers and architects. Provide oversight on release engineering processes and contribute to evolution of self-service model for scrum teams. Evaluate new technologies and infra enhancements required by T-Mobile enterprise (Infra foundational aspects). Partner with scrum teams on feature definition. Research end to end tracing and observability and ensure adherence to standards and maturity around observability to eliminate gaps during feature delivery. Lead and support quarterly SOX/Audit controls processes and provide proof/supporting documentation for attestation. Telecommuting is permitted, but applicants must live within a reasonable commuting distance. Experience and education requirements: PRIMARY REQUIREMENTS: Master’s degree in Electrical Engineering or related, and 5 years of relevant work experience. ALTERNATIVE REQUIREMENTS: Bachelor’s degree in Electrical Engineering or related, and 7 years of relevant work experience. In addition, the following skills are required: (1) Leveraging knowledge of DevOps (CI / CT / CD) and applying CI/CT/CD in an Agile environment to create and modify CI/CD pipeline leveraged by scrum teams for software development and releasing code to applicable environments. (2) Utilizing platform technologies and components including security, performance, optimization, and API integration to continuously optimize the application. (3) Conducting end to end incident management including reducing the MTTD, MTTE and MTTR, improving communication to stakeholders on impacts, mitigation, and corrective action, and conducting blameless postmortem and providing feedback to developers and architects. (4) Evaluating new technologies and infrastructure enhancements required by the enterprise to align with strategic architecture vision. Partnering with scrum teams on feature definition and delivery. Washington Pay Range: $145,211.00 to $192,400.00/year. The pay range above is the general base pay range for a successful candidate in the state listed. The successful candidate’s actual pay will be based on various factors, such as work location, qualifications, and experience. At T-Mobile, employees in regular, non-temporary roles are eligible for an annual bonus or periodic sales incentive or bonus, based on their role. Most Corporate employees are eligible for a year-end bonus based on company and/or individual performance and which is set at a percentage of the employee’s eligible earnings in the prior year. Certain positions in Customer Care are eligible for monthly bonuses based on individual and/or team performance, while Retail and Business Sales roles are eligible for monthly or quarterly sales incentives. And since we are ALL owners, EVERY employee at T-Mobile is eligible for an Annual Stock Grant. For information about T-Mobile’s amazing benefits, check out To apply, visit Create a candidate profile, and apply to REQ274657. EOE.