New

Platform Principal Data Engineer

Mass General Brigham (Enterprise Services)
remote work
United States, Massachusetts, Somerville
399 Revolution Drive (Show on map)
Jul 18, 2025
The Opportunity Responsible for Data Engineering Standards CoE, driving automation and best practices to standardize and accelerate development. Responsible for overseeing the design, development, implementation, and maintenance of data solutions within the organization. Support team of data engineers, collaborating with cross-functional teams, data scientists, and business stakeholders to ensure the efficient and reliable management of data. What You'll Do -Enhance and administer the DBT and CI/CD platform architecture to improve scalability, performance, and automation. -Design and build reusable, high-performance data pipelines using technologies like Snowflake, Python, and DBT to support both operational and analytical needs. -Lead the design, development and automation of CI/CD pipelines for data workflows using Azure DevOps, Git, and orchestration tools. -Evaluate emerging features in DBT, CI/CD, and related tools; lead POCs, define adoption strategies, and support rollout to development teams. -Act as an escalation point to troubleshoot and solve technical challenges. -Leverage Python and cutting-edge AI technologies, including Large Language Models (LLMs), to automate and streamline the data management lifecycle - from intelligent metadata tagging and automated code validation to advanced data profiling and pipeline generation. -Lead Data Engineering platform collaboration sessions and actively drive standard adoption and technical best practices. -Proactively identify opportunities to innovate and expand platform capabilities in alignment with strategic goals. -Champion continuous improvement through agile delivery, platform upgrades, and process innovation. -Mentor and support engineers at all levels, fostering a strong culture of learning and technical excellence. What You'll Bring Bachelor's Degree Computer Science required or Bachelor's Degree Related Field of Study required MGB can consider experience in lieu of a degree Experience in professional information technology positions 8-10+ years required and Data warehousing development in large reporting environment(s) 5-7 years required and Experience working with data integration tools, ETL frameworks, and workflow management systems (e.g., Apache Airflow) required. 2+ years of hands-on experience in DBT tool development and administration. Experience in CI/CD pipeline development using Azure DevOps and Azure Git, including repository management and enforcing best practices. Experience with AI/ML technologies, including LLMs, to support platform automation and innovation.Strong attention to detail and a proactive approach to process improvement and standards development. Python experience. Highly Preferred: Proficient with DBT tool, comfortable designing, developing, and performing admin tasks. Strong understanding of CI/CD processes using Azure DevOps or Git. Skills for Success Expertise in data engineering principles, data modeling, ETL development, and data warehousing. Hands-on experience with DBT, CI/CD pipelines, and cloud data platforms (Azure, Snowflake). Strong ability in building data pipelines using Snowflake features ( Snowpipe, SnowSQL, Snow Sight, Data Streams ). Proficiency in working with relational databases (e.g., SQL Server, Oracle, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra). Working Model Hybrid required, Onsite 1-3x weekly, local or willing to relocate is required for weekly or at least 4x monthly M-F Eastern Business Hours required Remote work requires stable, secure, quiet, compliant work station Mass General Brigham Incorporated is an Equal Opportunity Employer. By embracing diverse skills, perspectives and ideas, we choose to lead. All qualified applicants will receive consideration for employment without regard to race, color, religious creed, national origin, sex, age, gender identity, disability, sexual orientation, military service, genetic information, and/or other status protected under law. We will ensure that all individuals with a disability are provided a reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment.