Lead Developer

Job Purpose

Intercontinental Exchange, Inc. (ICE) presents an opportunity for a full-time Lead Developer to our dynamic team dedicated to building and enhancing a robust data platform for processing and managing both structured and unstructured mortgage data using AI. In this role, the candidate will play a pivotal part in designing, developing, and maintaining scalable data solutions that drive business insights and operational efficiency. The ideal candidate will have a proven track record in architecting and implementing sophisticated data systems, utilizing the latest advancements in big data management, modern database technologies, and a variety of programming and scripting languages.

This position demands advanced technical proficiency, innovative problem-solving capabilities, leadership qualities, and the ability to mentor and guide team members effectively. Exceptional professionalism, proactive collaboration, and outstanding communication skills are essential. The candidate will actively engage and influence diverse stakeholders across the organization to align technical solutions with strategic business objectives. Strong written and verbal communication skills are imperative, given the candidate's responsibility to articulate complex technical concepts clearly and persuasively to both technical and non-technical audiences.

Responsibilities

The candidate will serve as a Lead Developer within our technical team, responsible for:

• Designing, developing, and overseeing a robust big data platform.
• Promoting innovation, ensuring operational excellence, and enhancing scalability across enterprise environments.

Knowledge and Experience

• Deep understanding of designing and implementing scalable, high-performance big data architectures that support both structured and unstructured data processing.
• Proven experience in building, deploying, and optimizing data platforms for large-scale data ingestion, storage, processing, and analytics.
• Advanced programming and scripting skills in Python, Shell scripting, and SQL.
• Expertise in Apache Spark, Hadoop, and Kafka for large-scale data processing and real-time data streaming.
• Proficiency with data catalog tools like AWS Glue, Apache Atlas, or Unity catalog for metadata management and data discovery.
• Hands-on experience with AWS, Azure, or Google Cloud Platform for deploying and managing cloud-based data solutions.
• Experience with Jupyter Notebooks, Pandas, and data visualization tools for data exploration and analysis.
• Knowledge of Docker, Kubernetes, and CI/CD pipelines for scalable deployment and automation.
• Strong knowledge of both relational (e.g., PostgreSQL, MySQL) and NoSQL (e.g., MongoDB, Cassandra) databases.
• Understanding of data privacy, compliance standards, and best practices for securing sensitive data.
• Experience working in Agile teams comprised of 5-8 cross-skilled engineers.
• Solid understanding of version control tools (ideally Git).
• Experience beyond using open-source tools as-is, and writing custom code on top of, or in addition to, existing open-source frameworks.
• Knowledge of continuous integration and continuous deployment (CI/CD) pipelines.
• Experience in an applied R&D environment, working in an agile and innovation-lab culture.
• Exceptional problem-solving skills and strategic thinking capabilities.
• Proven leadership abilities, including mentoring and guiding technical teams.
• Excellent written and verbal communication skills.
• Ability to effectively collaborate with and influence diverse stakeholders and teams to align technology solutions with business objectives.

Preferred Skills

• Familiarity with traditional AI techniques alongside modern Generative AI technologies.

#LI-MA1