Data Engineer

M9 Solutions is seeking aData Engineer to work on a government contract for a client located inWashington, DC. An active Top Secret/SCI clearance is required.

Responsibilities

• Interpret business needs and select appropriate technologies in implementing data of shared and/or master sets of data.
• Work with key business stakeholders, IT experts, and subject-matter experts to plan and deliver optimal data solutions.
• Create, maintain, and optimize data pipelines as workloads move from development to production for specific use cases to ensure seamless data flow for the use case.
• Perform technical and non-technical analyses on project issues and help to ensure technical implementations follow quality assurance metrics.
• Analyze data and systems architecture, create designs, and implement information systems solutions.
• Define and communicate a clear product vision for client's software products, aligning with user needs and business objectives.
• Create and manage product roadmaps that reflect both innovation and growth strategies.
• Develop and design data pipelines to support an end-to-end solution.
• Develop and maintain artifacts (e.g. schemas, data dictionaries, and transforms related to extract, transform (ETL) processes).
• Integrate data pipelines with AWS Cloud services to extract meaningful insights.
• Manage production data within multiple datasets ensuring fault tolerance and redundancy.
• Design and develop robust and functional dataflows to support raw data and expected data.
• Provide technical support for deployed applications and dataflows.
• Collaborate with the data engineering team to design and launch new features.
• Coordinate and document dataflows, capabilities, etc.
• Support off-hours deployment such as evening or weekends.
• Coordinate with other team members to reach project milestones and deadlines.

Required Skills and Qualifications

• Work Authorization: US Citizenship is required.
• An active Top Secret/SCI clearance is required.
• Bachelor's degree or equivalent experience in lieu of degree.
• Knowledge of Cloud architectures and enabling tools and technologies, such as, AWS Cloud.
• Familiar with AWS.
• Knowledge with software platforms and services, such as, Docker, Kubernetes, JMS/SQS, SNS, Kafka, AWS Lambda, NiFi, Airflow, or similar.
• Experience utilizing JavaScript, Elasticsearch, JSON, SQL, XML.
• Knowledge with datastores MongoDB/DynamoDB, PostgreSQL, S3, Redshift, JDBC/ODBC, and Redis.
• Familiar with Linux/Unix server environments.
• Experience with Agile development methodology and publishing and/or presenting design reports.
• Knowledge with Collaboration tools, such as, Jira and Confluence.
• Experience with stakeholder management, ETL, data pipelines, effective team communication, product management, data engineering, data management, master data management, agile, intelligence community, and client engagement.

Preferred Skills and Qualifications

• Master's degree or equivalent experience in a related field.
• Familiarity and experience with the intelligence community and the intel cycle.
• Experience with Cloud message APIs and usage of push notifications.
• Interest in learning and using the latest software tools, methods, and technologies to solve real world problems sets vital to national security.
• Knowledge of public keys and digital certificates.
• Experience with DevOps environments and Cloud message APIs and usage of push notifications.
• Specialization in object-oriented programming languages, scripting, and databases.