As a Data Engineer III, you will join a small and growing team of Data Engineers. You will work on new and existing data pipelines for NTT Security’s core products and contribute to drive business value based on data.
Designing and implementing data pipelines from scratch.
Improving existing data pipelines while addressing performance and scaling.
Implementing proof-of-concept prototypes for data collection, extraction and transformation logic.
Operating in position of Technical Lead for data platforms.
Working closely with product architects, product management and other engineering teams.
Contributing to product planning discussions by estimating engineering effort.
B.S. degree in Computer Science or related field with 8+ years of industry experience.
Experience designing data pipelines with SQL/NoSQL databases and Hadoop Ecosystem.
Experience solving performance and scaling problems for multi-terabyte data set.
Excellent programming skills in one or more of these languages: Java, Python, Scala
Ability to quickly understand business requirements and transform them into data models.
3+ years experience in position of Technical Lead.
Experience with ETL architecture and SQL.
Experience with messaging systems such as Kafka is a major plus.
Experience building systems with Lambda Architecture is a major plus.
Expertise in scripting languages like perl/bash.
Experience in productivity tools such as Jira, Git, Confluence is a plus.