Sr Data Engineer

Location and contract:

Candidates located in the US will be taken into consideration, please note that this is a contractor role with the opportunity to become a FTE

The role

As part of the Direct-to-Consumer Decision Sciences team, the Data Engineer will be responsible for creating a connected data ecosystem that unleashes the power of our streaming data. We gather data from across all customer/prospect journeys in near real-time, to allow fast feedback loops across territories; combined with our strategic data platform, this data ecosystem is at the core of being able to make intelligent customer and business decisions.

In this role, the Data Engineer will share responsibilities in the development and maintenance of an optimized and highly available data pipelines that facilitate deeper analysis and reporting by the business, as well as support ongoing operations related to the Direct to Consumer data ecosystem

Responsibilities 

• Help manage a high-performance team of Data Engineers
  
• Provide guidance in the designing, building, testing, scaling, and maintaining of data pipelines from a variety of sources (Internal, third party, cloud based, etc.), according to business and technical requirements
• Deliver observable, reliable and secure software, embracing “you build it you run it” mentality, and focus on automation and GitOps
  
• Continually work on improving the codebase and have active participation and oversight in all aspects of the team, including agile ceremonies
  
• Take an active role in story definition, assisting business stakeholders with acceptance criteria
  
• Work with Principal Engineers and Architects to share and contribute to the broader technical vision
  
• Develop and champion best practices to improve the efficiency of the team, striving towardse xcellence and raising the bar within the department
  
• Operationalize data processing systems utilizing DevOps principles

Qualifications

• 5+ years relevant experience in Data Engineering
• Experience of near Real Time & Batch Data Pipeline development in a similar Big Data Engineering role
  
• Programming skills an object oriented programming language such as Python, Java, or Scala and experience in writing reusable/efficient code to automate analysis and data processes 
  
• Experience in processing structured and unstructured data into a form suitable for analysis and reporting with integration with a variety of data metric providers ranging from advertising, web analytics, and consumer devices
  
• Experience implementing scalable, distributed, and highly available systems using Google Cloud
  
• Hands on programming experience of the following (or similar) technologies: Apache Beam, Scio, Apache Spark, and Snowflake
  
• Experience in progressive data application development, working in large scale/distributed SQL, NoSQL, and/or Hadoop environment
  
• Develop data catalogs and data cleanliness to ensure clarity and correctness of key business metrics
  
• Experience building streaming data pipelines using Kafka, Spark, or Flink
  
• Data modelling experience (operationalizing data science models/products) a plus

About the company

 NBC Universal owns and operates over 20 different businesses across 30 countries including a valuable portfolio of news and entertainment television networks, a premier motion picture company, significant television production operations, a leading television stations group, and world-renowned theme parks and a premium ad-supported streaming service.

There you can be your authentic self. As a company uniquely positioned to educate, entertain and empower through our platforms, Comcast NBC Universal stands for including everyone. They strive to foster a diverse and inclusive culture where our employees feel supported, embraced and heard. NBC Universal believes that it's workforce should represent the communities we live in so that together, they can continue to create and deliver content that reflects the current and ever-changing face of the world.