Sr. Data Engineer
Pluto TV
West Hollywood, CAThis was removed by the employer on 1/29/2021 2:34:00 PM PST
Not to worry we have many other jobs on the site;
Browse all jobs
Browse the IS/IT Category
Search for Sr. Data Engineer jobs in West Hollywood-CA
Search all Sr. Data Engineer postings
Full Time Job
Overview and Responsibilities
The Sr. Data Engineer for streaming will be responsible for supporting and enhancing our Kafka and Kinesis based streaming data collection platforms. The ideal candidate will need to have hands-on experience with Kafka (open source or Confluent) and AWS Kinesis. The candidate must have proven experience working on cloud platforms and be very familiar with AWS. A strong working knowledge of kafka components namely Topics, Producer/Consumer, KStream, KTable, KSQL is a basic prerequisite. Also Kinesis components including streams, firehose and data analytics are definitely desired. The candidate should have worked on streaming systems that handle very large volume and high-velocity data and should have a good understanding of streaming best practices.
This is a critical role with a wide range of responsibilities, including:
This position will be part of Pluto TV's Data Engineering department and will be working with the team responsible for collecting analytical streaming data from all our client software. This is a very fast-paced environment dealing with very large volume/velocity of data. You must have strong analytical and problem-solving skills and strong organizational and prioritization skills.
Basic Qualifications
We believe the right individual will have the following skills and experience in order to be successful in this role:
• Strong knowledge of Java, Python or Scala
• Strong knowledge of Kafka (Topics, Producer/Consumer, KStream, KTable, KSQL)
• Knowledge of AWS Kinesis (streams, firehose, and data - analytics) would be nice to have
• Knowledge of SQL and familiarity with modern cloud databases like Snowflake
• Good experience with the following technology stacks
• Frameworks: Spring Framework, Flink, JUnit, Mockito, Apache Flink.
• Cloud Technologies: AWS(VPC, Kubernetes, EC2, Lambda, CloudWatch and etc)
• Deployment Tools: Jenkins, Docker, Helm, terraform
• Monitoring tools: Grafana, Prometheus
• Strong technical and troubleshooting skills
• Strong experience with data streaming systems
• Effectively and clearly communicate open project risks and dependencies with the data team and other internal teams
Additional Qualifications
• 7 years' experience in data engineering and data streaming
• Demonstrated understanding of Kafka
• Demonstrated ownership and ability to lead several projects simultaneously
• Demonstrated strong time-management, prioritization and leadership skills
• Demonstrated strong troubleshooting and problem-solving skills
• Strong interpersonal skills, with the ability to cultivate relationships and negotiate with internal clients
• Ability to meet deadlines and partner timelines
• Demonstrated strong written and oral communication skills
• Bachelor's Degree or Equivalent