Senior Big Data Engineer
WWE
Stamford, CTThis was removed by the employer on 3/20/2019 8:21:00 AM PST
Not to worry we have many other jobs on the site;
Browse all jobs
Browse the IS/IT Category
Browse the TV Network Category
Search for Senior Big Data Engineer jobs in Stamford-CT
Search all Senior Big Data Engineer postings
Full Time Job
Senior Big Data Engineer, Data Platform Engineering
We are seeking a Senior Big Data Engineer to join a dynamic data platform engineering team responsible for building the WWE data management platform. You will play a key role in the architecture, design and development of the data pipeline using Big Data Technologies on AWS/Google Cloud. You will be working closely with the WWE data engineering, analytics and science teams leveraging the usable data lake built out of multiple media internal and external datasets.
Key Responsibilities:
• Build and validate large-scale batch and real-time data pipelines with Big Data Technologies such as Talend Real-Time Big Data Platform, Python, Spark, Hadoop, Hive, Pig, Redshift, Snowflake, NoSQL DB on AWS/Google Cloud
• Evaluate, configure and implement new technologies, methodologies and architecture design patterns to build data processing ETL pipeline
• Design and Develop processes for data discovery, modeling, mining and archival
• Collaborate with data analytics team to ensure the integrity and availability of the data necessary for the business analytics & reporting
• Think strategically & bring new ideas to build the ETL pipeline architecture and how to scale it with the business as it grows
• Build reusable components and framework to speed up the data pipeline development
• Provide guidance/ directions to the data engineers team and implement best practices as well as standards across all the data pipelines
Education & Technical Experience Requirements:
• Bachelor's in computer science, science, or similar field of study
• 8 years of Data Warehousing, OLAP, SQL Queries, ETL/ELT design and development experience
• 3 years of experience with AWS services including S3, Redshift, EMR, Lambda and RDS
• 3 years of solid experience in developing and performance tuning the data pipeline with Hadoop, Hive, Spark, Talend Big Data Platform
• 3 years of experience in programming languages such as Python, Scala, R, Java or C#
• 2 years of experience with parallel computing, batch processing, and stream processing using tools such as Kinesis or Kafka
• 2 years of experience in columnar databases such as RedShift, Snowflake as well as NoSQL databases such as MongoDB, DynamoDB
• Self-starter and highly motivated to add value to the team and platform using innovations around data and data solutions
• Experience in dealing with the structured, semi-structured and unstructured datasets
• Excellent communication skills to collaborate with the data engineering, analytics and science teams
• Experience in Social Media Datasets such as Twitter, YouTube, Facebook, Instagram is a plus
• Experience in Google Clickstream, DFP, or Adobe Analytics datasets is a plus
• Experience in dealing with the Media content subscription-based datasets is a plus
• Experience in creating restful API's is a plus
• Experience in AI, machine learning and statistics is a plus
• Experience in Media and Entertainment Industry is a plus
_
WWE is an Equal Opportunity Affirmative Action employer and is subject to federal regulations pertaining to employment. WWE does not unlawfully discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, disability, marital status, veteran status, or any other basis prohibited under federal, state or local laws governing non-discrimination in employment in every location in which the Company has facilities. WWE also provides reasonable accommodation for qualified individuals with disabilities in accordance with the Americans with Disabilities Act (ADA) and any other state or local laws. For information about Privacy and Information Security for WWE employment candidates, please review our Candidate Privacy Policy. For information regarding Terms and Conditions for this and other WWE websites, please review our Terms and Conditions of Use.