Data Engineer
Sony Music
New York, NYThis was removed by the employer on 10/15/2018 3:49:00 PM PST
Not to worry we have many other jobs on the site;
Browse all jobs
Browse the IS/IT Category
Search for Data Engineer jobs in New York-NY
Search all Data Engineer postings
Full Time Job
The Orchard is an independent music and film distribution company distributing music from artists such as AWOLNATION, Kelsea Ballerini, and Skepta as well as films like Cannes Grand Prix Winner BPM (Beats Per Minute), and Sundance Jury Prize winner Dina, and The Hero. With our industry-leading technology and operations, we partner with companies of all sizes to make their music, films and videos available across hundreds of digital outlets and physical retailers around the world. At The Orchard, the focus is to provide a comfortable, social and engaging environment to encourage productivity and creativity.
The Orchard is looking for a Data Engineer to join our NYC (East Village) development team.
Responsibilities
• Create and maintain systems to load and transform very large data sets from digital media retailers (iTunes, Spotify, YouTube, etc) as well as social media sources.
• Work with a cross-functional team to create data-driven insights and reports for business stakeholders.
• Work with the Software Engineering team to create customer-facing analytics tools and visualizations.
• Deliver hundreds of million of rows of analytics to end users daily.
• Take advantage of our continuous integration and deployment
• Participate in technical design and peer review for new projects
Qualifications
• Experience with AWS ecosystem. Some preferred services are Redshift, RDS, S3, SWF.
• Proven experience with ETL frameworks (Airflow, Luigi, or our own open sourced garcon).
• Expertise with at least one distributed data store (Redshift, Cassandra, Snowflake).
• Familiarity with noSQL technologies (mongoDB, DynamoDB).
• Proficient in scripting language of choice. Python is strongly preferred, PHP a plus.
• Highly proficient in writing SQL for a relational datastore (MySQL, PostgreSQL).
• Knowledge of technologies that can deal with Big Data is a Big Plus (Kafka, Spark, Hive, Hadoop/MapReduce).
• Ability to write automated tests (unit, functional, and integration) to ensure code works as expected.
• Desire to collaborate with other engineers through peer code reviews.
• Deep understanding of data structures and schema design.
• Detail-oriented, proactive problem solving skills.
The Orchard is committed to providing equal employment opportunity for all persons regardless of age, disability, national origin, race, color, religion, sex, sexual orientation, gender identity or expression, pregnancy, veteran or military status, genetic information or any other status protected by applicable federal, state, or local law.