Big Data Engineer
Hearst Magazines
Center Valley, PAThis was removed by the employer on 12/16/2019 1:12:00 PM PST
Not to worry we have many other jobs on the site;
Browse all jobs
Browse the IS/IT Category
Search for Big Data Engineer jobs in Center Valley-PA
Search all Big Data Engineer postings
Full Time Job
Hearst Magazines is seeking a Big Data Engineer to join our Data Studio team. Hearst Data Studio is an internal team that gives advertisers additional insights into how our audience responds to our content. Hearst Data Studio brings together research analysts, data scientists and programmatic specialists.
As a part of Hearst Magazines, we offer the best of both worlds: a nimble, fast-paced entrepreneurial environment coupled with the career development opportunities and perks of an established company. Hearst Data Studio provides you with the stability of a big company with the forward-looking feel of a startup.
The impact you'll have
As a Big Data Engineer, will be part of the team applying AI (Artificial Intelligence) and machine learning to digital data to find better ways to connect to our audience. Your ability to design and develop data solutions and platform components will be instrumental in how effectively we can store, extract and transform our multi-terabyte to petabyte range data.
.
What you'll do
• You will work on in big data platform and ecosystem, create complex data processing pipelines for data management functionalities.
• You will design and build high quality solutions and be responsible for designing and building final testing including unit tests, integration test, load test and user acceptance tests.
• You will use your Jenkins and/or Bamboo skills to own the end to end CI/CD pipelines for the software components.
• You will partner with director of engineering, product managers, and stakeholders to clarify requirements and implement solutions that encompass analysis, programming, and how to integrate these solutions into the larger eco-system.
• You will regularly interact with business partners and stakeholders to lead technical solution discussions.
• You will be developing technical solution options for custom client/business requirements.
• You will participate in the creation and/or review of technical architectural frameworks for various data platforms.
• As a seasoned data engineer, you will direct or assist others in the development of detailed programs and system specifications and test plans.
Who you are
• You have six (6) or more years of professional work experience in an Engineering, IT or Technology role
• You have an expertise in at least one server-side development language such as Java, Scala, Python.
• You are extremely proficient with SQL and have worked with multiple databases
• In the past Two or more years, you have experience designing and developing of scalable data applications using modern frameworks and distribution including Spark, Hortonworks
• You are comfortable with enterprise technologies and principles, such as SOA, REST and have worked with tools such as Maven, Gradle and SBT for managing large projects.
• You have experience large product integrations and performance enhancements.
• You have analyzing large volumes of data (multi-terabyte to petabyte range).
• You have software design experience using architecture and design patterns.
• You have Experience with CI frameworks including Bamboo and Jenkins.
• Bachelor's Degree in an engineering or equivalent field (computers science, computer engineering, etc.).