Lead Data Engineer
CAA
Nashville, TNThis is a Full Time Job
Lead Data Engineer (T2)
Job Description
The Role
• Lead data engineering execution in support of complex application development initiatives, ensuring data integrations, pipelines, and models align with established architectural standards
• You and your teammates will work collaboratively with other engineers to design, build, and execute data migrations between systems, including data mapping, transformation, validation, and reconciliation to help ensure data accuracy and completeness across environments.
• You will use your software development skills in an agile environment to develop new data pipelines, APIs, and data management tools and your experience with continuous delivery will support the end-to-end lifecycle: design, deployment, test, operations, monitoring and support.
Languages and Frameworks
• Proficiency in Python with a history of delivering production pipelines.
• E xperience building production scripts or services used for data movement and validation.
• Experience with the Azure data stack (Azure Data Factory, Azure Data Lake, Tabular Model / DAX, Microsoft Fabric) is preferred, though strong experience with comparable technologies is also valued.
Languages and Frameworks
• We'd like to see real SQL and NoSQL production experience.
• We're particularly interested in your expertise with SQL Server and MongoDB.
• You should be comfortable modeling data, analyzing source and target schemas, writing complex queries, and resolving data quality issues during migration.
Tools
• Experience maintaining projects using a distributed version control system such as Git and GitHub.
• Experience in automated pipeline deployment and schemas into production environments would be great.
• You should be experienced with agile methods and the concepts behind continuous delivery.
• We expect you to be passionate about developing migrations, data structures, pipelines, and APIs, so we want to see your experience with security, testing, performance, JSON, and REST.
• We are eager to hear about your experience and opinions around data quality, test strategy, and test automation.
Focus
• We expect you to have a passion for and experience shipping and maintaining production software products and data migrations.
• You must have strong verbal and written skills.
• We are most interested in candidates who want to work in an environment where attention to detail, solving problems, simplicity, quality, and moving quickly are highly prized.
Location
This role is hybrid, based in our Nashville office.
CAA does not accept unsolicited resumes from third-party recruiters unless they were contractually engaged by CAA to provide candidates for a specified opening. Any such employment agency, person or entity that submits an unsolicited resume does so with the acknowledgement and agreement that CAA will have the right to hire that applicant at its discretion without any fee owed to the submitting employment agency, person or entity.