Job Information
Burns & McDonnell Senior Data Engineer - Information Technology (Kansas City) in Kansas City, Missouri
Description
The Data Engineer will help build and maintain the cloud DeltaLake platform leveraging Databricks. Candidates will be expected to contribute to all stages of the data lifecycle including data ingestion, data modeling, data profiling, data quality, data transformation, data movement, and data curation. This job is located in-office at our World Headquarters in Kansas City.
Job Responsibilities may include:
Architect data systems that are resilient to disruptions and failures
Ensure high uptime for all data services
Bring modern technologies and practices into the system to improve reliability and support rapid scaling of the business’s data needs
Scale up our data infrastructure to meet business needs
Develop production data pipeline patterns leveraging
Provide subject matter expertise and hands on delivery of data acquisition, curation and consumption pipelines on Azure
Responsible for maintaining current and emerging state of the art compute and cloud based solutions and technologies.
Build effective relationships with internal stakeholders
Familiarity with the technology stack available in the industry for metadata management: Data Governance, Data Quality, MDM, Lineage, Data Catalog etc.
Hands-on experience implementing analytics solutions leveraging Python, Spark SQL, Databricks Lakehouse Architecture, Kubernetes, Docker
All other duties as assigned
Qualifications
Bachelor's degree in Computer Science, Information Technology, Management Information Systems (MIS), Data Science or related field. Applicable years of experience may be substituted for degree requirement.
Minimum 8 years of experience in software engineering
Experience with leading large and complex data projects, preferred
Experience with large-scale data warehousing architecture and data modeling, preferred
Worked with Cloud-based architecture such as Azure, AWS or Google Cloud, preferred
Experience working with big data technologies e.g. Snowflake, Redshift, Synapse, Postgres, Airflow, Kafka, Spark, DBT, preferred
Experience implementing pub/sub and streaming use cases, preferred
Experience leading design reviews, preferred
Experience influencing a team’s technical and business strategy by making insightful contributions to team priorities and approaches, preferred
Working knowledge of relational databases, preferred
Expert in SQL and high-level languages such as Python, Java or Scala, preferred
Demonstrate the ability to analyze large data sets to identify gaps and inconsistencies in ETL pipeline and provide solutions for pipeline reliability and data quality, preferred
Experience in a infrastructure as code / CICD development environment, preferred
Proven ability to build, manage and foster a team-oriented environment
Excellent communication (written and oral) and interpersonal skills
Excellent organizational, multi-tasking, and time-management skills
EEO/Minorities/Females/Disabled/Veterans
Job Business Analysts
Primary Location US-MO-Kansas City
Schedule: Full-time
Travel: Yes, 5 % of the Time
Req ID: 225938
#LI-RH #COR