Senior Data Engineer

Description

We are offering an exciting opportunity for a Data Engineer to join our team in Columbus, Ohio, United States. The successful candidate will play a pivotal role in our IT team, providing data solutions that support business strategies. This role involves working closely with the corporate business intelligence teams to develop, maintain, and enhance data solutions that enable strategic decision-making.

Responsibilities:

Collaborate with the Data Architect to develop, maintain, and improve data solutions for analytics and business intelligence.
Design and implement high-performance data ingestion pipelines from multiple sources using Databricks and Azure-native solutions.
Develop and document ETL/ELT architecture, including CDC, mappings, data flows, procedures, schedules, ensuring overall integration integrity.
Work with source system and business subject matter experts to understand the data requirements and options available within data sources to meet data and business needs.
Design and implement a semantic layer based on reporting requirements from the BI and business teams.
Analyze data quality upstream and downstream to establish trust in data solutions.
Work with external vendor teams to support BI initiative roll-out across multiple phases.
Provide support for strategic decisions related to data and analytics, long-term BI investments, and the toolsets that will support these new initiatives.
Engage in meetings necessary to perform duties and aid business and technical development.
Utilize skills in Apache Kafka, Apache Spark, Cloud Technologies, Database, EO/IR systems, Algorithm Implementation, Analytics, Apache Hadoop, API Development, AWS Technologies, and Azure Databricks.

Requirements

Experience with Azure Databricks is necessary

Proficiency in Cloud Technologies is required

Strong understanding of Database structures and management

Experience with EO/IR systems is a must

Ability to implement algorithms effectively

Strong analytical skills are needed

Knowledge of Apache Hadoop is mandatory

Experience in API Development is required

Proficiency in AWS Technologies is essential

Technology Doesn't Change the World, People Do.

Robert Half is the world's first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.

Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app and get 1-tap apply, notifications of AI-matched jobs, and much more.

All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.

2024 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking "Apply Now," you're agreeing to Robert Half's Terms of Use.